E5CF GitHub - glyn/nginx_robot_access at 3f0bda43e1b9572e15a2daec58cc8ac33f568d8c
[go: up one dir, main page]

Skip to content

glyn/nginx_robot_access

Repository files navigation

NGINX robot access module

WORK IN PROGRESS

This NGINX module enforces the rules in robots.txt for web crawlers that choose to disregard those rules.

Contributing

See the Contributor Guide if you'd like to submit changes.

Alternatives

  • Configure NGINX to block specific user agents, although this doesn't share the configuration in robots.txt
  • Roboo protects against robots that do not implement certain browser features

About

NGINX robot access module

Topics

Resources

License

Code of conduct

Contributing

Stars

Watchers

Forks

Packages

No packages published

Languages

0