perl-WWW-RobotRules
Database of robots.txt-derived permissions
This module parses /robots.txt files as specified in "A Standard for Robot Exclusion", at <https://www.robotstxt.org/robotstxt.html>. Webmasters can use the /robots.txt file to forbid conforming robots from accessing parts of their web site.
Releases Overview
| Release | Stable | Testing |
|---|---|---|
| Fedora Rawhide | 6.02-39.fc40 | - |
| Fedora 40 | 6.02-39.fc40 | - |
| Fedora 39 | 6.02-37.fc39 | - |
| Fedora 38 | 6.02-36.fc38 | - |
File a new bug report »
Package Info
Related Packages
Package Info
- Upstream: https://metacpan.org/release/WWW-RobotRules
- License(s): GPL-1.0-or-later OR Artistic-1.0-Perl
- Maintainers: mspacek, jplesnik
Related Packages
You can contact the maintainers of this package via email at
perl-WWW-RobotRules dash maintainers at fedoraproject dot org.
Sources on Pagure