| Name: | perl-WWW-RobotRules |
|---|---|
| Version: | 6.02 |
| Release: | 30.el9 |
| Architecture: | noarch |
| Group: | Unspecified |
| Size: | 25395 |
| License: | GPL+ or Artistic |
| RPM: | perl-WWW-RobotRules-6.02-30.el9.noarch.rpm |
| Source RPM: | perl-WWW-RobotRules-6.02-30.el9.src.rpm |
| Build Date: | Mon Jan 10 2022 |
| Build Host: | build-ol9-x86_64.oracle.com |
| Vendor: | Oracle America |
| URL: | https://metacpan.org/release/WWW-RobotRules |
| Summary: | Database of robots.txt-derived permissions |
| Description: | This module parses /robots.txt files as specified in "A Standard for Robot Exclusion", at <https://www.robotstxt.org/robotstxt.html>. Webmasters can use the /robots.txt file to forbid conforming robots from accessing parts of their web site. |