| Name: | perl-WWW-RobotRules |
|---|---|
| Version: | 6.02 |
| Release: | 18.module+el8.3.0+7739+ee8eefab |
| Architecture: | noarch |
| Module: | perl-libwww-perl:6.34:8030020200428102957:d4f97118 perl-libwww-perl:6.34:8060020210901111951:d4f97118 |
| Group: | Development/Libraries |
| Size: | 25394 |
| License: | GPL+ or Artistic |
| RPM: | perl-WWW-RobotRules-6.02-18.module+el8.3.0+7739+ee8eefab.noarch.rpm |
| Source RPM: | perl-WWW-RobotRules-6.02-18.module+el8.3.0+7739+ee8eefab.src.rpm |
| Build Date: | Wed Aug 12 2020 |
| Build Host: | jenkins-10-147-72-125-3f885686-7094-40be-970e-55465d439a6e.appad2iad.osdevelopmeniad.oraclevcn.com |
| Vendor: | Oracle America |
| URL: | http://search.cpan.org/dist/WWW-RobotRules/ |
| Summary: | Database of robots.txt-derived permissions |
| Description: | This module parses /robots.txt files as specified in "A Standard for Robot Exclusion", at <http://www.robotstxt.org/wc/norobots.html>. Webmasters can use the /robots.txt file to forbid conforming robots from accessing parts of their web site. |