[ol8_appstream] perl-WWW-RobotRules-6.02-18.el8.noarch

Name:perl-WWW-RobotRules
Version:6.02
Release:18.el8
Architecture:noarch
Group:Development/Libraries
Size:25395
License:GPL+ or Artistic
RPM: perl-WWW-RobotRules-6.02-18.el8.noarch.rpm
Source RPM: perl-WWW-RobotRules-6.02-18.el8.src.rpm
Build Date:Sat Mar 09 2019
Build Host:ca-build101.us.oracle.com
Vendor:Oracle America
URL:http://search.cpan.org/dist/WWW-RobotRules/
Summary:Database of robots.txt-derived permissions
Description:
This module parses /robots.txt files as specified in "A Standard for Robot
Exclusion", at <http://www.robotstxt.org/wc/norobots.html>. Webmasters can
use the /robots.txt file to forbid conforming robots from accessing parts
of their web site.

Changelog (Show File list) (Show related packages)