[ol10_appstream] perl-WWW-RobotRules-6.02-41.el10.noarch

Name:perl-WWW-RobotRules
Version:6.02
Release:41.el10
Architecture:noarch
Group:Unspecified
Size:24844
License:GPL-1.0-or-later OR Artistic-1.0-Perl
RPM: perl-WWW-RobotRules-6.02-41.el10.noarch.rpm
Source RPM: perl-WWW-RobotRules-6.02-41.el10.src.rpm
Build Date:Tue Jan 28 2025
Build Host:build-ol10-x86_64.oracle.com
Vendor:Oracle America
URL:https://metacpan.org/release/WWW-RobotRules
Summary:Database of robots.txt-derived permissions
Description:
This module parses /robots.txt files as specified in "A Standard for Robot
Exclusion", at <https://www.robotstxt.org/robotstxt.html>. Webmasters can
use the /robots.txt file to forbid conforming robots from accessing parts
of their web site.

Changelog (Show File list) (Show related packages)