Name: | python3-robot-detection |
---|---|
Version: | 0.4 |
Release: | 1.el9 |
Architecture: | noarch |
Group: | Unspecified |
Size: | 109657 |
License: | GPLv3+ |
RPM: | python3-robot-detection-0.4-1.el9.noarch.rpm |
Source RPM: | python-robot-detection-0.4-1.el9.src.rpm |
Build Date: | Thu Mar 03 2022 |
Build Host: | build-ol9-x86_64.oracle.com |
Vendor: | Oracle America |
URL: | https://github.com/rory/robot-detection |
Summary: | Library for detecting bot HTTP UA headers |
Description: | robot_detection is a python module to detect if a given HTTP User Agent is a web crawler. It uses the list of registered robots from http://www.robotstxt.org: [Robots Database](http://www.robotstxt.org/db.html). |