Package profile
Protego
- Summary: Pure-Python robots.txt parser with support for modern conventions
- Author: Anubhav Patel <anubhavp28@gmail.com>
- License: BSD-3-Clause
- Homepage: https://github.com/scrapy/protego
- Source: https://github.com/scrapy/protego
- Number of releases: 16
- First release: 0.1.dev0 on 2019-07-18
- Latest release: 0.7.0 on 2026-09-21
- Latest release size: 13.4 KB (pure Python wheel)
1 known vulnerabilityLatest: GHSA-wjmf-p669-5m5p — Protego has exponential backtracking ReDoS in robots.txt URL wildcard matching View all →
Appears in:Packages with highest PyPI growth in June 2026Packages with highest PyPI growth in March 2026
Dependencies
Protego has no dependency.Dependent packages
| Package | Optional | Group |
|---|---|---|
| mcp-server-fetch | false | |
| scrapy | false | |
| newspaper4k | true | all |
Similar packages
- parsoA Python Parser
- bashlexPython parser for bash
- mistletoeA fast, extensible Markdown parser in pure Python.
- argparsePython command-line parsing library
- parsyEasy-to-use parser combinators, for parsing in pure Python
- dparseA parser for Python dependency files
- lkmlA speedy LookML parser implemented in pure Python.