Repository info

protego

• Summary: a summary of protego
• Description: A pure-Python robots.txt parser with support for modern conventions.
• Stars: 70
• Number of forks: 28