Package profile
Scrapy
- Summary: A high-level Web Crawling and Web Scraping framework
- Author: Scrapy developers <pablo@pablohoffman.com>
- License: BSD-3-Clause
- Homepage: https://scrapy.org/
- Documentation: https://docs.scrapy.org/
- Source: https://github.com/scrapy/scrapy
- Number of releases: 115
- First release: 0.8 on 2009-12-12
- Latest release: 2.19.0 on 2026-09-10
- Latest release size: 370.9 KB (pure Python wheel)
14 known vulnerabilitiesLatest: GHSA-76g3-c3x4-crvx — Scrapy: S3DownloadHandler sends signed S3 requests over plaintext HTTP by default View all →
Dependencies
Scrapy has 34 dependencies, 10 of which optional.Dependent packages
| Package | Optional | Group |
|---|---|---|
| llama-index-readers-web | false | |
| news-please | false | |
| scrapy-splash | false | |
| itemadapter | true | scrapy |
| scrapfly-sdk | true | scrapy |
Similar packages
- urlextractCollects and extracts URLs from given text.
- trafilaturaPython & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML.
- playwrightA high-level API to automate web browsers
- mechanizeStateful, programmatic web browsing
- flaskA simple framework for building complex web applications.
- httplib2A comprehensive HTTP client library.
- panelThe powerful data exploration & web app framework for Python.