Scrapy is your go-to tool for efficiently extracting structured data from the web. It's built for speed and extensibility, making complex scraping tasks manageable. You'll use `scrapy startproject` to get started and define your scraping logic within spiders.
A Python framework for building web crawlers and scraping data from websites.
Developers who need to automate data extraction from websites for analysis, research, or content aggregation.
Not enough data yet. Star history will appear after a few days of tracking.
logo
version python_version ubuntu macos windows coverage conda deepwiki
Scrapy_ is a web scraping framework to extract structured data from websites.
It is cross-platform, and requires Python 3.10+. It is maintained by Zyte_
(formerly Scrapinghub) and many other contributors_.
.. _many other contributors: https://github.com/scrapy/scrapy/graphs/contributors .. _Scrapy: https://scrapy.org/ .. _Zyte: https://www.zyte.com/