Scrapy is your go-to tool for efficiently extracting structured data from the web. It's built for speed and extensibility, making complex scraping tasks manageable. You'll use `scrapy startproject` to get started and define your scraping logic within spiders.
A Python framework for building web crawlers and scraping data from websites.
Developers who need to automate data extraction from websites for analysis, research, or content aggregation.
logo
version python_version ubuntu macos windows coverage conda deepwiki
Scrapy_ is a web scraping framework to extract structured data from websites.
It is cross-platform, and requires Python 3.10+. It is maintained by Zyte_
(formerly Scrapinghub) and many other contributors_.
.. _many other contributors: https://github.com/scrapy/scrapy/graphs/contributors .. _Scrapy: https://scrapy.org/ .. _Zyte: https://www.zyte.com/