firecrawl
🔥 The Web Data API for AI - Power AI agents with clean web data
scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.