scraping

🔥 The Web Data API for AI - Power AI agents with clean web data

Scrapy, a fast high-level web crawling & scraping framework for Python.

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!

🕵️‍♂️ Collect a dossier on a person by username from 3000+ sites

Python scraper based on AI

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Custom Selenium Chromedriver | Zero-Config | Passes ALL bot mitigation systems (like Distil / Imperva/ Datadadome / CloudFlare IUAM)

Stealth headless browser for AI agents — bypass Cloudflare, bot detection, and anti-scraping. Drop-in Puppeteer/Playwright replacement.

A browser testing and web crawling library for PHP and Symfony

Web crawler and scraper for Rust

Linkedin Automation Tool: Describe your product. Define your target market. The AI finds the leads for you.

List of anti-detect and humanizing tools and browsers, including captcha solvers and sms-activation.

Library for Rapid (Web) Crawler and Scraper Development