scraper

🔥 The Web Data API for AI - Power AI agents with clean web data

Create agents that monitor and act on your behalf. Your agents are standing by!

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

🚀「Douyin_TikTok_Download_API」是一个开箱即用的高性能异步抖音、快手、TikTok、Bilibili数据爬取工具，支持API调用，在线批量解析及下载。

🔥 The open-source no-code platform for web scraping, crawling, search and AI data extraction • Turn websites into structured APIs in minutes 🔥

A Chrome DevTools Protocol driver for web automation and scraping.

Linkedin Automation Tool: Describe your product. Define your target market. The AI finds the leads for you.

Node.js library to receive live stream events (comments, gifts, etc.) in realtime from TikTok LIVE.

An ergonomic Python HTTP Client with TLS fingerprint

A Multi-User Selfhosted price tracker for Amazon, Aliexpress, ebay and many more along with custom stores. Get notified when price matches one or more criterias set by the user

Python quick start guides to get the most out of Oxylabs' Web Scraper API free trial.

A very simple news crawler with a funny name

Library for Rapid (Web) Crawler and Scraper Development

Web service and CLI tool for SEO site audit: crawl site, lighthouse all pages, view public reports in browser. Also output to console, json, csv, xlsx

SEO python scraper to extract data from major searchengine result pages. Extract data like url, title, snippet, richsnippet and the type from searchresults for given keywords. Detect Ads or make automated screenshots. You can also fetch text content of urls provided in searchresults or by your own. It's usefull for SEO and business related research tasks.