Spider offers lightning-fast web scraping capabilities, letting you extract data efficiently. It supports advanced features like headless Chrome, WebDriver integration, and AI automation for sophisticated data retrieval tasks. You can integrate it via `cargo add spider` or use the `spider_cli` for command-line operations.
A high-performance web crawler and scraper built in Rust.
Developers needing to programmatically collect web data for analysis, automation, or content generation.
Website | Guides | API | Examples | Discord
The fastest web crawler and scraper for Rust.
[dependencies]
spider = { version = "2", features = ["spider_cloud"] }
use spider::{
configuration::{SpiderCloudConfig, SpiderCloudMode, SpiderCloudReturnFormat},
tokio, // re-export
website::Website,
};
#[tokio::main]
async fn main() {