ppspider

A TypeScript web scraping framework with task management and data storage capabilities.

TypeScript33974Updated 4y agoAbandoned

Quick Overview

What is this?

ppspider is built on Puppeteer for headless browser control. It uses decorators to manage task queues and scheduling, supports NeDB and MongoDB for data persistence, and offers data visualization features.

What problem does it solve?

A TypeScript web scraping framework with task management and data storage capabilities.

Who should use it?

Developers needing a structured way to build and manage web crawlers with integrated data handling and visualization.

Setup difficulty:Medium

Pros

Decorator-based task queue and scheduling.
Flexible data storage with NeDB/MongoDB support.
Built-in data visualization and UI features.

Cons

Requires understanding of Puppeteer and TypeScript.
Can be complex for simple scraping tasks.

Scores

Trust Score

41

Star reputation (15%)51

Star velocity 7d (15%)0

Commit recency (15%)5

Fork ratio (10%)73

Issue ratio (10%)79

Contributor signal (10%)15

README quality (5%)100

License (5%)100

Homepage/demo (5%)0

Docs URL (5%)0

Topic count (5%)100

Maintenance

40

Commit frequency20

Issue management80

Documentation85

Popularity

38

Stars10

Forks10

Growth trend10

Star History

Snapshot Versions

Version	Commit	Size	Downloads	Date
latestLatest	HEAD	958.6 KB	0	1d ago

Alternatives

bull

OptimalBits

70

Premium Queue package for handling distributed jobs and messages in NodeJS.

Featured

JavaScript16.2K11.4K10d ago

asynq

hibiken

63

Simple, reliable, and efficient distributed task queue in Go

Go13.1K169182mo ago

rq

78

Simple job queues for Python

Featured

Python10.6K51.5K1d ago

skypilot

skypilot-org

75

Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, Slurm, 20+ clouds, on-prem).

Featured

Python9.8K1.0K6h ago

taskq

vmihailenco

49

Golang asynchronous task/job queue with Redis, SQS, IronMQ, and in-memory backends

Go1.3K10611mo ago

react-native-background-task

jamesisaac

38

Periodic background tasks for React Native apps, cross-platform (iOS and Android), which run even when the app is closed.

Abandoned

Java1.1K1112y ago

Community Reviews

Loading reviews...