data-engineering

Apache Superset is a Data Visualization and Data Exploration Platform

Learn how to develop, deploy and iterate on production-grade ML applications.

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Event Driven Orchestration & Scheduling Platform for Mission Critical Applications

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

Turns Data and AI algorithms into production-ready web applications in no time.

An orchestration platform for the development, production, and observation of data assets.

🐚 Python-powered shell. Full-featured, cross-platform and AI-friendly.

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

📙 Awesome Data Catalogs and Observability Platforms.

Dataplane is an Airflow inspired unified data platform with additional data mesh and RPA capability to automate, schedule and design data pipelines and workflows. Dataplane is written in Golang with a React front end.