The Apache workflow orchestrator. DAG-based scheduling for data pipelines, ETL, and ML training.
Airflow is where data teams land when cron jobs stop being enough: they need dependency graphs, retries, backfills, and a UI showing which runs failed. The DAGs are Python; the scheduler and worker are separate processes you orchestrate with Celery, Kubernetes, or the LocalExecutor. Alternatives: Prefect (newer, prettier UI), Dagster (type-aware, asset-first), plain cron with cronic (if the DAG is a straight line).
Each bar is this project's percentile among all 152 CE projects for that signal — 80% means it beats 4 out of 5 projects on that axis. Grade is an equal-weighted composite. Reddit mindshare lands here next; HN already contributes.
docker pull apache/airflow:3.4.0-python3.12 docker pull apache/airflow:3.4.0-python3.13 docker pull apache/airflow:3.4.0-python3.14 docker pull apache/airflow:3.4.0-python3.11 docker pull apache/airflow:3.3.2-python3.14 No comments yet. Be the first.