Airflow & DAGs · Architecture & Scalability

What happens if the Scheduler dies?

Mediumschedulerhareliability

Interview question

What happens if the Airflow Scheduler dies?

How to answer

The short answer

The scheduler is what schedules tasks. If one scheduler dies, task definitions don't vanish. They live in the metadata DB / files.

Airflow can run multiple schedulers for high availability (shared metadata DB). If one fails, another keeps scheduling.