Skip to content
LakeBench
ProblemsCommunityPricing
Sign inStart practicing
Back
  1. Home
  2. Interview prep
  3. What happens if the Scheduler dies?

Airflow & DAGs · Architecture & Scalability

What happens if the Scheduler dies?

Mediumairflow-17
schedulerhareliability

Question

What happens if the Airflow Scheduler dies?

Solution

The scheduler is what schedules tasks. If one scheduler dies, task definitions don't vanish. They live in the metadata DB / DAG files.

Airflow can run multiple schedulers for high availability (shared metadata DB). If one fails, another keeps scheduling.

Scheduler 1 / 2 / 3 → Shared metadata DB
PreviousNext