Airflow & DAGs · Core Concepts & DAGs

What is the Metadata Database?

Easymetadatadatabase

Interview question

What is the Airflow Metadata Database, and why can it become a bottleneck?

How to answer

The short answer

The metadata DB stores Airflow internal state: runs, , states, connections, variables, XCom metadata.

Production: PostgreSQL / MySQL. SQLite: local learning only.

It becomes a bottleneck with thousands of DAGs, millions of task instances, heavy scheduler traffic, and many UI users. Treat it like a critical production database: size it, tune it, monitor it, and back it up.