Airflow & DAGs · Architecture & Scalability

What is the role of an Airflow Worker?

Easyworkerexecution

Interview question

What is the role of an Airflow Worker?

How to answer

The short answer

A worker actually executes tasks.

In distributed setups, workers talk through the executor plumbing (for example a Celery broker/backend). Keep heavy compute off Airflow when you can: submit to Spark/dbt/warehouse and let Airflow orchestrate.