Skip to content
LakeBench
ProblemsCommunityPricing
Sign inStart practicing
Back
  1. Home
  2. Interview prep
  3. What is the role of an Airflow Worker?

Airflow & DAGs · Architecture & Scalability

What is the role of an Airflow Worker?

Easyairflow-13
workerexecution

Question

What is the role of an Airflow Worker?

Solution

A worker actually executes tasks.

Scheduler decides → Worker runs the Python/Bash/Spark-submit task

In distributed setups, workers talk through the executor plumbing (for example a Celery broker/backend). Keep heavy compute off Airflow when you can: submit to Spark/dbt/warehouse and let Airflow orchestrate.

PreviousNext