Airflow & DAGs · Advanced Development

What is XCom?

Mediumxcomtaskflow

Interview question

What is XCom in Airflow?

How to answer

The short answer

XCom = Cross-communication. Tasks exchange small pieces of information (IDs, file paths, timestamps, small configs).

It is not for large datasets. Don't put a 500 MB in XCom.

Instead:

How big you can go depends on the metadata DB/backend. Treat XCom as small metadata only.