Nandini Menon

Pro

@nandinimenon

Pro member

Data engineer at a a fintech startup. Mostly PySpark and interview prep.

Visakhapatnam, Andhra Pradesh10+ years / staff+1 questions5 answers

PySparkPostgres

Streak: 13d
XP: 3196
Lessons done: 20
Studio passes: 22

Week Warrior10 Lessons10 Tickets2,500 XP

Share on X Share on LinkedIn

Questions

votes

answers

views

Backfill via CLI vs re-triggering, which preserves lineage better?

Need to reprocess two weeks of a DAG after fixing a bug. Options are airflow dags backfill from the CLI, or manually clearing and re-triggering task instances in the UI. Does one preserve run history and lineage metadata better than the other?

Airflowairflowbackfill