Karthik Narayanan

Pro

@karthik_narayanan

Pro member

Learning Python while contributing to open source around system design.

Coimbatore, Tamil Nadu10+ years / staff+1 questions2 answers

PythonPandas

Streak: 0d
XP: 1482
Lessons done: 12
Studio passes: 9

10 Lessons5 Tickets1,000 XP

Share on X Share on LinkedIn

Questions

votes

answers

views

Backfilling 2 years of history without melting the warehouse

Need to backfill a corrected metric across 2 years of daily partitions into a warehouse that also serves live BI traffic during business hours. What throttling or scheduling patterns do people use so a backfill doesn't starve production queries?

Data Engineeringdata-engineeringbackfill