Padma Gowda

@padmagowda

Free member

I break prod so you do not have to. Delta Lake by day, system design on weekends.

Pune, Maharashtra0–2 years1 questions1 answers

Delta LakeSpark

Streak: 2d
XP: 1152
Lessons done: 7
Studio passes: 8

First Lesson5 Tickets1,000 XP

Share on X Share on LinkedIn

Questions

votes

answers

views

N+1 pattern hiding inside an ORM-generated ETL job

An ETL job built on top of an ORM for convenience turned out to be issuing one query per row for a related lookup, invisible until volume grew. 10k rows went from a few seconds to 20+ minutes. How do you catch this class of bug before it hits production volume?

Performanceperformanceorm