7
Agree on the staging table swap. Atomic promote prevented partial reads.
Hitting a wall in prod and looking for patterns others have used. Minimal repro below but happy to share more context.
Context: Coalesce vs repartition before write, still confused
Happy to share schema snippets or metrics if useful.
Agree on the staging table swap. Atomic promote prevented partial reads.
Idempotent writes with merge keys saved us during backfills.
ELI5 version: it's not broken, it's just slow because it's checking way more stuff than it needs to. Narrowing what it checks is almost always the fix.
Sign in to reply.