9
Start with the execution plan, numbers beat guesses.
Hitting a wall in prod and looking for patterns others have used. Minimal repro below but happy to share more context.
Context: How many files per partition is too many for Parquet?
Happy to share schema snippets or metrics if useful.
Start with the execution plan, numbers beat guesses.
Small nit: the broadcast hint gets ignored once the table is over threshold, check the UI to confirm.
Yes, the partial index was the win for us too.
Prefer a staging table plus validation gate before promoting to prod tables.
Small nit: the broadcast hint gets ignored once the table is over threshold, check the UI to confirm.
Plain English: the system prefers to guess a good-enough plan than the perfect plan, because figuring out the perfect plan would take longer than just running the good-enough one.
We saw the same issue, fixing the partition filter dropped runtime 60%.
Sign in to reply.
© 2026 Lakebench, operated by Hunnurji Rao. Bengaluru, Karnataka, India.
No cluster. No install. Just the tab.