@utkarshshah
Pro member
Platform engineer focused on cost optimization and Python at scale.
A topic doing maybe 500 messages/sec was set up with 100 partitions "for future scale." Now seeing longer rebalance times and more open file handles than expected on the brokers. Was that overprovisioning a mistake?
Hitting a wall in prod and looking for patterns others have used. Minimal repro below but happy to share more context. Context: Data vault hype, when is it actually justified? Happy to share schema snippets or metrics if useful.
© 2026 Lakebench, operated by Hunnurji Rao. Bengaluru, Karnataka, India.
No cluster. No install. Just the tab.
