@snehareddy
Pro member
Student / switching in DE working on dbt. Interested in CDC.
Daily job reads ~50k small JSON event files, a few KB each, from S3. Listing plus reading takes 20+ minutes before any actual processing starts. Compacting upstream isn't an option right now. What can we do on the read side?
© 2026 Lakebench, operated by Hunnurji Rao. Bengaluru, Karnataka, India.
No cluster. No install. Just the tab.
