@swathibalakrishnan
Pro member
Consultant helping teams ship reliable Databricks workloads.
Composer environment started at ~40 DAGs with fast parsing. Now at ~300 DAGs, the scheduler's DAG parse loop takes minutes, and task scheduling latency has visibly degraded.
© 2026 Lakebench, operated by Hunnurji Rao. Bengaluru, Karnataka, India.
No cluster. No install. Just the tab.