@padmanarayanan
Pro member
Data engineer at a a fintech startup. Mostly GCP and system design.
This worked in dev on sample data but fails at full volume. Details: Context: Great Expectations vs dbt tests for pipeline contracts Happy to share schema snippets or metrics if useful.
A flaky external API call task fails intermittently. Airflow's retries plus retry_delay gives fixed-interval retries. Is there a clean built-in way to get exponential backoff, or does this need custom code?
Everyone talks about data contracts between producers and consumers, but concretely, is it a schema file, a service, a Confluence doc, or something else teams actually maintain long-term?
© 2026 Lakebench, operated by Hunnurji Rao. Bengaluru, Karnataka, India.
No cluster. No install. Just the tab.
