12
Accepted answer
retry_exponential_backoff=True on the task, combined with retry_delay as the base and max_retry_delay as a cap, gives you exponential backoff with no custom retry logic at all.
A flaky external API call task fails intermittently. Airflow's retries plus retry_delay gives fixed-interval retries. Is there a clean built-in way to get exponential backoff, or does this need custom code?
Accepted answer
retry_exponential_backoff=True on the task, combined with retry_delay as the base and max_retry_delay as a cap, gives you exponential backoff with no custom retry logic at all.
Document the grain decision, most BI bugs turn out to be grain bugs.
Sign in to reply.