Beginner · 25 min · 5 steps
Is our data fresh? Catching a pipeline that quietly stopped
Rohit Nair, Data Reliability Engineer at QuickLogistics Express
It is Tuesday, 9:15 AM. Rohit Nair is a data reliability engineer at QuickLogistics Express, a courier and freight company that sends over 120,000 packages every day across Indian cities. The VP of fleet operations calls him in a hurry. The morning dashboard shows exactly zero deliveries in all of India since 07:30 AM.
The question
How do we use SQL to measure how old the newest data is, and raise a warning or an alarm when the delay is too long?
- Freshness checks
- DATEDIFF
- SLA monitoring
- dbt
The rest of this case study is locked
The data, every step with its code and result, and the final answer open with a pass. A few case studies stay free so you can see how they work.