Intermediate · 30 min · 5 steps
Paying only for the month you ask about, not the whole table
Aarti Joshi, Senior Lakehouse Architect at CloudMart Technologies
It is 10:00 AM on the first working day of the month. Aarti Joshi, a lakehouse architect at CloudMart Technologies, is called to an urgent budget meeting with the Chief Financial Officer and the VP of Infrastructure. CloudMart is an online commerce platform with over 60,000 merchants. The new AWS invoice has arrived, and the Amazon Athena query bill has jumped from 3,200 USD to 18,400 USD (over ₹15,20,000) in one month.
The question
How much scanned data, and how much cloud money, do we save when a table is split into folders by month so a query reads only the folder it needs?
- Parquet
- Partition pruning
- Predicate pushdown
- FinOps
The rest of this case study is locked
The data, every step with its code and result, and the final answer open with a pass. A few case studies stay free so you can see how they work.