Projects
Start with a beginner project and work up. Each one runs in your browser, with checks that tell you when it works.
These lessons are not a second catalog or a video course, and this tab cannot publish a repo for you. Passing every LakeBench lesson means you can write the transforms, the DAG habits, the tests, and the design argument. It does not publish a repo. The Cloud capstone is a numbered GCP free-tier checklist this tab cannot execute. Do those steps outside, then copy the solutions you wrote, add a README that states grain, schedule, and failure modes, and push that.
Ingest a CSV-shaped API feed, model a star from orders, and clean messy bronze into silver.
Pandas Data Wrangling
PANDASClean dirty e-commerce CSV exports in Pandas: strip currency symbols, standardize mixed dates, drop duplicates, and fill missing categories.
CV: “Engineered an automated data cleansing pipeline in Pandas using vectorized regex, mixed date parsing, and duplicate handling.”
Pandas Data Wrangling
PANDASReshape flat transaction rows into multi-dimensional executive cross-tabulations in Pandas using pivot_table().
CV: “Designed automated commercial pivot dashboards in Pandas transforming millions of transaction rows into multi-dimensional executive matrices.”
Incremental Spark MERGE, a simulated night job, dbt-shaped staging and tests, and a publish suite.
Pandas Data Wrangling
PANDASSegment retail customer transaction histories into Recency, Frequency, and Monetary tiers in Pandas using groupby and qcut scoring.
CV: “Built a customer RFM segmentation engine in Pandas combining groupby multi-aggregations, timedelta recency math, and behavioral tiering.”
Pandas Data Wrangling
PANDASResample irregular high-frequency IoT temperature telemetry into uniform 1-minute time series intervals with forward-fill and interpolation in Pandas.
CV: “Engineered an IoT telemetry standardization pipeline in Pandas utilizing DatetimeIndex resampling, time interpolation, and threshold auditing.”
Pandas Data Wrangling
PANDASPerform automated two-way financial ledger reconciliation in Pandas using outer joins, merge indicators, and discrepancy reporting.
CV: “Built an automated financial reconciliation pipeline in Pandas utilizing full outer joins, merge indicators, and fee variance auditing.”
Pandas Data Wrangling
PANDASDetect and isolate numerical transaction anomalies in Pandas using the robust non-parametric Interquartile Range (IQR) technique.
CV: “Built statistical anomaly detection engines in Pandas utilizing non-parametric IQR fences to isolate fraudulent card-testing spikes.”
Pandas Data Wrangling
PANDASCompress massive DataFrames by downcasting 64-bit numerical types and converting high-cardinality strings to categorical dtypes.
CV: “Engineered automated memory optimization pipelines in Pandas cutting DataFrame footprints by over 70% and eliminating batch container OOMs.”
Pandas Data Wrangling
PANDASEnforce strict runtime data quality contracts on incoming Pandas DataFrames before triggering downstream ingestion jobs.
CV: “Architected shift-left runtime schema assertion frameworks in Pandas preventing data corruption across production warehouse tables.”
Bigger projects you build over a few weeks on your own laptop. Each one comes with a week plan, starter code, viva questions with model answers and a resume line, so you can present it with confidence.
Intermediate · 5 weeks
Turn a raw sales file into a star schema and a dashboard a manager can read.
Open the planBeginner friendly · 4 weeks
Pull data from a public API every day, load it safely, and chart it.
Open the planBeginner friendly · 3 weeks
Clean messy student records and show placement rates by branch, skill and company.
Open the planBeginner friendly · 3 weeks
Check every new file against rules and send a clear pass or fail report.
Open the planIntermediate · 4 weeks
Spot unusual payments with SQL window functions and show them on a simple report.
Open the planIntermediate · 5 weeks
Turn a stream of page-view events into sessions, funnels and a daily report.
Open the planSame grain fights, in the studio.
The 12 to 18 month path that sequences these is on the roadmap.
