Learn · cloud
Where your pipelines actually run, and what each managed service is for.
GCP walkthrough with AWS and Azure names: IAM, object storage, BigQuery, Composer, Dataproc, then a free-tier deploy checklist.
Core foundational modules are free. Advanced production modules need Pro.
Playable walkthroughs: watch the system move, predict the next step, stamp a memory seal, then practice. Completing a Trace counts toward readiness.
Everything you have built so far runs on your laptop. Your laptop sleeps, has one disk, and is not a place a company will keep its customer data. So the work moves to rented computers, which introduces three new problems that have nothing to do with data: who is allowed to touch what, where files live now that there is no C drive, and who pays for the query you just ran. Cloud platforms are the answer to those, and the reason a badly written query can cost real money.
You will spend more time on permissions than you expect. A large share of real cloud work is IAM, storage layout, and cost, not clever architecture. Knowing the shape of the services and the vocabulary across providers is what lets you be useful in the first week.
Basic pipeline experience
You should have written something that reads and writes data. The cloud versions make far more sense with that reference point.
No cloud account needed
This track walks through GCP with the AWS and Azure names alongside, and the exercises are simulated. There is no bill.
4 stages, in the order they build on each other. Each stage lists the modules and lessons it covers, and what you should be able to do by the end of it.
Cut through the marketing. It is someone else's computers, rented by the second, with an API in front of them. Everything else follows from that.
What is the CloudFree
0/4
What cloud computing is, the main service types, data lakes versus warehouses, and security basics.
By the end of this stage
You can explain what you are actually renting, and why it is billed the way it is.
Two things underpin every cloud data system: who is allowed to do what, and where the bytes live. Get these two and the service names become easy.
Cloud Mental ModelFree preview
0/3
Which cloud, who can do what, and where bronze files actually land.
Module Checkpoint
2 conceptual questions to verify mastery
By the end of this stage
You can reason about IAM roles and object storage layout, and explain why a folder path in a bucket is a design decision rather than a detail.
Where people get stuck
IAM is boring right up until it is the reason your job fails at 3 a.m. or the reason data leaked. Learn it properly now.
Warehouses, managed Spark, and managed schedulers each replace something you have already built by hand. Knowing what each one is for stops you from using a warehouse as a queue.
Managed Data Services
0/4
Warehouses, orchestrators, Spark clusters, and the function that fires when a file lands.
Module Checkpoint
1 conceptual questions to verify mastery
By the end of this stage
You can map a pipeline onto real services and name the equivalent on the other two major providers.
In the cloud, a design decision is a line item. Scanning a whole table because you forgot a partition filter has a price, and someone will ask about it.
Cost, Security, and Shipping It
0/3
Read a bill, know why a job cannot reach a database, then land ingest on a real free-tier project.
Module Checkpoint
1 conceptual questions to verify mastery
By the end of this stage
You can estimate what a design costs, spot the obvious waste, and go through a deploy checklist without leaving a bucket public.
Finishing the lessons is not the goal. These are the things you should be able to do afterwards, and each one is worth checking honestly.
30 minutes a day
about 6 sessions
1 hour a day
about 3 sessions
4 hours a weekend day
about 1 session
This track is conceptual on purpose. Nothing here bills you. When you are done, spending one afternoon in a real free tier account creating a bucket and running one query makes the whole track concrete, and it is the single best use of your time afterwards.
These counts cover reading and the built-in exercises only. Real practice on the drills and a capstone will add to it, and that time is where most of the learning happens.
| Common mistake | What to do instead |
|---|---|
| Collecting certifications before understanding the primitives. | Certification exams test product names. Learn storage, identity, and cost first, then the exam is easy and the knowledge is real. |
| Treating a warehouse as a general purpose database. | Warehouses are built for scanning large amounts of data, not for many small lookups. Using the wrong one is slow and expensive. |
| Giving pipelines broad admin permissions because it is quicker. | It is quicker until an incident. Least privilege is the default expectation on any real team. |