Day 34Phase 07 · dbt + Data Quality

Data Quality

The curriculum for this day stays visible. The lesson, code, and workspace unlock with a pass.

By the end of today you can

  • Implement multi-layer defense in depth: pre-load schema checks, in-flight validation, and post-load integrity audits.
  • Distinguish between halt-the-pipeline circuit breakers and quarantine isolation workflows.
  • Detect volume anomalies and metric drop-offs before dirty data propagates to production dashboards.

The 3-Stage Quality Defense Model

Testing data only when it reaches the final dashboard is the equivalent of an automobile factory inspecting brakes after the car has already been delivered to a customer.

High-reliability data platforms enforce quality gates across three distinct lifecycle stages:

This is the first section of the lesson. The rest unlocks with a pass.

Core topics: Defense in depth: Pre-load vs In-flight vs Post-load verification, Column invariants (uniqueness, referential integrity, range bounds), Row count anomaly detection & statistical deviation (Z-score), Freshness SLAs & silent pipeline stalls, Circuit breakers: quarantine vs pipeline abort, Data contract enforcement

Build: Data quality & circuit breaker engine: schema enforcement → statistical volume anomaly detector → referential integrity validator → quarantine isolation router.

A failing pipeline that halts execution is an inconvenience; a silent corrupt pipeline that writes dirty metrics to production is an executive catastrophe.

Already have a pass? Go to your account. Need a pass? See pricing.