File formats & storage · Performance & Layout

What is data skipping?

Mediumdata skippingstatisticsmin maxParquetperformance

Interview question

What is data skipping in columnar lakes and table formats?

How to answer

The short answer

Data skipping means the engine uses stored statistics (and sometimes indexes/bloom filters) to avoid reading files, row groups, or pages that cannot satisfy a query filter.

Building blocks

  • File / row-group min and max per column
  • Null counts, distinct counts (when present)
  • Bloom filters (ORC/Parquet/some table formats)
  • values and table-format manifests

What makes skipping effective

  • Selective on columns that have tight min/max ranges
  • Good layout: partitioning, clustering, Z-order, sorted writes
  • Avoiding huge files where every column spans the full domain

Interview tip: Data skipping is the umbrella term; , , and Z-order are ways to make skipping actually happen.