Batch & Streaming · Streaming Processing

What is Kappa architecture?

MediumKappareplayKafkaarchitecture

Interview question

What is the Kappa architecture, and how does it differ from Lambda?

How to answer

The short answer

Kappa architecture uses a single streaming pipeline (plus a durable log) as the main processing path. Need a recompute? Replay the log through the same stream job (or a batch job that reuses the same logic), instead of maintaining a separate batch system forever.

Output
Lambda:  stream path + batch path (two logics)
Kappa:   log (Kafka) --> one processing job --> serving tables
              \-- replay for backfill / recompute --/

Requirements

  • Durable, replayable event log
  • Idempotent or versioned sinks so replay is safe
  • Enough retention / cold storage of events

Interview tip: "Kappa = unify on the stream/log; Lambda = dual batch+speed." Mention trade-off: replay cost vs dual-code cost.