Guaranteeing order per user_id across partitions

Kafka / Streamingkafka ordering

Hitting a wall in prod and looking for patterns others have used. Minimal repro below but happy to share more context.

Context: Guaranteeing order per user_id across partitions

Happy to share schema snippets or metrics if useful.

2 answers

Consider DuckDB or Polars for this size before spinning up a cluster.

In our case the root cause was an implicit cast preventing pushdown.