Vishal Naidu

Pro

@vishaln

Pro member

Former analyst, now building pipelines with AWS. Based in Mysuru.

Mysuru, KarnatakaStudent / switching in1 questions3 answers

AWSPython

Streak: 6d
XP: 3331
Lessons done: 29
Studio passes: 19

3-Day Streak25 Lessons10 Tickets2,500 XP

Share on X Share on LinkedIn

Questions

votes

answers

views

Exactly-once with Kafka and Flink, do we really need transactions?

Building a Flink job reading from Kafka, writing aggregates back to Kafka. Team is debating whether enabling Kafka transactions (EXACTLY_ONCE sink semantics) is worth the throughput cost versus at-least-once with idempotent downstream consumers.

Kafka / Streamingkafkaflink