25
We replaced custom sensors with data contracts and row count checks.
This worked in dev on sample data but fails at full volume. Details:
Context: Dataflow streaming with BigQuery sink, duplicate rows on retry
Happy to share schema snippets or metrics if useful.
We replaced custom sensors with data contracts and row count checks.
Document the grain decision, most BI bugs turn out to be grain bugs.
Could you share a sketch of the salting logic?
Sign in to reply.