4
Accepted answer
Worth measuring the serialized size before choosing broadcast.
This worked in dev on sample data but fails at full volume. Details:
Context: Data vault hype, when is it actually justified?
Happy to share schema snippets or metrics if useful.
Accepted answer
Worth measuring the serialized size before choosing broadcast.
+1, saw identical behaviour after upgrading Spark 3.4 to 3.5.
Worth measuring the serialized size before choosing broadcast.
Small nit: the broadcast hint gets ignored once the table is over threshold, check the UI to confirm.
Sign in to reply.