4
Check whether AQE is disabled in your Spark conf, skew join handling helped us a lot here.
Team is split on approach A vs B. Looking for experiences from similar scale.
Context: CDC from OLTP to lakehouse, Debezium vs DMS
Happy to share schema snippets or metrics if useful.
Check whether AQE is disabled in your Spark conf, skew join handling helped us a lot here.
Sign in to reply.