4
Accepted answer
In our case the root cause was an implicit cast preventing pushdown.
Team is split on approach A vs B. Looking for experiences from similar scale.
Context: Predicate pushdown not happening in Spark SQL join
Happy to share schema snippets or metrics if useful.
Accepted answer
In our case the root cause was an implicit cast preventing pushdown.
Short version for anyone skimming: this is a classic case of the tool doing exactly what you told it to, not what you meant. Double check the assumption, not the code.
Sign in to reply.