PySpark data engineering interview problem. Difficulty: advanced. Pattern: Medallion. About 20 minutes. Part of the Pro drill bank.
Append a micro-batch via union and print a checkpoint path (no Delta sink). Treat this as a production helper: match the contracted return shape, including empty and duplicate inputs.
Union bronze with batch as an append-only Medallion write stand-in. Print a checkpoint path string, then return the combined frame ordered by event_id. Assign result.
Input: bronze + batch Output: event_id | event_type 1 | click 2 | view 3 | purchase 4 | click Append semantics without a Delta writer.
Topics: lakebench, pyspark, union, checkpoint.
More PySpark interview questions · All interview problems · Learn data engineering
Interview-style drill: Append a micro-batch via union and print a checkpoint path (no Delta sink).
Union `bronze` with `batch` as an append-only Medallion write stand-in. Print a checkpoint path string, then return the combined frame ordered by `event_id`. Assign `result`.