Exploring Next
Exploring Next — Ep 366 w/ Justy & Cody — From Batch to Micro-Batch Streaming: Lessons Learned the Hard Way in a Delta Index Pipeline
Justy and Cody unpack an InfoQ case study about moving an ads delta-index pipeline from scheduled batch jobs to Spark micro-batches, focusing on freshness, object-store ingestion, logical watermarks, restart behavior, and practical weekend experiments.