Exploring Next
Exploring Next — Ep 453 w/ Justy & Cody — databricks.com/blog/debunking-8-data-layout-myths-why-liquid-clustering-outperforms-partitioning
Justy and Cody dig into Databricks arguing that Liquid Clustering beats old-school partitioning for modern lakehouse tables. Cody buys some of the technical case, especially the point that modern formats prune from table metadata rather than folder paths, but he pushes on how much of the evidence is vendor-controlled and how broadly the claims travel outside Delta-heavy setups. Justy leans into who should care: teams with shifting query patterns, painful repartitioning, small-file messes, or mixed batch and real-time workloads. They land on a pretty practical verdict: this is less a universal law than a strong sign that manual partition design is becoming a tax many teams no longer need to pay.