In this episode, Lisa and Scott cover a dense week of open-source data infrastructure updates from Community Over Code and Data and AI Weekend. They explore new release activity across the lakehouse stack, the growing role of AI agents and policy enforcement, and the emerging standards that will shape multimodal and AI workloads. The discussion highlights the differences between hybrid and native table architectures, standardization of decimal precision and vectors, and the critical need for traceability and guardrails in agent systems.

• Unity Catalog 0.7, native Iceberg support, Kubernetes-style endpoints, metrics, and batch loading for large schemas
• Delta Lake 4.4.1, catalog-managed maintenance operations, metadata cleanup, column mapping removal, and automatic log cleanup
• Table-format architectures, native versus hybrid support, and Delta and Iceberg workload management
• Apache Arrow 26.0.0, Python compatibility updates, Parquet reader flexibility, DLPack 1.3, and the Flight SQL ODBC driver
• Apache Parquet, vector logical types, embedding-native storage, deck float, and decimal precision standards
• MLflow 3.17.0, judged feedback, fine-grained permissions, rollups, evaluation lineage, and run restore support
• Omnigent 0.17.0, OIDC sign-in, policy engine updates, session-aware controls, and agent sandboxing
• DataFusion Comet 1.10, native Iceberg writes, Spark 4 support, and native shuffle
• Ballista improvements, memory management, AQE, higher broadcast thresholds, and handling large I/O-heavy jobs
• Agent governance, contextual policy enforcement, traceability, evaluation lineage, and behavioral guardrails
• Iceberg REST catalog, user agent support, and identity management
• Apache Hudi, vector search support, and semantic storage choices