Apache Data Lakehouse Weekly: April 3–9, 2026

The open lakehouse community gathered in San Francisco this week for the biggest Iceberg Summit yet, two full in-person days at the Marriott Marquis, while Arrow's release engineering hummed along, Polaris settled into its first full month as a top-level project, and Parquet's ALP encoding vote moved toward a close. The summit didn't just celebrate what the community has built; it provided the forum to hash out the debates that have defined the dev lists all spring.

Apache Iceberg

Iceberg Summit 2026, the third edition of the ASF-sanctioned gathering, on April 7, organized by Sung Yun, with lightning talks and networking before the main event. Speakers from Apple, Bloomberg, Pinterest, Wells Fargo, and contributors from across the vendor ecosystem took the stage, making this the most industry-spanning Iceberg event to date.

The V4 design direction was front and center. Ryan Blue and the core contributor group have spent months laying groundwork through the dev list, and the summit provided an in-person venue to align on what V4 will actually look like in practice. The that Russell Spitzer and Amogh Jahagirdar advanced across multiple proposals is similarly headed toward resolution, promising dramatic reductions in commit latency and metadata storage footprint.

The AI contribution guidelines debate, which pulled in Holden Karau, Kevin Liu, Steve Loughran, and Sung Yun on the dev list over the preceding weeks, was a natural candidate for in-person resolution at the summit. The community has been converging on disclosure requirements and code provenance standards for AI-generated contributions; with many of the same contributors in the same room, a working policy is likely to emerge from this week's discussions.

Péter Váry's . Jean-Baptiste Onofré filed the project's first board report as a TLP at the March 26 ASF board meeting, documenting community health and strategic direction under Polaris's own PMC, a governance milestone that marks the project's full independence.

The was scheduled for April, following the 58.1.0 shipment in March, which arrived with no breaking API changes. The Rust implementation has become one of the most actively maintained parts of the Arrow ecosystem, with a release cadence that matches the project's growing adoption in data lakehouse query engines.

The completed its review period, and the formal acceptance vote was expected to close this week. ALP delivers significantly better compression ratios for floating-point data by encoding the exponent and mantissa separately, a direct performance benefit for ML feature stores and scientific computing workloads where float-heavy columns dominate. The encoding has been the subject of months of careful review, and its acceptance marks one of the most meaningful additions to the Parquet specification in recent memory.

The Variant type that shipped in February continued to see integration discussion across engine teams. Spark, Trino, and Dremio contributors compared notes on their implementation experiences, working through edge cases in semi-structured data handling that the spec leaves partially open to interpretation. Getting these implementations to converge is critical: Parquet's value as a cross-engine format depends on consistent behavior across the ecosystem, and Variant is novel enough that divergence is a real risk.

The — Build your lakehouse on Iceberg with a free trial