Cover Image for Open Lakehouse + AI Meetup - Bellevue
Cover Image for Open Lakehouse + AI Meetup - Bellevue
Avatar for Open Lakehouse + AI
12 Going

Open Lakehouse + AI Meetup - Bellevue

Register to See Address
Bellevue, WA
Registration
Approval Required
Your registration is subject to host approval.
Welcome! To join the event, please register below.
About Event

Open Lakehouse + AI Meetup - Wednesday, October 7, 5:00 PM – 9:00 PM PDT | Bellevue, WA

​RSVP HERE 👉 https://bit.ly/openlakehouse10-07

We're bringing together the open source and data engineering community for an evening focused on the latest in open lakehouse and AI architectures! 🚀 Whether you work on data infrastructure, contribute to open source, or want to dive into the future of AI and interoperable lakehouse systems, you’ll fit right in.

Don't miss this opportunity to accelerate your data journey and contribute to shaping the future of data and AI! ​🌟

5:00 - 6:00 PM: Registration / Mingling

6:00 - 6:05 PM: Welcome Remarks / Housekeeping

6:10 - 6:40 PM: Session #1 - Modern Analytics at GPU Speed: Accelerating Spark, Delta Lake, Iceberg, and Spark Connect - Felix Cheung, NVIDIA

6:45 - 7:15 PM: Session #2 - A Unified Future for Delta and Apache Iceberg - Micah Kornfield, Databricks

7:20 - 8:00 PM: Panel Discussion - Connecting the Open Lakehouse and AI Ecosystem

Panelists: Luke Kim (Spice AI), Shawn Chang (AWS), Haoyan Geng (Databricks)

8:00 - 9:00 PM: Networking / Light Bites

Session Descriptions

Modern Analytics at GPU Speed: Accelerating Spark, Delta Lake, Iceberg, and Spark Connect - Felix Cheung, NVIDIA

GPU acceleration enables Apache Spark to process modern analytics workloads significantly faster without changing existing Spark applications. This session introduces GPU-accelerated Spark, presents benchmark results and customer success stories, and highlights where acceleration delivers the greatest value—particularly for join-intensive workloads and the Gold layer of the Medallion architecture.

Beyond compute acceleration, we'll discuss the importance of optimizing data access by accelerating Delta Lake and Apache Iceberg. We'll conclude with an overview of an end-to-end accelerated Spark architecture featuring Spark Connect, illustrating how GPU acceleration, modern data lakes, and analytics work together to deliver faster time to insight.

A Unified Future for Delta and Apache Iceberg

Delta Lake and Apache Iceberg™ have converged on similar ideas: columnar metadata for efficient pruning, manifest trees for scalability, and deletion vectors for fast updates. Yet today, we maintain two separate metadata structures, duplicating work and diverging in capabilities.

The next major evolution of Delta Lake reimagines metadata from the ground up. This talk introduces a unified metadata architecture where Delta Lake commits store content metadata directly in Iceberg v4's adaptive metadata tree. Delta Lake gains efficient tree-structured manifests and Iceberg interoperability while preserving the transactional guarantees that Delta users depend on.

Event Partners

Location
Please register to see the exact location of this event.
Bellevue, WA
Avatar for Open Lakehouse + AI
12 Going