Building an Open Lakehouse: Lessons from Spark, Iceberg and REST Catalogs

​Welcome to the November virtual Iceberg meetup.

This month's talk is presented by

​Alex Pajaron from Bunch Capital

Building an Open Lakehouse: Lessons from Spark, Iceberg and REST Catalogs.

​In this demo-driven talk, we’ll explore what it takes to build a modern lakehouse pipeline on open table formats and object storage. Using Apache Spark, Apache Iceberg, the Polaris REST catalog, and S3-compatible storage, we’ll follow event data through multiple transformation layers and examine patterns for incremental processing, upserts, snapshot-based reads, and table maintenance.

​Beyond the happy path, the talk will focus on the integration challenges that emerge when these components meet: catalog and storage authentication, file I/O configuration, object-storage compatibility, and the boundaries between Spark, Iceberg, the catalog, and the storage layer.

Join the Community
Continue any conversations via apache-iceberg's slack. We've got a channel dedicated to this under #meetup-virtual.

Want to Present?
We've created a google form to simplify the process of submitting a talk. This is a rolling CFP, and you can submit as many ideas as you want. Please, refrain from submitting AI Slop (yes it is easy, but we want to hear from you).