Data takes Flight: Transforming data with Spark and MotherDuck via Iceberg

​Storage and compute have split apart. With Apache Iceberg catalogs now widely adopted, your data isn't locked into a single warehouse anymore — you can pick the best engine for each job instead of forcing everything through one expensive platform.

​In this session, Colin Rogers and Jacob Matson walk through a real, multi-engine architecture built for exactly this: unstructured, high-volume data that needs more than one tool to handle well.

• ​Ingest dense, unstructured data (like transcripts) with Spark

• ​Write those transformations to Iceberg

• ​Transform with dbt Core and MotherDuck

• ​Visualize the results with Dives

• ​Orchestrate the whole pipeline with MotherDuck's Flights