

When Pipelines Fail Early: Type-Safe Data Engineering in Scala
Hosted by Siddharth Banga
Registration
Past Event
About Event
What if your data pipeline could get rejected by the compiler before it even runs? Think: config chaos that never compiles, schema drift caught right in the middle, side-effects tamed before they wreak havoc.
In this 45-minutes, you’ll glimpse:
A builder that fails to compile if you forget a contract or a sink,
An orchestrator where effects respect fiber safety, and Spark transforms stay pure,
A scaffold that won’t generate boilerplate until your types align,
Runners for Spark, Flink, Kafka—swapped by trait, not rewrite,
Just a taste of what's possible when scala’s functional toolkit is your guardrail. Attend, be surprised; leave with patterns you’ll wish your current pipelines had.