Berlin Experimentation Meetup #12
We’re excited to announce BEM #12 on March 12, 2026.
With winter in Berlin coming to an end, we’re bringing the experimentation community back together for the first BEM edition of the year. Expect an evening of practical insights, strong conversations, and new connections across product, science, data, and engineering.
A big thank you to Contentful for hosting us in their Berlin office — and thank you to Spotify for supporting the event.
Doors open: 17:30
First talk: 18:30
Lineup
18:30 — Ahmed Amer (Contentful)
Evaluating AI Agents (Closing the Loop Between Quality and Enterprise Compliance)
Practical approaches to evaluating agentic systems with a clear link between quality signals and enterprise compliance expectations.
19:00 — Dr. Jan Philipp Harries (ellamind)
Your Agent Works Great Until Step 7: How to Actually Evaluate Agentic AI
Why single-turn evals miss the real failures in multi-step agent workflows, and what trajectory-based evaluation looks like in practice (based on deployments in regulated German industries).
19:30 — Sebastian Ankargren (Spotify)
The Value of Experimentation (in the AI Era)
Sebastian will share what experimentation value looks like at Spotify, how platform and culture help maximize it, and how AI and experimentation strengthen each other.
20:00 — Panel: Scaling Experimentation
A discussion on what it really takes to scale experimentation across teams, products, and tooling — including how AI is changing workflows and increasing the speed of learning.
Panelists: Johan Söderholm (Spotify), Sebastian Ankargren (Spotify), Valerija Spasojevic (Asana Rebel) — including hands-on workflows for rapid testing of many ideas with AI.
20:00–21:30 — Networking
Reserve your spot and be part of Berlin’s experimentation community.
Come for the talks, stay for the conversations — looking forward to seeing familiar and new faces.