​Agents in production: beyond the demo

​Everyone has an agent demo. Very few have agents running in production, at scale, without surprises. For the second edition of Second Opinion, Alan's new tech event series, we're digging into what it actually takes to get there, with the people building the infrastructure and the guardrails.

​Lineup

​ 🦜 Medical safety with stochastic parrots

​Thomas Humeau - Full Stack Data Scientist @ Alan

​LLMs can demonstrate remarkable knowledge of complex topics, yet fail unpredictably on seemingly simple questions. We will walk you through how we built a system at Alan that allows us to harness LLMs capabilities to help our members navigate health-related questions while preventing these limitations from putting them at risk.

​🔐 Who gives the agent access to production?

​Romaric Philogène - CEO & Co-founder @ Qovery

​Agents read production all day but rarely change it. Romaric Philogène (Qovery) shares what Qovery sees in real agent traffic, why production writes are so risky, and three layers that let agents act safely, with a live demo.

​💸 Every token has a price and an address: context engineering for cost, quality, and privacy

​Charline Boulie - Senior Solutions Architect, Startups @ AWS

​In production, the context window is where your bill and your risk quietly build up: every token costs money, and is also data you've sent, cached and possibly retained. Charline Boulie (AWS) shares how to treat context as a budget that balances cost, answer quality and privacy, and where cost and privacy pull in opposite directions.

​​Agenda

• ​🚪 6:00 PM: Doors open

• ​🎤 6:30 PM: Talks + Q&A

• ​🍻 8:00 PM: Drinks & networking

​Second Opinion is Alan’s tech event series. It covers problems that one prompt can’t solve, with a second opinion from builders who’ve already solved them.