Agentic + AI Observability Night SF
Join us for an Agentic + AI Observability Night on Thursday, March 26 from 3:30pm - 9:00pm PST in SF, our marquee multi-track event on how to rigorously evaluate, ship, and monitor AI agents in production.
This event is built for engineers, ML practitioners, GenAI engineers, and AI startup founders who are already running agents in production (or about to) and need a serious evaluation and observability practice, not just a demo. Across several tracks and multiple speakers from leading AI companies, we’ll go deep on evaluation design, harnesses, tracing, and metrics for agentic systems, plus the architectures and tooling that make those evaluations actionable. Whether you’re at an early-stage startup or an established company, if you care about getting AI agents into production and keeping them healthy, we hope you will join us!
You’ll hear from the following leaders in the AI space: Databricks, Factory.ai, Arize, Sentry.io, LanceDB and more!
Why you should attend
Learn modern eval patterns: How teams design evaluation suites, datasets, and pipelines for multi-step agents, tools, and RAG-heavy workflows.
See how evaluations drive architecture: Real examples of how evaluation results shape data/feature platforms, retrieval setups, and tool orchestration.
Go beyond logs: Build structured traces, evals, and performance dashboards that explain why agents behave the way they do over time.
Live demos of observability and evaluation tools, tracing integrations, and evaluation workflows purpose-built for agentic systems.
Learn from multiple AI companies: Multiple speakers share battle-tested patterns, failure modes, and “never again” stories from real production agents.
AGENDA
3:30pm: Registration & Mingling
5:00pm: Keynote
5:45pm: Breakout #1 (2 tracks)
6:30pm: Breakout #2 (2 tracks)
7:15pm: Breakout #3 (2 tracks)
7:45pm: Reception
9:00pm: Goodnight