Leveling Up AI Agents: Evaluations, Feedback Loops & Context Engineering
Join us at the Google Toronto office on August 12 for a hands-on evening of ideas, demos, and cutting-edge techniques focused on building smarter, more adaptable LLM-powered agents.
As the next generation of agentic systems takes shape, new challenges arise: How do you evaluate complex, multi-step behaviors? What role does prompt design play in long-term agent performance? And how can experimentation and feedback loops help agents continuously learn and improve?
This technical gathering—cohosted by Arize AI and Google—dives deep into agent evaluation frameworks, prompt optimization strategies, and real-world workflows for debugging and iterating on autonomous AI systems.
Whether you're using open-source frameworks or customizing your own stack, you’ll leave with actionable tools and inspiration to accelerate your agent development.
Come for the learning, stay for the networking, great food, and conversations with fellow builders.
Note: Registration is required by August 7. A valid government-issued photo ID is required for entry.
Event Agenda
5:00 PM – 6:00 PM
Check-In & Networking
Kick off the evening with light bites, drinks, and informal conversation with developers, engineers, and AI practitioners.
6:00 PM – 6:20 PM
Welcome & Opening Talk
Jason Lopatecki, Arize AI
An overview of today’s agent development landscape, the evaluation bottlenecks teams face, and why prompt iteration and feedback loops are becoming the foundation of scalable, performant AI systems.
6:20 PM – 6:40 PM
Talk: Build with Google AI
Cindy Zhong, Google
6:40 PM – 7:10 PM
Demo & Talk: Building Feedback-Driven Agentic Workflows
Dylan Couzon, Arize AI
A live demo of how to trace agent decisions, implement evaluations, and create closed-loop workflows for continuously improving agent performance using real-world data.
7:10 PM – 7:30 PM
Inside the Loop: Evaluating and Iterating on Agent Behavior at Wayfair
Victor Sulaiman, Wayfair & Jason Lopatecki, Arize AI
7:30 PM – 8:30 PM
Food, Drinks & Networking
Connect with fellow attendees, meet the speakers, and dive deeper into your own use cases in a relaxed setting.