Leveling Up AI Agents: Evaluations, Feedback Loops & Context Engineering

Name: Leveling Up AI Agents: Evaluations, Feedback Loops & Context Engineering
Start: 2025-08-12T17:00:00.000-04:00
End: 2025-08-12T20:30:00.000-04:00
Location: 65 King St E

Arize AI

65 King St E

Toronto, Ontario

Event Full

If you’d like, you can join the waitlist.

Please click on the button below to join the waitlist. You will be notified if additional spots become available.

You will be asked to verify token ownership with your wallet.

About Event

Join us at the Google Toronto office on August 12 for a hands-on evening of ideas, demos, and cutting-edge techniques focused on building smarter, more adaptable LLM-powered agents.

As the next generation of agentic systems takes shape, new challenges arise: How do you evaluate complex, multi-step behaviors? What role does prompt design play in long-term agent performance? And how can experimentation and feedback loops help agents continuously learn and improve?

This technical gathering—cohosted by Arize AI and Google—dives deep into agent evaluation frameworks, prompt optimization strategies, and real-world workflows for debugging and iterating on autonomous AI systems.

Whether you're using open-source frameworks or customizing your own stack, you’ll leave with actionable tools and inspiration to accelerate your agent development.

Come for the learning, stay for the networking, great food, and conversations with fellow builders.

Note: Registration is required by August 7. A valid government-issued photo ID is required for entry.

Event Agenda

5:00 PM – 6:00 PM
Check-In & Networking
Kick off the evening with light bites, drinks, and informal conversation with developers, engineers, and AI practitioners.

6:00 PM – 6:20 PM
Welcome & Opening Talk
Jason Lopatecki, Arize AI
An overview of today’s agent development landscape, the evaluation bottlenecks teams face, and why prompt iteration and feedback loops are becoming the foundation of scalable, performant AI systems.

6:20 PM – 6:40 PM
Talk: Google Cloud AI Factory
An overview of Google Cloud’s AI Factory and how it supports scalable and efficient AI development.

6:40 PM – 7:10 PM
Demo & Talk: Building Feedback-Driven Agentic Workflows
SallyAnn DeLucia, Arize AI
A live demo of how to trace agent decisions, implement evaluations, and create closed-loop workflows for continuously improving agent performance using real-world data.

7:10 PM – 7:30 PM
TBD Talk or Panel
An additional session is in the works—stay tuned for an exciting talk or panel that adds further depth to the evening’s exploration of agents and prompt learning.

7:30 PM – 8:30 PM
Food, Drinks & Networking
Connect with fellow attendees, meet the speakers, and dive deeper into your own use cases in a relaxed setting.

Location

65 King St E

Toronto, ON M5C 1G3, Canada

2nd Floor

Presented by

Arize AI

Generative AI-focused workshops, hackathons, and more. Come build with us!

Hosted By

449 Going