AWAAI Innovate & Advance with Jigyasa Grover
Beyond the Hype: Evaluating AI Agents
AI agents are everywhere right now.
But here’s the real question: How do we know if they actually work, and whether we can trust them?
Padmini and I are super excited to host a fireside chat with the fabulous Jigyasa Grover for AWAAI's next Innovate & Advance session to talk about agent evaluation and trust.
As AI systems move from simple chatbots to autonomous agents capable of multi-step reasoning and decision-making, evaluating them becomes much harder. Traditional benchmarks and accuracy metrics often don't tell the full story.
👉 What if an agent reaches the right answer through flawed reasoning?
👉 What if it takes an inefficient or risky path to get there?
👉 What does “production-ready” even mean for agentic systems?
We'll explore themes such as:
• The trust gap in AI agents
• New evaluation approaches like human-in-the-loop and LLM-as-a-judge
• Observability for agentic systems and how we refine real-world performance
If you’re building AI systems, experimenting with agents, or trying to understand where this technology is headed, you need to be there.