

How We Built It: LangSmith Engine (San Francisco)
Join us for an evening in San Francisco with Ben Tannyhill (Product Manager @ LangChain) and Brendan Falk (CEO @ Hercules).
Most teams can build agents. Far fewer have a system to improve them.
In this meetup, Ben Tannyhill will walk through LangSmith Engine — an agent that sits on top of your traces, identifies recurring failure patterns, and suggests concrete next steps. We'll cover the architecture decisions behind it and how teams use it to operationalize the agent improvement loop.
Then, Brendan Falk will talk about the behind the scenes of improving the Hercules Harness.
Agenda ⏰
6:00 PM: Welcome + Food/Drinks
6:30 PM: Presentation with Ben Tannyhill (LangChain) - How We Built it: LangSmith Engine
6:50 PM: Q&A Session with Ben Tannyhill
7:00 PM: Presentation with Brendan Falk (Hercules) - Improving the Hercules Harness
7:15 PM: Q&A Session with Brendan Falk
7:25 PM: Networking
8:30 PM: Event Ends
Event info:
🎤 Please note this event is fully in-person and will not be live-streamed or recorded.
📍 Location: SOMA – address provided upon approval.
🎟️ We can only admit guests with approved registrations.
About the host:
LangChain powers the full agent development lifecycle — building, testing, deploying, and monitoring — so AI teams can improve their agents systematically. LangSmith Engine accelerates this cycle, automatically surfacing and fixing issues to improve agents over time. LangSmith is neutral by design, so teams can customize their own stack to optimize on cost and performance as the landscape evolves. More than 7,000 customers, including Nvidia, Bridgewater, LinkedIn, Workday, Harvey, and Rippling trust LangSmith to build and manage their agents. Learn more: www.langchain.com