Agent Evaluation Science NYC @ Jane street
Agent Evaluation Science Fall 2026 — NYC
November 20, 2026 · New York City
AI agents are moving quickly into real-world workflows, while the science for evaluating them is still developing. Agent Evaluation Science (AES) is hosting its Fall 2026 symposium in New York City: a one-day research gathering for researchers and practitioners working to build the scientific foundations and research community around agent evaluation.
The program will include invited research talks, peer-reviewed contributed talks, a fireside conversation, poster presentations, and an extended poster and reception session, with participants from academia and industry.
Call for submissions
We welcome short papers and abstracts on agent evaluation, including evaluation methods, benchmarks, empirical studies, evaluation infrastructure, reliability and failure analysis, and lessons from evaluating deployed agent systems. Submissions will undergo open review and peer review, with accepted work considered for oral or poster presentation.
Attendance
Registration is free, and you do not need to submit a paper or abstract to register. Because capacity is limited, registration does not automatically guarantee final admission. Priority will be given to accepted oral and poster presenters and participants working directly on relevant research.
Travel support for some presenters may be available depending on funding.
About Agent Evaluation Science
Agent Evaluation Science is a non-profit initiative to help build a rigorous scientific foundation for evaluating AI agents. We are developing a broader research community around evaluation methods, shared standards and infrastructure, open scientific review, and evidence from real-world agent systems.
The NYC symposium is part of an ongoing effort. We are planning additional symposia, workshops, open calls, and community activities in 2027, including events on the West Coast.
Register for the event to receive updates. If you would like to contribute research, help organize future activities, or participate in the broader AES community, we would also be glad to stay in touch.