

In the Loop SF: A Private Dinner for AI & Human Data Leaders
An intimate dinner in San Francisco for a small group of leaders shaping how human data is used to train, evaluate and improve AI systems.
Hosted by Prolific, In the Loop brings together senior practitioners across AI, data, evaluation, research, and operations for an off the record evening of candid conversation.
No panels. No presentations. No pitches.
Just a carefully curated group of peers comparing notes on the questions that are difficult to unpack in larger rooms - from building reliable human evaluation systems and maintaining data quality, to designing better workflows for increasingly capable models.
The evening is designed for people directly responsible for the quality, strategy or infrastructure behind human data in AI.
Expect thoughtful conversation around topics such as:
What high quality human data looks like as models become more capable
Where evaluation and data operations are breaking down today
How leading teams are approaching expert data, annotation, and model feedback
What the next generation of human-in-the-loop systems may require
The evening
6:00PM - Arrival and drinks
6:45PM - Welcome
7:00PM - Dinner and conversation
9:15 PM - Wrap up
Attendance is intentionally limited and registration is subject to approval to keep the group relevant and the conversation candid.
The restaurant and full location details will be shared with confirmed guests.
About Prolific
Prolific partners with leading AI teams to design and run rigorous human research - helping them evaluate models, understand human behavior and preferences, and generate the evidence needed to make better decisions about how AI systems are built and improved. Learn more about Prolific.