Where Translation Ends: Hyper-Localized Multilingual Evals | Private Dinner Hosted by LILT & AI CIRCLE
After an incredible evening together in Paris, LILT and AI Circle are bringing our Roundtable Series to New York City.
Join Spence Green, CEO of LILT, and an intimate group of researchers, evaluation experts, and technical leaders for an off-the-record conversation exploring one of AI's most pressing challenges:
How do we meaningfully evaluate intelligence across languages, cultures, and local contexts?
Helping lead the chat will be Dr. Michelangelo Conserva, a Research Scientist at Google Research specializing in foundation models and AI evaluation. His current work in geospatial AI involves building deep-learning architectures to extract fine-scale, sub-meter details from massive global datasets. He holds a Ph.D. in Artificial Intelligence, where his research established novel mathematical frameworks for quantifying AI task hardness and evaluating algorithmic failure modes. Michelangelo brings a rigorous perspective to understanding how AI models adapt, perform, and fail in highly complex environments.
As foundation models become increasingly multilingual, evaluation has become far more than a translation problem. Cultural nuance, regional knowledge, dialects, and hyper-local context continue to expose gaps in today's benchmarks, creating blind spots that directly impact real-world deployment.
Together, we'll discuss topics like; why current multilingual benchmarks continue to fall short, the shift toward hyper-localized evaluation, measuring cultural and regional understanding beyond translation, building evaluation frameworks that reflect how people actually communicate, and so much more.
Rather than presentations or panels, this evening is designed as a collaborative discussion among peers actively shaping the future of multilingual AI.
Expect thoughtful conversation, exceptional company, and the opportunity to exchange ideas with leaders working at the forefront of evaluation research.
_________________________________
About LILT:
LILT is the only AI-native multilingual solution for frontier AI data and enterprise localisation. We help make your data and content multilingual—faster, more accurately, securely, and at scale. Specialising in language-grounded alignment and multimodal evaluation, we provide research-grade expertise to govern AI systems. Unlike crowdsourced options, our curated expert network and continuous quality calibration provides high-fidelity signals to build reliable models ready for global deployment. Learn more about LILT.
AI Circle is a community of practitioners across research and deployment that are advancing the frontier of AI. Our members come from frontier AI native startups through large enterprises. We host events at our chapters in SF, NYC, Seattle, London, Paris, MIT and Stanford. Learn more about AI Circle.