Cover Image for Robotics & World Models Reading Club 23: Engineering Robotic Simulators for Evaluation and Beyond. SF 8/15
Cover Image for Robotics & World Models Reading Club 23: Engineering Robotic Simulators for Evaluation and Beyond. SF 8/15
Avatar for Saturday Robotics
Presented by
Saturday Robotics
🤖 Saturday Reading Club on Robotics & World Models for AI Researchers in SF
Hosts: Junfan Zhu, Aurora Feng
discord.gg/WH7DrTHRXK
8 Going

Robotics & World Models Reading Club 23: Engineering Robotic Simulators for Evaluation and Beyond. SF 8/15

Register to See Address
Registration
Approval Required
Your registration is subject to host approval.
Welcome! To join the event, please register below.
About Event

Robotics & World Models Reading Club 23: Engineering Robotic Simulators for Evaluation and Beyond. SF 8/15

A high-signal reading group for AI researchers & builders pushing the frontiers of robotic world models, WAMs, and embodied intelligence. In our previous sessions, we brought together researchers and engineers from Boston Dynamics, Google DeepMind, NVIDIA, Stanford, UC Berkeley, Physical Intelligence, Tesla, Generalist, Rhoda AI, and leading Bay Area robotics startups.

Hosted by Junfan Zhu & Aurora Feng.

Reading Club 23's Core Theme

Engineering Robotic Simulators for Evaluation and Beyond

Keynote: Kaifeng Zhang (Columbia, World Labs)

How do you use your simulator--if at all? For evaluation, synthetic data generation, or training?

A simulator is a system designed for recreating real-world appearance and dynamics, modeling tasks that matter, and making experimentation efficient and scalable. Building a useful simulator takes more than creating eye-catchy visuals and identifying a handful of physics parameters.

In this talk, I will discuss how we can engineer simulators for different parts of the robot learning pipeline. First, for evaluation, I will present Rea2Sim-Eval, our recent work for turning real-world scenes into simulatable environments for evaluating policies. The work shows that carefully modeling both appearance and dynamics to match the real world can make simulation a much more trustworthy proxy for policy performance. To achieve this, we use modern tools from vision and graphics: visual gap is closed with Gaussian Splatting, and the dynamics gap is closed using learned digital twins. Together, they allow policies trained on real-world data to operate zero-shot in sim, achieving strong correlations even for challenging tasks involving deformable objects.

I will then discuss some ongoing efforts that move beyond evaluation towards a complete coverage of the robot learning pipeline, including data generation and training. We explore how real-to-sim can be fully automated with an agentic workflow, and how sim with calibrated physics can serve as a data engine to enable training and seamless sim-to-real transfer. Together, these efforts aim to build toward a future where simulation serves as a key component for building robot foundation models.


​​​​​​​​​Pre-Readings


​​​​​​​Location

San Francisco

​​​​​​​​​​Date & Time

Saturday, August 15, 2026 | 2:00 PM – 5:00 PM

​​​​​​​​​​​Join Discord Community

https://discord.gg/WH7DrTHRXK

​​​​​​​​​​Follow Saturday Robotics on X

https://x.com/saturdayrobotic


​​​​​​​​​​Agenda

2:00 PM – 2:30 PM Door Opens & Social

  • Food 😋, beverages🧋 and UNLIMITED strawberries 🍓 (our official reading club fruits ☺️😄).

2:30 PM – 3:30 PM Keynote by Kaifeng Zhang (Columbia, World Labs)

YouTube Recording: TBD (We are looking for recording volunteers)

3:30 PM – 5:00 PM Q&A, ​open-floor roundtable (10–20 min per topic) on spotlight papers or any paper you’d like to highlight. Feel free to share why the paper matters and its technical details.


​​​​​​​​​​​​​​​​Past events

#reading-club-18-0718: Causal World Models For Real-World Intelligence. SF 07/18

#reading-club-17-0711: Soft Tactile-Centric Multimodal Intelligence Toward Safe and Dexterous Manipulation. SF 07/11

Quan Luu, Purdue.

#private-lunch-icml-0709: Saturday Robotics x ICML Private Lunch (Seoul)

#reading-club-16-0704: The Embodied AI Hardware Stack — Supply Chain, Sensors, and the Data Flywheel — SF 07/04

Jerry Huang, Robotics Center of Silicon Valley.

#reading-club-15-0627: Scaling Touch: Flexible Tactile Skin for Dexterous Manipulation

Binghao Huang, Columbia, Amazon FAR.

#deep-tech-week-14-0625: Deep Tech Week Research Night

SPEAR: A Simulator for Photorealistic Embodied AI Research. (ECCV 2026 accepted) by Mike Roberts, Senior Research Scientist, Adobe Research.

Bogdan Cristei, Venture Partner at SHACK15 Ventures.

Simone Totaro, CTO at Saturn Dynamics.

Shumo Chu, CEO at General Intelligence Labs.

Margaret Zhang, CEO at ThirdBrain Labs.

#reading-club-13-0620: HumanEgo: Train Robot Policy from 30 min Egocentric Videos — SF 0620

#reading-club-12-0613: Origami Robotics (YC W26) on Dexterity

#cvpr-denver-11-0606: 🤖🥘 Saturday Robotics x Manycore Tech x Neural Motion | CVPR 2026 Denver Research Night | Robotics & World Models Reading Club 11

Junfan Zhu & Aurora Feng, Founders of Saturday Robotics

Anthony Zhao, Head of North America at Manycore Tech SpacialVerse

Aurora Feng, Founder at Neural Motion. NM-GenET.

Max Zhaoshuo Li, Robotics and World Model Tech Lead at NVIDIA Cosmos. Cosmos 3.

Xiaofan Li, World Model Tech Lead at X Square Robot. WALL-WM.

Zesen Zhao, University of Michigan. Test-Time Scaling for World Action Models via Zero-Shot Geometric Verification.

Pengyi Liao. VGGT-Ω: From 3D Reconstruction to Scalable Spatial Representation.

Jie Wang, University of Pennsylvania, GRASP Lab. Toward a Robotics MMLU: Lessons from Sim & Real Evaluations of Generalist Policies.

Gordon Qian, Senior AI Researcher at Snap. Diffusion-DRF: Free, Rich, and Differentiable Reward for Video Diffusion Fine-Tuning.

#reading-club-10-0530: Bringing Robots to Life — Learning Humanoid Instincts from the Body Up | San Francisco 0530

Haochen Shi (Stanford, co-advised by Karen Liu & Shuran Song)

#private-dinner-01-0529: Robo Plov x Saturday Robotics

#reading-club-09-0523: CVPR Warm-up & Founders Spotlight — DeltaWorld + VisuoTactile Dexterous Hands

Tommie Kerssies (Amazon Frontier AI & Robotics)

Arjun Subramaniam (Factory Intelligence)

#reading-club-08-0516: Embodied Human Data as the “Internet of Motion and Behavior”

Ryan Punamiya (NVIDIA Gear, Georgia Tech)

#reading-club-07-0509: Learning to Dream: World Models, Imagination, Path to Foundation Models for Control

Ahmet Şemi ASARKAYA (Agility Robotics)

#reading-club-06-0502: Evolution of Video World Models for Robotics

Tongzhou Mu (Rhoda AI)

#reading-club-05-0425: World Models for Physical Intelligence: From Predictive Brains to Embodied Robots

Daniel Dugas & Sergio Arnaud (Meta FAIR)

#reading-club-04-0418: Abstractions of the Physical World for Decision-Making

Siming He (UC Berkeley)

#reading-club-03-0411: Robotic Policy Adaptation

Haoyi Niu (UC Berkeley)

#reading-club-02-0404: JEPA Zoo

Julian Saks (https://x.com/JulianSaks)

#reading-club-01-0328

Join Discord Community

https://discord.gg/WH7DrTHRXK

Follow Saturday Robotics

https://x.com/saturdayrobotic

Follow YouTube

https://www.youtube.com/@saturdayrobotic

Subscribe to Luma Calendar

https://luma.com/saturdayrobotic

​​​​​​​​​​Logistics

Spots are limited. Please arrive by 2:00 PM for check-in. Keynote will begin promptly at 2:30 PM.

  • We currently do not have volunteers available to assist with late check-ins. Given the high volume of inquiries and 100+ attendees (both online and onsite), we kindly ask that you arrive on time to ensure smooth entry.

Location
Please register to see the exact location of this event.
Avatar for Saturday Robotics
Presented by
Saturday Robotics
🤖 Saturday Reading Club on Robotics & World Models for AI Researchers in SF
Hosts: Junfan Zhu, Aurora Feng
discord.gg/WH7DrTHRXK
8 Going