Embodied AI: World Models from Scratch Session 3
Unlock the mystery of world models—no one fully understands them yet, but they're transforming how we interact with AI. Join the embodied AI group as they guide you through this open, hands-on technical series to build world models from scratch and gain deep expertise in architecture, training, and implementation.
Each session pairs technical concepts with practical tools: runnable code, clear diagrams, and interactive explorables that let you experiment in real time. Progress from leveraging pretrained models to constructing your own from the ground up, covering critical aspects like training optimization, model adaptation, computational efficiency, and distillation techniques. Whether you're a researcher, engineer, or curious builder, this series will equip you with the skills to understand and create world models that power the next generation of AI systems.
This session will cover:
Chapter 4: Building a World Model from Scratch
4.1 From Observations to Representations
4.2 Tokenizing Observations
4.3 Learning Latent Representations
4.4 Modeling Dynamics
4.5 Conditioning on Actions
4.6 Predicting Future States
4.7 Decoding Predictions
4.8 Deterministic vs. Stochastic Dynamics
4.9 Building the Complete World Model