Vibe-Coding in 3D: What Frontier Models Can (and Can't) Build
You've seen AI make images, videos and Blender scenes. Now it can build 3D apps you can explore on your screen, or walk around in.
Builders who use AI coding agents every day show you live how they do it, from a single prompt to a working 3D app. No coding or terminal skills needed: one prompt to your AI agent sets everything up.
⚡ Live builds: watch an AI agent turn an idea into a 3D app, and see what it gets right and wrong
⚔️ Which AI tools actually work for 3D: Unity, PICO and MCP compared, so you know what to use
🧠 Which frontier models build 3D best: tested side by side on the same prompt
🖥️ The emulator loop: connect your agent, build and test instantly, right on your computer
You'll walk away knowing how to:
Turn an idea into a working 3D app with an AI coding agent
Choose the right AI tool for your project
Pick the frontier model that performs best for 3D and spatial builds
Connect your agent to an emulator to build and test fast, without hardware
Spot what AI still gets wrong in 3D, and fix it
Perfect for vibe coders, creators and 3D artists who want to see what AI can do beyond the flat screen.
👀 Something big is coming at the end of October, and this session is the perfect warm-up.
📚 Part of the SensAI Open Lecture series: Building with Frontier AI
Join our other sessions:
🗓️ Agenda:
⏰ 10:00 – 10:10 AM PT
🤖 Can AI Really Build 3D Now?
📝 What's possible today, what still breaks, and what changed in the last few months
⏰ 10:10 – 10:20 AM PT
⚔️ Which AI Tools Work for 3D?
📝 Frontier models and agent setups (CLI vs MCP) put to the test: what each does best, and which to pick for your project
⏰ 10:20 – 10:50 AM PT
🚀 Live: Build and Test on an Emulator
📝 Connect your AI agent to an emulator, then build, run and fix a 3D app in real time, with no headset needed
⏰ 10:50 – 11:00 AM PT
💬 Open Q&A
📝 Bring your ideas and ask anything about building 3D with AI
Speakers:
👤 Nigel Hartman combines software engineering, AI and XR to create cutting-edge digital experiences. With years at Deutsche Telekom and a background in bioinformatics, he's a Snap Spectacles developer and has won multiple XR hackathons, including the Snap Spectacles Community Challenge.
👤 Sushant Srikrish builds XR experiences hands-on with frontier models like Claude Code, GPT and Gemini. As founder of VR Anywhere and a Unity and WebXR developer, he won 1st place at XRCC'26 (Meta IWSDK track) with a solo-built AI inspection tool and 1st place at Worlds in Action at SIGGRAPH 2026.
About:
SensAI Hackademy gives you early access to devkits, wearables, and expert-led courses. Join our community and team up with top spatial, AI and creative builders in year-round hackathons and events.