How to Turn Gaussian Splats into Structured, Interactive 3D Worlds

​Gaussian Splats are powerful - but static.

​We are bringing a solution that runs zero-shot 3D object detection directly on splats, automatically identifying, labeling, and localizing objects as persistent 3D bounding boxes in under two minutes, with no manual setup - and we're showing you exactly how it works.

​We're also featuring a live demo of Morph Lab - a real-time Gaussian splat scene morphing tool built on WebXR, showing what you can create on top of splat-based worlds.

​What You'll Walk Away With

• ​Learn how to run zero-shot object detection on splats

• ​Understand how multi-view rendering, depth estimation, and cloud GPU inference power the pipeline

• ​See what structured splats enable for games, interactive experiences, and AI agents

• ​How this approach compares to manual annotation and traditional scene setup workflows

• ​Walk away with a clear picture of how to bring it to your own splat-based environments

​Agenda

• ​11:00 - 11:15 AM PT – Morph Lab live demo
  Real-time splat scene morphing in WebXR (David Romero)

• ​11:15 AM - 12 PM PT – Splat Analyzer
  Zero-shot 3D object detection on Gaussian splats (Nigel Hartman)

• ​12:00 - 12:15 PM PT – Q&A

​Why This Matters Right Now

​Gaussian Splats are increasingly used across VFX, virtual production, games, and XR - but they remain visual-only assets. Turning them into environments that AI systems and real-time applications can understand and act inside requires structured scene data: object labels, spatial positions, and persistent bounding boxes.

​Until now, getting that structure meant manual annotation or purpose-built capture pipelines. The solution we built automates this entirely, opening up a new class of interactive and agentic applications built on top of splat-based worlds.

​Your Speakers:

​Nigel Hartman is a Technical Expert at SensAI Hackademy, XR Bootcamp instructor, and SIGGRAPH 2026 co-instructor. Nigel works at the intersection of AI and spatial computing and built the solution you'll see demoed live.

​David Romero is an XR & 3DGS developer and community builder with 7+ years in emerging technologies. He has led community and developer relations at Luma AI, Varjo, and HTC VIVE, working at the intersection of spatial computing, Gaussian splatting, and developer ecosystems.

​Get ready for the #WorldsinAction Hack at SIGGRAPH, this online workshop is exactly the prep you need.