Get a Grip on Your Virtual Reality: Building Hand Gesture Interactions with Unity

​👋✨ Hands-On Reality Bending: When VR Meets Your Real-World

​Ever wanted to control everything with just your hands? (Yes, like a wizard. 🧙‍♂️) In this workshop, we’ll explore how to use hand poses and gestures to not just wave at thin air, but to actually interact with the real world inside VR.

​

​🗓️ Schedule Highlights

​12:00 – 12:30  Hand poses & gesture interactions 🖐️

​12:45 – 13:15  Hand physics-based interactions ⚡

​13:15 – 14:15  Lunch break 🍕

​14:30 – 15:00  Real environment interaction in VR 🏠

​15:15 – 15:45  Mini-project challenge 💡

​✨ Bonus: Gaussian splats in VR 🌌

​

​💻 What you’ll need:

• ​A compatible laptop/PC with the Meta Quest 2 or 3 headset (we provide the headsets)

• ​Unity + C# experience is nice to have, but totally not required. We’ll guide you through it!

​

​🛠️ Setup Prerequisites

​To make the most of the workshop, please have the following ready on your laptop:

• ​Unity 6000.0.xx (6000.0.55f1 to be specific)

• ​Meta All-in-One SDK (from the Unity Asset Store)

• ​URP (Universal Render Pipeline) – from Package Manager

• ​OpenXR Plugin – from Package Manager

• ​VS Code or Visual Studio for coding