[Go to site: main page, start]

XR Blocks Logo XR Blocks

Accelerating AI + XR
Innovation

Get to know XR Blocks

Join us in exploring the next generation of computing, where digital and physical information come together. These demos highlight experimental features in Android XR, available on on both desktop and Android XR devices like Galaxy XR and Project Aura.
AI + XR

XR Blocks Gem

Transform your ideas into magical, interactive worlds for Android XR. Whether you want to summon a beautiful dandelion or create an XR volleyball game that reacts to your hand, just tell me your vision. XR Blocks Gem bridges the gap between imagination and immersion, letting you build the impossible in seconds in an Android XR headset like Galaxy XR. On Desktop, we offer you a simulated environment to preview your XR app. Check out our blog for more details.

Create XR Nowarrow_forward
XR Blocks SDK

Create for the immersive web

XR Blocks is an opensource framework to help you develop immersive experiences for the web, featuring XR Realism (depth-aware physics, geometry-aware occlusion, and lighting estimation), XR Interaction (hand interaction, gesture recognition), and creative AI + XR use cases (Gemini, Gemini Live, LiteRT, TensorFlow Lite).

Explore Live Demosarrow_forward Browse GitHub Repoarrow_forward
AI + XR

Gemini Ice-breakers

Get to know Gemini, your friendly and infinitely knowledgeable assistant on both desktop Chrome and Android XR (Galaxy XR) with XR Blocks. This demo gives you a set of conversation starters to show off what Gemini can do for you.

Explore arrow_forward
XR Realism

Ballpit

See how digital and physical information come together in Android XR. Inspired by DepthLab, this demo creates a 3D map of your space in both simulated reality and XR, and allows you to play virtual ballpit with physical collisions.

Explore arrow_forward
XR Interaction

Gesture Recognition

Command the digital world with your bare hands. This demo features an experiment with XR Blocks and LiteRT, highlighting new ways you can interact with hand interactions. Like a conductor leading an orchestra, a simple "yeah" gesture unleashes a vibrant cascade of colorful stripes. Want to add some cheer? A quick thumbs-up fills the screen with a delightful shower of balloons! It's much more intuitive than it looks.

Explore arrow_forward
View on GitHub

Publications


If you find XR Blocks inspiring or useful in your project, please cite our preliminary white papers: XR Blocks: Accelerating AI + XR Innovation and Vibe Coding XR: Accelerating AI + XR Prototyping with XR Blocks and Gemini


Example innovation powered by XR Blocks: Sensible Agent: A Framework for Unobtrusive Interaction with Proactive AR Agent. ACM UIST 2025.

WebAI Summit 2025 Talk

Be the first to get updates from XR Blocks

Frequently Asked Questions

What is XR Blocks?

XR Blocks is web-based, a cross-platform framework designed to accelerate human-centered AI+XR innovation. XR Blocks provides a modular architecture with plug-and-play components for core abstraction in AI+XR, including user representation, environmental perception, gestures, and spatial UI. Crucially, it is designed with the mission of “minimum code from idea to reality”, enabling rapid prototyping of complex AI+XR apps. Built upon accessible technologies (WebXR, three.js, TensorFlow, Gemini), our toolkit lowers the barrier to entry for researchers and designers.

How can I start building with XR Blocks?

We recommend you to fork our GitHub repository, browser each template and sample project, and then start coding while referring to the manual.

For vibe coders, feel free to try out our Gemini Gem, and start building AI + XR apps on Android XR devices or desktop.

What is Android XR?

XR stands for extended reality. It’s an umbrella term that encompasses all technologies that blend the real and virtual worlds including virtual reality, augmented reality, and mixed reality. Android XR is an operating system for extended reality devices that use these technologies, like headsets and glasses. It provides the user interface, the ability to access popular apps, and AI assistance from Gemini to these devices.

How do I get Android XR?

Android XR is an operating system for headsets and glasses. The first device, Samsung Galaxy XR, is available now.

When will Android XR-powered devices be available?

The first device, Samsung Galaxy XR, is available now. Other devices will be available in 2026.

How can I start developing for Android XR?

You can check out developer.android.com/xr for documentation and information to get started with Android XR. If you are choosing WebXR, XR Blocks here is also a great way to make creative Android XR applications.