Gemini Project Astra transforms user experience in Android XR

Gemini has ability to remain silent in background until a question is asked
An undated image. — Canva
An undated image. — Canva 

Android XR has introduced an exciting new feature called Gemini which is powered by Project Astra and Gemini 2.0. 

This innovative technology enhances the user experience by providing seamless virtual and real-world interactions.

Last year, users got to experience Android XR as the most outstanding feature of Gemini 2.0. However, an extended look at this experience emerged recently, showcasing footage from inside the headset.

Gemini capabilities

When activated through Quick Settings, Gemini listens for commands and understands what users see on the virtual screen and through the front-facing cameras. 

Whether it's translating text, identifying venues on Google Maps, or explaining YouTube videos, Gemini offers a range of helpful features. It can also answer questions about the real world, such as providing information about a sports team based on visual cues like jerseys.

Gemini to offer seamless interaction

Another impressive aspect of Gemini is its ability to remain silent in the background until a question is asked. This allows users to interact naturally with others while wearing the handset.

Moreover, the ease of asking questions without any preface makes the experience feel like having another person next to you.

Currently, Astra is a standalone app for trusted testers and will soon be integrated into the Gemini app on Pixel and Galaxy S25 devices. 

Notably, the recent S25 launch event revealed that the hardware is lighter than Vision Pro.

The “forehead rest” design also improves weight distribution, reducing the need for a top strap while the USB-C cable attachment to the battery pack enables extended usage with other units.