Important: This feature is rolling out slowly over time, so you may not have access to it yet.
With Guided Vision, you can get descriptions and real-time help from Gemini while talking through what’s around you. Once enabled, you can share your camera in Gemini Live to get audio guidance on things like reading fine print on food labels, identifying color differences, ordering from low-lit menus, or locating household objects. And if your camera isn't lined up, you get instant voice feedback on how to reframe, guiding you to adjust your camera, pan across a space, or center an object so you get the answers you need.
How to use Guided Vision
Guided Vision is a feature available in Gemini Live. Learn how to use Gemini Live.
To turn on Guided Vision in Gemini:
- On your Android device, open the Gemini mobile app
.
- At the top, tap your profile picture or initial Settings
.
- Turn Use Guided Vision in Live on
or off
.
- If you turn Use Guided Vision in Live on, on the on-screen notification, you can tap Start Live to begin a Live chat.
Once Guided Vision is turned on, you can start a Guided Vision session when you go Live and share your device’s camera.
To end a Guided Vision session, tap End Live session .
Set quick access to Guided Vision
You can quickly start Guided Vision with shortcut options on your device.
Set the shortcuts to open Live with camera
You can add an accessibility shortcut to enable guided vision quickly. Learn how to set up accessibility shortcuts.
To set Guided Vision as an accessibility shortcut:
- Open your device’s Settings app.
- Tap Accessibility. Under “Vision assistance,” tap Guided Vision.
- Under “Options,” make sure Guided vision shortcut is turned on
- Tap Guided vision shortcut to open the shortcut options. You can choose:
- Accessibility button to tap the floating button to start Guided Vision.
- Accessibility gesture to swipe up from the bottom of your phone screen with two fingers to start Guided Vision.
- Volume keys to press and hold both volume keys to start Guided Vision.
Set TalkBack to start Live with camera
You can start Gemini Llive with TalkBack, the screen reader for Android. To set Guided Vision with TalkBack:
- Make sure TalkBack is up to date (Update here).
- While TalkBack is enabled, tap on screen with three fingers to bring up the TalkBack menu.
- Choose Guided Vision.
What you can do with Guided Vision
- Read or translate text: Get audio descriptions of text like small labels, complex signs, menu descriptions, appliance displays, or any text in your environment.
- Identify objects: Get audio guidance to identify and find the position of objects around you. For example, you can ask for help finding pepper in a spice cabinet.
- Describe objects: Get help understanding things like color, shape, and pattern of items. For example, you can ask if the color or pattern of a shirt goes with a pair of pants.
- Understand your surroundings: Get audio descriptions of what’s around you. For example, you can ask for help finding where an earbud fell or get a description of a room’s layout.
Limitations and Warnings
Related resources