Google is rolling out a new accessibility feature called Guided Vision for Gemini Live, giving people who are blind or have low vision another way to understand their surroundings through real-time AI-generated audio descriptions.
Guided Vision Brings Real-Time Visual Assistance to Gemini Live
Guided Vision is launching on compatible Android devices and uses a smartphone’s camera to help users interpret objects, text and other details in their immediate surroundings.
Users can share their camera through Gemini Live and ask Google’s AI assistant to describe what it sees. The feature can help read small or difficult-to-see text, describe nearby surroundings, locate and identify objects, and provide information about specific items captured by the camera.
The system is designed to make visual information more accessible without requiring users to manually capture and upload individual images.
Users Can Ask Follow-Up Questions About What Gemini Sees
A key part of Guided Vision is its conversational functionality. Instead of receiving only a single description, users can continue asking Gemini questions about whatever the camera is showing.
For example, after Gemini helps locate a product, a user could ask the assistant to read its expiration date. If the requested object or information is outside the camera’s view, Google says Gemini can provide audio cues intended to help the user reposition the phone and bring the relevant item into the frame.
That combination of live camera input, spoken descriptions and follow-up questions could be useful for everyday tasks involving labels, packaging, household objects and other visual information.
Google Expands Android Accessibility Tools
Guided Vision is designed primarily for people who are blind or have low vision, although it can also be used by anyone who wants visual assistance in a particular situation.
The approach is similar to accessibility technology offered by Apple through VoiceOver Live Recognition on devices including the iPhone and Apple Vision Pro. These tools increasingly combine cameras, artificial intelligence and audio feedback to make visual environments easier to interpret.
In addition to the Gemini app, Guided Vision is available through Google’s TalkBack screen reader. Users can also configure an accessibility shortcut to access the feature through the Settings app on devices running Android 9 or later.
Google previously announced the functionality as part of a broader collection of updates for Pixel and Android devices.
Google Warns Guided Vision Is Not a Mobility Aid
Despite its potential uses, Google is placing clear limits on how people should rely on the technology.
The company cautions users against depending on Guided Vision for “navigation, safe-travel guidance, or obstacle detection.” Google also says the feature should not be treated as a replacement for a cane or other mobility aid.
The warning highlights an important limitation of AI-powered visual systems: descriptions generated from a smartphone camera may be useful for identifying objects or reading information, but they are not designed to provide the reliability required for safety-critical navigation.
AI Accessibility Features Continue to Expand
Guided Vision reflects a broader push by major technology companies to use artificial intelligence to improve accessibility. Smartphone cameras and multimodal AI systems can increasingly recognize text, objects and scenes while allowing users to interact with that information through natural-language questions.
For Android users with visual impairments, integrating those capabilities directly into Gemini Live and TalkBack could make them easier to access during routine tasks.
Google’s rollout of Guided Vision adds another practical use for Gemini’s real-time visual capabilities, particularly for people who need assistance reading fine print, identifying objects or understanding details in their surroundings. At the same time, Google’s safety guidance makes clear that the technology is intended as an accessibility assistant rather than a substitute for established mobility tools.
Abigail Prescott is a contributor to Campuslately.com, covering a wide range of topics including news, politics, business, technology, sports, entertainment, and lifestyle. She focuses on delivering clear, accurate reporting and useful information that helps readers stay informed about current events and emerging trends. With a reader-first approach, Abigail highlights stories that matter, providing balanced coverage and accessible insights on issues relevant to everyday audiences.
