Google's 'Ask Photos' will surf user data

'Ask Photos' has entered initial testing, final product will scan private data

Tech Desk - Jul 20, 2024

An undated image of the Google insignia. — Reuters

Google’s ‘Ask Photos’ feature, first introduced at I/O 2024, has entered initial testing. The feature uses Google’s Gemini AI to search through a user's photos using natural language without needing to toggle or organise them first. The company hasn’t announced a release date, but a select few individuals have been asked to provide feedback.

Ask Photos enables Gemini to browse a user’s images and videos stored on their device.

Google CEO Sundar Pichai demonstrated how the AI could pull up his license plate number by searching through his albums and finding a matching image.

9to5Google’s report on the matter was first noted by a Pixel 8 Pro user. Unlike the official demo, the feature seems to be available on the search tab via the ‘ask’ button beside the search bar.

Tapping this triggers a new interface with a string of prompts and space to write personal notes.

Some aspects are still undergoing testing. For instance, 'photos of me over time' prompted an error. Gemini’s ability to search through images and identify very specific aspects will be a treat for users, especially those with unorganised data.

Google Photos already features the ability to identify people or places via images, and ‘Ask Photos’ is a step towards embedding Gemini into Google services.