Google’s new AI feature lets you search the web by uploading a video

Google has been the dominant search engine for more than a decade. However, to stay competitive with the new generation of AI search engines, Google’s had to step up its game by implementing AI, and these new features are the latest salvo. 

On Thursday, Google launched new ways to search that leverage AI, starting with the ability to search using a video in Google Lens. Now, if you’re curious about something happening in real-time in front of you, you can ask Google about it by shooting a quick video of what you are seeing. 

Also: The best AI search engines: Google, Perplexity, and more

Here’s what you do: Open Lens in the Google app on your phone, hold down the shutter button, and audibly state the question you want to learn more about. Google shares the example of a user recording a group of fish swimming in a circle at an aquarium and asking, “Why are they swimming together?” 

The feature is available for Search Labs users who are enrolled in the “AI Overviews and more” experiment and have the Google app, which is free to download for both Android and iOS users. 

Furthermore, users also can use voice prompts when taking a photo with Lens in the Google app for Android and iOS. The uploading process remains the same — shoot a picture by clicking the shutter button — but now you can add a voice question. This capability is available globally now. 

The Lens shopping experience has also been upgraded. Users now can take a photo of an item and get a more helpful result page that includes information such as reviews, prices, and retailers where the item can be purchased. 

Beyond visual element search, Google added a feature to help you find what you hear. With the latest Circle to Search update, users can search for songs without leaving the page on which they heard the sound. For example, if you hear a song on Instagram you want to know more about, you simply activate Circle to Search to find out. 

Also: Google’s AI podcast tool transforms your text into stunningly lifelike audio – for free

With the rollout of AI-organized result pages (mobile only) in the US, your results page will also look slightly different. At launch, the new results design will apply only to recipe and meal inspiration searches, invoking a full-page experience organized by the most relevant results for the user. 

Lastly, Google said it has been testing new ways to display AI Overviews that enable users to get the sources they’re seeking more easily. The new design displays prominent links to supporting webpages directly within the AI Overview text and, due to positive feedback, will be rolled out to all countries where AI Overviews are available.