Google recently announced on its blog that it's bringing multi-modal search capabilities to its AI mode. This new feature allows users to delve deeper into image content through complex questions. This functionality is available to users with access to the AI mode, enabling them to directly ask questions about photos they upload or take with their cameras.
The new image analysis feature in AI mode is based on Google Lens's multi-modal technology. Google states that this mode can understand the entire scene within an image, including the relationships between objects, materials, colors, shapes, and arrangement. Using a technique called "query fan-out," users can ask multiple questions about the image and the objects it depicts, receiving more detailed information than traditional searches.
For example, a user could take a picture of a bookshelf and ask: "If I like these books, what other similar, highly-rated books are there?" The AI mode would identify each book in the photo and generate a list of recommended books, complete with links for more information and purchase. Even better, users can continue asking questions to further refine their search, such as "I'm looking for quick reads; which of these recommendations are the shortest?" This interactive approach makes searching more intelligent and personalized.
Google says the new AI mode feature will roll out to millions of users in the experimental program in the coming weeks. Previously, this mode was limited to Google One AI Premium subscribers. This launch aims to compete with popular services like Perplexity and OpenAI's ChatGPT Search.
Google also stated that it will continue to improve the user experience and expand this new feature to provide users with a better service experience.
Key Highlights:
🌟 New Feature: Google's AI mode allows users to ask in-depth questions about image content through multi-modal search.
📚 Smart Recommendations: Users can upload photos and receive relevant book recommendations and links.
🚀 Expansion Plan: The new feature will be rolled out to millions of users, with continuous improvements planned for the future.
