What to know

  • Google’s AI Mode now includes image search, allowing users to upload photos and ask questions about them.
  • The feature uses multimodal capabilities powered by Google Lens and Gemini 2.0 to provide detailed, contextually relevant responses.
  • AI Mode is now available to millions more users in the U.S. through Google Labs.
  • Users can ask follow-up questions to refine their searches and explore topics further.

Google has introduced a significant upgrade to its experimental AI Mode in Search, enabling users to interact with images for more intelligent and nuanced search results. This feature combines Google Lens’ advanced image recognition with Gemini 2.0’s multimodal reasoning capabilities, allowing you to upload photos or take pictures and ask questions about them. Whether it’s identifying objects, understanding their relationships, or exploring related topics, AI Mode delivers detailed and comprehensive answers.

For example, you can upload a photo of a bookshelf and ask, “If I enjoyed these, what are some similar books that are highly rated?” AI Mode will analyze the image, identify the books, and provide recommendations with links to learn more or purchase them. Additionally, you can refine your search by asking follow-up questions, such as, “Which of these recommendations is the shortest?”

This enhancement is part of Google’s broader effort to make AI-driven search more accessible and versatile. Previously limited to Google One AI Premium subscribers, AI Mode is now available to millions more users in the U.S. through Google Labs. To access it, you need to be at least 18 years old, have the latest Google app or Chrome browser, and enable search history.

The multimodal capabilities of AI Mode represent a leap forward in search technology. By analyzing the entire scene in an image, including object relationships, materials, colors, and arrangements, the system generates multiple queries to provide richer insights than traditional searches. This approach ensures responses are not only accurate but also contextually relevant, making it easier for you to explore complex topics or make informed decisions.

Google’s investment in AI Mode underscores its commitment to redefining search experiences. As the feature continues to evolve, it could become a cornerstone of how users interact with visual and textual information online. With its ability to handle longer and more complex queries, AI Mode is poised to set a new standard for search functionality.

Via: The Verge