Google has unveiled a suite of new features for its AI Mode in Search, aiming to enhance learning and exploration just in time for the back-to-school season. These updates introduce advanced capabilities designed to assist users in interacting with various content types and organizing information more effectively.
Enhanced Image and PDF Interactions
Users can now pose questions about images directly from desktop browsers, a functionality previously limited to Android and iOS devices. This expansion allows for a more seamless integration of visual content into search queries. Additionally, support for PDF uploads on desktop is slated for release in the coming weeks. This feature will enable users to upload documents, such as lecture slides, and engage in detailed inquiries about their content. AI Mode will analyze the uploaded files and cross-reference them with web information to provide comprehensive responses, complete with linked sources. Future updates are expected to extend support to additional file types, including those from Google Drive.
Canvas: A Tool for Organization
The newly introduced Canvas feature in AI Mode assists users in planning and organizing information. Whether creating study plans or managing projects, Canvas offers a dynamic side panel that updates with refinements as users input more data. The upcoming upload feature will further enhance customization by incorporating context from files like class notes. Notably, Canvas projects are designed to be revisited across sessions, ensuring continuity in planning and organization. This feature is rolling out in the coming weeks to users participating in the AI Mode Labs experiment in the U.S., accessible via a "Create Canvas" option when planning is requested.
Real-Time Assistance with Search Live
Incorporating capabilities from Project Astra, Search Live introduces real-time, interactive assistance through video input. Users can engage in back-and-forth conversations with AI Mode by utilizing their device's camera. This integration with Google Lens allows users to point their camera at an object or scene and ask questions, receiving immediate, context-aware responses. To access this feature, users can open Lens in the Google app, tap the Live icon, and interact with the AI while pointing their camera. Search Live with video input is rolling out this week on mobile devices in the U.S. for users in the AI Mode Labs experiment.
Browse Integration with Lens in Chrome
Google is enhancing the browsing experience by integrating Google Lens with Chrome and AI Mode. Soon, clicking the Chrome address bar will present an option to "Ask Google about this page," enabling users to delve deeper into the content of their current webpage. This functionality allows users to select specific elements, such as diagrams, and receive AI-generated overviews in a side panel. Additionally, users will be able to ask follow-up questions through AI Mode by selecting the AI Mode option at the top of Lens search results or via a "Dive deeper" button at the bottom of the AI Overview. This integration is set to enhance the depth and interactivity of web browsing.
Back-to-School Focus
A Google executive highlighted the timely nature of these features, stating they are "just in time for the back-to-school season." Whether you're a student, parent, or educator—or simply wrapping up a busy summer—AI Mode is poised to assist in exploring complex questions and discovering high-quality information from across the web. To get started on desktop, users can look for the new AI Mode button on the Google homepage.
These enhancements reflect Google's commitment to evolving its search capabilities, integrating advanced AI features to provide users with more interactive and personalized experiences. By expanding the functionality of AI Mode, Google aims to support users in their learning journeys and information exploration, particularly as they prepare for the upcoming academic year.
Source: Virtualization Review Google Announces New Learning-Themed AI Mode Features for Search -- Virtualization Review
