• Thread Author
Artificial intelligence (AI) has seamlessly woven itself into the fabric of our daily routines, revolutionizing how we work, create, and interact with technology. Recognizing this transformative shift, Microsoft has unveiled a comprehensive Windows 11 update, introducing a suite of AI-driven features designed to enhance user experience, boost productivity, and foster creativity. This article delves into these groundbreaking additions, offering insights into their functionalities, benefits, and potential considerations.

AI-Powered Settings Management​

Navigating and adjusting system settings can often be a daunting task, especially for users unfamiliar with the intricacies of the operating system. To address this, Microsoft has integrated an AI agent directly into the Windows 11 Settings app. This intelligent assistant allows users to describe their desired changes in natural language. For instance, typing "enable quiet hours" into the Settings search box prompts the AI to suggest one-click actions to implement the change instantly. If a direct action isn't feasible, the enhanced Windows search guides users to the appropriate settings page. Currently, this feature is available for English-speaking users on Snapdragon-powered Copilot+ PCs, with plans to extend support to Intel and AMD devices in the near future.

Click to Do: Contextual Actions at Your Fingertips​

"Click to Do" is a feature that introduces smart, contextual actions to text and images displayed on your screen, streamlining workflows without the need to switch between applications. By pressing the Windows key combined with a mouse click, Windows key + Q, or accessing through the Start menu and Snipping Tool, users can activate this functionality. Once engaged, relevant actions appear, such as prompting Copilot, conducting web searches, creating bulleted lists, drafting documents or emails, or scheduling Teams meetings—all without leaving the current window. New additions include "Practice in Reading Coach," "Read with Immersive Reader," and "Draft with Copilot in Word," further enhancing productivity.

Advanced Photo Editing with Relight​

The Photos app has been augmented with the "Relight" tool, bringing professional-grade lighting controls to your images. Users can open a photo, navigate to Edit > Relight, and position up to three virtual light sources around the subject. Each light's intensity, color, and position can be adjusted using intuitive sliders, or users can select from presets like "Studio Portrait" and "Cinematic Glow." This feature empowers users to enhance their photos with precision, achieving desired lighting effects without the need for external software.

Creative Enhancements in Paint​

Microsoft Paint, a longstanding staple of the Windows ecosystem, has received significant AI-driven upgrades. The new AI-powered Sticker Generator allows users to input a prompt, generating custom stickers that can be added to the canvas, copied, or saved for future use. Additionally, the introduction of "Object Select" enables users to isolate and edit specific elements within an image with a simple click, facilitating more intricate and creative designs.

Snipping Tool: Perfect Screenshots and Color Picker​

The Snipping Tool has been enhanced with two notable features: "Perfect Screenshot" and "Color Picker." The Perfect Screenshot utilizes AI to capture precisely what is needed, eliminating the necessity for post-capture cropping or resizing. This feature is exclusive to Copilot+ PCs. The Color Picker, available to all Windows 11 users, allows for quick identification and extraction of any color from the screen, streamlining design and editing processes.

Copilot Vision: A Smarter Windows Experience​

Copilot Vision on Windows has been introduced to make the Windows 11 experience more intuitive and responsive. When enabled, Copilot can "see" the user's desktop and provide real-time assistance based on the displayed content. This feature is currently available in the U.S. and aims to offer contextual support, enhancing user interaction with the operating system.

Improved Windows Search​

Finding files without remembering their exact names is a common challenge. To address this, Windows 11 introduces an improved search experience powered by AI models that leverage the on-board neural processing unit (NPU) on Copilot+ PCs. Users can now search for documents and photos by describing their contents. For example, a document about cars, buses, and airplanes can be found by searching for "modes of transport." This enhancement makes it more intuitive and efficient to locate files, information, or settings.

Recall: Retrieving Past Activities​

The "Recall" feature captures and stores snapshots of user activity, enabling comprehensive search functionality. Despite initial privacy concerns, Microsoft has implemented safeguards such as encryption via the PC's Trusted Platform Module and Windows Hello authentication. Users have control over data retention and filtering options, ensuring a balance between functionality and privacy.

Privacy and Security Considerations​

While these AI-driven features offer substantial benefits, they also raise important privacy and security considerations. Features like Recall and Copilot Vision involve capturing and analyzing user activity, which could potentially expose sensitive information. Microsoft has addressed these concerns by implementing robust security measures, including data encryption and user authentication protocols. Users are encouraged to review and configure privacy settings to align with their comfort levels, ensuring a secure and personalized experience.

Conclusion​

The latest Windows 11 update signifies a significant leap forward in integrating AI into the operating system, offering users enhanced tools for productivity, creativity, and system management. By leveraging these new features, users can enjoy a more intuitive and efficient computing experience. However, it's crucial to remain mindful of privacy implications and configure settings accordingly to maintain a secure digital environment.

Source: Gizbot All the New AI Features Arriving with the Latest Windows 11 Update