Microsoft Windows 11 Gets Powerful AI Features for Better Productivity and Accessibility

Microsoft's latest Windows 11 update introduces a suite of on-device AI capabilities designed to enhance user interaction, accessibility, and productivity. These features, rolling out through the current month's non-security preview release and Microsoft Store app updates, are set to transform the Windows 11 experience.

AI Agent for Settings​

Exclusive to Copilot+ PCs, the new AI-powered settings assistant allows users to manage system configurations using natural language commands. By typing phrases like "turn on quiet hours" or "connect Bluetooth" into the Settings search bar, users receive actionable suggestions for one-click adjustments. Initially available on Snapdragon-based Copilot+ PCs, this feature is slated to expand to Intel and AMD Copilot+ systems in the near future.

Enhanced Click to Do​

The Click to Do feature has been updated to offer more AI-driven contextual tools, including:

• Reading Coach: Assists users in improving reading fluency.
• Immersive Reader: Presents selected text in a focused format to enhance readability.
• Draft with Copilot in Word: Generates document drafts based on user prompts.
• Microsoft Teams Integration: Facilitates messaging or meeting scheduling directly from recognized email addresses.

Users can activate Click to Do using shortcuts like Windows + click, Windows + Q, or gestures such as swiping from the right on touch-enabled devices.

Photos App: AI-Based Relight​

The updated Photos app introduces the Relight feature, enabling users to apply up to three virtual light sources to images. This allows for adjustments in brightness, softness, color, and intensity, akin to professional editing tools. Currently, this feature is exclusive to Copilot+ PCs equipped with Snapdragon X chips.

Paint: AI Sticker Generator and Object Selection​

Two new AI-powered tools have been added to the Paint app:

• Sticker Generator: Creates custom stickers based on text prompts (e.g., "a cat wearing sunglasses").
• Object Select: Utilizes AI to isolate and edit specific elements within an image.

These enhancements build upon previous features like Cocreator and generative erase, further expanding Paint's creative capabilities.

Snipping Tool: Perfect Screenshot and Color Picker​

The Snipping Tool now includes:

• Perfect Screenshot: Employs AI to intelligently crop screen captures to relevant content (available on Copilot+ PCs only).
• Color Picker: Allows users to sample any color from the screen and view it in HEX, RGB, or HSL formats.

The Color Picker feature is accessible on all Windows 11 devices, enhancing the tool's versatility.

Copilot Vision and Highlights​

Currently available in the U.S., Copilot Vision offers real-time AI assistance based on on-screen content. It can analyze displayed information, provide help, and offer step-by-step instructions with visual cues. Users can activate this feature through the Copilot app and select the content they wish to share.
These advancements underscore Microsoft's commitment to integrating AI seamlessly into the Windows 11 ecosystem, providing users with intuitive and efficient tools to enhance their computing experience.

---

Source: Business Standard https://www.business-standard.com/technology/tech-news/microsoft-windows-11-new-update-features-on-device-ai-capabilities-coming-125072300777_1.html