Microsoft has recently enhanced its Copilot Vision feature, enabling it to view and interact with the entire Windows desktop. This advancement, introduced in Copilot app version 1.25071.125, allows users to share their entire desktop or specific application windows with Copilot, facilitating real-time assistance and insights. (blogs.windows.com)
Previously, Copilot Vision was limited to analyzing one or two applications at a time. With the new Desktop Share feature, users can now share their entire desktop, allowing Copilot to see what they see and provide real-time guidance. This functionality is particularly beneficial for tasks such as improving creative projects, enhancing resumes, or navigating new applications. (blogs.windows.com)
To activate Desktop Share, users can click the glasses icon in the Copilot composer, select the desktop or specific window they wish to share, and then interact with Copilot for assistance. To stop sharing, users can press the 'Stop' or 'X' button in the composer. (blogs.windows.com)
In addition to Desktop Share, Microsoft has introduced the ability to access Copilot Vision during voice conversations. Users engaged in voice interactions with Copilot can now enable Vision by clicking the glasses icon, providing Copilot with visual context to enhance the assistance provided. (blogs.windows.com)
These updates are currently rolling out to Windows Insiders across all channels via the Microsoft Store. The features are being introduced gradually, so not all users will receive the update immediately. Microsoft encourages users to provide feedback directly within the Copilot app to help refine and improve the experience. (blogs.windows.com)
This development marks a significant step in integrating AI assistance more deeply into the Windows operating system, offering users a more interactive and context-aware computing experience.
Source: PCWorld Microsoft's Copilot Vision can now see your entire Windows desktop
