Microsoft has recently unveiled a groundbreaking feature within its Copilot Studio: the autonomous computer use agent. This innovation empowers AI agents to independently navigate user interfaces, executing tasks such as clicking buttons, selecting menus, and entering text into fields. Currently available through an early access research preview, this capability signifies a substantial advancement in AI-driven automation.
"With computer use in Copilot Studio, makers can build agents that automate tasks on user interfaces across both desktop and browser applications, including Edge, Chrome, and Firefox," Microsoft stated. "If a person can use the app, the [AI] agent can too." Further details are anticipated at the upcoming Microsoft Build event in May.
This development positions Microsoft alongside other tech giants like Anthropic, OpenAI, and Google, all of whom are integrating autonomous computing capabilities into their platforms.
In December, Microsoft introduced Copilot Vision, enabling users to browse the web with AI assistance. With user consent, Copilot Vision can read and analyze web pages, offering insights and simplifying information. Recently, this feature has been extended to Windows Insiders, allowing early adopters to test and provide feedback.
Additionally, Microsoft has announced the 'Researcher' feature in Microsoft 365 Copilot, combining OpenAI's deep research model with Copilot's capabilities. This tool integrates third-party data from platforms like Salesforce, ServiceNow, and Confluence, facilitating comprehensive research tasks.
Another notable addition is the 'Analyst' feature, designed to function like a skilled data scientist. Built on OpenAI's o3-mini reasoning model, it can execute data queries using Python, providing real-time code visibility. "You can use Analyst to turn raw data scattered across multiple spreadsheets into a demand forecast for a new product, a visualization of customer purchasing patterns, or a revenue projection," Microsoft explained.
These enhancements underscore Microsoft's commitment to integrating advanced AI capabilities into its suite of tools, aiming to streamline workflows and boost productivity for users across various platforms.
Source: Analytics India Magazine Microsoft Launches Computer Use Agent for Copilot Studio | AIM Media House
Last edited:
