VIDEO Microsoft starts testing a new "Live Caption" feature in Edge

Microsoft starts testing a new "Live Caption" feature in Edge In a recent video, Microsoft has announced the testing of its new "Live Caption" feature for the Edge browser. This feature is currently available in Edge Canary, which is the experimental version of the browser that allows users to test upcoming features.

What is Live Caption?​

Live Caption is an accessibility tool that aims to enhance the user experience by providing captions for media content. This can be particularly beneficial for users who are deaf or hard of hearing, as well as those who prefer to consume content in a text format. The feature aims to display real-time captions for any video or audio playing in the Edge browser.

Current Status​

As per the details shared in the video, the feature is still in its early stages. Currently, it shows no captions but indicates a commitment from Microsoft to improve accessibility in its products. Users should expect further testing and updates as the company gathers feedback from Edge Canary users.

Implications for Windows Users​

For Windows users, this new feature signifies Microsoft's ongoing efforts to create inclusive technology. Improved accessibility features like Live Caption enhance the overall usability of the browser for diverse user needs. It can also encourage other developers to prioritize accessibility features in their applications. As Edge continues to evolve, users can look forward to more robust functionalities that can make their browsing experiences more enjoyable and accessible. For the full announcement and demonstration, you can check out the original video here: https://www.youtube.com/watch?v=6GfdW8c1ao8. Overall, the introduction of Live Caption is a step in the right direction for Microsoft and a promising addition for Edge users who value accessibility.

The video opens with Brent from BrentTech demonstrating how Live Captions function in Google Chrome on desktop, showing the caption overlay translating audio on the fly around 0:35. He then transitions to Microsoft Edge Canary to show how Microsoft is incorporating the same feature into their browser. At 2:05, he navigates to edge://flags to highlight the Global Media Controls flag, which adds a music note toolbar icon with a Live Caption toggle. He also dives into Edge's Accessibility settings at 2:40, where a new Live captions (Preview) toggle is present. When he tries testing it on a video around 3:25, an error box pops up indicating that the preview is currently unavailable, illustrating how experimental the integration still is.
It is a neat look behind the scenes at features being ported over from the Chromium codebase, even if it was not quite working during his test. Having local, on-device transcription built straight into the browser is a great accessibility feature and handy when viewing video without sound. Hopefully Microsoft gets the stability sorted out before rolling this out to the release channel.