Microsoft Photos App Update: AI Super Resolution and OCR Features

  • Thread Author
In a recent update for the Windows 11 24H2 Insider build, Microsoft has unleashed a powerful new feature into its Photos app: AI Super Resolution upscaling. This innovative technology allows users to amplify their images’ resolution by up to eight times while retaining clarity, turning the Photos app into a more robust tool for digital image enhancement. However, this exciting feature is currently exclusive to machines equipped with Qualcomm Snapdragon processors under the Copilot+ branding, leaving many users unable to take advantage of these enhancements.

What Does AI Super Resolution Upscaling Bring to the Table?​

Super Resolution technology is not entirely new; it's already been making waves on certain smartphones equipped with locally-processed AI applications. With the rollout of Snapdragon X Elite SoCs, Microsoft aims to bring these advanced capabilities to its desktop offerings. The upscaling feature is particularly beneficial for various tasks, such as:
  • Cropping Images: Users can easily crop images while maintaining high resolution in the resulting output.
  • Enhancing Low-Quality Photos: Dull or pixelated images can be spruced up significantly, giving them a fresh lease on life.
  • Zooming In: The technology allows users to zoom in on details without the dread of pixelation ruining their view.
  • Preparing for Large Prints: For those who enjoy printing their photographs, higher resolutions are essential, and this tool simplifies that process.
To engage the Super Resolution feature, users merely need to click an icon located in the far right corner of the top row of the app in version 2024.11100.17007.0.

The AI Framework Behind Upscaling​

At the heart of this Super Resolution capability lies the power of NPUs (Neural Processing Units). Microsoft positions the feature as reliant on these specialized processors, suggesting that they are necessary for generative AI tasks. However, the irony is that many modern laptops and desktops, even those without Snapdragon processors, are adequately equipped to handle such operations.
Looking ahead, it’s anticipated that this feature will eventually expand to support Intel Core 200 and AMD Ryzen AI 300 CPUs, broadening accessibility to a larger audience.

New Features and Enhancements Beyond Upscaling​

Alongside Super Resolution, this Insider update also introduces a game-changing OCR (Optical Character Recognition) feature. The Photos app can now recognize text across more than 160 languages, allowing users to select and copy text effortlessly to their clipboard. Just click the OCR icon at the window’s bottom once the text is detected.
In the spirit of continuous improvement, Microsoft has made several user-friendly tweaks:
  • One-Click Opens: Users can now opt to open images with just a single click.
  • Automatic Resizing: Large images will automatically adjust to fill the window, enhancing the overall user experience.
Moreover, users engaged in beta testing can quickly submit feedback via the Feedback Hub using the shortcut Windows + F under Apps > Photos.

The Competitive Landscape of AI in Image Editing​

The move to incorporate sophisticated AI tools into Windows apps places Microsoft in close competition with leading players like Adobe, which has been touting its recent AI enhancements in Photoshop and other software. The release of generative AI-based tools, such as an eraser in the Photos app, and foreground features in Microsoft Paint, showcase the company's determination to provide users with powerful, subscription-free editing options.
With plans for public rollout slated for November, users of Snapdragon, Intel, and AMD Copilot+ PCs will be poised to explore these innovations.

Conclusion​

This latest evolution of the Microsoft Photos app is a notable step toward integrating AI functionalities into user-friendly formats. As features become increasingly accessible, users can look forward to tools that not only enhance their creative workflows but also democratize advanced features. For those fortunate enough to own a compatible Snapdragon-powered PC, the addition of AI Super Resolution upscaling is nothing short of a game changer. As Microsoft continues to push the boundaries of technology, eager users will undoubtedly benefit from such advancements.
Keep an eye on future updates, as the landscape of Windows apps continues to evolve with exciting new capabilities!
Source: TechSpot Microsoft Photos app gets AI super resolution upscaling in Windows Insider build