Microsoft has unveiled a series of generative AI enhancements for its Windows 11 applications—Paint, Snipping Tool, and Notepad—marking a significant advancement in integrating artificial intelligence into everyday productivity tools.

Generative AI in Paint

Paint, a longstanding staple in Windows, now features two notable AI-driven tools:

  • Generative Fill: This tool allows users to add or modify content within images using simple text prompts. By selecting an area and describing the desired addition, Paint generates content that seamlessly integrates with the existing image, maintaining its original style. This feature is initially available on Snapdragon-powered Copilot+ PCs and requires a Microsoft account for access. Availability may vary based on regional criteria. [Source]
  • Generative Erase: Users can remove unwanted objects from images, with the AI intelligently filling in the gaps to make it appear as if the object was never there. This feature is available to all Windows 11 users. [Source]

AI-Powered Enhancements in Notepad

Notepad has been augmented with the following AI capabilities:

  • Rewrite: This feature enables users to rephrase sentences, adjust tone, and modify content length. By selecting text and choosing the "Rewrite" option, Notepad generates multiple variations, allowing users to select the most suitable version. This feature is available in preview to users in the United States, France, UK, Canada, Italy, and Germany, requiring a Microsoft account. Microsoft 365 Personal and Family and Copilot Pro subscribers in Australia, New Zealand, Malaysia, Singapore, Taiwan, and Thailand can also use AI credits to access this feature. [Source]
  • Summarize: Users can condense content by selecting text and choosing the "Summarize" option. Notepad generates a concise summary, streamlining the process of understanding lengthy documents. This feature is available in preview to users in the United States, France, UK, Canada, Italy, and Germany, requiring a Microsoft account. Microsoft 365 Personal and Family and Copilot Pro subscribers in Australia, New Zealand, Malaysia, Singapore, Taiwan, and Thailand can also use AI credits to access this feature. [Source]

Advancements in Snipping Tool

The Snipping Tool has been updated with features aimed at enhancing user experience:

  • Draw & Hold: This feature assists users in drawing precise lines and shapes. By selecting the pen tool and drawing a shape, holding the cursor or pen still for a moment converts the stroke into a well-formed shape, which can then be resized or adjusted as needed. [Source]
  • Protocol Launch: Developers can now customize which Snipping Tool capture features are shown when invoked from their applications, offering improved flexibility and integration with web technologies. [Source]

Implications and Impact

The integration of generative AI into these applications signifies Microsoft's commitment to enhancing user productivity and creativity. By embedding AI directly into familiar tools, users can perform complex tasks more efficiently without the need for specialized software. These features are currently available to Windows Insiders in the Canary and Dev Channels, with broader availability expected following user feedback and further refinement.

Technical Details

These AI features leverage advanced machine learning models to understand and generate content based on user input. The generative fill and erase functions in Paint utilize diffusion-based models to create and modify images, while the rewrite and summarize features in Notepad employ natural language processing techniques to analyze and generate text variations. The Draw & Hold feature in Snipping Tool uses shape recognition algorithms to assist in creating precise annotations.

By integrating these AI capabilities, Microsoft aims to provide users with intuitive tools that enhance creativity and productivity, reflecting the company's broader strategy of embedding AI across its product suite.