Microsoft CoPilot can understand handwriting

As part of its addition to OneNote, Microsoft's CoPilot tests handwriting detection

Tech Desk - Jul 12, 2024

An undated image of the CoPilot logo. — Microsoft/Canva

Microsoft is working on training CoPilot to understand and engage with handwritten notes on OneNote.

The feature entered beta testing later last month and when active, will let users pen notes using a stylus and then have CoPilot summarize them, generate a list or engage in any other way with them.

Additionally, the feature will be able to convert handwritten notes into regular text that’ll be much easier to edit and share.

The AI was introduced to OneNote in November, once active, the feature will roll out to CoPilot for Microsoft 365 subscribers and CoPilot pro users.

Beta tests have revealed CoPilot to be fairly successful in completing this feature. Users have had it recognize their handwritten text and accurately convert it into text and engage with it, create lists, etc.

Some work may still be needed on the recognizability front, it’s not yet certain how the software performs with poor handwriting, Samsung's Galaxy AI faced a similar roadblock.

For those wanting to test Copilot’s handwritten note recognition, they will need to be a Microsoft 365 Insider running the latest OneNote on Windows build (17628.20006 or later) and have a Copilot Pro or Copilot for Microsoft 365 subscription.