Microsoft is testing a major upgrade to its Copilot AI that can view your entire screen instead of just working within the Edge browser.
The new Copilot Vision feature helps users navigate apps like Photoshop and Minecraft by analysing what's on display and offering step-by-step guidance, even highlighting specific tools instead of just giving verbal instructions.
The feature operates more like a shared Teams screen instead of Microsoft's controversial Recall snapshot system.
Currently limited to US beta testers, Copilot Vision will eventually highlight interface elements directly on users' screens. It works on standard Windows PCs instead of requiring specialised Copilot+ hardware, with mobile versions coming to iOS and Android.
Alongside visual assistance, Microsoft is adding document search capabilities. Copilot can now find information within files like Word documents and PDFs instead of just searching by filename.
Both updates will roll out fully in the coming weeks, potentially transforming how users interact with both apps and documents on their Windows devices.