Microsoft Copilot will get a series of new features that will allow it to conduct a spoken conversation and understand the content displayed on the screen. However, these new features will only be available to some English-speaking countries at the moment…
You'll soon be able to have discussions with your computer in person. MicrosoftMicrosoft It just announced a series of new features for Copilot, including Copilot Voice, the ability to understand spoken language and respond in a natural voice. According to Microsoft, this is not a simple voice assistant. Copilot will now be able to listen actively, and it will be possible to interrupt it for a more natural conversation experience. In addition, it will encourage the user and provide a form of emotional support.
Copilot voice demonstration. In English, enable automatic translation of subtitles. © Microsoft
Another important new feature, Microsoft announced Copilot Vision. Copilot will now be able to understand screen content, comment on it, make suggestions and answer questions on the current web page. The description sounds a lot like Molmo, a Amnesty InternationalAmnesty International The open source was revealed a few days ago.
Copilot vision demonstration. In English, enable automatic translation of subtitles. © Microsoft
Artificial intelligence that takes the time to think
Microsoft envisions Copilot being able to follow you through your daily life, automatically taking notes, scheduling event reminders without you having to tell it, and cheering you on during the big day. Microsoft also announced Think Deeper, which will allow Copilot to tackle more complex questions. The AI will take more time to think about the response, a feature similar to the new OpenAI o1 feature launched in September.
These same functions will also be available in a new version ofto requestto request mobile. However, the co-pilot will have to face the artificial intelligence he developed appleapple and GoogleGooglewhich works natively on iPhone and smartphones AndroidAndroid. Apple specifically announced visual intelligence for next year, and Google is working on developing it Astra project.
For now, these new features will only be available in English and in a small number of English-speaking countries, on Copilot+ PC, Windows 11, and the mobile app. Microsoft plans to add more languages and regions soon for Copilot Voice, which will be available for free, while Copilot Vision and Think Deeper will require a subscription to Copilot Pro.
