Microsoft has introduced new Copilot capabilities on Windows for all users, including a tool that can understand and respond to questions about the content on your screen. These refreshed Copilot apps for iOS, Android, Windows, and the web feature a more “warm” and “distinct” style, as described by Microsoft.
Copilot Vision
Copilot Vision provides a view of what you’re looking at on your PC, specifically focusing on the sites you visit with Microsoft Edge. This feature, accessible through Copilot Labs, interacts with text and images on webpages to answer queries related to the content.
Vision, triggered by typing “@copilot” in Edge’s address bar, offers search capabilities similar to Google on Android but with enhanced privacy considerations according to Microsoft.
Microsoft assures users that Copilot Vision respects privacy and does not store data after conversations. The feature is limited to analyzing specific types of websites to maintain data security.
Accusations of privacy breaches in the past have motivated Microsoft to emphasize data protection measures with Copilot Vision.
Think Deeper
Think Deeper, a new feature of Copilot, enhances its problem-solving capabilities by utilizing reasoning models for more complex tasks. Microsoft aims to make Copilot more versatile and assist with various practical challenges.
Think Deeper will be available for select Copilot Labs users in specific regions, allowing them to benefit from advanced reasoning models.
Copilot Voice
Copilot Voice, a new feature accessible to users in certain countries, introduces synthetic voices for conversing with Copilot. Users can interact with Copilot through voice commands, with responses spoken aloud.
Similar to OpenAI’s voice technology, Copilot Voice adapts to user tone during conversations and features time-based usage limits for optimal functionality.
Personalization
Microsoft plans to introduce personalization settings for Copilot, customizing the user experience based on past interactions and preferences. With this setting enabled, Copilot recommends features and conversation starters tailored to individual users.
European users may experience delays in receiving these personalization features due to compliance evaluations, reflecting Microsoft’s commitment to data privacy in the EU.
