Microsoft (MSFT) is giving its AI-powered Copilot a major upgrade, outfitting it with a variety of new features, including the ability to remember important data about you, take actions on your behalf, perform visual searches, and more as part of its Copilot and 50th anniversary event on Friday.
The upgrades are part of Microsoft’s effort to keep competing AI services like Google’s (GOOG, GOOGL) Gemini and Apple (AAPL) Intelligence at bay, while ensuring it gets the most out of its vast investments in both OpenAI and its own AI capabilities.
The biggest update to the AI assistant is the ability to memorize your content. Microsoft says Copilot will be able to remember information like your favorite food, family members’ birthdays, and your general interests to create a profile of you that can provide you with reminders and suggestions based on your likes.
The company says you’ll be able to control the type of information Copilot remembers about you and let you opt out of using it.
Microsoft has run into trouble in the past when it comes to its AI features and what they can remember. It had to pull back its Recall software, which took screenshots of your activity while using your computer, ahead of its release over security concerns.
Microsoft eventually tweaked Recall’s functionality and made it an opt-in feature that requires users to choose to use it rather than having it active by default.
Eventually, Microsoft says, you’ll be able to change Copilot’s appearance. Though there’s no word on whether you’ll be able to make it look like everyone’s favorite helper: Clippy.
Copilot’s Actions feature will allow the software to take actions on your behalf using chat prompts. For instance, Microsoft claims Copilot Actions will work with most websites, including launch partners like OpenTable, Booking.com, and others.
AI companies are hoping agentic AI will help drive adoption, with Google prepping agents for the web and games and OpenAI launching tools for developers to build AI agents. Samsung and Google also offer agentic capabilities via their smartphones, and Apple is working on adding agentic features to Apple Intelligence.
In addition to customization and actions, Copilot now gets visual search on the web and in the Copilot app called Copilot Vision. That means you can use your smartphone’s camera to take pictures or use live video to search the web for information about the things around you. On the web, you’ll be able to use Copilot Vision to read your screen and search for content or change settings. It will also work with certain apps like Photoshop, helping you navigate and showing you how to use it.
The company is also adding a number of other capabilities to Copilot, including Podcasts, which pull information from the web and provide it to you in an audio format. The app can also act as a personal shopper, help you perform multi-step research, and add Copilot Search directly to the Bing browser.
Microsoft’s moves help solidify its position as a leader in the consumer AI space, while also serving as a stark reminder of how far behind rival Apple is in the AI wars. The company has delayed the release of a generative AI-powered version of Siri until later this year and has, so far, provided relatively basic AI features, like photo editing and text summaries.
Email Daniel Howley at [email protected]. Follow him on Twitter at @DanielHowley.
Click here for the latest technology news that will impact the stock market.
Read the latest financial and business news from Yahoo Finance.