Microsoft’s Bing Chat A.I. bot now lets you search using images

Microsoft On Tuesday, he announced a significant update to his AI chatbot: visual search. Users can now take a photo or upload it to Bing Chat and request more information about it through desktop apps or Bing.

“Bing can understand and interpret the context of the image and answer questions about it,” Microsoft wrote in a statement. “Whether you’re traveling to a new city on vacation and asking about the architecture of a particular building or at home trying to come up with lunch ideas based on the contents of your fridge, upload the image to Bing Chat and use it to harness the knowledge of the web to get you answers.”

The update comes as the AI ​​arms race rages on among chatbot leaders such as Microsoft, GoogleOpenAI and Anthropic. In an effort to develop the most advanced AI, the tech giants are rapidly launching new features, aiming to keep up with not only their text chat bot competitors, but also the AI ​​heavyweights.

Although image searches – and responses that include images – are now part of the user experience for chatbots, none of the leading text-based chatbots seem to be able to generate their own images yet, unlike tools like Midjourney, Stable Diffusion, and DALL- E 2. However, Google says the feature is on its way for Bard chatbot.

Microsoft’s decision to allow images for Bing Chat comes on the heels of Google’s recent debut of an image search feature for Bard, its AI chatbot. With Google Lens, users can request information from the Bard about a photo they’ve uploaded, ask them to create a comment or even just add some zest to chatbot responses, such as asking for restaurant recommendations with photos of the restaurant’s interiors included. At the time of writing, OpenAI’s ChatGPT does not allow image uploads, the chatbot is still entirely text-based, and Anthropic’s chatbot, Claude 2, works similarly.