Bing Visual Search

Deliver new experiences that enable users to search with images and gain insights in compelling new ways.

Interpret images to build tailored visual experiences

Create compelling visual experiences through interpretation of images on a device of your choice. Enrich the search experience with visually similar images and products from your business, and use Bing Visual Search to recognise celebrities, monuments, artworks and other related objects. Identify barcodes or extract textual information from images to provide rich insights – all through the single API.

See it in action

Want to build this?

Discover intelligent context identification

Use smart identification of image content to recognise celebrities, find products or search for related content. Bing Visual Search automatically identifies the type of picture, recognising image context whether it is a barcode, a business card or a product.

Enhance product recommendations for your business

Create compelling product recommendations for your domain through visually similar images and products. For example, build a crop-free product selection experience for your users to detect and delineate fashion products automatically.

Make your applications and devices intelligent

Add search intelligence to your apps and devices. Integrate with any image source to get annotations and information, whether using a bot, mobile device or output from another Cognitive Service.

Augment image understanding through OCR

Extract structured textual information to build better search results by reading the text in images using optical character recognition (OCR).

Powerful statistics for your queries

Inform your strategic decisions with the Bing Statistics add-in. Quickly retrieve statistics such as your top queries, call volume, market distribution, response code summary and many more – and derive rich insights to advance your business. Visit the portal to consume these statistics. You can subscribe to Bing Statistics Add-in from Azure Portal.

Take a look at Bing Visual Search scenarios

Retail assistant or holiday planner with visual capabilitiesThe retail assistant or holiday planner can help your customers have interactions with your business bot and provide suggestions based on the visual information.4231
  1. Overview
  2. Flow

Retail assistant or holiday planner with visual capabilities

Overview

The retail assistant or holiday planner can help your customers have interactions with your business bot and provide suggestions based on the visual information.

Flow

  1. 1 Users interact with your business assistant
  2. 2 Assistant understands context from LUIS
  3. 3 Assistant passes visual context to the Bing Visual Search API
  4. 4 Bot optionally gets more information for user queries exclusively from your domain using the Bing Custom Search API
Visual AssistantVisual assistant provides rich information based on content of the image with capabilities such as reading business card, identifying barcode, and recognising popular people, places, objects, artworks and monuments.123546
  1. Overview
  2. Flow

Visual Assistant

Overview

Visual assistant provides rich information based on content of the image with capabilities such as reading business card, identifying barcode, and recognising popular people, places, objects, artworks and monuments.

Flow

  1. 1 Users interact with bot
  2. 2 Bot understands context from LUIS
  3. 3 Bot passes visual context to the Bing Visual Search API
  4. 4 Bot gets additional information from Bing Entity Search for rich context on people, place, artworks, monument and objects.
  5. 5 Bot gets additional information for barcodes.
  6. 6 Bot optionally gets more information on barcodes/queries exclusively from your domain through the Bing Custom Search API.
  7. 7 Assistant renders similar products/destinations from your domain or provides more information around celebrity/place/monuments/artworks.

Explore the Cognitive Services APIs

Computer Vision

Distill actionable information from images

Face

Detect, identify, analyse, organise and tag faces in photos

Ink Recogniser PREVIEW

An AI service that recognises digital ink content, such as handwriting, shapes and ink document layout

Video Indexer

Unlock video insights

Custom Vision

Easily customise your own state-of-the-art computer vision models for your unique use case

Form Recogniser PREVIEW

The AI-powered document extraction service that understands your forms

Text Analytics

Easily evaluate sentiment and topics to understand what users want

Translator Text

Easily conduct machine translation with a simple REST API call

QnA Maker

Distill information into conversational, easy-to-navigate answers

Language Understanding

Teach your apps to understand commands from your users

Immersive Reader PREVIEW

Empower users of all ages and abilities to read and comprehend text

Speech services

Unified speech services for speech-to-text, text-to-speech and speech translation

Speaker Recognition PREVIEW

Use speech to identify and verify individual speakers

Content moderator

Automated image, text and video moderation

Anomaly detector PREVIEW

Easily add anomaly detection capabilities to your apps.

Personaliser PREVIEW

An AI service that delivers a personalised user experience

Explore the Bing Visual Search API