Visual Assistant

Visual assistant provides rich information based on content of the image with capabilities such as reading business card, identifying barcode and recognizing popular people, places, objects, artworks and monuments.

Visual AssistantVisual assistant provides rich information based on content of the image with capabilities such as reading business card, identifying barcode and recognizing popular people, places, objects, artworks and monuments.123546

Users interact with bot

Bot understands context from LUIS

Bot passes visual context to the Bing Visual Search API

Bot gets additional information from Bing Entity Search for rich context on people, place, artwork, monument and objects.

Bot gets additional information for barcodes.

Optionally Bot gets more information on barcodes/queries exclusively from your domain through the Bing Custom Search API.

Assistant renders similar products/destinations from your domain or provides more information around celebrity/place/monuments/artworks.

  1. 1 Users interact with bot
  2. 2 Bot understands context from LUIS
  3. 3 Bot passes visual context to the Bing Visual Search API
  4. 4 Bot gets additional information from Bing Entity Search for rich context on people, place, artwork, monument and objects.
  1. 5 Bot gets additional information for barcodes.
  2. 6 Optionally Bot gets more information on barcodes/queries exclusively from your domain through the Bing Custom Search API.
  3. 7 Assistant renders similar products/destinations from your domain or provides more information around celebrity/place/monuments/artworks.