Visual Assistant

Visual assistant provides rich information based on content of the image with capabilities such as reading business card, identifying barcode, and recognising popular people, places, objects, artworks and monuments.

Assistente VisualO assistente visual fornece informações detalhadas com base no conteúdo da imagem com recursos como a leitura de cartões de visita, a identificação de códigos de barras e o reconhecimento de pessoas, lugares, objetos, obras de arte e monumentos conhecidos.123546

Users interact with bot

Bot understands context from LUIS

Bot passes visual context to the Bing Visual Search API

Bot gets additional information from Bing Entity Search for rich context on people, place, artworks, monument and objects.

Bot gets additional information for barcodes.

Bot optionally gets more information on barcodes/queries exclusively from your domain through the Bing Custom Search API.

Assistant renders similar products/destinations from your domain or provides more information around celebrity/place/monuments/artworks.

  1. 1 Users interact with bot
  2. 2 Bot understands context from LUIS
  3. 3 Bot passes visual context to the Bing Visual Search API
  4. 4 Bot gets additional information from Bing Entity Search for rich context on people, place, artworks, monument and objects.
  1. 5 Bot gets additional information for barcodes.
  2. 6 Bot optionally gets more information on barcodes/queries exclusively from your domain through the Bing Custom Search API.
  3. 7 Assistant renders similar products/destinations from your domain or provides more information around celebrity/place/monuments/artworks.