Training and procedural guidance powered by mixed reality

Enable your team and employees to learn new processes and materials faster, with fewer errors, and greater confidence by providing persistent holographic instructions mapped to precise locations in their physical workspace. Jumpstart employee comprehension with head-up, hands-free experiences using HoloLens devices. And with Azure Spatial Anchors, you can place directions on the procedure’s most important objects and return to this content over time.

Formation et instructions de procédure optimisées par la réalité mixteAidez les gens à apprendre plus rapidement avec des instructions numériques étape par étape que vous pouvez verrouiller sur des objets importants dans des espaces de travail ou des salles de classe.Azure Active DirectoryAzure Spatial AnchorsCosmos DBMedia ServicestrustAzure App ServiceMicrosoftHoloLensClientVideo Indexer

The user creating the training session authenticates using their Azure Active Directory credentials from HoloLens.

The client application connects to its own web service to create a training session. Metadata about that training session is stored in Azure Cosmos DB.

The user scans the environment and places a first anchor where the first step of the procedure needs to happen. Azure Spatial Anchors validates that the user has sufficient permissions to create anchors via Azure AD, and then stores the anchor.

The user records a video of the procedure on HoloLens and uploads it to Azure

The video is encoded with Media Services and prepared for on-demand viewing, as well as processed with Video Indexer for better content search. Video Indexer stores the metadata on Azure Cosmos DB.

The app saves against its Web service the anchor ID for that first step, alongside a link to the video.

The user, in the same session, then moves on to step 2, places an anchor there and again records a video of the procedure and saves the resulting anchor ID and video link to its web service. That process is then repeated until all steps in the procedure have been executed. As the user moves from step to step, previous anchors are still visible with their respective step number.

A trainee comes in, selects the training session, retrieves the anchor IDs and links to videos that are part of the procedure.

The trainee scans the room to find the anchors indicating the real-world location of each step in the procedure. Once one has been found, all anchors will be retrieved and shown in the app.

The trainee can then retrace the exact steps of the expert who recorded the procedure, and view holographic videos of each step at the right location in the lab.

  1. 1 The user creating the training session authenticates using their Azure Active Directory credentials from HoloLens.
  2. 2 The client application connects to its own web service to create a training session. Metadata about that training session is stored in Azure Cosmos DB.
  3. 3 The user scans the environment and places a first anchor where the first step of the procedure needs to happen. Azure Spatial Anchors validates that the user has sufficient permissions to create anchors via Azure AD, and then stores the anchor.
  4. 4 The user records a video of the procedure on HoloLens and uploads it to Azure
  5. 5 The video is encoded with Media Services and prepared for on-demand viewing, as well as processed with Video Indexer for better content search. Video Indexer stores the metadata on Azure Cosmos DB.
  1. 6 The app saves against its Web service the anchor ID for that first step, alongside a link to the video.
  2. 7 The user, in the same session, then moves on to step 2, places an anchor there and again records a video of the procedure and saves the resulting anchor ID and video link to its web service. That process is then repeated until all steps in the procedure have been executed. As the user moves from step to step, previous anchors are still visible with their respective step number.
  3. 8 A trainee comes in, selects the training session, retrieves the anchor IDs and links to videos that are part of the procedure.
  4. 9 The trainee scans the room to find the anchors indicating the real-world location of each step in the procedure. Once one has been found, all anchors will be retrieved and shown in the app.
  5. 10 The trainee can then retrace the exact steps of the expert who recorded the procedure, and view holographic videos of each step at the right location in the lab.

Implementation guidance

Products/Description Documentation

Spatial anchors

Create multi-user, spatially aware mixed reality experiences

Azure Active Directory

Synchronise on-premises directories and enable single sign-on

Azure Cosmos DB

Globally distributed, multi-model database for any scale

App Service

Quickly create powerful cloud apps for web and mobile

Media Services

Encode, store and stream video and audio at scale

Video Indexer

Make your media more discoverable and accessible