{"id":972,"date":"2019-10-10T00:00:00","date_gmt":"2019-10-10T00:00:00","guid":{"rendered":"https:\/\/azure.microsoft.com\/blog\/leveraging-cognitive-services-to-simplify-inventory-tracking"},"modified":"2025-06-25T20:55:46","modified_gmt":"2025-06-26T03:55:46","slug":"leveraging-cognitive-services-to-simplify-inventory-tracking","status":"publish","type":"post","link":"https:\/\/azure.microsoft.com\/en-us\/blog\/leveraging-cognitive-services-to-simplify-inventory-tracking\/","title":{"rendered":"Leveraging Cognitive Services to simplify inventory tracking"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\"><img loading=\"lazy\" decoding=\"async\" title=\"pic 1\" src=\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/10\/cfe7cb1b-24e7-4748-b7eb-2d85e1b84919.webp\" alt=\"The team of interns at the New England Research and Development Center in Cambridge\" width=\"827\" height=\"620\"><br>Who spends their summer at the Microsoft Garage New England Research &amp; Development Center (or \u201cNERD\u201d)? The Microsoft Garage internship seeks out students who are hungry to learn, not afraid to try new things, and able to step out of their comfort zones when faced with ambiguous situations. The program brought together Grace Hsu from Massachusetts Institute of Technology, Christopher Bunn from Northeastern University, Joseph Lai from Boston University, and Ashley Hong from Carnegie Mellon University. They chose the Garage internship because of the product focus\u2014getting to see the whole development cycle from ideation to shipping\u2014and learning how to be customer obsessed.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Microsoft Garage interns take on experimental projects in order to build their creativity and product development skills through hacking new technology. Typically, these projects are proposals that come from our internal product groups at Microsoft, but when Stanley Black &amp; Decker asked if Microsoft could apply image recognition for asset management on construction sites, this team of four interns accepted the challenge of creating a working prototype in twelve weeks.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Starting with a simple request for leveraging image recognition, the team conducted market analysis and user research to ensure the product would stand out and prove useful. They spent the summer gaining experience in mobile app development and AI to create an app that recognizes tools at least as accurately as humans can.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"the-problem\">The problem<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">In the construction industry, it\u2019s not unusual for contractors to spend over 50 hours every month tracking inventory, which can lead to unnecessary delays, overstocking, and missing tools. All together, large construction sites could lose more than $200,000 worth of equipment over the course of a long project. Addressing this problem is an unstandardized mix that typically involves barcodes, Bluetooth, RFID tags, and QR codes. The team at Stanley Black &amp; Decker asked, \u201cwouldn\u2019t it be easier to just take a photo and have the tool automatically recognized?\u201d<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Because there are many tool models with minute differences, recognizing a specific drill, for example, requires you to read a model number like DCD996. Tools can also be assembled with multiple configurations, such as with or without a bit or battery pack attached, and can be viewed from different angles. You also need to take into consideration the number of lighting conditions and possible backgrounds you\u2019d come across on a typical construction site. It quickly becomes a very interesting problem to solve using computer vision.<\/p>\n\n\n\n<figure class=\"wp-block-image has-custom-border\"><img decoding=\"async\" src=\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/10\/8b733582-5579-4181-a571-6c12bbc17d97.webp\" alt=\"Four different DeWalt drills that look very similar\" style=\"border-radius:0px\" title=\"pic 2\" \/><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\"> &nbsp;<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"how-they-hacked-it\">How they hacked it<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Classification algorithms can be easily trained to reach strong accuracy when identifying distinct objects, like differentiating between a drill, a saw, and a tape measure. Instead, they wanted to know if a classifier could accurately distinguish between very similar tools like the four drills shown above. In the first iteration of the project, the team explored PyTorch and Microsoft\u2019s <a href=\"https:\/\/azure.microsoft.com\/en-us\/services\/cognitive-services\/custom-vision-service\/\" target=\"_blank\" rel=\"noopener\">Custom Vision<\/a> service. Custom Vision appeals to users by not requiring a high level of data science knowledge to get a working model off the ground, and with enough images (roughly 400 for each tool), Custom Vision proved to be an adequate solution. However, it immediately became apparent that manually gathering this many images would be challenging to scale for a product line with thousands of tools. The focus quickly shifted to find ways of synthetically generating the training images.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">For their initial approach, the team did both three-dimensional scans and green screen renderings of the tools. These images were then overlaid with random backgrounds to mimic a real photograph. While this approach seemed promising, the quality of the images produced proved challenging.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">In the next iteration, in collaboration with Stanley Black &amp; Decker\u2019s engineering team, the team explored a new approach using photo-realistic renders from computer-aided design (CAD) models. They were able to use relatively simple Python scripts to resize, rotate, and randomly overlay these images on a large set of backgrounds. With this technique, the team could generate thousands of training images within minutes.<\/p>\n\n\n\n<figure class=\"wp-block-image has-custom-border\"><img decoding=\"async\" src=\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/10\/77c912e3-7686-43ba-b118-49998e0492ef.webp\" alt=\"Image generated in front of a green screen vs an image rendered from CAD\" style=\"border-radius:0px\" title=\"Dewalt Images\" \/><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">On the left is an image generated in front of a green screen versus an extract from CAD on the right.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"benchmarking-the-iterations\">Benchmarking the iterations<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">The Custom Vision service offers reports on the accuracy of the model as shown below.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><img loading=\"lazy\" decoding=\"async\" title=\"pic 5\" src=\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/10\/63ae80b7-c139-4389-90a5-004342fed9cd.webp\" alt=\"Exemplary report extracted from the custom vision service\" width=\"600\" height=\"237\"><br>For a classification model that targets visually similar products, a confusion matrix like the one below is very helpful. A confusion matrix visualizes the performance of a prediction model by comparing the true label of a class in the rows with the label outputted by the model in the columns. The higher the scores on the diagonal, the more accurate the model is. When high values are off the diagonal it helps the data scientists understand which two classes are being confused with each other by the trained model.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Existing Python libraries can be used to quickly generate a confusion matrix with a set of test images.<br><img loading=\"lazy\" decoding=\"async\" title=\"pic 6\" width=\"1226\" height=\"1060\" src=\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/10\/e4ee446e-7626-45b3-8a9b-7e707643baa1.webp\" alt=\"Confusion matrix for 10 products from DeWalt\"><\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"the-result\">The result<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">The team developed a React Native application that runs on both iOS and Android and serves as a lightweight asset management tool with a clean and intuitive UI. The app adapts to various degrees of Wi-Fi availability and when a reliable connection is present, the images taken are sent to the APIs of the trained Custom Vision model on Azure Cloud. In the absence of an internet connection, the images are sent to a local computer vision model.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">These local models can be obtained using Custom Vision, which exports models to Core ML for iOS, TensorFlow for Android, or as a Docker container that can run on a Linux App Service in Azure. An easy framework for the addition of new products to the machine learning model can be implemented by exporting rendered images from CAD and generating synthetic images.<\/p>\n\n\n\n<figure class=\"wp-block-image has-custom-border\"><img decoding=\"async\" src=\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/10\/b5b96427-7b1b-4b6c-90b8-4117e188be18.webp\" alt=\"Captures of the user interface of the inventory app\" style=\"border-radius:0px\" title=\"inventory image 1\" \/><\/figure>\n\n\n\n<figure class=\"wp-block-image has-custom-border\"><img decoding=\"async\" src=\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/10\/3218e705-246b-4666-9a02-cfd63a62ad4a.webp\" alt=\"Captures of the user interface of the inventory app\" style=\"border-radius:0px\" title=\"inventory image 2\" \/><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">Images in order from left to right: inventory checklist screen, camera functionality to send a picture to Custom Vision service, display of machine learning model results, and a manual form to add a tool to the checklist.<\/p>\n\n\n\n<figure class=\"wp-block-image has-custom-border\"><img decoding=\"async\" src=\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/10\/5e533f8f-01bd-4ebe-b6bb-2570eff07edd.webp\" alt=\"Arch_Diagram\" style=\"border-radius:0px\" title=\"Arch_Diagram\" \/><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"what-s-next\">What\u2019s next<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Looking for an opportunity for your team to hack on a computer vision project? Search for an <a href=\"https:\/\/openhack.microsoft.com\/\">OpenHack<\/a> near you.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Microsoft OpenHack is a developer focused event where a wide variety of participants (Open) learn through hands-on experimentation (Hack) using challenges based on real world customer engagements designed to mimic the developer journey. OpenHack is a premium Microsoft event that provides a unique upskilling experience for customers and partners. Rather than traditional presentation-based conferences, OpenHack offers a unique hands-on coding experience for developers.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The <a href=\"https:\/\/docs.microsoft.com\/en-us\/learn\/paths\/classify-images-with-vision-services\/\" target=\"_blank\" rel=\"noopener\">learning paths<\/a> can also help you get hands on with the cognitive services.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Who spends their summer at the Microsoft Garage New England Research &amp; Development Center (or \u201cNERD\u201d)? The Garage Internship seeks out students who are hungry to learn, not afraid to try new things, and able to step out of their comfort zones when faced with ambiguous situations.<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"ms_queue_id":[],"ep_exclude_from_search":false,"_classifai_error":"","_classifai_text_to_speech_error":"","_alt_title":"","footnotes":"","msx_community_cta_settings":[]},"categories":[1454],"tags":[],"audience":[3057,3055,3056],"content-type":[1481],"product":[1637,3164],"tech-community":[],"topic":[],"coauthors":[416],"class_list":["post-972","post","type-post","status-publish","format-standard","hentry","category-ai-machine-learning","audience-data-professionals","audience-developers","audience-it-implementors","content-type-thought-leadership","product-azure-ai-custom-vision","product-microsoft-foundry","review-flag-1680286581-56","review-flag-1680286584-658","review-flag-machi-1680286585-314","review-flag-microsofts","review-flag-ml-1680286585-776","review-flag-new-1680286579-546","review-flag-summe-1680286584-4"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.2 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Leveraging Cognitive Services to simplify inventory tracking | Microsoft Azure Blog<\/title>\n<meta name=\"description\" content=\"Who spends their summer at the Microsoft Garage New England Research &amp; Development Center (or \u201cNERD\u201d)? The Garage Internship seeks out students who are hungry to learn, not afraid to try new things, and able to step out of their comfort zones when faced with ambiguous situations.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/azure.microsoft.com\/en-us\/blog\/leveraging-cognitive-services-to-simplify-inventory-tracking\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Leveraging Cognitive Services to simplify inventory tracking | Microsoft Azure Blog\" \/>\n<meta property=\"og:description\" content=\"Who spends their summer at the Microsoft Garage New England Research &amp; Development Center (or \u201cNERD\u201d)? The Garage Internship seeks out students who are hungry to learn, not afraid to try new things, and able to step out of their comfort zones when faced with ambiguous situations.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/azure.microsoft.com\/en-us\/blog\/leveraging-cognitive-services-to-simplify-inventory-tracking\/\" \/>\n<meta property=\"og:site_name\" content=\"Microsoft Azure Blog\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/microsoftazure\" \/>\n<meta property=\"article:published_time\" content=\"2019-10-10T00:00:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-06-26T03:55:46+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/10\/cfe7cb1b-24e7-4748-b7eb-2d85e1b84919.webp\" \/>\n<meta name=\"author\" content=\"Matthew Calder\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@azure\" \/>\n<meta name=\"twitter:site\" content=\"@azure\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Matthew Calder\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"7 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/leveraging-cognitive-services-to-simplify-inventory-tracking\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/leveraging-cognitive-services-to-simplify-inventory-tracking\/\"},\"author\":[{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/author\/matthew-calder\/\",\"@type\":\"Person\",\"@name\":\"Matthew Calder\"}],\"headline\":\"Leveraging Cognitive Services to simplify inventory tracking\",\"datePublished\":\"2019-10-10T00:00:00+00:00\",\"dateModified\":\"2025-06-26T03:55:46+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/leveraging-cognitive-services-to-simplify-inventory-tracking\/\"},\"wordCount\":1086,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/#organization\"},\"image\":{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/leveraging-cognitive-services-to-simplify-inventory-tracking\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/10\/cfe7cb1b-24e7-4748-b7eb-2d85e1b84919.webp\",\"articleSection\":[\"AI + machine learning\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/azure.microsoft.com\/en-us\/blog\/leveraging-cognitive-services-to-simplify-inventory-tracking\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/leveraging-cognitive-services-to-simplify-inventory-tracking\/\",\"url\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/leveraging-cognitive-services-to-simplify-inventory-tracking\/\",\"name\":\"Leveraging Cognitive Services to simplify inventory tracking | Microsoft Azure Blog\",\"isPartOf\":{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/leveraging-cognitive-services-to-simplify-inventory-tracking\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/leveraging-cognitive-services-to-simplify-inventory-tracking\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/10\/cfe7cb1b-24e7-4748-b7eb-2d85e1b84919.webp\",\"datePublished\":\"2019-10-10T00:00:00+00:00\",\"dateModified\":\"2025-06-26T03:55:46+00:00\",\"description\":\"Who spends their summer at the Microsoft Garage New England Research &amp; Development Center (or \u201cNERD\u201d)? The Garage Internship seeks out students who are hungry to learn, not afraid to try new things, and able to step out of their comfort zones when faced with ambiguous situations.\",\"breadcrumb\":{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/leveraging-cognitive-services-to-simplify-inventory-tracking\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/azure.microsoft.com\/en-us\/blog\/leveraging-cognitive-services-to-simplify-inventory-tracking\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/leveraging-cognitive-services-to-simplify-inventory-tracking\/#primaryimage\",\"url\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/10\/cfe7cb1b-24e7-4748-b7eb-2d85e1b84919.webp\",\"contentUrl\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/10\/cfe7cb1b-24e7-4748-b7eb-2d85e1b84919.webp\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/leveraging-cognitive-services-to-simplify-inventory-tracking\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Blog home\",\"item\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"AI + machine learning\",\"item\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/category\/ai-machine-learning\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Leveraging Cognitive Services to simplify inventory tracking\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/#website\",\"url\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/\",\"name\":\"Microsoft Azure Blog\",\"description\":\"Get the latest Azure news, updates, and announcements from the Azure blog. From product updates to hot topics, hear from the Azure experts.\",\"publisher\":{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/#organization\",\"name\":\"Microsoft Azure Blog\",\"url\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2024\/06\/microsoft_logo.webp\",\"contentUrl\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2024\/06\/microsoft_logo.webp\",\"width\":512,\"height\":512,\"caption\":\"Microsoft Azure Blog\"},\"image\":{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/microsoftazure\",\"https:\/\/x.com\/azure\",\"https:\/\/www.instagram.com\/microsoftdeveloper\/\",\"https:\/\/www.linkedin.com\/company\/16188386\",\"https:\/\/www.youtube.com\/user\/windowsazure\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/#\/schema\/person\/c702e5edd662b328b49b7e1180cab117\",\"name\":\"shakir\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/secure.gravatar.com\/avatar\/9342c7c05bb16548741bc5cd3a3e3b7ee0c8e746844ad2cc582db5beb5514c6f?s=96&d=mm&r=g7664e653ea371ce16eaf75e9fa8952c4\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/9342c7c05bb16548741bc5cd3a3e3b7ee0c8e746844ad2cc582db5beb5514c6f?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/9342c7c05bb16548741bc5cd3a3e3b7ee0c8e746844ad2cc582db5beb5514c6f?s=96&d=mm&r=g\",\"caption\":\"shakir\"},\"sameAs\":[\"https:\/\/azure.microsoft.com\"],\"url\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/author\/shakir\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Leveraging Cognitive Services to simplify inventory tracking | Microsoft Azure Blog","description":"Who spends their summer at the Microsoft Garage New England Research &amp; Development Center (or \u201cNERD\u201d)? The Garage Internship seeks out students who are hungry to learn, not afraid to try new things, and able to step out of their comfort zones when faced with ambiguous situations.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/azure.microsoft.com\/en-us\/blog\/leveraging-cognitive-services-to-simplify-inventory-tracking\/","og_locale":"en_US","og_type":"article","og_title":"Leveraging Cognitive Services to simplify inventory tracking | Microsoft Azure Blog","og_description":"Who spends their summer at the Microsoft Garage New England Research &amp; Development Center (or \u201cNERD\u201d)? The Garage Internship seeks out students who are hungry to learn, not afraid to try new things, and able to step out of their comfort zones when faced with ambiguous situations.","og_url":"https:\/\/azure.microsoft.com\/en-us\/blog\/leveraging-cognitive-services-to-simplify-inventory-tracking\/","og_site_name":"Microsoft Azure Blog","article_publisher":"https:\/\/www.facebook.com\/microsoftazure","article_published_time":"2019-10-10T00:00:00+00:00","article_modified_time":"2025-06-26T03:55:46+00:00","og_image":[{"url":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/10\/cfe7cb1b-24e7-4748-b7eb-2d85e1b84919.webp","type":"","width":"","height":""}],"author":"Matthew Calder","twitter_card":"summary_large_image","twitter_creator":"@azure","twitter_site":"@azure","twitter_misc":{"Written by":"Matthew Calder","Est. reading time":"7 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/leveraging-cognitive-services-to-simplify-inventory-tracking\/#article","isPartOf":{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/leveraging-cognitive-services-to-simplify-inventory-tracking\/"},"author":[{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/author\/matthew-calder\/","@type":"Person","@name":"Matthew Calder"}],"headline":"Leveraging Cognitive Services to simplify inventory tracking","datePublished":"2019-10-10T00:00:00+00:00","dateModified":"2025-06-26T03:55:46+00:00","mainEntityOfPage":{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/leveraging-cognitive-services-to-simplify-inventory-tracking\/"},"wordCount":1086,"commentCount":0,"publisher":{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/#organization"},"image":{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/leveraging-cognitive-services-to-simplify-inventory-tracking\/#primaryimage"},"thumbnailUrl":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/10\/cfe7cb1b-24e7-4748-b7eb-2d85e1b84919.webp","articleSection":["AI + machine learning"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/azure.microsoft.com\/en-us\/blog\/leveraging-cognitive-services-to-simplify-inventory-tracking\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/leveraging-cognitive-services-to-simplify-inventory-tracking\/","url":"https:\/\/azure.microsoft.com\/en-us\/blog\/leveraging-cognitive-services-to-simplify-inventory-tracking\/","name":"Leveraging Cognitive Services to simplify inventory tracking | Microsoft Azure Blog","isPartOf":{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/leveraging-cognitive-services-to-simplify-inventory-tracking\/#primaryimage"},"image":{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/leveraging-cognitive-services-to-simplify-inventory-tracking\/#primaryimage"},"thumbnailUrl":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/10\/cfe7cb1b-24e7-4748-b7eb-2d85e1b84919.webp","datePublished":"2019-10-10T00:00:00+00:00","dateModified":"2025-06-26T03:55:46+00:00","description":"Who spends their summer at the Microsoft Garage New England Research &amp; Development Center (or \u201cNERD\u201d)? The Garage Internship seeks out students who are hungry to learn, not afraid to try new things, and able to step out of their comfort zones when faced with ambiguous situations.","breadcrumb":{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/leveraging-cognitive-services-to-simplify-inventory-tracking\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/azure.microsoft.com\/en-us\/blog\/leveraging-cognitive-services-to-simplify-inventory-tracking\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/leveraging-cognitive-services-to-simplify-inventory-tracking\/#primaryimage","url":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/10\/cfe7cb1b-24e7-4748-b7eb-2d85e1b84919.webp","contentUrl":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/10\/cfe7cb1b-24e7-4748-b7eb-2d85e1b84919.webp"},{"@type":"BreadcrumbList","@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/leveraging-cognitive-services-to-simplify-inventory-tracking\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Blog home","item":"https:\/\/azure.microsoft.com\/en-us\/blog\/"},{"@type":"ListItem","position":2,"name":"AI + machine learning","item":"https:\/\/azure.microsoft.com\/en-us\/blog\/category\/ai-machine-learning\/"},{"@type":"ListItem","position":3,"name":"Leveraging Cognitive Services to simplify inventory tracking"}]},{"@type":"WebSite","@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/#website","url":"https:\/\/azure.microsoft.com\/en-us\/blog\/","name":"Microsoft Azure Blog","description":"Get the latest Azure news, updates, and announcements from the Azure blog. From product updates to hot topics, hear from the Azure experts.","publisher":{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/azure.microsoft.com\/en-us\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/#organization","name":"Microsoft Azure Blog","url":"https:\/\/azure.microsoft.com\/en-us\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2024\/06\/microsoft_logo.webp","contentUrl":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2024\/06\/microsoft_logo.webp","width":512,"height":512,"caption":"Microsoft Azure Blog"},"image":{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/microsoftazure","https:\/\/x.com\/azure","https:\/\/www.instagram.com\/microsoftdeveloper\/","https:\/\/www.linkedin.com\/company\/16188386","https:\/\/www.youtube.com\/user\/windowsazure"]},{"@type":"Person","@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/#\/schema\/person\/c702e5edd662b328b49b7e1180cab117","name":"shakir","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/9342c7c05bb16548741bc5cd3a3e3b7ee0c8e746844ad2cc582db5beb5514c6f?s=96&d=mm&r=g7664e653ea371ce16eaf75e9fa8952c4","url":"https:\/\/secure.gravatar.com\/avatar\/9342c7c05bb16548741bc5cd3a3e3b7ee0c8e746844ad2cc582db5beb5514c6f?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/9342c7c05bb16548741bc5cd3a3e3b7ee0c8e746844ad2cc582db5beb5514c6f?s=96&d=mm&r=g","caption":"shakir"},"sameAs":["https:\/\/azure.microsoft.com"],"url":"https:\/\/azure.microsoft.com\/en-us\/blog\/author\/shakir\/"}]}},"msxcm_display_generated_audio":false,"msxcm_animated_featured_image":null,"distributor_meta":false,"distributor_terms":false,"distributor_media":false,"distributor_original_site_name":"Microsoft Azure Blog","distributor_original_site_url":"https:\/\/azure.microsoft.com\/en-us\/blog","push-errors":false,"_links":{"self":[{"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/posts\/972","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/comments?post=972"}],"version-history":[{"count":1,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/posts\/972\/revisions"}],"predecessor-version":[{"id":43625,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/posts\/972\/revisions\/43625"}],"wp:attachment":[{"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/media?parent=972"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/categories?post=972"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/tags?post=972"},{"taxonomy":"audience","embeddable":true,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/audience?post=972"},{"taxonomy":"content-type","embeddable":true,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/content-type?post=972"},{"taxonomy":"product","embeddable":true,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/product?post=972"},{"taxonomy":"tech-community","embeddable":true,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/tech-community?post=972"},{"taxonomy":"topic","embeddable":true,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/topic?post=972"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/coauthors?post=972"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}