{"id":32315,"date":"2024-03-13T08:00:00","date_gmt":"2024-03-13T15:00:00","guid":{"rendered":"https:\/\/azure.microsoft.com\/en-us\/blog\/?p=32315"},"modified":"2024-03-20T16:31:47","modified_gmt":"2024-03-20T23:31:47","slug":"accelerate-your-productivity-with-the-whisper-model-in-azure-ai-now-generally-available","status":"publish","type":"post","link":"https:\/\/azure.microsoft.com\/en-us\/blog\/accelerate-your-productivity-with-the-whisper-model-in-azure-ai-now-generally-available\/","title":{"rendered":"Accelerate your productivity with the Whisper model in Azure AI\u00a0now generally available"},"content":{"rendered":"\n

Human speech remains one of the most complex things for computers to process. With thousands of spoken languages in the world, enterprises often struggle to choose the right technologies to understand and analyze audio conversations while keeping right data security and privacy guardrails in place. Thanks to generative AI, it has become easier for enterprises to analyze every customer interaction and derive actionable insights from these interactions.<\/p>\n\n\n

\n\t
\n\t\t
\n\n\t\t\t\t\t\t\t
\n\t\t\t\t\t\"a\t\t\t\t<\/div>\n\t\t\t\n\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\n\t\t\t\t\t

Azure AI<\/h2>\n\n\t\t\t\t\t
\n\t\t\t\t\t\t

Build intelligent apps at enterprise scale with the Azure AI portfolio.<\/p>\n\t\t\t\t\t<\/div>\n\n\t\t\t\t\t\t\t\t\t\t\t

\n\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\tLearn more<\/span>\n\t\t\t\t\t\t\t\t<\/span>\n\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t<\/div>\n\n\t\t\t\t\t<\/div>\n\t<\/div>\n<\/div>\n\n\n\n

Azure AI offers an industry-leading portfolio of AI services<\/a> to help customers make sense of their voice data. Our speech-to-text service in particular offers a variety of differentiated features through Azure OpenAI Service and Azure AI Speech. These features have been instrumental in helping customers develop multilingual speech transcription and translation, both for long audio files and for near-real-time and real-time assistance for customer service representatives.<\/p>\n\n\n\n

Today, we are excited to announce that OpenAI Whisper on Azure is generally available. Whisper<\/a> is a speech to text model from OpenAI that developers can use to transcribe audio files. Starting today, developers can begin using the generally available Whisper API in both Azure OpenAI Service<\/a> as well as Azure AI Speech<\/a> services on production workloads, knowing that it is backed by Azure\u2019s enterprise-readiness promise. With all our speech-to-text models generally available, customers have greater choice and flexibility to enable AI powered transcription and other speech scenarios.<\/p>\n\n\n

\"graphical<\/figure>\n\n\n\n

Since the public preview of the Whisper API in Azure<\/a>, thousands of customers across industries across healthcare, education, finance, manufacturing, media, agriculture, and more are using it to translate and transcribe audio into text across many of the 57 supported languages. They use Whisper to process call center conversations, add captions for accessibility purposes to audio and video content, and mine audio and video data for actionable insights. <\/p>\n\n\n

\n\t
\n\t\t

\n\t\t\tLearn more\t\t<\/p>\n\t\t\n\t\t\tInvest in app innovation to stay ahead of the curve<\/span> <\/span>\n\t\t<\/a>\n\t<\/div>\n<\/div>\n\n\n\n

We continue to bring OpenAI models to Azure to enrich our portfolio and address the next generation of use-cases and workflows customers are looking to build with speech technologies and LLMs. For instance, imagine building an end-to-end contact center workflow\u2014with a self-service copilot carrying out human-like conversations with end users through voice or text; an automated call routing solution; real-time agent assistance copilots; and automated post-call analytics. This end-to-end workflow, powered by generative AI, has the potential to bring a new era in productivity to call centers around the world.<\/p>\n\n\n\n

Whisper in Azure OpenAI Service<\/strong> <\/h2>\n\n\n\n

Azure OpenAI Service enables developers to run OpenAI\u2019s Whisper model in Azure, mirroring the OpenAI Whisper model functionalities including fast processing time, multi-lingual support, and transcription and translation capabilities. OpenAI Whisper in Azure OpenAI Service is ideal for processing smaller size files for time-sensitive workloads and use-cases. <\/p>\n\n\n\n

Lightbulb.ai<\/a>, an AI innovator, is looking to transform call center workflows, has been using Whisper in Azure OpenAI Service.<\/p>\n\n\n\n

\n

“By merging our call center expertise with tools like Whisper and a combination of LLMs, our product is proven to be 500X more scalable, 90X faster, and 20X more cost-effective than manual call reviews and enables third-party administrators, brokerages, and insurance companies to not only eliminate compliance risk; but also to significantly improve service and boost revenue. We are grateful for our partnership with Azure, which has been instrumental in our success, and we’re enthusiastic about continuing to leverage Whisper to create unprecedented outcomes for our customers.”<\/p>\nTyler Amundsen, CEO and Co-Founder, Lightbulb.AI<\/cite><\/blockquote>\n\n\n\n

To learn more about how to use the Whisper model with the Azure OpenAI Service click here:\u202fSpeech to text with Azure OpenAI Service<\/a>. <\/p>\n\n\n\n

Try out the Whisper REST (representational state transfer) API in the Azure OpenAI Studio<\/a>. The API supports translation services<\/a> from a growing list of languages to English, producing English-only output. <\/p>\n\n\n\n

OpenAI Whisper model in Azure AI Speech <\/h2>\n\n\n\n

Users of Azure AI Speech<\/a> can leverage OpenAI\u2019s Whisper model in conjunction with the Azure AI Speech batch transcription API. This enables customers to easily transcribe large volumes of audio content at scale for non-time-sensitive batch workloads.<\/p>\n\n\n\n

Developers using Whisper in Azure AI Speech also benefit from the following additional capabilities: <\/p>\n\n\n\n