Running a Custom Text to Speech Model On Premise

Dominic Heun 20 Reputation points
2025-01-27T10:38:34.78+00:00

Hi there,

at my company, we are currently relying on Azure services for Speech-To-Text (STT) and Text-To-Speech (TTS) processing. These services work quite reliably for us and we would like to continue using these services.

However recently, I got the requirement of running the TTS and STT On-Premises. By utilizing connected containers, I don't see a problem in running STT. However our customer would like to use a custom, pre-trained TTS model.

Therefore my ideal solution would be to let the customer train the TTS Model in the azure cloud and then use this model in a custom TTS container.

However, the Azure docs that I can find only mention the usage of a custom STT model and never mention the possibility of using custom TTS.

The only hint I found was this community question: https://learn.microsoft.com/en-us/answers/questions/1530530/custom-neural-text-to-speech-on-premise

Therefore my question would be, if anything has been done since then to support custom-build TTS models in connected containers?

Azure AI Speech
Azure AI Speech
An Azure service that integrates speech processing into apps and services.
1,881 questions
0 comments No comments
{count} votes

Accepted answer
  1. SriLakshmi C 2,245 Reputation points Microsoft Vendor
    2025-01-27T20:57:29.1433333+00:00

    Hello Dominic Heun,

    Greetings and Welcome to Microsoft Q&A! Thanks for posting the question.

    I understand that you're looking for a way to use custom Text-To-Speech (TTS) models on-premises with Azure's connected containers. While Azure supports custom Speech-To-Text (STT) models in containers,

    Azure Cognitive Services currently allows custom Speech-to-Text (STT) models to be deployed in connected containers, but it does not support deploying custom Text-to-Speech (TTS) models in the same way. Custom TTS models, including those with neural voice customization, are only available for use within the Azure cloud environment and cannot be exported for on-premises deployment in containers.

    However, I encourage you to submit a feature request for adding the "Open in New Tab" option through the Azure Feedback Forum to Microsoft for future improvements. Here's the link to the Azure Feedback Forum: Post idea · Community (azure.com).

    I Hope this helps. Do let me know if you have any further queries.


    If this answers your query, do click Accept Answer and Yes for was this answer helpful.

    Thank you!

    0 comments No comments

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.