Why speech translation and speech diaization cannot be combined into one service?

Question

Hi,

We have noticed that Azure AI Speech provide speech translation and speech diarization service separately. Is there a way to combine those two into one service? Furthermore, the segments from speech translation are very different than that from speech diarization. We want to see a) best option is to combine those two into one service, or b) at least segmentation can be the same for two services.

Please let us know what are available solution for now.

Thanks a million!

Answer 1

Hello Ning Zhu,

Greetings and Welcome to Microsoft Q&A! Thanks for posting the question.

I understand that you are looking for Combining speech translation and speech diarization into one service,

Currently, Azure AI Speech provides speech translation and speech diarization as separate services. The primary reason for this separation is that they serve different purposes and have distinct functionalities. Speech translation focuses on converting spoken language into another language, while speech diarization is concerned with identifying and attributing speech segments to different speakers in a conversation.

At present, there is no built-in solution to combine these two services into one. The segments produced by speech translation and speech diarization are inherently different due to their respective processing methods and objectives. Therefore, achieving consistent segmentation across both services is not feasible with the current offerings.

You can keep an eye on the Azure Speech Service release notes for updates on What's new in Azure AI Speech page will be updated accordingly with more details.

However, I encourage you to submit a feature request for adding the "Open in New Tab" option through the Azure Feedback Forum to Microsoft for future improvements. Here's the link to the Azure Feedback Forum: Post idea . Community(azure. com).

I Hope this helps. Do let me know if you have any further queries.

---

If this answers your query, do click Accept Answer and Yes for was this answer helpful.

Thank you!