Speechsynthesizer causes JVM crash during finalization (Speech client-sdk for Java)

Lucas Mikulla 0

https://github.com/Azure-Samples/cognitive-services-speech-sdk/issues/2701

As I detailed in the above github issue, there is a reproducible bug in the Java client-sdk for Azure Speech. During Finalization of Speechsynthesizer Instance it can cause a Memory Access Violation, resulting in a full crash of the JVM.

Version of Speech SDK 1.40.0

Platform, Operating System, and Programming Language

OS: Windows Server 2022 und Windows 11 Pro Programming language: Java OpenJDK 11

navba-MSFT 27,185 Reputation points Microsoft Employee

2024-12-18T09:49:15.11+00:00

@Lucas Mikulla Welcome to Microsoft Q&A Forum, Thank you for posting your query here!

.

Thanks for sharing the details. I am looking into the details. I will get back to you once I have an update on this.

.
navba-MSFT 27,185 Reputation points Microsoft Employee

2024-12-23T05:44:01.7033333+00:00

@Lucas Mikulla Thanks for sharing the details. I am looking into this internally. I will get back to you if I need more details on this.
navba-MSFT 27,185 Reputation points Microsoft Employee

2024-12-24T02:48:39.3466667+00:00

@Lucas Mikulla I was able to repro this issue at my end and find the cause of this issue.Cause:

The problem with the provided code is that it doesn't wait for the speech synthesis to complete before the synthesizer object is closed. When I tried it, I got this error - java.lang.IllegalStateException: Cannot dispose a synthesizer while async synthesis is running. Await async synthesis to avoid unexpected disposals.

.

Fix:

I replaced test.speak("Hello"); with test.speak("Hello").get(); and Speech SDK did not crash anymore.

.

Hope this helps. If you have any follow-up questions, please let me know. I would be happy to help.

**

Please do not forget to "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.
Lucas Mikulla 0 Reputation points

2024-12-24T19:55:31.3866667+00:00

This is not the issue we are observing. The sample code might not be fully clear about it, I can amend that in 2 weeks time.

Our code is already using speakTextAsync().get() to correctly wait for synthesis to finish. We do not get the typed exception from the answer.

Instead after a few thousand instances are closed the entire Java process crashes with an illegal access exception in the crash dump as detailed on GitHub. This is a bug in the speech sdk JNI library.
navba-MSFT 27,185 Reputation points Microsoft Employee

2024-12-31T06:01:31.38+00:00

@Lucas Mikulla Thanks for getting back. I ran my code multiple times for almost 10000 iterations, and it still did not crash. From the crash dump which you had shared, it looks like the crash occurs during garbage collection. When synthesizer is closed or terminated, it calls the close method of the PushAudioOutputStreamCallback object to signal that writing to output stream has finished. Internally, the callback object is stored as a private member of PushAudioOutputStream.

.

From the stack trace, it looks like the exception occurs when Speech SDK's JNI code is trying to access the Java object associated with PushAudioOutputStream. Speech SDK log file doesn't show any error.

.

Plan 1:

Could you please check if PushAudioOutputStream object exists when close method of AzureStreamToJMFStream is called?

.

Plan 2:

Could you please share a small snippet equivalent to yourAzureStreamToJMFStream class? I am not able to reproduce the error in my test code. So, it is difficult to debug.

.

Awaiting your reply.
navba-MSFT 27,185 Reputation points Microsoft Employee

2025-01-02T02:38:20.6766667+00:00

@Lucas Mikulla Just following up to check if you had any updates on above plan. Awaiting your reply.
navba-MSFT 27,185 Reputation points Microsoft Employee

2025-01-08T05:05:08.6566667+00:00

@Lucas Mikulla Thanks for the update. I am waiting for your reply.

Share via

Speechsynthesizer causes JVM crash during finalization (Speech client-sdk for Java)

Your answer