Help Integrating Microsoft.CognitiveServices.Speech.Extension.MAS into Unity for AEC and Noise Suppression

Question

I am working on a Unity project (version 2023.2.20f1) that utilizes the Microsoft.CognitiveServices.Speech v1.41.1 NuGet package for speech recognition. I am trying to extend this functionality to include acoustic echo cancellation (AEC) and noise suppression by integrating the Microsoft.CognitiveServices.Speech.Extension.MAS package. However, I have encountered several issues and would appreciate guidance on the following points:

1. Integration Issues: The MAS extension does not include a lib folder or .dll file like other NuGet packages I have used, making it unclear how to properly import it into Unity.
2. NuGet2Unity Attempt: I attempted to use NuGet2Unity, a .NET Core app designed to package NuGet packages as .unitypackage files. Unfortunately, this wouldn’t generate a working Unity-compatible package.
3. Current Setup:

• Speech SDK: Microsoft.CognitiveServices.Speech v1.41.1
  • Unity version: 2023.2.20f1

I have experience importing other NuGet packages into Unity successfully, but this particular extension has been challenging due to its lack of clear integration instructions for Unity.

Questions:

1. Has anyone successfully integrated the MAS extension into Unity?
2. Are there alternative workflows or tools to convert this NuGet package into a Unity-compatible format?
3. Could I be missing an additional step or dependency specific to the MAS extension?

Any suggestions, tutorials, or tips would be greatly appreciated. If additional context is needed, let me know!

Answer 1

Hello Vedaant,

Welcome to the Microsoft Q&A and thank you for posting your questions here.

I understand that you need help to Integrat Microsoft.CognitiveServices.Speech.Extension.MAS into Unity for AEC and Noise Suppression.

1. Integrating the Microsoft.CognitiveServices.Speech.Extension.MAS package into Unity can be challenging due to its unique structure. Unlike typical NuGet packages, the MAS extension might not include a lib folder or .dll file. To integrate it, you should manually extract the package contents and place them in the appropriate directories within your Unity project. This involves downloading the .nupkg file, extracting it using a tool like 7-Zip, and then copying the necessary files into your Unity project's Assets folder.
2. NuGet2Unity can sometimes struggle with complex packages like the MAS extension. An alternative method is to manually convert the NuGet package into a Unity-compatible format. This involves downloading the .nupkg file, extracting its contents, and placing them into your Unity project's Assets folder. You can then configure the necessary references within Unity to ensure the package is correctly integrated.
3. Ensure that all dependencies required by the Speech SDK and MAS extension are correctly referenced in your Unity project. This might include verifying that the Speech SDK dependencies are properly set up and checking for any platform-specific settings needed for the MAS extension to function correctly in Unity.

Tutorials and documentation:

• https://learn.microsoft.com/en-us/training/modules/azure-speech-services-tutorials-mrtk/?source=recommendations
• https://learn.microsoft.com/en-us/azure/ai-services/speech-service/audio-processing-speech-sdk?source=recommendations
• https://learn.microsoft.com/en-us/windows/mixed-reality/develop/unity/best-practices-for-working-with-unity-and-visual-studio?source=recommendations

However, if you would like manual integration, the below is high level summary of what you should do:

1. Extract the NuGet Package

• Download the .nupkg file for the MAS extension.
• Extract the contents using a tool like 7-Zip.

2. Import into Unity

• Copy the extracted files into your Unity project’s Assets folder.
• Ensure that the necessary scripts and resources are correctly referenced.

3. Configure Unity

• Set up any required platform-specific settings.
• Ensure that the Speech SDK and MAS extension are correctly configured in your Unity project.

I hope this is helpful! Do not hesitate to let me know if you have any other questions.

---

Please don't forget to close up the thread here by upvoting and accept it as an answer if it is helpful.