Hololens 2, Azure, Unity, and MRTK

Question

I have a digital twin case, I need to scan a real car with Hololens 2 and then store it in Azure as a 3D model to stream it to another colleague. I need to be able to update it from my Hololens and to put annotations and drawings.

Appreciate your help :)

Answer 1

Hello @Omar Ahmed

To achieve what you are asking for, you can use Azure Object Anchors, which is a managed cloud service that converts 3D assets into AI models that enable object-aware mixed reality experiences for the Hololens.

You can follow the steps in the Unity HoloLens with MRTK quickstart to create a Unity HoloLens app that uses Azure Object Anchors. Once you have created the app, you can use the Hololens 2 to scan the car and upload the 3D model to Azure Object Anchors.

You can then stream the 3D model to your colleague and update it from your Hololens as needed.

To add annotations and drawings, you can use Unity to create a UI that allows you to add and edit annotations and drawings on the 3D model.

I hope this helps!

Answer 2

Hi Omar Ahmed !

Thank you for following up.

We have noticed that you rated an answer as not helpful. We appreciate your feedback and are committed to improving your experience with the Q&A.

I am clarifying on pointers previously shared

Process is like below.

1. You have to upload the 3d assets to unity and also link the digital twins data to unity through bing maps key (A free Dev account is needed to create bing maps keys, but depreciated on 2028, we should request unity github team to provide relevant for azure maps too)
2. Once digital twins' data is synced to the unity assets, you can test the simulation in Hololens.

This documentation https://learn.microsoft.com/en-us/training/paths/build-mixed-reality-azure-digital-twins-unity/ guides through an example of simulating a wind turbine through digital twins, unity in Hololens.

If I missed anything please let me know and I'd be happy to add it to this answer, or feel free to comment below with any additional information.

Please don’t forget to Accept Answer and Yes for "was this answer helpful" wherever the information provided helps you, this can be beneficial to other community members.

Thank you.