Azure GPU-optimized VM with driver extension throws modprobe: ERROR: could not insert 'nvidia': No such device on startup

Robin Allen 0

Hi,

I created a VM through the Azure portal to test some simple processing.

I selected the Nvidia GPU-Optimized VMI

The first one I tried didn't work and threw the error

Installing drivers ...

modprobe: ERROR: could not insert 'nvidia': No such device

Install complete

I then tried installing the NVIDIA GPU extension via the portal and it didn't make any difference.

Also the nvidia SMI command doesn't exist.

Is there an existing solution for this? I've searched for similar questions and found nothing that works for me.

1 answer

Nikhil Duserla 3,565 Reputation points Microsoft Vendor

2024-12-16T13:38:25.7733333+00:00

Hi @Robin Allen,

Welcome to the Microsoft Q&A Platform! Thank you for asking your question here.

We have observed that you are encountering the error message "modprobe: ERROR: could not insert 'nvidia': No such device." This suggests that the NVIDIA driver may not be installed properly, or the system is failing to recognize the GPU.

Extension installs NVIDIA GPU drivers on Linux N-series virtual machines (VMs). Depending on the VM family, the extension installs CUDA or GRID drivers. Ensure that you are using a compatible VM size that supports NVIDIA GPUs.

To verify that the system has a CUDA-capable GPU, run the following command: lspci | grep -i NVIDIA. If there is no output, it means the GPU is not recognized by the system. If the GPU is detected, but the drivers are not functioning, you may need to reinstall the NVIDIA drivers.

Still if you are facing the same issue, I would recommend you Disable Nouveau.

If you have any further queries, do let us know.
Please sign in to rate this answer.
Nikhil Duserla 3,565 Reputation points Microsoft Vendor

2024-12-17T12:12:20.66+00:00

Hi @Robin Allen,If I have answered your question, please accept this as an acknowledgment of appreciation.

Nikhil Duserla 3,565 Reputation points Microsoft Vendor

2024-12-19T12:45:58.2+00:00

Hi @Robin Allen,If I have answered your question, please accept this as an acknowledgment of appreciation.

Robin Allen 0 Reputation points

2024-12-19T13:17:03.06+00:00

Hi,

Thank you for the answer. I've tried all of the above to no avail.

I get no output for

lspci | grep -i NVIDIA

Is there something else I need to do to get a GPU on the system? My thinking is that the VM is capable of handling a GPU but doesn't already have one. I'm not sure how to go about adding one however.

Robin Allen 0 Reputation points

2024-12-19T13:30:30.1666667+00:00

Hi, thanks for the answer however it didn't solve my problem. Since this VM is just capable of housing a GPU, maybe that means that it doesn't come with one already in place? Do I need to take another step to add a GPU to the environment?

The below didn't yield any results after following all steps.

lspci | grep -i NVIDIA

Nikhil Duserla 3,565 Reputation points Microsoft Vendor

2024-12-19T14:18:02.6233333+00:00

Hi Robin Allen,

Thank you for sharing the information. I see that your issue has not been resolved.

Ensure that you are using an N-series VM (e.g., NC, ND) that is optimized for GPU workloads. The GPU capabilities of Azure N-series VMs backed by NVIDIA GPUs, you must install NVIDIA GPU drivers. The NVIDIA GPU Driver Extension installs appropriate NVIDIA CUDA or GRID drivers on an N-series VM.

Install or manage the extension using the Azure portal or tools such as the Azure CLI or Azure Resource Manager templates.

If you have any further queries, please let us know. I’m happy to help!

Nikhil Duserla 3,565 Reputation points Microsoft Vendor

2024-12-20T15:08:24.1433333+00:00

Hi Robin Allen,

We noticed that you rated an answer as not helpful. I just wanted to follow up and see if you've had a chance to review my last response, which helps resolve your issue.

Thank you!

Nikhil Duserla 3,565 Reputation points Microsoft Vendor

2024-12-23T13:50:23.08+00:00

Hi Robin Allen,

Have you reviewed the solution provided above and tried implementing it? Please let me know if I can assist you further.
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

Azure GPU-optimized VM with driver extension throws modprobe: ERROR: could not insert 'nvidia': No such device on startup

1 answer

Your answer