Evaluation run getting failed for customized models - Vision Studio

Deepankar 80

I am unable to obtain the evaluation score for my trained custom model. I have correctly set the COCO file location in my blob storage, and the images referenced under the status have a privacy level of anonymous read-only. Despite this, I am still unable to run the evaluation.

Error: Prediction on evaluation image failed with error: Prediction for https://storagename.blob.core.windows.net/foldername/filename.jpg failed with code: InternalServerError, message: An internal error occured.

I can access my image path in the browser's incognito mode, so it doesn't seem to be a server connectivity issue.

I was able to run evaluations for my previous custom models, but the new one is failing. It seems the recent update is causing some issues. Could someone please look into this?

WhatsApp Image 2025-01-04 at 23.10.04_6437c33f

Saideep Anchuri 860 Reputation points Microsoft Vendor

2025-01-06T07:31:05.16+00:00

Hi Deepankar

Welcome to Microsoft Q&A Forum, thank you for posting your query here!

It seems that you are encountering an InternalServerError when trying to evaluate your custom model in Vision Studio. This could indicate an unknown issue on the server side. Could you confirm your region of deployment, it might be a regional specific issue on MS side. You can test in other available regions.

If the issue still persists, please create a support ticket.

Kindly refer similar thread: https://learn.microsoft.com/en-us/answers/questions/1657204/azure-ai-vision-studio-how-to-fix-internalserverer

Thank You.
Saideep Anchuri 860 Reputation points Microsoft Vendor

2025-01-07T00:44:14.1233333+00:00

Hi Deepankar

Following up to see if the given response was helpful.

Thank You.
Saideep Anchuri 860 Reputation points Microsoft Vendor

2025-01-08T00:44:29.1766667+00:00

Hi Deepankar

We haven’t heard from you on the last response and was just checking back to see if the give response was helpful.

Thank You.
Deepankar 80 Reputation points

2025-01-08T01:56:28.3533333+00:00

@Saideep Anchuri : "I apologize for my absence over the past four days. I have verified that all my resources (Storage Account, Azure AI services multi-service account, Vision Project Resource Region) are located in the EAST US region. I was able to successfully run evaluation tests within the same project until August 2024. However, when attempting to run the evaluation with a new dataset recently, it has been failing within the same project.
Deepankar 80 Reputation points

2025-01-08T04:18:25.5966667+00:00

Yes, It looks after recent changes of packages are causing those issues. Thanks, Saideep, for your help.

Accepted answer

Saideep Anchuri 860 Reputation points Microsoft Vendor

2025-01-08T03:56:54.17+00:00
Hi Deepankar

As you mentioned it worked till Aug 2024, I think there might have been some changes on backend side. I would suggest you connect with product team. But here are the common practices to test with.

Test in other available regions.

Test with other image formats. Png, .jpgs.

since this is an internal error, I would suggest you raise a support ticket with support team.

Thank You.
Please sign in to rate this answer.

0 comments No comments
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

Evaluation run getting failed for customized models - Vision Studio

0 additional answers

Your answer