OpenAI Chat Completion API: Resource not found if I use the Model Version mentioned in AI Foundry

Question

When I try to use the chat completions API, if I send the Model Version for the 4o-mini model as 2024-08-01-preview, it works. But it doesn't work for the model version 2024-07-18 on which it is deployed.

When using the non-preview version, it throws error 404: Resource not found.

Even when using the Playground, it sends the request to the preview version instead of the mentioned non-preview version.

Is this expected? Is there any documentation mentioning I can/can't use a particular model version?

Answer 1

Hi Siddharth Agarwal,

Welcome to Microsoft Q&A Forum, Thank you for posting your query here!

Yes, this behavior is expected due to how Azure OpenAI manages model versions. The 404: Resource not found error occurs when attempting to use a model version that is either not available for your endpoint or deprecated in your region. Azure OpenAI Service follows a structured lifecycle for its API versions, with new preview APIs typically released on a monthly cadence. Older preview versions are often deprecated as newer versions become available.

Key Points:

1. Model Versioning: The model version 2024-07-18 may no longer be accessible, while 2024-08-01-preview remains available.
2. Preview vs. Non-Preview Versions: Preview models (e.g., 2024-08-01-preview) are updated frequently, and older versions may be deprecated. If the Playground defaults to a preview version, it indicates that the non-preview version might not be fully supported.
3. Best Practice: Always use the latest available model version to ensure compatibility.

For the latest model availability and versioning details, refer to:

• Azure OpenAI Model Versions
• Azure OpenAI API Reference

I hope this is helpful!

Please do not forget to "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.