Question Regarding Reflection Time for Version Changes in Azure OpenAI

Question

The following text has been translated from Japanese to English using a translation tool. Please excuse any awkward phrasing or errors in the text.**

Question:**

We would like to inquire about the propagation time for updating the deployed model version in Azure OpenAI.

Background:

We changed the deployed "2024-05-13" version resource of 4o to "2024-11-20", but the specification of the response_format type json_schema, which is available from the 2024-08-06 version onwards, returns the following error:

"Invalid parameter: 'response_format' of type 'json_schema' is not supported with this model. Learn more about supported models at the Structured Outputs guide: https://platform.openai.com/docs/guides/structured-outputs"

Performed Verification:

• The same error occurred via the API and the chat playground.
• We have confirmed that the console display shows "2024-11-20".
• We are using API version 2024-10-21.
• After confirming this issue, we deleted the deployment and redeployed with the 2024-11-20 version. As a result, we were able to send requests normally with the same parameters and prompts.

From the above, we believe that although the console display has been changed, the actual reflection is taking time.

The following is the original Japanese text.
【お聞きしたい内容】

AzureOpenAIでデプロイしているモデルのバージョンを更新した際に反映にかかる時間がどれくらいかかるのかお伺いしたいです。

【背景】

デプロイしている4oの"2024-05-13"バージョンリソースを"2024-11-20"変更したが、2024-08-06バージョン以降で使用できるresponse_formatのタイプjson_schemaの指定が以下のエラーで返ってきます。

"Invalid parameter: 'response_format' of type 'json_schema' is not supported with this model. Learn more about supported models at the Structured Outputs guide: https://platform.openai.com/docs/guides/structured-outputs"

【行った確認作業】

・API経由でもチャットプレイグラウンドでも同様のエラーでした。

・コンソール画面からの表示では2024-11-20になっていることを確認できております。

・APIバージョンは2024-10-21を使用しております。・本事象確認後、一度デプロイを削除し、2024-11-20バージョンでデプロイしなおしたところ、　同じパラメータ、プロンプトで正常にリクエストを送ることができました。以上のことから、コンソール上では変更されているが、実際の反映に時間がかかるものと考えております。

Answer 1

I have confirmed the response before translation. Thank you for your reply. I was considering an update method that would not cause downtime for the application I am using, but I felt that redeploying would be the most reliable way. Thank you very much.

Answer 2

Hi 85795786

I'm glad to hear that your issue has been resolved. And thanks for sharing the information, which might be beneficial to other community members reading this thread as solution. Since the Microsoft Q&A community has a policy that "The question author cannot accept their own answer. They can only accept answers by others ", so I'll reiterate the previous response to an answer in case you'd like to accept the answer. This will help other users who may have a similar query find the solution more easily. 

Ask: Question Regarding Reflection Time for Version Changes in Azure OpenAI

Solution: I have confirmed the response before translation. I was considering an update method that would not cause downtime for the application I am using, but I felt that redeploying would be the most reliable way.

 If you have any further questions or concerns, please don't hesitate to ask. We're always here to help.

Thank you!