Structured Output in gpt-4o-mini

Question

I was attempting to test the structured outputs feature from this article, specifically the MathReasoning example:
https://platform.openai.com/docs/guides/structured-outputs/introduction

I was using the gpt-4o-mini deployment from Azure AI Studio and constantly getting the following error:

Error code: 400 - {'error': {'message': "Invalid parameter: 'response_format' must be one of 'json_object', 'text'.", 'type': 'invalid_request_error', 'param': 'response_format', 'code': None}}

I searched online and found someone that said that Azure Studio doesn't support this feature yet (including json schema) and I was wondering if this is true or not.

Answer 1

I find this extremely weird that this isn't actually working, because the model that is deploy in Azure: GPT-4o-mini (2024-07-18) should actually have this functionality based on the documentation from openAI:
https://platform.openai.com/docs/guides/structured-outputs/supported-models

But somehow it does not work. It works for the large GPT-4o (2024-08-06) model though.

Can someone from Microsoft clarify what's going on here and when we can expect support for the mini model?

Answer 2

Same question here, any updates regarding the ETA for structured outputs in gpt-4o-mini in Azure OpenAI?

Thanks!

Answer 3

Well, this is not looking good, I understand that MS needs some time to sync with OAI but it's been a while now, unfortunately for us this feature is critical, we'll have to switch to OpenAI endpoints until this problem is solved.

Answer 4

Any updates on an ETA for mini?

Answer 5

Hi, any updates on the ETA for structured output in azure?

TIA!