Structured Output in gpt-4o-mini

Michael Wang 40

I was attempting to test the structured outputs feature from this article, specifically the MathReasoning example:
https://platform.openai.com/docs/guides/structured-outputs/introduction

I was using the gpt-4o-mini deployment from Azure AI Studio and constantly getting the following error:

Error code: 400 - {'error': {'message': "Invalid parameter: 'response_format' must be one of 'json_object', 'text'.", 'type': 'invalid_request_error', 'param': 'response_format', 'code': None}}

I searched online and found someone that said that Azure Studio doesn't support this feature yet (including json schema) and I was wondering if this is true or not.

Arne Rustad 55 Reputation points

2024-10-10T09:53:54.2533333+00:00

Why is this not yet fixed? It's been like two months since OpenAI released strict structured output for gpt-4o-mini. Can we please get an ETA for when it will be added to Azure OpenAI as well?
ChrisH 56 Reputation points

2024-10-20T13:56:37.0566667+00:00

Any updates at all on this?!

Even a ballpark date from Microsoft would be good here, it's impossible to plan without.
Harish R 10 Reputation points

2024-10-28T22:23:17.71+00:00

Any updates from the microsoft team?
Martin Zachoszcz 20 Reputation points

2024-11-06T18:14:26.0433333+00:00

update please? @Microsoft? Pleeease update on this!
Chris Tielkes 0 Reputation points

2024-11-07T14:56:36.72+00:00

We really need the structured output feature for gpt-4o-mini to meet our business requirements. An estimated release date on this would allow our teams to go forward. Thanks.
noxah 10 Reputation points

2024-11-11T07:36:24.4566667+00:00

@YutongTie-MSFT
Can you confirm this really is in the team's backlog? It has been more than three months since OpenAI released this functionality. It really looks like it has been forgotten given the timeline:

August 6: Released by OpenAI

September 3: Support by Azure OpenAI (but without 4o-mini)

November 11: Still no news

10 answers

Martin Zachoszcz 20 Reputation points

2024-10-09T17:26:15.1566667+00:00

I find this extremely weird that this isn't actually working, because the model that is deploy in Azure: GPT-4o-mini (2024-07-18) should actually have this functionality based on the documentation from openAI:
https://platform.openai.com/docs/guides/structured-outputs/supported-models

But somehow it does not work. It works for the large GPT-4o (2024-08-06) model though.

Can someone from Microsoft clarify what's going on here and when we can expect support for the mini model?
Please sign in to rate this answer.

4 people found this answer helpful.
Harish R 10 Reputation points

2024-10-28T22:23:03.5133333+00:00

Any updates from the microsoft team?
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.
Torsten 10 Reputation points

2024-10-02T10:41:45.9766667+00:00

Same question here, any updates regarding the ETA for structured outputs in gpt-4o-mini in Azure OpenAI?

Thanks!
Please sign in to rate this answer.

2 people found this answer helpful.
Lukas Gamper 5 Reputation points

2024-10-05T07:26:31.5533333+00:00

For me it's also super urgent to get the gpt-4o-mini structured output
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.
ChrisH 56 Reputation points

2024-09-17T19:34:16.9533333+00:00

Any updates on an ETA for mini?
Please sign in to rate this answer.

1 person found this answer helpful.
ChrisH 56 Reputation points

2024-10-04T07:21:35.8266667+00:00

Looks like json_schema may now be broken with Gpt-4o full now too. As of Tue/Wed update anyway. Got a support ticket raised. Posting here incase it helps anyone.

ChrisH 56 Reputation points

2024-10-05T09:33:59.2+00:00

Resolved it myself. If this helps anyone, the endpoint url in the studio is misleading. For me it shows:

https://<redact>.openai.azure.com/openai/deployments/gpt-4o/chat/completions?api-version=2023-03-15-preview

To use json_schema you need to use this (as far as I can tell undocumented) endpoint:

https://<redact>.openai.azure.com/openai/deployments/gpt-4o/chat/completions?api-version=2024-08-01-preview

(Figured out by using the playground, and seeing where that is actually sending requests to...)

Gyan Veda 15 Reputation points

2024-10-05T15:02:48.3166667+00:00

@ChrisH thanks for sharing! You said this works for json_schema. Does this also work for Structured Outputs?

ChrisH 56 Reputation points

2024-10-05T17:31:04.98+00:00

json_schema == structured outputs. Though not tried with function calling, I assume it's the same issue, if that's suddenly stopped working too.

Torsten 10 Reputation points

2024-10-07T17:28:16.3466667+00:00

@ChrisH But this is for gpt-4o right? Not for gpt-4o-mini?
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.
Andrey Lukin 5 Reputation points

2024-09-27T18:29:54.8066667+00:00

Hi, any updates on the ETA for structured output in azure?

TIA!
Please sign in to rate this answer.

1 person found this answer helpful.

0 comments No comments
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.
Gyan Veda 15 Reputation points

2024-09-30T14:52:04.2933333+00:00

Any updates for Structured Outputs for mini? It'd be super helpful, thank you!
Please sign in to rate this answer.

1 person found this answer helpful.

0 comments No comments
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

Structured Output in gpt-4o-mini

10 answers

Your answer