Gpt-4o-mini doesn't support structured outputs in Azure AI Studio deployments

Adeeb Faiyaz 45 Reputation points
2024-10-30T23:22:14.8366667+00:00

The gpt-4o-mini accessible through Open AI's endpoint supports structured outputs but through Azure it does not. The following error is seen when structured outputs are used using gpt-4o-mini from Azure:

openai.BadRequestError: Error code: 400 - {'error': {'message': "Invalid parameter: 'response_format' of type 'json_schema' is not supported with this model. Learn more about supported models at the Structured Outputs guide: https://platform.openai.com/docs/guides/structured-outputs", 'type': 'invalid_request_error', 'param': None, 'code': None}}

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,361 questions
Azure Startups
Azure Startups
Azure: A cloud computing platform and infrastructure for building, deploying and managing applications and services through a worldwide network of Microsoft-managed datacenters.Startups: Companies that are in their initial stages of business and typically developing a business model and seeking financing.
434 questions
{count} votes

Accepted answer
  1. YutongTie-MSFT 53,241 Reputation points
    2024-10-31T15:11:41.8033333+00:00

    Hello @Adeeb Faiyaz

    Thanks for reaching out to us, unfortunately GPT-4o-mini doesn't support structured output right now, currently only gpt-4o version: 2024-08-06 supports structured outputs.

    This feature will come soon but there is currently no ETA for this feature based on product team's guidance.

    Reference document - https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/structured-outputs?tabs=python-secure

    You can get the latest news from the What's new page - https://learn.microsoft.com/en-us/azure/ai-services/openai/whats-new

    I hope this helps! Let us know if you need any further help, if you have any other issues, feel free to open a new thread.

    Regards,

    Yutong

    -Please kindly accept the answer if you feel helpful to support the community, thanks a lot.

    4 people found this answer helpful.

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.