Share via

Azure OpenAI Assistant API: Support for Image Input

Schmidt, Friedrich 10 Reputation points
2024-09-06T12:26:52.1033333+00:00

I'm currently facing an issue with the Azure OpenAI Assistant API when trying to use image input with the GPT-4 Vision model. While this feature has been available through OpenAI since May, it seems that Azure hasn't implemented it yet in their Assistant API.

Current Setup

  • Model: GPT-4 Vision
  • API Version: 2024-07-01-preview

Error Message

When attempting to pass an image input, I receive the following error:

Error code: 400 {'error': {'message': "Invalid message content: only messages with 'type=text' are supported currently.", 'type': 'invalid_request_error', 'param': 'content', 'code': 'invalid_type'}}

Could someone from the Azure team provide information on when we can expect support for image input in the Assistant API? This feature is crucial for our application and its absence in Azure's implementation is causing limitations in our development process.

Any insights or updates on this matter would be greatly appreciated. Thank you in advance for your assistance.

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,472 questions

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.