I am using the Azure Open AI assistant api in the production. The thing is that it is in the beta version, and my question is it safe to use it in the production environment.

Hi @Muhammad Atif Ayaz , Thank you for reaching out to Microsoft Q&A forum! Using the Azure OpenAI assistant API in production while it's in beta carries some risks, as beta versions are still in testing and may not be fully stable. Azure Assistant API is currently in preview. While preview APIs are generally not recommended for use in production environments, they can be used for testing and development purposes. However, it is important to keep in mind that preview APIs are subject to change and may not have undergone the necessary testing and validation for production use. If you do decide to use Azure OpenAI Assistant API in a production environment, it is recommended to closely monitor the API's performance and to have a plan in place to address any issues that may arise. Additionally, it is important to keep up to date with any changes or updates to the API and to adjust your implementation accordingly. You can keep an eye on the Azure OpenAI Service release notes for updates on What's new in Azure OpenAI Service page will be updated accordingly with more details. Hope this helps. Do let us know if you any further queries. If this answers your query, do click Accept Answer and Yes for was this answer helpful.

I am using Azure Assistant API its in beta version, is it safe to use it in production?

Accepted answer

santoshkc 9,400 Reputation points Microsoft Vendor

2024-09-17T12:53:04.3266667+00:00

Hi @Muhammad Atif Ayaz,

Thank you for reaching out to Microsoft Q&A forum!

Using the Azure OpenAI assistant API in production while it's in beta carries some risks, as beta versions are still in testing and may not be fully stable.

Azure Assistant API is currently in preview. While preview APIs are generally not recommended for use in production environments, they can be used for testing and development purposes. However, it is important to keep in mind that preview APIs are subject to change and may not have undergone the necessary testing and validation for production use.

If you do decide to use Azure OpenAI Assistant API in a production environment, it is recommended to closely monitor the API's performance and to have a plan in place to address any issues that may arise. Additionally, it is important to keep up to date with any changes or updates to the API and to adjust your implementation accordingly.

You can keep an eye on the Azure OpenAI Service release notes for updates on What's new in Azure OpenAI Service page will be updated accordingly with more details.

Hope this helps. Do let us know if you any further queries.

If this answers your query, do click Accept Answer and Yes for was this answer helpful.
Please sign in to rate this answer.
Muhammad Atif Ayaz 20 Reputation points

2024-09-17T13:22:49.6833333+00:00

Thanks for you quick response.

I just have few more questions.

What is the expected time for the stable release of it.

And if you can suggest some alternative versions similar to this one.

Thanks for your time again

santoshkc 9,400 Reputation points Microsoft Vendor

2024-09-18T15:18:58.39+00:00

Hi @Muhammad Atif Ayaz,

Thank you for your follow-up query.

The timeline for a stable release of the Azure OpenAI Assistant API is uncertain, as Azure doesn’t provide specific dates for beta features. These can remain in preview for months based on feedback and improvements. Stay updated by checking Azure’s OpenAI Service release notes and announcements.

For alternatives to the Azure OpenAI Assistants API, which allows creating tailored AI assistants with custom instructions, code interpreters, and custom functions, you could consider building custom solutions using Azure’s GPT-4 model integrated with other Azure services like Azure Logic Apps or Azure Functions for enhanced functionality. This would allow you to build assistants with custom workflows, tool integration, and code execution capabilities.
I hope you understand! Thank you.

Do click Accept Answer and Yes for was this answer helpful.

santoshkc 9,400 Reputation points Microsoft Vendor

2024-09-19T17:20:39.9033333+00:00

Hi @Muhammad Atif Ayaz,

Following up to see if the above answer was helpful. If this answers your query, do click Accept Answer and Yes for was this answer helpful. Thank you.

Muhammad Atif Ayaz 20 Reputation points

2024-09-23T13:50:38.8533333+00:00

Hi @santoshkc

My used case is that I only want to use give instruction to the Open AI only once at the start of the chat, instead of giving it again and again in every chat. Can this be performed on your given options.
Other please suggest me according to my use case, that will be really helpful.

Muhammad Atif Ayaz 20 Reputation points

2024-09-23T13:50:50.43+00:00

Hi @santoshkc

My used case is that I only want to use give instruction to the Open AI only once at the start of the chat, instead of giving it again and again in every chat. Can this be performed on your given options.
Other please suggest me according to my use case, that will be really helpful.

santoshkc 9,400 Reputation points Microsoft Vendor

2024-09-24T11:06:15.1566667+00:00

Hi @Muhammad Atif Ayaz,

You can provide instructions to Azure OpenAI at the start of the chat and maintain them throughout the session without repeating them. This can be achieved by storing the initial instruction in your system and sending it to the model only once.

You can give the instructions in the System message and apply the changes:

I hope this helps. Thank you.

Muhammad Atif Ayaz 20 Reputation points

2024-09-25T06:34:57.8133333+00:00

This is possible in chat playground, how to implement this to API level that I am using. For example when we create client give credentials tell about the model.
I have made an api that works back and forth without anything knowing what the previous chat msg was and what was the instructions.

santoshkc 9,400 Reputation points Microsoft Vendor

2024-09-25T18:07:08.0633333+00:00

Hi @Muhammad Atif Ayaz,

To provide instructions only once in Azure OpenAI via API, try to initialize the client with credentials and include a "System message" with your instructions in the first request. Maintain a conversation history in your application, storing each user input and model response, and include this history in subsequent API calls to preserve context without repeating instructions.

Thank you.

Muhammad Atif Ayaz 20 Reputation points

2024-10-10T11:38:12.72+00:00

I want to use it to API level, where the previous messages is not connected with the current message. This will not achieve that I guess.
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

I am using Azure Assistant API its in beta version, is it safe to use it in production?

0 additional answers

Your answer