OpenAPI service is returning no response and no error

Question

OpenAPI service is returning no response and no error

Manaswita Datta 0 Microsoft Employee

HI, we are using gpt-4o with the below config: User's image

For some of the requests it is giving no response and no error message. User's image

Wanted to understand the reason for this and also how to avoid it?

James McCarthy 0 Reputation points

2025-01-18T23:26:10.33+00:00

It looks like the finish reason there is content filter. Seems like the content filter caught something and terminated the response
Manas Mohanty 2,110 Reputation points Microsoft External Staff

2025-01-21T12:45:54.3466667+00:00
Hi Manaswita Datta,

Welcome to the Microsoft Q&A and thank you for posting your questions here.

There might be multiple regions behind no response. You can follow below steps to debug the issue.

As part of retry mechanism, we should request the model to look up again in case of no answer with a modified query.

Here is a debugging measure, you can adopt the catch the issue

Use Try-catch block in response snippet to catch the errors caused by content filtering or rate limit or internal server error or data not found (in case of add you own data)

Once the issue is identified, proper action like using a custom content filter with higher severity threshold / Increase or decrease max_token/modify prompt to clear and concise query with specific instructions and retry /Change region of deployment or API version of model/Improve quality of indexing (add your own data) can be adopted.

Kindly refer below doc for reference.

prompt-engineering

content-filter-in-azure-ai-foundry

Feel free to ask if you have any additional queries.

Hope above pointers helps.

Thank you.
Manas Mohanty 2,110 Reputation points Microsoft External Staff

2025-01-23T04:40:13.3033333+00:00

Hi Manaswita Datta,

We are checking to see if above information helped.

Thank you.
Manas Mohanty 2,110 Reputation points Microsoft External Staff

2025-01-24T04:14:03.21+00:00

Hi Manaswita Datta,

We haven’t heard from you on the last response and was just checking back to see if the give response was helpful.

Thank you.

Your answer

James McCarthy 0 Reputation points

2025-01-18T23:26:10.33+00:00

It looks like the finish reason there is content filter. Seems like the content filter caught something and terminated the response
Manas Mohanty 2,110 Reputation points Microsoft External Staff

2025-01-21T12:45:54.3466667+00:00

Hi Manaswita Datta,

Welcome to the Microsoft Q&A and thank you for posting your questions here.

There might be multiple regions behind no response. You can follow below steps to debug the issue.

As part of retry mechanism, we should request the model to look up again in case of no answer with a modified query.

Here is a debugging measure, you can adopt the catch the issue

Use Try-catch block in response snippet to catch the errors caused by content filtering or rate limit or internal server error or data not found (in case of add you own data)

Once the issue is identified, proper action like using a custom content filter with higher severity threshold / Increase or decrease max_token/modify prompt to clear and concise query with specific instructions and retry /Change region of deployment or API version of model/Improve quality of indexing (add your own data) can be adopted.

Kindly refer below doc for reference.

prompt-engineering

content-filter-in-azure-ai-foundry

Feel free to ask if you have any additional queries.

Hope above pointers helps.

Thank you.
Manas Mohanty 2,110 Reputation points Microsoft External Staff

2025-01-23T04:40:13.3033333+00:00

Hi Manaswita Datta,

We are checking to see if above information helped.

Thank you.
Manas Mohanty 2,110 Reputation points Microsoft External Staff

2025-01-24T04:14:03.21+00:00

Hi Manaswita Datta,

We haven’t heard from you on the last response and was just checking back to see if the give response was helpful.

Thank you.

Share via

OpenAPI service is returning no response and no error

Your answer