False Positives in Azure OpenAI Content Filtering: Incorrect Detection of Sensitive Content

Pierre-Yves 0 Reputation points
2025-03-01T15:46:46.3066667+00:00

Hello,

I am experiencing recurring false positives with Azure OpenAI Service’s content filtering (GPT-4o).

📌 Context:

  • I am developing a chatbot application using Azure OpenAI GPT-4o.
  • The chatbot asks general, neutral questions, but some harmless and inoffensive phrases are being blocked by the content filter.
  • Specific Example for a prompt command in french on an assistant :
    • If the AI asks: "Lorsque vous interagissez avec l'utilisateur pour la première fois, commencez toujours par lui demander s'il préfère le vouvoiement ou le tutoiement." In english "When interacting with the user for the first time, always start by asking if they prefer informal or informal address."
    • The error message returned is:
          The generated content was filtered due to triggering Azure OpenAI Service's content filtering system.
      

Reason: This response contains content labeled as "Sexual (medium)". ```

- This is **clearly a false positive**, as this phrase has **no connection to sensitive or inappropriate content**.

📌 Broader Issue:

  • This issue is not limited to formal/informal speech questions.
  • Other completely neutral phrases (e.g., personal preferences, communication styles, workplace interactions) are randomly blocked, often classified as "Sexual (medium)" or "Hate speech (low/medium)".
  • The filtering seems maybe more aggressive in French than in English.

📌 Impact on the Application:

  • The AI becomes unusable in standard conversational scenarios.
  • Users see unjustified blocking messages, disrupting their experience.
  • It is impossible to tailor the chatbot for professional or commercial environments without complex workarounds.

📌 What I Have Already Tried:

Rephrasing the questions to avoid certain triggering words.

Modifying the system prompt to clarify that the chatbot should prevent misinterpretations in filtering.

Testing in English vs. French (false positives are significantly more frequent in French).

Activating content filtering logs and analyzing blocked requests.

Trying to adjust Azure OpenAI filter settings

📌 Questions for Microsoft / the Community:

1️⃣ Why are completely inoffensive phrases being blocked by Azure OpenAI’s content filter?

2️⃣ Is filtering stricter in French than in other languages?

3️⃣ Is there a way to adjust filtering levels without disabling moderation entirely?

4️⃣ How can we report a false positive to Microsoft to improve the filtering system?

5️⃣ Have other users encountered this issue in similar chatbot use cases?

This issue is severely limiting the adoption of Azure OpenAI for chatbots and professional applications. Any help or shared experiences would be greatly appreciated! 🙏

Thank you in advance for your responses

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,746 questions
{count} votes

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.