Does azure-ai-contentsafety client library have functionality to call promptShield and protectedMaterialDetection endpoint? If not when will it come?

Question

Does azure-ai-contentsafety client library have functionality to call promptShield and protectedMaterialDetection end? If not when will it come? I want to call Azure AI content safety services' promptShield and protectedMaterial endpoint through Azure content safety client

Answer 1

Hi Nitish Gautam,

Thanks for reaching out to Microsoft Q&A.

As of now, the Azure AI Content Safety client library does not support direct methods to call the promptShield and protectedMaterialDetection endpoints. To utilize these features, you can make HTTP requests to the respective REST APIs. For promptShield, refer to the Prompt Shields documentation, and for protectedMaterialDetection, consult the Protected Material Detection guide.

Regarding the integration of these endpoints into the client library, there is no official announcement or timeline available at this moment. For the most current information, please monitor the Azure AI Content Safety documentation and the Azure AI services blog.

Please feel free to click the 'Upvote' (Thumbs-up) button and 'Accept as Answer'. This helps the community by allowing others with similar queries to easily find the solution.

Answer 2

@Nitish Gautam Welcome to Microsoft Q&A Forum, Thank you for posting your query here!

.

Updated:
Currently we haven't provided SDK for Prompt Shield and Protected Material. However, as a workaround you can use REST APIs to access these APIs. The API documentations can be found in APIs: Details - Microsoft Azure API Management - developer portal

.

If the support is released in future, we will update our documentation. Currently we don't have any ETA on this.

.

The below sample code should help on below scenarios:

1. Protecting the LLM against Jailbreak attacks using Prompt Shield
2. Protecting the LLM against Indirect Attacks (malicious instructions that have been injected in a RAG scenario) using Prompt Shield

Sample code: https://github.com/Azure/azure-openai-samples/blob/main/use_cases/AI_content_safety/0-rai-policy-management-and-prompt-shield.ipynb

.

Hope this helps.
.
**

Please do not forget to "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.