Responsible AI FAQ for Document analysis with Copilot (preview)
Important
Some or all of this functionality is available as part of a preview release. The content and the functionality are subject to change.
Note
This feature is included in Microsoft Sustainability Manager Premium.
What does it mean to analyze documents with Copilot?
Document analysis is a generative AI tool powered by Azure OpenAI. It allows you to upload ESG-related documents to Microsoft Sustainability Manager and ask questions related to them in natural language.
What can document analysis do?
Document analysis allows you to quickly extract information from long-form environmental, social, and governance (ESG) documents. You can select between one and five documents to collectively analyze. You can delete documents from Sustainability Manager at any time.
What are the intended uses of document analysis?
Document analysis is intended to help sustainability practitioners extract key information from ESG documents using natural language. Examples of these documents are sustainability reports or calculation guidance documentation.
How was Copilot evaluated? What metrics are used to measure performance?
Copilot was evaluated through a thorough red teaming process, testing for common risks such as violence, self-harm, sexual content, and hate and fairness. In addition, Copilot’s performance was measured using extensive grounded response testing. It tests for coverage of intended uses to assess accuracy and the extent to which responses are grounded in reference data.
What are the limitations of document analysis? How can users minimize the impact of its limitations when using the system?
Collective analysis on documents is currently limited to at most five documents at a time. Additionally, there are currently only three supported file types: PDF, DOCX, and TXT. Finally, Copilot can only recognize and search text at this time. Any images contained within the document aren't supported.
What operational factors and settings allow for effective and responsible use of document analysis?
You can turn Copilot on and off through the Power Apps admin settings. Copilot includes the following disclosure messaging, plus the ability to give feedback:
- "AI-generated content may be incorrect."
- "Make sure AI-generated content is accurate and appropriate before using."
- "Files are available to all users. Uploaded file content is available to anyone chatting with Copilot, regardless of file permissions or access controls."
