Use Document intelligence to summarize File from Copilot Studio

Torsten Saemann 0

How can I create a PowerAutomate Flow within Copilot Studio to attach a File to get it summarized?

kothapally Snigdha 1,270 Reputation points Microsoft Vendor

2024-12-02T12:52:01.45+00:00
Hi Torsten Saemann

Greetings & Welcome to Microsoft Q&A forum! Thanks for posting your query!

To create a Power, Automate Flow within Copilot Studio that attaches a file for summarization using Azure AI Document Intelligence. Here are some steps to follow. can you please refer this https://never-stop-learning.de/using-document-intelligence-from-power-automate

Log in to your Power Automate account and navigate to the "My Flows" section.

Click on "Create" and choose "Automated cloud flow" or "Instant cloud flow" based on your requirements.

Choose a trigger that suits your scenario, such as "When a file is created" or "When an email arrives with an attachment.

If necessary, set conditions to filter which files should initiate the flow.

Click on "New step" and search for "OneDrive" or "SharePoint" (depending on where your files are stored).

Click on "New step" and choose the "HTTP" action.

Configure HTTP Request:

set the method to POST. Enter the URL of your Azure AI Document Intelligence endpoint. After the HTTP action, add a step to handle the response from Azure AI Document Intelligence.

Use the "Parse JSON" action to extract relevant information from the response. You may need to provide a sample schema based on expected output.

Select an action like "Get file content" to retrieve the file you want to summarize

Depending on how you want to summarize the content, you can either use built-in functions in Power Automate or call another service that handles the summarization. Thank you!
kothapally Snigdha 1,270 Reputation points Microsoft Vendor

2024-12-04T01:12:49.5633333+00:00

Hi Torsten Saemann

Following up to see if the above response was helpful.
kothapally Snigdha 1,270 Reputation points Microsoft Vendor

2024-12-05T01:43:59.6166667+00:00

Hi Torsten Saemann

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution, please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.
Torsten Saemann 0 Reputation points

2024-12-05T20:23:18.18+00:00

Thank You very much indeed for your rapid response.

The description however is not detailed enough to follow step by step in Copilot Studio. I also asked for a scenario where the user spontaneously attaches a file in the user dialoge rather than locating a file in OneDrive etc.

Maybe You can be a bit more precise?
kothapally Snigdha 1,270 Reputation points Microsoft Vendor

2024-12-09T02:14:19.64+00:00
Hi Torsten Saemann

Start by logging into your Microsoft account and accessing Copilot Studio.

Click on the "Create" icon and select "New Copilot." Name your Copilot appropriately based on its intended function.

In the prompt section, design how you want users to initiate file attachments. For example, you might use prompts like "Please attach your file" or "Upload your document here."

You need to create an action that allows users to attach files directly. This can be done by integrating a file upload feature in the dialogue.

To facilitate file uploads, integrate Power Automate within your Copilot. This allows you to create flows that can handle file attachments.

In Power Automate, set up a flow that triggers when a user attaches a file. This flow should include actions for processing the attached file.

Ensure that your flow includes an action for attaching files directly from the user interface, allowing users to browse their local files.

Test the functionality by simulating user interactions. Ensure that when prompted, users can easily attach files without having to navigate through OneDrive or other storage options.

After ensuring that all functionalities work as intended, publish your Copilot. Make sure to review all settings related to file handling and permissions.

I hope this helps you. Thank you.
Torsten Saemann 0 Reputation points

2024-12-10T16:22:00.7833333+00:00

Hi Kothapally, thanks a lot.

I trust it needs a short DEMO video to explain each step. I do not come to grips with the above description. I am left with too many „Where do I find this?“ in mind.
Torsten Saemann 0 Reputation points

2024-12-10T16:22:57.6333333+00:00

PS: Asking Copilot Studio dialoge doesn‘t help either.
kothapally Snigdha 1,270 Reputation points Microsoft Vendor

2024-12-12T04:11:28.3233333+00:00
Hi Torsten Saemann

Sorry for Dealy.

Unfortunately, I cannot provide a demo video, but these steps should help you get started with summarizing files using Document Intelligence in Copilot Studio.

Choose the document analysis or prebuilt model you wish to use in Document Intelligence Studio.

Upload your own document or select one of the sample documents provided.

After selecting the document, the analysis results will be displayed on the right side of the content-result-code window.

If you want to use custom models, you will need to train them on your specific documents. Refer to the custom model's overview for guidance on this process.

Thank you!

1 answer

Patel, Emanshu [CORP/US] 0 Reputation points

2025-02-03T15:55:59.6733333+00:00

Hello @Torsten Saemann

Ever figure this out?

From what I see msft's response assumes there will be a blend between CoPilot Studio and Azure Document Intelligence, which would need a API Key vs CoPilot being at the tenant level. Would you agree?

Sincerely,
Emanshu Patel
Please sign in to rate this answer.

0 comments No comments
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

Use Document intelligence to summarize File from Copilot Studio

1 answer

Your answer