Developing an Outlook Add-in with LLM Functionality: Technical and GDPR/Compliance Questions

Question

I'm developing an Outlook add-in with Large Language Model (LLM) functionality for a client, and I need guidance on several aspects of the project. The core concept is to analyze every incoming email in an organization using an LLM, which then suggests a custom workflow based on the email content.

Here's an example scenario:

A sales employee receives an inquiry from a potential customer. The LLM should analyze the email and suggest the following workflow:

• Enter customer information into the CRM tool
• Reach out to the customer to schedule a meeting
• Prepare for the meeting by collecting relevant information materials

The sales employee would then perform these tasks manually. The workflow suggestions should be automatically displayed within Outlook.

I have several questions regarding the implementation:

Email Analysis and Workflow Integration:

• How can a system be set up to automatically analyze the content of each incoming email?
• What's the best way to append the LLM-generated workflow suggestions to the email item?

I've read about extending the Microsoft Graph schema for emails, but I'm unsure if this is the optimal approach. Are there better alternatives?

LLM Implementation and Data Privacy:

• The client is based in Germany, so the solution must comply with GDPR standards. How can LLM technology be utilized while ensuring compliance?
• Since OpenAI is a subsidiary of Microsoft, does using the OpenAI API in Azure avoid third-party data sharing concerns? Does anyone have specific information on this?
• How can different knowledge bases or prompts be implemented for various organizations to ensure that the LLM returns organization-specific workflow suggestions?
• Is there a way to fine-tune the model to improve performance on this task?

User Interface in Outlook:

• How can the LLM's workflow suggestions be displayed directly in the Outlook client?
• The client wants the workflow information to appear automatically below the email content in a separate box, without becoming part of the email body. What's the best way to achieve this?

I would appreciate any advice and inspiration for these points. Thank you!