Custom engine agents for Microsoft 365 overview
Custom engine agents are specialized chat experiences built on any large language model (LLM) and tailored for specific domain or workflows. They allow organizations to create their own agents using tools like the Teams Toolkit, Microsoft Copilot Studio, and the M365 Agents SDK. Custom engine agents allow you to use your custom orchestrators, foundation models, and custom logic.
Custom engine agents utilize LLM technology that allows them to easily understand and respond to user queries, creating dynamic and immersive interactions. Custom engine agents also offer advanced functionalities such as task execution and content creation. These capabilities make custom engine agents indispensable tools for streamlining workflows and boosting productivity.
Important
- Custom engine agents are conversational Teams bots with a custom LLM. They don't require a Microsoft 365 Copilot license to build, debug and deploy. However, custom engine agents are only available to licensed Microsoft 365 Copilot users or users in tenants that allow metered usage of agents.
- The cost of a custom engine agent depends on the Azure services consumed in the app. To estimate the cost, visit the Azure Pricing Calculator.
Build custom engine agents
There are two options for building custom engine agents. You can use the Teams AI library and Teams Toolkit to build your agent with code, or you can use Microsoft Copilot Studio to build an agent with little to no code.
Teams AI library and Teams Toolkit
For enterprises seeking bot solutions that are precisely customized to user demands and scenarios, using the Teams AI library is a great choice. The Teams AI library utilizes LLMs that adhere to Microsoft's UX principles and that are compatible with Teams and Microsoft 365. Developing custom engine agents with the Teams AI Library can provide more natural, intuitive, and specialized user interaction experiences. This option is advantageous for developers wishing to customize model selection and orchestration, applying prior experience in Teams bot development, or aiming to ensure accessibility for all Microsoft 365 users.
Developers can also utilize the Teams Toolkit to construct their projects. The Teams Toolkit includes prebuilt templates for a seamless project launch, offering an ideal solution for quick starts, easy debugging, and deployment.
Explore templates to get started
Kickstart building your custom engine agents using Teams AI library with the prebuilt templates available in Teams Toolkit:
| Template | Description |
|---|---|
| Basic AI ChatBot | Build a basic AI chatbot for Teams using Teams AI library. |
| AI Agent ChatBot | Build an AI agent chatbot for Teams that can make decisions and perform actions based on LLM reasoning. AI Agent template has options to start from scratch or use OpenAI Assistants API. |
| Chat with your data | Expand AI bot's knowledge with your content to get more accurate answers to your questions. Chat with your data supports Azure AI Search, Microsoft Graph Search with Microsoft 365 and SharePoint content, and custom OpenAPI and data ingestion options. |
Take a tour of the sample scenarios
Explore sample scenarios available in Teams AI library GitHub repository to understand more about the capabilities you can add in your custom engine agents:
| Sample | Description | C# | JavaScript | Python |
|---|---|---|---|---|
| List bot | Harness the power of AI, simplify your workflow and bring order to your daily tasks with action chaining capabilities. | C# | JavaScript | Python |
| DevOps bot | Perform DevOps actions such as create, update, triage, and summarize work items. | C# | JavaScript | Python |
| Twenty questions bot | Use LLM capabilities and the concept of user intent by having users guess a secret within 20 questions, grounding the chatbot with some question and answer as a data source. | C# | JavaScript | Python |
| Math tutor assistant | Use OpenAI's Assistants API with the Code Interpreter tool and create an assistant that's an expert on math. | C# | JavaScript | Python |
| Food ordering assistant | Call actions to order food from a fictional restaurant called The Pub with complex interactions. | C# | JavaScript | Python |
Microsoft Copilot Studio
Microsoft Copilot Studio is a versatile platform that allows you to build and customize agents using low-code and pro-code tools. It integrates with Azure AI services and offers over 1,000 connectors, enabling the creation of sophisticated, multi-channel conversational agents.
Microsoft 365 Agents SDK
Microsoft 365 Agents SDK seamlessly integrates with AI services like Azure AI Foundry and orchestration layers such as Semantic Kernel. It offers interoperability with Copilot Studio, enabling you to enhance and extend existing agents with additional skills. This allows makers to delegate tasks to other agent functionalities. Additionally, you can connect to a Copilot Studio agent from code, gaining access to the full range of features within the Copilot Studio ecosystem.
Learn more: Microsoft 365 Agents SDK (Preview).