What's new in Azure AI Agent Service

This article provides a summary of the latest releases and major documentation updates for Azure AI Agent Service.

December 2024

Azure AI Service public preview

Azure AI Service is now available in preview. The service builds off of the Assistants API in Azure OpenAI, and offers several additional features, such as:

  • Several additional tools to enhance your AI agents' functionality, such as the ability to use Bing and as a knowledge source and call functions.
  • The ability to use non Azure OpenAI models:
    • Llama 3.1-70B-instruct
    • Mistral-large-2407
    • Cohere command R+
  • Enterprise ready security with secure data handling, keyless authentication, and no public egress.
  • The ability to either use Microsoft-managed storage, or bring your own.
  • SDK support for:
  • Debugging support using tracing with Application Insights

Next steps

Use the quickstart article to get started creating a new AI Agent.