Edit

Share via

Overview of the Azure AI SDKs

  • Article

Microsoft offers a variety of packages that you can use for building generative AI applications in the cloud. In most applications, you need to use a combination of packages to manage and use various Azure services that provide AI functionality. We also offer integrations with open-source libraries like LangChain and MLflow for use with Azure. In this article we'll give an overview of the main services and SDKs you can use with Azure AI Studio.

For building generative AI applications, we recommend using the following services and SDKs:

  • Azure Machine Learning for the hub and project infrastructure used in AI Studio to organize your work into projects, manage project artifacts (data, evaluation runs, traces), fine-tune & deploy models, and connect to external services and resources.
  • Azure AI services provides pre-built and customizable intelligent APIs and models, with support for Azure OpenAI, Azure AI Search, Speech, Vision, and Language.
  • Prompt flow for developer tools to streamline the end-to-end development cycle of LLM-based AI application, with support for inferencing, indexing, evaluation, deployment, and monitoring.

For each of these, there are separate sets of management libraries and client libraries.

Management libraries for creating and managing cloud resources

Azure management libraries (also "control plane" or "management plane"), for creating and managing cloud resources that are used by your application.

Azure Machine Learning

Azure AI services

Prompt flow

Client libraries used in runtime application code

Azure Client libraries (also called "data plane") for connecting to and using provisioned services from runtime application code.

Azure AI services

Prompt flow

Agentic frameworks:

Related content