Edit

Share via

How to use Azure OpenAI Service in AI Foundry portal

  • Article

You might have existing Azure OpenAI Service resources and model deployments that you created using the old Azure OpenAI Studio or via code. You can pick up where you left off by using your existing resources in AI Foundry portal.

This article describes how to:

  • Use Azure OpenAI Service models outside of a project.
  • Use Azure OpenAI Service models and an AI Foundry project.

Tip

You can use Azure OpenAI Service in AI Foundry portal without creating a project or a connection. When you're working with the models and deployments, we recommend that you work outside of a project. Eventually, you want to work in a project for tasks such as managing connections, permissions, and deploying the models to production.

Use Azure OpenAI models outside of a project

You can use your existing Azure OpenAI model deployments in AI Foundry portal outside of a project. Start here if you previously deployed models using the old Azure OpenAI Studio or via the Azure OpenAI Service SDKs and APIs.

To use Azure OpenAI Service outside of a project, follow these steps:

  1. Go to the AI Foundry home page and make sure you're signed in with the Azure subscription that has your Azure OpenAI Service resource.

  2. Find the tile that says Focused on Azure OpenAI Service? and select Let's go.

    Screenshot of the home page in Azure AI Foundry portal with the option to select Azure OpenAI Service.

    If you don't see this tile, you can also go directly to the Azure OpenAI Service page in AI Foundry portal.

  3. You should see your existing Azure OpenAI Service resources. In this example, the Azure OpenAI Service resource contoso-azure-openai-eastus is selected.

    Screenshot of the Azure OpenAI Service resources page in Azure AI Foundry portal.

    If your subscription has multiple Azure OpenAI Service resources, you can use the selector or go to All resources to see all your resources.

If you create more Azure OpenAI Service resources later (such as via the Azure portal or APIs), you can also access them from this page.

Use Azure OpenAI Service in a project

You might eventually want to use a project for tasks such as managing connections, permissions, and deploying models to production. You can use your existing Azure OpenAI Service resources in an AI Foundry project.

Let's look at two ways to connect Azure OpenAI Service resources to a project:

Connect Azure OpenAI Service when you create a project for the first time

When you create a project for the first time, you also create a hub. When you create a hub, you can select an existing Azure AI services resource (including Azure OpenAI) or create a new AI services resource.

Screenshot of the create resource page within the create project dialog.

For more details about creating a project, see the create an AI Foundry project how-to guide or the create a project and use the chat playground quickstart.

Connect Azure OpenAI Service after you create a project

If you already have a project and you want to connect your existing Azure OpenAI Service resources, follow these steps:

  1. Go to your AI Foundry project.

  2. Select Management center from the left pane.

  3. Select Connected resources (under Project) from the left pane.

  4. Select + New connection.

    Screenshot of the connected resources page with the button to create a new connection.

  5. On the Add a connection to external assets page, select the kind of AI service that you want to connect to the project. For example, you can select Azure OpenAI Service, Azure AI Content Safety, Azure AI Speech, Azure AI Language, and other AI services.

    Screenshot of the page to select the kind of AI service that you want to connect to the project.

  6. On the next page in the wizard, browse or search to find the resource you want to connect. Then select Add connection.

    Screenshot of the page to select the Azure AI Service resource that you want to connect to the project.

  7. After the resource is connected, select Close to return to the Connected resources page. You should see the new connection listed.

Try Azure OpenAI models in the playgrounds

You can try Azure OpenAI models in the Azure OpenAI Service playgrounds outside of a project.

Tip

You can also try Azure OpenAI models in the project-level playgrounds. However, while you're only working with the Azure OpenAI Service models, we recommend working outside of a project.

  1. Go to the Azure OpenAI Service page in AI Foundry portal.

  2. Select a playground from under Resource playground in the left pane.

    Screenshot of the playgrounds that you can select to use Azure OpenAI Service.

Here are a few guides to help you get started with Azure OpenAI Service playgrounds:

Each playground has different model requirements and capabilities. The supported regions will vary depending on the model. For more information about model availability per region, see the Azure OpenAI Service models documentation.

Fine-tune Azure OpenAI models

In AI Foundry portal, you can fine-tune several Azure OpenAI models. The purpose is typically to improve model performance on specific tasks or to introduce information that wasn't well represented when you originally trained the base model.

  1. Go to the Azure OpenAI Service page in AI Foundry portal to fine-tune Azure OpenAI models.

  2. Select Fine-tuning from the left pane.

    Screenshot of the page to select fine-tuning of Azure OpenAI Service models.

  3. Select + Fine-tune model in the Generative AI fine-tuning tabbed page.

  4. Follow the detailed how to guide to fine-tune the model.

For more information about fine-tuning Azure AI models, see:

Deploy models to production

You can deploy Azure OpenAI base models and fine-tuned models to production via the AI Foundry portal.

  1. Go to the Azure OpenAI Service page in AI Foundry portal.

  2. Select Deployments from the left pane.

    Screenshot of the models and endpoints page to view and create Azure OpenAI Service deployments.

You can create a new deployment or view existing deployments. For more information about deploying Azure OpenAI models, see Deploy Azure OpenAI models to production.

Develop apps with code

At some point, you want to develop apps with code. Here are some developer resources to help you get started with Azure OpenAI Service and Azure AI services:

Related content