Share via

Model Distillation in Azure AI Foundry

Tom Raisbeck 0 Reputation points
2025-03-11T19:54:34.64+00:00

I'd like to distill a Llama model into a DeepSeek model. According to this page, only very specific model can be used. Is this still true and, if so, do we know when this feature will be available for other models?

Azure AI services
Azure AI services
A group of Azure services, SDKs, and APIs designed to make apps more intelligent, engaging, and discoverable.
3,223 questions
0 comments

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. Pavankumar Purilla 4,280 Reputation points Microsoft External Staff
    2025-03-11T21:15:21.3166667+00:00

    Hi Tom Raisbeck,
    Yes, as of now, model distillation in Azure AI Foundry is limited to specific models. According to the latest documentation, distillation is supported for Microsoft models and a selection of open-source models available in the model catalog.
    Currently, there is no official announcement regarding when this feature will be expanded to support other models, such as DeepSeek. However, you can keep an eye on the Azure OpenAI Service release notes for updates on What's new in Azure OpenAI Service page will be updated accordingly with more details.

    Hope this helps. Do let us know if you have any further queries.

    If this answers your query, do click Accept Answer and Yes for was this answer helpful.

    0 comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.