Model Distillation in Azure AI Foundry

Question

I'd like to distill a Llama model into a DeepSeek model. According to this page, only very specific model can be used. Is this still true and, if so, do we know when this feature will be available for other models?

Answer 1

Hi Tom Raisbeck,
Yes, as of now, model distillation in Azure AI Foundry is limited to specific models. According to the latest documentation, distillation is supported for Microsoft models and a selection of open-source models available in the model catalog.
Currently, there is no official announcement regarding when this feature will be expanded to support other models, such as DeepSeek. However, you can keep an eye on the Azure OpenAI Service release notes for updates on What's new in Azure OpenAI Service page will be updated accordingly with more details.

Hope this helps. Do let us know if you have any further queries.

---

If this answers your query, do click Accept Answer and Yes for was this answer helpful.