Is there any Azure AI inference as a service like Amazon Bedrock

Question

Hi guys,

I am trying to do inference as a service so I dont have to run models on my dedicated servers all the time. Is there anyway I can do this like Amazon BedRock? One thing is that you can's host custom model with LoRA on BedRock, it would be great if I can do this here on Azure.

Hosting this on a dedicated A100 is quiet expensive especially for testing.

Best,

Peter

Answer 1

Hello Peter Ma,

Thanks for your question.

There are many inference-as-a-service options similar to Bedrock. Azure offers trained foundation models via Azure AI Studio.

See the AI catalog here: https://azure.microsoft.com/en-us/products/ai-model-catalog

Links you may find helpful:

https://techcommunity.microsoft.com/blog/educatordeveloperblog/getting-started-with-azure-ai-studio/4095602

https://azure.microsoft.com/en-us/products/ai-services/openai-service/
https://azure.microsoft.com/en-us/products/machine-learning/to deploy custom AI models

You can mark it 'Accept Answer' and 'Upvote' if this helped you

Regards,

Abiola

Answer 2

Hello Peter Ma,

Thanks for your question.

There are many inference-as-a-service options similar to Bedrock. Azure offers trained foundation models via Azure AI Studio.

See the AI catalog here: https://azure.microsoft.com/en-us/products/ai-model-catalog

Links you may find helpful:

https://techcommunity.microsoft.com/blog/educatordeveloperblog/getting-started-with-azure-ai-studio/4095602

https://azure.microsoft.com/en-us/products/ai-services/openai-service/
https://azure.microsoft.com/en-us/products/machine-learning/to deploy custom AI models

You can mark it 'Accept Answer' and 'Upvote' if this helped you

Regards,

Abiola