Deploy a Scheduled ML Pipeline in Azure with GitHub Integration

Question

Hello,

I am completely new to Azure and I need to deploy my model to run on Azure. Basically I have a pipeline.py file that runs every step of my application and connects all the other .py files located in she src/ folder, which is basically the following:

1. Read Image from Azure Blob Storage
2. Load my model weights which is also in Blob
3. Preprocess the image and read metadata
4. Perform segmentation on each image
5. Store the results in Azure PostGreSQL Database

This pipeline uses a deep learning model, I need to be able to scale up the resources if needed. It should run every day at a specific time. What would be the best option here? I also would like to connect to GitHub.

Thanks in advance.

Answer 1

Amanda Costa Spolti Greetings & Welcome to Microsoft Q&A forum!

You can deploy your machine learning model on Azure, scale resources as needed, schedule daily runs, and integrate with GitHub for version control and CI/CD. Azure provides a robust set of tools to help you manage and deploy machine learning applications efficiently.

I would suggest you start with the following documentations and do let me know if you have any specific queries.

Create and run machine learning pipelines with Azure Machine Learning SDK

Schedule machine learning pipeline jobs and Publish machine learning pipelines

Use GitHub Actions with Azure Machine Learning

Manage inputs and outputs for components and pipelines and Set up MLOps with GitHub