adf_publish an Main branch in ADF

Santhi Dhanuskodi 325 Reputation points
2024-03-13T05:07:46.6733333+00:00

hi,

I would like to understand about adf_publish branch. Wat is this branch used for? what code it contains? Main branch is the final or producation ready branch which contains the latest and working copy of all pipelines, dataflows and datasets.

Why we need to publish? after publishing, how it works and from where these pipelines run?

I want to understand from code perspective. I have heard that they are used in ci/cd pipeline for deployments in diff environments. But that dotn create any branches specific to any env. It will be single repos. Where the code is picked up for other environments?

Theory or documentation on these is not helping me to understand the flow, how and what code is used and the stages of execution etc,

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,340 questions
{count} votes

2 answers

Sort by: Most helpful
  1. AnnuKumari-MSFT 34,351 Reputation points Microsoft Employee
    2024-03-13T08:08:13.5433333+00:00

    Hi Santhi Dhanuskodi ,

    Thankyou for using Microsoft Q&A platform and thanks for posting your query here.

    • Git integration in ADF consists of selecting two branches Collaboration branch / Master branch Publish branch
    • Collaboration branch is where all the feature(local) branch is merged .
    • Publish branch is where all the changes including auto generated ARM templates gets published (by default, ADF creates ‘adf_publish’ branch for that).
    • Once the changes are merged and published , would generate the ARM template and store them in adf_publish branch.
    • DevOps Release pipeline would be configured to create a new release and deploy the ARM template each time a new change is pushed to the publish branch.

    Automated publish improvement in ADF's CI/CD flow - Microsoft Community Hub

    For better understanding , kindly watch out this video : Continuous integration and deployment in ADF

    If you want to avoid manual publishing you can implement NPM package to automate publishing for CICD

    Hope it helps. Kindly accept the answer by clicking on Accept answer button. Thankyou

    3 people found this answer helpful.

  2. Santhi Dhanuskodi 325 Reputation points
    2024-03-13T13:47:46.7966667+00:00

    I am trying to visualize the execution of pipelines, from where the code is picked up adf_publish or main...how it picks up code for other env?


Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.