Creating a pipeline to map data from Salesforce to Business Central using Azure Data Factory

Question

Hi everyone,

I’m working on creating a pipeline to map data from Salesforce to Business Central using Azure Data Factory. Here are the steps I’ve taken so far:

1. Copy Data: I’m using the Copy Data activity to get the data into a CSV file.
2. Azure Blob Storage: I’m getting the data into a CSV from Salesforce using Azure Blob Storage as a Linked Service.
3. ForEach Activity: I’m iterating over the CSV using a ForEach activity, in which I’m using another Copy Data activity to use Blob Storage as a source.
4. Web Activity: I’m using a Web activity to push the data using a POST request.

Answer 1

Hi Vaibhav Patil ,

Thankyou for using Microsoft Q&A platform and posting your query here.

As I understand your query, it seems you are trying to load the data from Salesforce to Business Central using ADF pipeline .

I have gone through the above mentioned steps that you are trying to follow . Could you please confirm what is the sink datastore for the copy activity inside foreach in your pipeline? I assume it's either Dynamics 365 or Dynamics CRM?

I would also like to confirm the reason why are you going for such long approach of first loading the data into Blob in csv and then iterating through each records and then one by one loading it into the destination?

Instead, you could directly use a single copy activity and place salesforce dataset as source and Dynamics dataset as sink and execute the copy activity.

Copy and transform data in Dynamics 365 (Microsoft Dataverse) or Dynamics CRM using Azure Data Factory or Azure Synapse Analytics

Kindly let me know if there is any gap in my understanding. Thankyou