How to get data for all the fields listed there in CRM using Azure data factory
For getting full load data from the CRM database to the Azure SQL database, I am using the table option in the copy source and getting the data for all the columns.
But when I am trying to get incremental data using Query option for which I am using Fetch XML query like below:
<fetch mapping="logical" version="1.0">
<entity name="@{variables('TableName')}">
<all-attributes />
<filter>
<condition attribute ="modifiedon" operator="ge" value="@{variables('TransactionDate')}"/>
</filter>
</entity>
</fetch>
I am not getting data for many of the attributes in the table even though we have data for these columns at the source. I have used all the attribute names in the query and tested, but still no use. Only by using Table option i.e Full load we are getting correct data.
So, is there any workaround solution for getting incremental data from CRM source?
Thanks in advance for your assistance.