i cannot find add directory inside container
SharedScreenshot.jpg
Getting below error while try to connect with Azure SQL Database using linked service through Azure Data Factory
Please Check Below error:- Cannot connect to SQL Database. Please contact SQL server team for further support. Server: 'cms-data-cleansing-poc.database.windows.net', Database: 'datacleansingdb', User: 'admindata@poc'. Check the linked service…
DeltaCopyDatabase
Where can we find the Delta copy from Database template in ADF referred in this article - https://learn.microsoft.com/en-us/azure/data-factory/solution-template-delta-copy-with-control-table
ADF billing is high
Hi, I had asked about the cost of scheduled as well as manual triggers as per answer in the below thread no matter whether it is manual or scheduled triggers the cost applicable in the pipeline activities involved.…
How we can extract Oracle eloqua bulk api objects using Oracle Eloqua Connector in adf
We want to ingest activities data from eloqua to snowflake using Oracle Eloqua Connector but we can't see activities table. But we are able to ingest activities data from eloqua bulk api. What is the reason?
Connecting to SFTP Source in App Fabric using SSH Private Key
I'm trying to establish a connection to an SFTP source in Azure App Fabric, but I'm encountering a roadblock. While Azure Data Factory offers various authentication methods like SSH and Basic, I haven't found similar options in App Fabric. Options…
How to use a private key to connect to an SFTP datasource in AppFabric?
I am creating my first data factory in app fabric. One feature I found missing is that I cannot connect to a SFTP source unless, I have basic authentication. In the previous version of Azure Data Factory, I had an option of selecting the authentication…
ADF Copy data activity pagination with continuation token with GET request
I am building ETL pipeline in Microsoft Fabric, ADF service to load data from API, but I am having difficulties implementing pagination rules with continuation token. I know that, according to Azure documentation, it should be possible to use this…
How to check text in row 1 of Excel file for about 10 column headers?
I'm using Azure Data Factory (ADF) on the portal. I use the latest Chrome browser to get to ADF. I'm not an admin and have no admin rights. I have an Excel file I want to read. I'm still fairly new to ADF. I'm guessing this could be done in a data flow.…
I am getting a BadRequest error while running adf pipeline which contains mapping data flow activity
Hi, I am getting BadRequest error while running adf pipeline which contains data flow activity. It was running fine previously.
Is it possible to use function encrypt HmacSHA256 on Azure Data Factory ?
Hi All, I have ADF Pipeline to call some API and that API required signature (encrypt HmacSHA256) for authenticate in body. Is it possible to use function encrypt HmacSHA256 on Azure Data Factory ? or Do you have any solution to encrypt HmacSHA256 on…
Dynamic Array Mapping in ADF Copy Activity
I'm attempting to set up dynamic mapping between blob storage in an ADF (Azure Data Factory) Copy activity. In the mapping section, I'm trying to add an additional column using dynamic content from a set variable that is an array. However, I encounter…
Copy Files from sharepoint online site to azure datalake storage
Hello We are trying to setup the flow which will copy files from sharepoint online site to azure datalake storage. As per my understanding there are 2 options : Using ADF to pull the files as mentioned in the link below…
Transforming JSON files using data flow
Hello! I currently have about 60 json files inside a blob container which most of them have different fields and values. I have created a pipeline with a get metadata activity that points to the container, with the field list set to Child items. I have…
ODATA doesn't support expand in ADF
Hi, The expand verb does not seem to work in ADF with the ODATA connector. This means that we cannot fetch the child / nested items. The select works fine but not expand. Anyone has experience or workaround with this ?
Authentication failure with linked service. Linked service exist in corp tenant and data factory exist in torus tenant. How do I resolve this issue, is it possible to raise exception so that authentication will be success.
Operation on target Execute dataflow failed: {"StatusCode":"DFExecutorUserError","Message":"Job failed due to reason: Client initialization failed. Check if the endpoint is reachable and if your auth token is valid.…
Parametrization for connection string is not working in linked service
Hi there, I have solution - data pipeline in Synapse taking data from mysql database. I need to parametrize it to be able run process across many environemnts (CI/CD). I set many linked services with code referencing on variable in yml file in style…
Unable to create dynamic linked service for Microsoft Access database
Hi Team I am trying to create Linked service for Microsoft Access database using dynamic connection string where i am passing connection string value through parameter, test connection working fine but I am getting following error while saving the linked…
Cannot reference to an invalid or deleted Credential object for Fabric Linked Service
Getting this error after refreshing ADF page , credentials is getting removed from Fabric Warehouse Linked Service . Seems a similar problem like…