Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,966 questions
0 answers
ADF Pipeline Fails with Error ‘StatusCode: DFExecutorUserError, Message: Job Failed Due to Reason: Failed to Create a Child Event Loop’ or Succeeds but Does Not Write Any Data at Target
Hi team, My ADF pipeline recently started failing with the following error. My pipeline takes data from Cosmos DB, transforms it, and dumps it as a CSV file into a storage account. Error Message: Operation on target Data_Transfer failed:…
asked 2024-12-03T18:49:01.0833333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(48, 5%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESC%3C/text%3E%3C/svg%3E)
Swetha Cadambi
0
Reputation points Microsoft Employee
asked 2024-12-03T18:49:01.0833333+00:00
Swetha Cadambi
0
Reputation points Microsoft Employee
0 answers
Error loading CSV into Oracle using Copy Data Activity
Trying to load a CSV file into Oracle. I am able to import the schema and map the source to the target. When I go to run the pipeline, I get the following error: UserErrorOdbcOperationFailed Failure happened on 'Sink' side.…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(73.60000000000001, 84%, 17%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ETB%3C/text%3E%3C/svg%3E)
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(288, 61%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EP%3C/text%3E%3C/svg%3E)
2 answers
How do I dynamically read multiple file names?
I am trying to read name of about 20+ csv files, and ingest data dynamically. Below is diagram of how I ingest data from each csv file individually. So, I have at least 20+ pipelines for each csv files. Below is how each csv files' name look like: If I…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(12.8, 39%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKJ%3C/text%3E%3C/svg%3E)
1 answer
How to make build preview
Hi, Please find the docuements - https://learn.microsoft.com/en-us/azure/data-factory/continuous-integration-delivery-improvements To use the build-preview, it is necessary to add build-preview to package.json. However, it does not give any clues how to…
asked 2024-12-03T02:44:03.8166667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(211.20000000000002, 43%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJ6%3C/text%3E%3C/svg%3E)
JP-6279
0
Reputation points
answered 2024-12-03T11:55:19.78+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Smaran Thoomu
17,610
Reputation points Microsoft Vendor
1 answer
How can I update the data source (Azure Storage) for Azure Analysis Services without using the SQLServer module or the Invoke-ASCmd method?
Can I update the data source (Azure Storage) for Azure Analysis Services (AAS) without relying on the SQLServer PowerShell module i.e using the Invoke-ASCmd method to make the changes? Are there alternative approaches or tools available to update the…
asked 2024-12-02T07:15:54.95+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(3.2, 80%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ETC%3C/text%3E%3C/svg%3E)
T, Charandeep
0
Reputation points
commented 2024-12-03T11:42:39.3333333+00:00
Smaran Thoomu
17,610
Reputation points Microsoft Vendor
1 answer
One of the answers was accepted by the question author.
CDC support for Azure PostgreSQL flexible server
Hi, The current ADF do not support Azure PostgreSQL flexible server under Change Data Capture. I this going to be supported in future ? If why when can it be expected ?
asked 2024-11-29T11:34:17.16+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(3.2, 23%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERA%3C/text%3E%3C/svg%3E)
Rohant Agrawal
20
Reputation points
accepted 2024-12-03T11:37:54.8633333+00:00
Rohant Agrawal
20
Reputation points
5 answers
How to Pass File Name from Copy Data Activity to Next Transform Activity ?
Hi, In copy data activity, I am generating a file by extracting data from a DB source. In the copy data activity, I am sinking this to Azure Blob storage under a newly generated file with naming convention…
asked 2024-11-29T10:21:42.5633333+00:00
Rohant Agrawal
20
Reputation points
answered 2024-12-03T11:19:24.74+00:00
Pinaki Ghatak
5,230
Reputation points Microsoft Employee
1 answer
New ServiceNow Connector in ADF(Unable to pass the SQL query in Source side)
Hi Team, How Can I pass the SQL query in ServiceNow dataset while using ServiceNow as Source in ADF Copy Activity As New ServiceNow connector does not support SQL query as per Microsoft docs. It supported in legacy connector so I passed the SQL query…
asked 2024-11-18T10:33:44.7333333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(169.60000000000002, 98%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPC%3C/text%3E%3C/svg%3E)
pankaj chaturvedi
86
Reputation points
commented 2024-12-03T11:09:40.9666667+00:00
Smaran Thoomu
17,610
Reputation points Microsoft Vendor
3 answers
Unable to flatten a complex json object using mapping data flow flatten activity
Hi all, I have a json file with this…
asked 2024-11-26T10:25:04.34+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(147.20000000000002, 31%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMJ%3C/text%3E%3C/svg%3E)
Mariska Janson
0
Reputation points
answered 2024-12-03T10:49:43.59+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(201.6, 18%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGG%3C/text%3E%3C/svg%3E)
Ganesh Gurram
1,825
Reputation points Microsoft Vendor
1 answer
Get data from Azure SQL Database Managed Instance(Linked Service) using Synapse notebook spark pool
I have a linked service from Azure SQL Database Managed Instance and I want to get the data via Synapse spark pool In simple words I want to connect to the Azure SQL Database Managed Instance(Linked Service) and get the data via Synapse Notebook spark…
asked 2024-03-07T13:32:46.88+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(57.599999999999994, 69%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAS%3C/text%3E%3C/svg%3E)
Aditya Singh
160
Reputation points
commented 2024-12-03T10:44:07.03+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(76.8, 37%, 17%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJ%3C/text%3E%3C/svg%3E)
JEichhorn
0
Reputation points
0 answers
How can I update the data source (Azure Storage) for Azure Analysis Services without using the SQLServer module or the Invoke-ASCmd method, preferably using Python?
I am looking for a way to achieve this using Python. Please suggest any tools, libraries, or approaches that can facilitate this, such as using REST APIs or handling XMLA directly. A step-by-step explanation or references would be greatly appreciated.
asked 2024-12-03T10:34:09.55+00:00
T, Charandeep
0
Reputation points
asked 2024-12-03T10:34:09.55+00:00
T, Charandeep
0
Reputation points
0 answers
How to store json data in csv of API which is authenticated using grant_type = password in ADF
We have requirement where we need to generate token using grant type as password and use that token to call API to get data. We need to store this data in CSV file in ADLS. We are able to get the response but are unable to store it in proper json…
asked 2024-12-03T10:16:19.89+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(233.6, 21%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKA%3C/text%3E%3C/svg%3E)
Kukade, Atharva
0
Reputation points
asked 2024-12-03T10:16:19.89+00:00
Kukade, Atharva
0
Reputation points
1 answer
Cannot connect to Azure SQL source from mapping data flow
Hello Microsoft Support, I'm experiencing an issue with Azure Data Factory when executing a Mapping Data Flow that involves a Calendar_Sql source. The Spark job fails with the following error message: Spark job failed: { "text/plain":…
asked 2024-11-27T22:59:11.32+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(259.20000000000005, 32%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMT%3C/text%3E%3C/svg%3E)
Max Teitelbaum
20
Reputation points
answered 2024-12-03T09:59:36.5233333+00:00
Pinaki Ghatak
5,230
Reputation points Microsoft Employee
1 answer
Error: 401 'Microsoft.IdentityModel.Tokens.AudienceUriValidationFailedException' was thrown.
I have used all the correct values here, and I'm receiving an access token from the code below I have given this amount of API permission (for testing purposes ofcourse) but when I access it through the endpoint below: …
asked 2024-12-02T17:55:22.67+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(281.6, 4%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMA%3C/text%3E%3C/svg%3E)
Muhammad Arsal
0
Reputation points
commented 2024-12-03T09:58:22.18+00:00
Muhammad Arsal
0
Reputation points
1 answer
Copy Storage Account to a different resource group.
Hello there, I plan to copy my storage account to a different resource group using the azcopy command. The document below recommends appending the SAS key to the source or destination URL in the command if the authentication method is not Microsoft Entra…
asked 2024-12-03T02:04:47.6466667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(131.20000000000002, 92%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJ%3C/text%3E%3C/svg%3E)
Jessie
85
Reputation points
edited a comment 2024-12-03T09:23:12.28+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(297.6, 81%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAS%3C/text%3E%3C/svg%3E)
Amrinder Singh
5,155
Reputation points Microsoft Employee
0 answers
A pipeline in Azure Data Factory loses certain fields, yet a newly created pipeline with the same setup does not.
In Azure Data Factory, a pipeline consists of two activities: one is a Web Activity and the other is a Copy Data Activity. The pipeline first acquires a token through the Web Activity and then uses the token to retrieve data from the Synapse database.…
asked 2024-12-03T08:15:14.4066667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(211.20000000000002, 59%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EYZ%3C/text%3E%3C/svg%3E)
Yujin Zhu (Shanghai Wicresoft Co Ltd)
0
Reputation points Microsoft Vendor
edited the question 2024-12-03T09:23:05.24+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(64, 60%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHJ%3C/text%3E%3C/svg%3E)
Harshitha Jannapu
530
Reputation points Microsoft Vendor
0 answers
Unable to Apply Certain Filter Conditions (e.g., TriggerName, TriggerBy, Status) in ADF monitor URL Query Parameters
I need a link that navigates to the ADF Monitor page and automatically applies filter conditions, such as triggername, from another site. Currently, I can use a URL like the following to pre-fill the pipelinename filter field on the ADF Monitor…
asked 2024-11-28T06:49:25.46+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(147.20000000000002, 6%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EWS%3C/text%3E%3C/svg%3E)
Weixiao Sun
0
Reputation points Microsoft Employee
commented 2024-12-03T09:05:59.16+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(99.2, 65%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECB%3C/text%3E%3C/svg%3E)
Chandra Boorla
3,950
Reputation points Microsoft Vendor
1 answer
Unable to copy payload from snowflake sql rest api to Azure blob
Hi , I am using web activity to get oauth token and passing subscription key and token to get method source dataset in a copy activity. postman is giving correct result but getting below error:- "Code": 22755, "Message":…
asked 2024-11-10T23:09:03.8133333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(272, 5%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJ%3C/text%3E%3C/svg%3E)
John
190
Reputation points
commented 2024-12-03T08:14:39.0833333+00:00
Chandra Boorla
3,950
Reputation points Microsoft Vendor
2 answers
One of the answers was accepted by the question author.
SMB 3 Implementation in .net core
There isn't any library available to implement network file sharing using SMB3 protocol in .net core. The existing SMBLibrary only supports SMB1 and SMB2. Which library to use for SMB3 implementation?
Azure Files
Azure Files
An Azure service that offers file shares in the cloud.
1,318 questions
Azure Functions
Azure Functions
An Azure service that provides an event-driven serverless compute platform.
5,185 questions
ASP.NET Core
ASP.NET Core
A set of technologies in the .NET Framework for building web applications and XML web services.
4,667 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,966 questions
C#
C#
An object-oriented and type-safe programming language that has its roots in the C family of languages and includes support for component-oriented programming.
11,093 questions
asked 2024-08-20T13:50:11.1766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(297.6, 39%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAR%3C/text%3E%3C/svg%3E)
Aniesha Razdan
40
Reputation points
commented 2024-12-03T06:50:59.1766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(12.8, 89%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
荒井 元成
0
Reputation points
1 answer
Copy Files from sharepoint online site to azure datalake storage
Hello We are trying to setup the flow which will copy files from sharepoint online site to azure datalake storage. As per my understanding there are 2 options : Using ADF to pull the files as mentioned in the link below…
asked 2024-11-06T22:12:34.5+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(102.4, 35%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ES%3C/text%3E%3C/svg%3E)
Sourav
115
Reputation points
commented 2024-12-03T06:13:45.7833333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(304, 6%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKD%3C/text%3E%3C/svg%3E)
Keshavulu Dasari
1,925
Reputation points Microsoft Vendor