I am not able to signup for azure portal because it says my mobile number is not verified
Hi team, Since last 2 days I am trying to signup for the Microsoft azure portal but every time I am getting this error that my mobile number is not getting verified, I even tried with other mobile number and it had the same error please help
Data Factory Copy Activity - SYNC - Stored Proc - Has anyone used generic parameter to use same proc on multiple tables?
I am trying to use the copy activity and in the sync side, use the stored procedure option. It requires two parameters. One of them is a custom data type for the table. Has anyone figured out a way to use a generic parameter so that this same copy could…
ADF - FullandIncremental load with selections, sometimes working but not all the time
Hello ADF Forum, We are using ADF to get the data from SAP ECC extractors (CDC) to snowflake, we have built the data flow with conditions and without conditions. ADF run mode -> "Full and Incremental", when I choose with selections…
access to my organization
I can not access to my organization on Azure DevOps portal. It was CICD pipeline for ADF. this error "401 - Uh-oh, you do not have access. Your account, Mahdi@nematshahimahdigmail.onmicrosoft.com is not authorized to view this page. Make sure the…
ADF Pipeline created using Python fails its first run but succeeds later
Hi, I am using python script to create pipelines in ADF. The issue I am facing is the pipeline gets created but fails its first run with schema not matching or column mapping issues. But Once i click on some of the components but do not make any…
Azure Data Factory pipeline fails randomly with error: "Specified argument was out of the range of valid values"
Hey, Currently I'm struggling with ADF pipeline that fails pretty randomly. It loads multiple tables from sql database to data lake in parquet format. There are 3 retries for copy data activity, sometimes it succeeds on one of the retries, sometimes…
I am getting the below error when I try to insert into a azure data lake table. "Type=System.IO.FileNotFoundException,Message=Could not load file or assembly 'System.Text.Json"
I am getting the below error when I try to insert into a azure data lake table from adf pipeline . "The type initializer for 'Azure.Core.Serialization.JsonObjectSerializer' threw an…
We want to loop all folder and file recursively of BLOB Storage for given container using python in azure data factory custom activity and write data in in blob in .CSV file
Hi All, We want to loop all folder and file recursively of BLOB Storage for given container using python in azure data factory custom activity and write data in in blob in .CSV file. also when we connect blob storage using ADF custom activity using SAS…
Ensuring Private Connectivity for Cross-Cloud Data Transfers Using STS and Azure Data Factory
Hello, I am working on a project where Google Cloud and Azure are connected via a private connection (Cloud Interconnect/ExpressRoute). I need to ensure that data transfers between Google Cloud Storage and Azure Storage happen over this private…
ADF Managed Virtual Network unexpectedly incurring cost in other region
Recently I have implemented denied public access, virtual networking and private endpoints for my SQL Servers, as well as Managed Virtual Networks in my ADF. Everything works as intended, but there was a quick spike in the cost for my ADF, which I…
Data flow failed due to transient error
The ADF data flow failed due to a transient error, and during the retry, some data was already loaded into the sink, leading to duplicate records in the insert scenario. Since I didn't implement CDC at the source level and there are no sink checkpoint…
hi, how can i have the discounts for students for certifications?
I went to https://learn.microsoft.com/es-mx/credentials/certifications/student-discounts to get the discount for some certifications but I already completed the survey but I don't have the discount for the exams
ADF Pipeline "Bad Request" Error when Debug run
Hi all, I have a pipeline in ADF that is incrementally loading objects from Salesforce whose LastModifiedDate is between the last date in my sink (Fabric Warehouse) and the current runtime. I want to do that in a single pipeline now with parameters. The…
Getting this error - "at Source 'source1': com.jcraft.jsch.JSchException: SSH_MSG_DISCONNECT: 11" when previewing data on azure data factory dataflow
I have a dataset that is a csv file existing on azure sftp. I am able to connect to sftp from linked service and able to preview data on the dataset. I have a dataflow where I want to select a few columns from this csv and copy them onto another…
Add a public i.p. to data factory
I'd like to set up a public static i.p. to data factory, so my client could whitelist me in his firewall. I went through all of the documentation, created virtual network(s) & public i.p.(s). When I try to create a new Integration runtime, in the…
DATA FACTORY COPY DATA TO REST API - Failure happened on 'Sink' side. ErrorCode=UserErrorPropertyInvalidOrMissing,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=The property 'additionalHeaders' is invalid or missing.,Sour
DATA FACTORY COPY DATA TO REST API returns Failure happened on 'Sink' side. ErrorCode=UserErrorPropertyInvalidOrMissing,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=The property 'additionalHeaders' is invalid or…
Connect Azure Data Factory to existing VM and run the R script
Need to execute the R script in existing Azure virtual machine on ADF. is this feasible ?
Pipeline throws exception as InvalidParameter for the parameter which is not specified
collectionName is not configured in pipeline ErrorCode=InvalidParameter, Message=The value of the property 'collectionName' is invalid: 'The required property is not specified.\r\nParameter name: collectionName'
Unexpected Activation of Tumbling Trigger Outside Scheduled Time
A tumbling trigger was set to start at 12:00 AM on February 6, 2022, and end at 12:00 AM on September 11, 2022, with a recurrence of every 1440 minutes (once every 24 hours). However, it has activated unexpectedly without manual initiation. What could be…
Changing ADF Trigger changes Advanced Filters in Container Blob EventGrid
Hi, I am using SFTP in a Storage Container set up with an EventGrid that triggers an ADF pipeline when a new file is uploaded to the container. My event grid subscription is set to the filters values you can see in the first attached image. With the…