Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,096 questions
1 answer
Data flow failed due to transient error
The ADF data flow failed due to a transient error, and during the retry, some data was already loaded into the sink, leading to duplicate records in the insert scenario. Since I didn't implement CDC at the source level and there are no sink checkpoint…
asked 2024-12-31T02:11:17.29+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(6.4, 21%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAP%3C/text%3E%3C/svg%3E)
Ananya patil
0
Reputation points
answered 2024-12-31T04:13:42.5433333+00:00
Nandan Hegde
33,001
Reputation points MVP
0 answers
Azure Synapse deployment failure
While creating azure synapse analytics when i deploy the deployment fails with the following error . The request content was invalid and could not be deserialized: Required property 'name' not found in 'sku'. (Code: InvalidRequestContent) Please…
asked 2024-12-31T02:04:43.7433333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(211.20000000000002, 84%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECB%3C/text%3E%3C/svg%3E)
Croydyn Berly
0
Reputation points
asked 2024-12-31T02:04:43.7433333+00:00
Croydyn Berly
0
Reputation points
0 answers
Identify the users with minimum votes and allocate new votes to that user in Synapse SQL
Hello Experts I came up with one problem where I am looking for a solution as I have two tables: Table1: Users |UserID | TotalTasks| | A3 | 12 | | A4 | 14 | | A5 | 11 | Table2: Tasks | TaskID | NewTask| | 1 …
asked 2024-12-27T17:28:31.5566667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(131.20000000000002, 89%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAT%3C/text%3E%3C/svg%3E)
Avanish Tomar
0
Reputation points
commented 2024-12-30T19:39:04.1066667+00:00
Erland Sommarskog
114.6K
Reputation points MVP
0 answers
InvalidHttpRequestToLivy: Submission failed due to error content =["requirement failed: Session isn't active."] HTTP status code: 400.
I searched the web high and low, and cannot find a viable solution. I am using Azure Synapse. I have 24 files within the Gen2 storage account, which I run a loop to read_csv for them all. Then write them into delta table with each run. After around 40…
asked 2024-12-30T09:10:35.3833333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(67.2, 85%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDW%3C/text%3E%3C/svg%3E)
Daniel Wang
0
Reputation points
commented 2024-12-30T18:43:27.38+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(288, 61%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EP%3C/text%3E%3C/svg%3E)
phemanth
12,735
Reputation points Microsoft Vendor
0 answers
requests from synapse pipelines blocked by firewall policy of cosmDB.
hello team, the requests are getting originated from synapse analytics pipelines to nosql coosmosDB. the requests are getting blocked by firewall settings of cosmosdb as the request IPs are different one for every run and requesting through public…
asked 2024-12-04T16:21:38.2566667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(3.2, 98%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAG%3C/text%3E%3C/svg%3E)
ANKIT GHENGE
40
Reputation points
commented 2024-12-30T18:08:28.67+00:00
Oury Ba-MSFT
19,831
Reputation points Microsoft Employee
2 answers
After long running synapse spark notebook failed with HTTP status code: 400 error
Hi, I have created synapse notebook in which using pyspark I am trying to join multiple delta lake tables and writing it to Azure SQL table. The no. of records in delta lake table are 142 million. Executing notebook from synapse pipeline and it is giving…
asked 2022-09-30T07:21:37.717+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(297.6, 52%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHD%3C/text%3E%3C/svg%3E)
heta desai
357
Reputation points
commented 2024-12-30T09:00:01.99+00:00
Daniel Wang
0
Reputation points
0 answers
read new column from .csv
Hi, my csv dataset files have two columns: column1, column2 I have created a serverless sqlpool view which reads the .csv file from the blobstorage container folder... If I want to pull another column, i.e. column3 into the existing .csv files, then the…
asked 2024-12-02T14:41:00.12+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(256, 70%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERN%3C/text%3E%3C/svg%3E)
Rajan,Naveen,US-St. Louis,External
5
Reputation points
edited the question 2024-12-30T07:44:51.96+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(220.8, 4%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESM%3C/text%3E%3C/svg%3E)
ShaktiSingh-MSFT
16,086
Reputation points
2 answers
One of the answers was accepted by the question author.
Deploying Synapse Workspace Subscription Error
I'm attempting to create a Synapse workspace, but I've encountered an error. The following message appears: Location 'eastus' is currently unable to accept new Windows Azure SQL Database servers for the subscription…
asked 2024-09-24T09:55:32.15+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(227.2, 22%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EI%3C/text%3E%3C/svg%3E)
ismaelhamed
20
Reputation points
commented 2024-12-29T00:46:14.9833333+00:00
Zargul Ansari
0
Reputation points
1 answer
How to fix 500 error on postman API
Hello Team, I am trying to create external APIs for my serverless SQL pool on postman. So I have created required access tokens using this URL (`https://login.microsoftonline.com/
asked 2024-12-19T18:39:14.1+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(112.00000000000001, 35%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESM%3C/text%3E%3C/svg%3E)
Shrimathi M
40
Reputation points
commented 2024-12-28T16:55:40.7+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(99.2, 65%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECB%3C/text%3E%3C/svg%3E)
Chandra Boorla
5,835
Reputation points Microsoft Vendor
0 answers
How to limit synapse spark to only send WARN/ERROR logs to log analytics workspace ?
I have followed the steps here: https://learn.microsoft.com/en-us/azure/synapse-analytics/spark/apache-spark-azure-log-analytics But now all the internal driver/executor logs are getting sent to log analytics workspace, which is leading to storage…
asked 2024-12-18T16:08:15.2766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(83.2, 65%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3E_%3C/text%3E%3C/svg%3E)
_user_unknown_
1
Reputation point
commented 2024-12-27T19:14:00.0166667+00:00
phemanth
12,735
Reputation points Microsoft Vendor
1 answer
One of the answers was accepted by the question author.
how to update apache spark pool version from3.3 to 3.4 if don't have any spark pools under the synapse workspace
i dont have spark pools configured under synapse analytics workspaces so how can i update syanpse spark pools to 3.4 version. is there any dependency validation required for this?
asked 2024-10-23T09:51:20.06+00:00
ANKIT GHENGE
40
Reputation points
commented 2024-12-27T15:04:53.09+00:00
ANKIT GHENGE
40
Reputation points
1 answer
Power BI: Azure AD single sign-on (SSO) through the data gateway is disabled for this organization
Hi, We have installed Azure synapse Analytics workspace in a Private endpoint and created a Power BI subnet inside the VNet which is hosting the Synapse dedicated pool. Now we have deployed the VNet gateway and created connection but when we try to…
asked 2023-10-17T22:13:00.1033333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(128, 16%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERK%3C/text%3E%3C/svg%3E)
Rajaniesh Kaushikk
191
Reputation points MVP
commented 2024-12-27T11:26:08.8033333+00:00
Mohsen
6
Reputation points
1 answer
Unable to create synapse workspace - property 'name' not found in 'sku'
I'm trying to create a new synapse workspace and receive the following error. { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for…
asked 2024-12-24T05:57:21.6+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(150.4, 57.99999999999999%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ER%3C/text%3E%3C/svg%3E)
robjkc
0
Reputation points
commented 2024-12-27T08:54:14.8533333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Smaran Thoomu
18,790
Reputation points Microsoft Vendor
2 answers
Getting TokenNotFoundInConfigurationException error when uploading a Python wheel as workspace package in Synpase
Hello Everyone I'm using Azure Synapse to run my Spark pipelines. I've build my pipeline to use a custom library code from utils package of the same project to perform some operation. To access the utils.pipeline file, have packaged my entire project in…
asked 2024-12-25T05:25:33.01+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(83.2, 22%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EM%3C/text%3E%3C/svg%3E)
manigandan
0
Reputation points
commented 2024-12-27T08:52:58.9433333+00:00
Smaran Thoomu
18,790
Reputation points Microsoft Vendor
1 answer
issues in synapse pipelines which accessing the checkpoints key with input parameters
hello team, i am getting synapse analytics pipelines failures with error referring the checkpoint mistaching with the checkpoint in input parameters. tried to check the input as the respective dataflow is fetching data from cosmosDb with CDC approach…
asked 2024-12-20T14:24:05.0233333+00:00
ANKIT GHENGE
40
Reputation points
edited a comment 2024-12-27T07:55:57.2866667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(201.6, 18%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGG%3C/text%3E%3C/svg%3E)
Ganesh Gurram
2,390
Reputation points Microsoft Vendor
1 answer
Deployment Failed in Azure Synapse: SKU 'name' missing error
"I'm trying to deploy an Azure Synapse Workspace and keep encountering the following error: 'The request content was invalid and could not be deserialized: Required property 'name' not found in 'sku'.' The full error is: { "code":…
asked 2024-12-24T13:05:27.6333333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(57.599999999999994, 40%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
azizure
0
Reputation points
commented 2024-12-27T00:51:10.84+00:00
Ganesh Gurram
2,390
Reputation points Microsoft Vendor
1 answer
GIT enabled Synapse Workspace: is there any way to get the current branch name via Python?
Hi, I was wondering if there is any method (or some other way) to retrieve the name of the currently selected GIT branch programmatically within a running Synapse Notebook session using Python. To make thinks even more complicated: the Synapse…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(297.6, 42%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMB%3C/text%3E%3C/svg%3E)
1 answer
One of the answers was accepted by the question author.
How to Execute DROP VIEW Command in Synapse Notebook with SQL Serverless Pool Connection?
How to Connect Synapse Notebook to SQL Serverless Pool for Executing DROP VIEW Command? I’m working with Azure Synapse Analytics and need to connect my Synapse Notebook to a SQL Serverless Pool to directly drop and create views. However, when I try…
asked 2024-12-23T13:16:04.3133333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 56.00000000000001%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EM6%3C/text%3E%3C/svg%3E)
MulluriNivas-6816
100
Reputation points
accepted 2024-12-26T14:15:43.5666667+00:00
MulluriNivas-6816
100
Reputation points
1 answer
Issue with Corrupted Azure Synapse Workspace During Creation
An issue has arisen with an Azure Synapse Analytics workspace during its creation process. Due to an error or misconfiguration during setup, the workspace became corrupted. As a result, the workspace is in a non-functional state and cannot be deleted or…
asked 2024-12-23T12:56:24.19+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(128, 68%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBT%3C/text%3E%3C/svg%3E)
Bram Teunis
0
Reputation points
commented 2024-12-26T02:33:56.85+00:00
Smaran Thoomu
18,790
Reputation points Microsoft Vendor
1 answer
unable to edit dataflow in synapse after creating it.
I have created dataflows in Pipeline but they are not editable. I am clicking on it to edit but it's not opening for me to edit
asked 2024-12-22T14:55:07.7+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(236.8, 39%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ES%3C/text%3E%3C/svg%3E)
Swarnima
0
Reputation points
commented 2024-12-25T13:53:49.23+00:00
Chandra Boorla
5,835
Reputation points Microsoft Vendor