Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,186 questions
0 answers
Error 1502
Im new to Azure....We have spark job thats has been running just fine for a long time we've had some issues with the data format lately but the pipeline was breaking in a different place than now. Now Im getting this error "errorCode":…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(6.4, 52%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ES%3C/text%3E%3C/svg%3E)
0 answers
How to query Azure sql DB using Synapse Notebooks
I want to query my azure sql db from azure synapse notebook. I have linked connection working and can use copy activities to read and write data from said synapse workspace to that db. What i would like to do is query that db straight from notebooks so i…
asked 2025-02-14T08:35:51.3333333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(28.799999999999997, 7.000000000000001%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJH%3C/text%3E%3C/svg%3E)
Jani Hämäläinen
80
Reputation points
commented 2025-02-14T20:13:31.7233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(288, 61%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EP%3C/text%3E%3C/svg%3E)
phemanth
13,795
Reputation points Microsoft Vendor
1 answer
Azure Synapse managed Vnet default routing through an NVA firewall
We have deployed a synapse instance with a managed vnet, We also have deployed a palo alto azure fw appliance that we want to inspect all traffic with. i understand I can use Private endpoints when communicating with synapse from other vnets and we have…
asked 2025-02-13T19:44:08.5733333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(6.4, 82%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESS%3C/text%3E%3C/svg%3E)
Shawn Schiebrel
0
Reputation points
commented 2025-02-14T18:43:50.78+00:00
phemanth
13,795
Reputation points Microsoft Vendor
1 answer
Synapse notebook script runs ok but stops on time out and stuck in queued in pipelines
I have a python script in a notebook that performs a parquet file schema correction. It is working fine, runs in less than 10 seconds, depending on the number of files to process. Now I need to run it in a pipeline that correct schemas and then send…
asked 2025-02-12T12:27:57.79+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(236.8, 39%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERS%3C/text%3E%3C/svg%3E)
Ricker Silva
0
Reputation points
edited a comment 2025-02-14T17:20:37.5733333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(201.6, 18%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGG%3C/text%3E%3C/svg%3E)
Ganesh Gurram
3,930
Reputation points Microsoft Vendor
1 answer
Disabling for Index of Azure Synapse Dedicated sql pool
Hi, I am having an Azure synapse dedicated sql pool instance but wanted to disable the default index creation as part creating the tables. Please let me know all steps around doing that. Also let me know how much better performance and storage do we get…
asked 2025-02-13T12:50:35.6466667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(294.40000000000003, 33%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENS%3C/text%3E%3C/svg%3E)
Nitish Sharma
0
Reputation points
commented 2025-02-14T13:50:46.7633333+00:00
Ganesh Gurram
3,930
Reputation points Microsoft Vendor
0 answers
Azure synapse spark start-up fail: CLUSTER_CREATION_TIMED_OUT: Livy session has failed.
Since a few days none of my spark pools in Azure synapse analytics are able to start-up. After trying for 15 minutes to start, I either get this message: LivySessionCreationTimeoutException: Livy session creation timed out. workspace: we-psch-a-data-syn,…
asked 2025-02-13T08:09:40.0633333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(230.39999999999998, 24%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPT%3C/text%3E%3C/svg%3E)
Pieter Tjerkstra
5
Reputation points
commented 2025-02-14T11:29:57.18+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Smaran Thoomu
20,285
Reputation points Microsoft Vendor
2 answers
Azure Synapse pipeline
Hi, I have a question regarding Synapse. I want to create a pipeline that can delta update the target table “quotes_target” from source table “quotes_source” with filtered quotes data. I have a list of quotes id of the updated quotes after I extracted it…
asked 2025-01-17T09:16:28.69+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(89.60000000000001, 14.000000000000002%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EL%3C/text%3E%3C/svg%3E)
Lotus88
46
Reputation points
commented 2025-02-14T11:03:37.0433333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(99.2, 65%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECB%3C/text%3E%3C/svg%3E)
Chandra Boorla
8,230
Reputation points Microsoft Vendor
0 answers
SharePoint List not showing in Azure Synapse Analytics
I have been setting up SharePoint List and Pulling the data into Azure Synapse Analytics for Power BI report for long time through Linked Service. This time set up a Linked Service. I can see the SharePoint List from Azure Synapse Analytics Studio but…
asked 2025-02-12T16:32:49.83+00:00
Gabe
1
Reputation point
commented 2025-02-14T10:20:46.39+00:00
Chandra Boorla
8,230
Reputation points Microsoft Vendor
1 answer
Synapse with DL and network restrction using Resource instances
Hello, I am at a loss so would greatly appreciate any assistance. I have created a synapse workspace with managed network and a Datalake gen2 as a linked service. The problem is that I am unable to manage the linked DL from Synapse studio as I just get…
asked 2022-04-05T07:56:57.997+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(195.2, 30%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ET%3C/text%3E%3C/svg%3E)
theodorbrander
56
Reputation points
answered 2025-02-14T08:14:56.9733333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(124.80000000000001, 88%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJ%3C/text%3E%3C/svg%3E)
JonasK
0
Reputation points
3 answers
One of the answers was accepted by the question author.
ADF Pipelines to Synapse or Fabric
Hi there, I would like to know if the actively running ADF pipelines could be copied and restored into Synapse or Fabric? (lift and shift). If possible Across accounts (to use as templates across accounts and customize/tune ADF pipelines little bit in…
asked 2025-02-11T17:48:15.4033333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(272, 69%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ER%3C/text%3E%3C/svg%3E)
RJ
326
Reputation points
commented 2025-02-14T07:53:24.98+00:00
Chiugo Okpala
160
Reputation points MVP
1 answer
One of the answers was accepted by the question author.
Is Azure Synapse Analytics expected to support Spark 3.5 in the near future?
Is Azure Synapse Analytics expected to support Spark 3.5 in the near future? Spark 3.5 allows to use Delta Lake 3.0 version which improved overall performance significantly. https://delta.io/blog/delta-lake-performance/ Apache Spark 3.5 compatible…
asked 2025-02-10T15:39:23.9866667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(35.2, 89%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAS%3C/text%3E%3C/svg%3E)
Akjol Syeryekkhaan
20
Reputation points Microsoft Employee
accepted 2025-02-13T20:59:12.2266667+00:00
Akjol Syeryekkhaan
20
Reputation points Microsoft Employee
1 answer
Github interaction with synapse
We have github repo which is connected to our synapse environment, anytime someone configure git it makes a commit to master branch, actually we want to pull the updates from github rather than updating from synapse to git
asked 2025-02-11T06:16:22.45+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(272, 61%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ETA%3C/text%3E%3C/svg%3E)
Tailor, Anurag
0
Reputation points
commented 2025-02-13T12:53:26.5533333+00:00
Chandra Boorla
8,230
Reputation points Microsoft Vendor
2 answers
One of the answers was accepted by the question author.
How to use linked service in Notebook with pyspark
I have pyspark script in Notebook to read and write data in ADLS Gen2. Below is an sample of the pyspark script. But in the Synapse I only have a linked service created with Service Principle could connect to the ADLS Gen2, so I need to specify in…
asked 2023-03-31T04:24:40.7333333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(92.8, 38%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESP%3C/text%3E%3C/svg%3E)
Shao Peng Sun
91
Reputation points
commented 2025-02-13T11:38:00.3+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(211.20000000000002, 73%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERS%3C/text%3E%3C/svg%3E)
Rajan Sethi
5
Reputation points
1 answer
One of the answers was accepted by the question author.
Compatibility of STRING_SPLIT function inside store procedure for Azure synapse serverless sql pool
I am trying to create a stored procedure in Azure synapse serverless sql pool. The STRING_SPLIT function works fine when used in a select statement but not inside store procedure. I receive an error that it is not recognized. The database compatibility…
asked 2025-02-12T16:03:14.8066667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(48, 57.99999999999999%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESS%3C/text%3E%3C/svg%3E)
Suraj Shashidhar
65
Reputation points
accepted 2025-02-13T10:18:07.35+00:00
Suraj Shashidhar
65
Reputation points
1 answer
Binary file copy activity is corrupting the file during copy from blob storage to azure file
I am currently working on copying files from blob storage to Azure Files. For the most part, the copy activities have been running smoothly. However, we have recently encountered an issue where the content of some files appears to be corrupted after…
asked 2025-02-11T10:02:03.9866667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(64, 96%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVA%3C/text%3E%3C/svg%3E)
Vivek, Anand
20
Reputation points
commented 2025-02-13T08:57:04.38+00:00
Smaran Thoomu
20,285
Reputation points Microsoft Vendor
1 answer
How to use set variable data in copy transformation for querying in where clause condition (DB-CosmosDB)
Hello all , Here I am trying to get the data from lookup and setting it as a variable and when I try to use it in copy transformation I am getting error. adding the snapshots-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(12.8, 24%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBD%3C/text%3E%3C/svg%3E)
1 answer
I am trying to use the default sql storage of synapse ws as the sink for my data, but it throws logon failure
Here is the error I am getting Cannot connect to SQL database: 'jdbc:sqlserver://<synapse workspace name>.sql.azuresynapse.net:1433;database={Built-in}', 'Managed Identity (factory name): <synapse workspace name>'.[SQL Exception]Error…
asked 2025-02-07T12:14:52.76+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(140.8, 26%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESN%3C/text%3E%3C/svg%3E)
Seema Nair
0
Reputation points
commented 2025-02-12T15:30:53.6366667+00:00
Ganesh Gurram
3,930
Reputation points Microsoft Vendor
3 answers
SSL/TLS CONNECTION ISSUE
Hi Team, when i run the pipeline i got error like below. Failure happened on 'Source' side. ErrorCode=UserErrorFailedToConnectOdbcSource,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=ERROR [HY000] [Microsoft][DriverSupport]…
asked 2023-09-13T15:39:28.32+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(51.2, 64%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERB%3C/text%3E%3C/svg%3E)
Ram Babu
80
Reputation points
answered 2025-02-12T15:12:30.74+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(44.800000000000004, 72%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ETD%3C/text%3E%3C/svg%3E)
Tran, Duc-Trung (Allianz Commercial)
0
Reputation points
2 answers
Cosmos Synapse Link - SQL Serverless Query
Please describe your issue below I have a Cosmos database in Well-Defined schema mode. I have a Synapse Serverless SQL instance. I have documents in Cosmos with objects that contain fields with null values. When I create a View for the Container in SQL…
asked 2024-12-03T09:26:57.8133333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(243.2, 78%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDB%3C/text%3E%3C/svg%3E)
David Baker
5
Reputation points
answered 2025-02-12T12:41:04.3833333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(38.4, 15%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EM%3C/text%3E%3C/svg%3E)
Manuel
0
Reputation points
2 answers
Is Azure Synapse being discontinued?
Hello everyone! I recently heard that Microsoft might be discontinuing the development of Azure Synapse, and I’d like to know more about it if that’s the case. If it is being deprecated, is there an alternative to Serverless SQL Pool? I know Databricks…
asked 2025-02-10T12:10:09.0033333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(249.60000000000002, 40%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EES%3C/text%3E%3C/svg%3E)
EDUARDO SOARES AZZOLIN
0
Reputation points
edited the question 2025-02-12T10:49:31.9+00:00
Smaran Thoomu
20,285
Reputation points Microsoft Vendor