Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,163 questions
1 answer
One of the answers was accepted by the question author.
Aggregate Functions Supported for Cube, Rollup and Grouping Set in serverless sql pool
Hello, The count distinct SQL Function does not work correctly when we use cube/rollup/grouping sets. I get below error when i try to join two open rowset datasets and perform count distinct. I could not find any documentation on list of SQL functions…
asked 2025-02-04T09:43:45.0833333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(48, 57.99999999999999%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESS%3C/text%3E%3C/svg%3E)
Suraj Shashidhar
0
Reputation points
commented 2025-02-04T10:30:16.6766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Smaran Thoomu
19,630
Reputation points Microsoft Vendor
0 answers
Transport-Level Error in SQL Query Execution Across Environments
A query runs correctly in SSMS when connected to the Synapse development environment, but it throws an error in the production environment. The data volume is the same in both environments for all tables used in the query. ERROR DETAILS: A…
asked 2025-02-03T14:51:02.33+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(220.8, 46%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESB%3C/text%3E%3C/svg%3E)
Surabhi B N
0
Reputation points
commented 2025-02-04T09:40:25.4833333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(288, 61%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EP%3C/text%3E%3C/svg%3E)
phemanth
13,620
Reputation points Microsoft Vendor
1 answer
Is there a feature in Azure Synapse Analytics similar to Databricks' DBFS FileStore system?
Specifically, I'm looking for a way to upload CSV files and read them directly into pandas dataframes within Azure Synapse notebooks without having to load the data into a database. In Databricks, I can easily do this using: …
asked 2025-02-03T11:06:11.5233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(300.8, 15%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EG2%3C/text%3E%3C/svg%3E)
Gabriel-2005
425
Reputation points
commented 2025-02-04T09:38:16.97+00:00
Smaran Thoomu
19,630
Reputation points Microsoft Vendor
0 answers
quota increase Synapse pipelines in a Synapse workspace
Hello, I need help to understand how workspace limit can be extend , associated process and cost. As we know with Default azure synapse configuration we have below given limit of artifacts Resource - Synapse pipelines in a Synapse workspace Default…
asked 2025-02-04T09:18:20.8566667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(67.2, 23%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECM%3C/text%3E%3C/svg%3E)
Chioaru, Monalisa
1
Reputation point
asked 2025-02-04T09:18:20.8566667+00:00
Chioaru, Monalisa
1
Reputation point
1 answer
Azure Synapse pipeline
Hi, I have a question regarding Synapse. I want to create a pipeline that can delta update the target table “quotes_target” from source table “quotes_source” with filtered quotes data. I have a list of quotes id of the updated quotes after I extracted it…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(89.60000000000001, 14.000000000000002%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EL%3C/text%3E%3C/svg%3E)
2 answers
How to stop ForEach activity if previous itertion fails in ADF/Synapse pipeline
I am trying to pull multiple tables from a Azure SQL Database . When data is loaded to its destination I am calling an SP that will update the status of a table to Success. Using ForEach activity multiple tables are puling. But, While pulling one table…
asked 2022-06-13T19:20:26.183+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(297.6, 52%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHD%3C/text%3E%3C/svg%3E)
heta desai
357
Reputation points
commented 2025-02-03T23:41:52.31+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(166.4, 23%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESW%3C/text%3E%3C/svg%3E)
Sasha Whittaker (CSPS-EFPC)
0
Reputation points
0 answers
How to control access to a folder in ADLS gen2 container while Storage account IAMs are in action
Hi, I have a synapse pipeline that saves an output file in a folder (ex: salary) in an ADLS container (ex: employee). Now Mr. X wants the data saved in the folder to be accessible only to him but storage account level IAMs have already given access to…
asked 2025-02-03T19:28:59.77+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(16, 74%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ES%3C/text%3E%3C/svg%3E)
SP
0
Reputation points
edited a comment 2025-02-03T19:45:56.8366667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(304, 6%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKD%3C/text%3E%3C/svg%3E)
Keshavulu Dasari
3,170
Reputation points Microsoft Vendor
1 answer
About partitioned parquet files on ADLS2
Hi everyone. I have the following scenario: a ADF pipeline stores a partitioned parquet file on ADLS2 a Synapse Spark Pool will read the data The partitioned data looks like this (step 1): Is this an optimal way of storing parquet data that will…
asked 2025-02-02T00:06:17.82+00:00
Jona
515
Reputation points
edited the question 2025-02-03T03:34:35.2166667+00:00
Nandamuri Pranay Teja
570
Reputation points Microsoft Vendor
1 answer
Creating external table by using for each loop and SQL procedure
Hi I am completely new to azure synapse analytics. I am trying to create external tables using parquet files stored in the list of folders in a container (azure data lake storage) I have created note book which return the sub folder name and the parquet…
asked 2025-01-30T10:50:29.7866667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(86.4, 30%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENH%3C/text%3E%3C/svg%3E)
Nimesha Hansani Amarasinghe
0
Reputation points
commented 2025-02-03T01:28:53.2866667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(99.2, 65%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECB%3C/text%3E%3C/svg%3E)
Chandra Boorla
7,490
Reputation points Microsoft Vendor
1 answer
Azure identity package issue after updating pyspark from 3.3 to 3.4.1
I've updating my PySpark Synapse project to use 3.4.1 Spark instead of 3.3. After upgrade, it works locally but fails on Synapse with AttributeError: module 'x509' has no attribute 'VerifiedClient'. Bottom of call stack: File…
asked 2025-01-30T08:01:13.2633333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(259.20000000000005, 99%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EI%3C/text%3E%3C/svg%3E)
Ivan
0
Reputation points Microsoft Employee
commented 2025-02-03T01:19:54.66+00:00
Chandra Boorla
7,490
Reputation points Microsoft Vendor
1 answer
How to fix "Failed to upload block This request is not authorized to perform this operation." error while writing a csv to ADLS Gen2 using synapse notebook
I am trying to write a dataframe into a csv file on ADLS Gen2 using Synapse Notebook. I am using pandas to_csv as below. The 'linkedService': 'xxxxx' uses system assigned managed identity which has the "Storage Blob Data Contributor" role…
asked 2025-01-30T21:07:29.7933333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(179.20000000000002, 82%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPB%3C/text%3E%3C/svg%3E)
Pranav Babu - O365 Admin Account
0
Reputation points
commented 2025-02-03T00:36:57.5033333+00:00
Chandra Boorla
7,490
Reputation points Microsoft Vendor
3 answers
Error using model.fit() in Synapse Apache Spark notebook
I have an unpredictable error. com.fasterxml.jackson.databind.exc.MismatchedInputException: No content to map due to end-of-input at [Source: (String)""; line: 1, column: 0] I would like to train a time series model using SARIMAX with four…
asked 2023-07-17T14:39:07.5533333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(195.2, 54%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAK%3C/text%3E%3C/svg%3E)
Abdelmonim Klaii
20
Reputation points
commented 2025-02-02T13:09:42.04+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(214.4, 79%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMA%3C/text%3E%3C/svg%3E)
Maryam Aamir
0
Reputation points
1 answer
Error on creating Synapse Spark database
Hi every one, I'm trying to create a database in Synapse Spark Notebook, but I'm getting this error: The very same error appears without the keyword LOCATION Regards Jona
2 answers
The Azure Synapse resource provider (Microsoft.Synapse) needs to be registered with the selected subscription
Hi Team, I am unable to use synapse analytics even though I have registered with Microsoft.Synapse and Microsoft.Sql. Can you please look into this? The below is screenshot for registered ones.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(297.6, 4%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESV%3C/text%3E%3C/svg%3E)
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(313.6, 40%, 40%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EY%3C/text%3E%3C/svg%3E)
1 answer
Getting an error in Azure Synapse when trying to start a session
LivyHttpRequestFailure: Something went wrong while processing your request. Please try again later. HTTP status code: 500. Trace ID: 31f333c2-2aec-485c-b314-be206390c5ba. Getting this when I try to start a session in both Dev or Test resource groups.
asked 2025-01-30T20:33:40.2833333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(243.2, 55.00000000000001%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJF%3C/text%3E%3C/svg%3E)
John Fisher
20
Reputation points
commented 2025-01-31T19:31:26.1666667+00:00
Chandra Boorla
7,490
Reputation points Microsoft Vendor
3 answers
Datetime2 error when querying parquet file produced from Synapse copy activity from OData Business Central Source (data seems to be changed from 0001-01-01 to 0000-12-30)
I have a pipeline running a copy activity to copy data from Business Central OData source to parquet file everyday. Everything works fine before 16/07/2024 but problem arises starting from 17/07/2024. The parquet file no longer be able to query from…
asked 2024-07-24T15:13:17.94+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(233.6, 10%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVC%3C/text%3E%3C/svg%3E)
Victor Chu
15
Reputation points
edited a comment 2025-01-31T17:04:51.4066667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(70.4, 46%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJS%3C/text%3E%3C/svg%3E)
Jeff S
0
Reputation points
1 answer
Not able to see IP Firewall rules changes under resourcechanges
Hi, Given a Synapse workspace who is associated to an alert and where the alert rule is configured as the Signal "Create/Update server firewall rule (servers/firewallRules)", when the configuration of the Firewall rules under Synapse…
asked 2025-01-28T22:29:10.42+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(172.8, 68%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJ1%3C/text%3E%3C/svg%3E)
Julio-14
0
Reputation points
commented 2025-01-31T04:06:58.9666667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(201.6, 18%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGG%3C/text%3E%3C/svg%3E)
Ganesh Gurram
3,675
Reputation points Microsoft Vendor
2 answers
why allocated v-core is always 0?
why allocated v-core is always 0? how to change it?
asked 2025-01-28T20:14:37.78+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(70.4, 71%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EYW%3C/text%3E%3C/svg%3E)
Yi Wang
0
Reputation points Microsoft Employee
commented 2025-01-31T04:00:43.4433333+00:00
Ganesh Gurram
3,675
Reputation points Microsoft Vendor
1 answer
Azure Synapse Notebook does't fail immediately in case of error in code
Hello, I am struggling with really weird behavior when executing a notebook within Azure Synapse. I am utilizing pyspark and sql within this notebook and noticed that the notebook doesn't fail immediately in case of a bug or let's say typo in a code. For…
asked 2025-01-23T18:26:28.9+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(182.40000000000003, 38%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPP%3C/text%3E%3C/svg%3E)
Peter Polacek
25
Reputation points
commented 2025-01-30T16:42:06.5633333+00:00
Chandra Boorla
7,490
Reputation points Microsoft Vendor
1 answer
One of the answers was accepted by the question author.
Using this mssparkutils.notebook.runMultiple function to run notebook in parallel, how to find the failed notebook.
Hi Team, Could you please help us to find the failed notebook in parallel run using the below code, but not able to find the failed one. Eg: If any notebook got failed it is stopping the processs, but we don't know which notebook failed , can you…
asked 2025-01-29T09:02:16.5633333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(163.2, 22%, 25%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESM%3C/text%3E%3C/svg%3E)
SaiSekhar, MahasivaRavi (Philadelphia)
100
Reputation points
commented 2025-01-30T13:52:19.5233333+00:00
SaiSekhar, MahasivaRavi (Philadelphia)
100
Reputation points