5,155 questions with Azure Synapse Analytics tags

Sort by: Updated
2 answers

Azure Synapse Notebook does't fail immediately in case of error in code

Hello, I am struggling with really weird behavior when executing a notebook within Azure Synapse. I am utilizing pyspark and sql within this notebook and noticed that the notebook doesn't fail immediately in case of a bug or let's say typo in a code. For…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,155 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,180 questions
asked 2025-01-23T18:26:28.9+00:00
Peter Polacek 20 Reputation points
commented 2025-01-30T15:13:48.2666667+00:00
Peter Polacek 20 Reputation points
2 answers

Using this mssparkutils.notebook.runMultiple function to run notebook in parallel, how to find the failed notebook.

Hi Team, Could you please help us to find the failed notebook in parallel run using the below code, but not able to find the failed one. Eg: If any notebook got failed it is stopping the processs, but we don't know which notebook failed , can you…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,155 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,317 questions
asked 2025-01-29T09:02:16.5633333+00:00
commented 2025-01-30T13:55:32.0366667+00:00
1 answer

Azure identity package issue after updating pyspark from 3.3 to 3.4.1

I've updating my PySpark Synapse project to use 3.4.1 Spark instead of 3.3. After upgrade, it works locally but fails on Synapse with AttributeError: module 'x509' has no attribute 'VerifiedClient'. Bottom of call stack: File…

Microsoft Identity Manager
Microsoft Identity Manager
A family of Microsoft products that manage a user's digital identity using identity synchronization, certificate management, and user provisioning.
747 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,155 questions
asked 2025-01-30T08:01:13.2633333+00:00
Ivan 0 Reputation points Microsoft Employee
commented 2025-01-30T13:34:08.29+00:00
Ivan 0 Reputation points Microsoft Employee
1 answer

Insert operation at Azure SQL Synapse Analytics is running longer

Hi, We have DW500C system and observing strange behavior, which i would like to understand bit better. we have a Fact load Insert statement that runs for more than an Hour and its direct execution of SELECT statement is completing within 15 minutes. I…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,155 questions
asked 2025-01-23T12:16:46.5033333+00:00
Rodrigues Dixon 0 Reputation points
commented 2025-01-30T13:33:02.77+00:00
Smaran Thoomu 19,390 Reputation points Microsoft Vendor
1 answer

Creating external table by using for each loop and SQL procedure

Hi I am completely new to azure synapse analytics. I am trying to create external tables using parquet files stored in the list of folders in a container (azure data lake storage) I have created note book which return the sub folder name and the parquet…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,155 questions
asked 2025-01-30T10:50:29.7866667+00:00
Nimesha Hansani Amarasinghe 0 Reputation points
answered 2025-01-30T13:19:07+00:00
Amira Bedhiafi 28,141 Reputation points
3 answers

The new ADF/Synapse connector to Salesforce no longer supports QueryAll to query deleted records in Salesforce. How can this be done?

Hi, The previous version of the ADF Salesforce connector (https://learn.microsoft.com/en-us/azure/data-factory/connector-salesforce-legacy?tabs=data-factory) supported querying deleted records in Salesforce: But the new version…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,155 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,180 questions
asked 2024-02-28T21:15:09.6433333+00:00
Kevin Chadney 10 Reputation points
answered 2025-01-30T11:17:27.4833333+00:00
Vincenzo Dell'Oste 0 Reputation points
0 answers

Not able to see IP Firewall rules changes under resourcechanges

Hi, Given a Synapse workspace who is associated to an alert and where the alert rule is configured as the Signal "Create/Update server firewall rule (servers/firewallRules)", when the configuration of the Firewall rules under Synapse…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,155 questions
asked 2025-01-28T22:29:10.42+00:00
Julio-14 0 Reputation points
commented 2025-01-30T03:34:53.5333333+00:00
Ganesh Gurram 3,510 Reputation points Microsoft Vendor
2 answers

why allocated v-core is always 0?

why allocated v-core is always 0? how to change it?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,155 questions
asked 2025-01-28T20:14:37.78+00:00
Yi Wang 0 Reputation points Microsoft Employee
commented 2025-01-30T03:33:23.3666667+00:00
Ganesh Gurram 3,510 Reputation points Microsoft Vendor
1 answer

Azure Synapse pipeline

Hi, I have a question regarding Synapse. I want to create a pipeline that can delta update the target table “quotes_target” from source table “quotes_source” with filtered quotes data. I have a list of quotes id of the updated quotes after I extracted it…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,155 questions
asked 2025-01-17T09:16:28.69+00:00
Lotus88 46 Reputation points
commented 2025-01-29T19:32:17.2866667+00:00
Chandra Boorla 7,340 Reputation points Microsoft Vendor
0 answers

Error on creating Synapse Spark database

Hi every one, I'm trying to create a database in Synapse Spark Notebook, but I'm getting this error: The very same error appears without the keyword LOCATION Regards Jona

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,155 questions
asked 2025-01-28T13:32:41.94+00:00
Jona 515 Reputation points
commented 2025-01-29T19:25:37.4866667+00:00
Chandra Boorla 7,340 Reputation points Microsoft Vendor
1 answer

Data loading into sql managed instance table taking time

Hi All, we have couple of data loads in which the distribution is taking lot of time. Our source queries are extracting results in and around 15 minutes but as per sys.dm_pdw_sql_requests column operation_type=OnOperation and column…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,155 questions
asked 2025-01-02T09:13:19.56+00:00
Dixon Rodrigues 0 Reputation points
commented 2025-01-29T17:30:08.0533333+00:00
Chandra Boorla 7,340 Reputation points Microsoft Vendor
1 answer

Azure Synapse Analytics is not getting registered when working with Lab " Explore Azure Synapse Analytics"

getting error while trying the lab Explore Azure Synapse Analytics Registering resource providers... Microsoft.Synapse is not yet registered. Waiting for 30 seconds before rechecking... Microsoft.Synapse is not yet registered. Waiting for 30 seconds…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,155 questions
asked 2024-12-14T10:38:47.2766667+00:00
Monish Bhanushali 15 Reputation points
commented 2025-01-29T09:50:38.7666667+00:00
Cristoffer Östberg 0 Reputation points
1 answer One of the answers was accepted by the question author.

In Synapse Notebook using pyspark inbuilt functions how to convert country code to country name as description

Hi Team, Could you please help us that how to change country code to country name (as description) for a column in synapse notebook using pyspark (modules or libraries) could you please share the code. we have used below but it is not working. …

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,155 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,317 questions
asked 2025-01-17T09:13:38.3733333+00:00
accepted 2025-01-29T08:55:31.1766667+00:00
1 answer

I have enabled azure synapse link for a container in dev environemnt. I want to turn off that right now? How do i do it?

I have enabled azure synapse link for a container in dev environment. I want to turn off that right now? I didn't create any workspace for that. i just enabled it for a particualr container.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,155 questions
asked 2025-01-24T04:04:52.9733333+00:00
crynos_001 0 Reputation points
commented 2025-01-29T03:44:21.7233333+00:00
Smaran Thoomu 19,390 Reputation points Microsoft Vendor
1 answer One of the answers was accepted by the question author.

setting up private endpoint between cosmos db and synapse analytics

hello team, i want to setup private endpoint for synapse workspace and cosmos db but the "managed virtual network" is set as No. how does it affect the private endpoint connection. please let me know if any way to establish the explicit…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,155 questions
Azure Cosmos DB
Azure Cosmos DB
An Azure NoSQL database service for app development.
1,742 questions
asked 2025-01-22T11:55:22.2066667+00:00
ANKIT GHENGE 105 Reputation points
commented 2025-01-28T13:12:03.9933333+00:00
ANKIT GHENGE 105 Reputation points
2 answers

How to connect synapse external table using ADF.

I have Azure Synapse external tables and wanted to bring those table data into another adls account using adf. Created Link service in ADF using authentication type as sql authentication. used admin username and password in the same. Test connection…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,155 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,180 questions
asked 2025-01-24T11:28:31.66+00:00
Harshraj Sawant 0 Reputation points
commented 2025-01-28T01:52:37.3533333+00:00
Ganesh Gurram 3,510 Reputation points Microsoft Vendor
1 answer

DP-203 Labs

Is there any way to do all the labs for DP-203 without costing alot of money AND without taking like 10 minutes to install something? For each lab, the ./setup.ps1 file takes like 10 or 15 minutes to load. I'd like to not have to delete the resources…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,535 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,155 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,317 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,180 questions
asked 2024-07-21T00:03:12.49+00:00
Ben Cohn 5 Reputation points
edited the question 2025-01-27T16:17:38.78+00:00
Rakesh Gurram 11,550 Reputation points Microsoft Vendor
1 answer

How to turn off azure synapse link for a container i didn't create it a workspace for it just anabled in azure cosmos db for dev env. My major concern is should i be charged for that?

How to turn off azure synapse link for a container i didn't create it a workspace for it just anabled in azure cosmos db for dev env. My major concern is should i be charged for that?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,155 questions
Microsoft Entra ID
Microsoft Entra ID
A Microsoft Entra identity service that provides identity management and access control capabilities. Replaces Azure Active Directory.
23,057 questions
asked 2025-01-24T04:06:52.27+00:00
crynos_001 0 Reputation points
answered 2025-01-27T07:25:11.9766667+00:00
phemanth 13,305 Reputation points Microsoft Vendor
0 answers

How to troubleshoot Azure Synapse Link failing to create/modify model.json

Hello, I am having issues with Azure Synapse Link failing to create or modify the model.json file in the blob. This only started happening yesterday. Can someone provide advice on what might be causing this issue and how to resolve it? Thank you. Best…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,155 questions
asked 2024-09-19T20:47:53.33+00:00
Vidhya Ramesh 0 Reputation points
edited the question 2025-01-27T04:58:27.2433333+00:00
Rakesh Gurram 11,550 Reputation points Microsoft Vendor
1 answer One of the answers was accepted by the question author.

Power BI error about format of the values

Mdxscript(Model) (264,25) calculatiuon error in measure 'xyz'[outflow]:Function 'CONTAINSROW' doesnot support comparing values of type text with the values of type number.consider using the value or Format function to convert one of the values.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,155 questions
asked 2024-09-16T10:33:11.5266667+00:00
Pandey, Anuja 20 Reputation points
edited the question 2025-01-27T04:57:02.1366667+00:00
Rakesh Gurram 11,550 Reputation points Microsoft Vendor