Azure Synapse Notebook does't fail immediately in case of error in code
Hello, I am struggling with really weird behavior when executing a notebook within Azure Synapse. I am utilizing pyspark and sql within this notebook and noticed that the notebook doesn't fail immediately in case of a bug or let's say typo in a code. For…
Using this mssparkutils.notebook.runMultiple function to run notebook in parallel, how to find the failed notebook.
Hi Team, Could you please help us to find the failed notebook in parallel run using the below code, but not able to find the failed one. Eg: If any notebook got failed it is stopping the processs, but we don't know which notebook failed , can you…
Azure identity package issue after updating pyspark from 3.3 to 3.4.1
I've updating my PySpark Synapse project to use 3.4.1 Spark instead of 3.3. After upgrade, it works locally but fails on Synapse with AttributeError: module 'x509' has no attribute 'VerifiedClient'. Bottom of call stack: File…
Insert operation at Azure SQL Synapse Analytics is running longer
Hi, We have DW500C system and observing strange behavior, which i would like to understand bit better. we have a Fact load Insert statement that runs for more than an Hour and its direct execution of SELECT statement is completing within 15 minutes. I…
Creating external table by using for each loop and SQL procedure
Hi I am completely new to azure synapse analytics. I am trying to create external tables using parquet files stored in the list of folders in a container (azure data lake storage) I have created note book which return the sub folder name and the parquet…
The new ADF/Synapse connector to Salesforce no longer supports QueryAll to query deleted records in Salesforce. How can this be done?
Hi, The previous version of the ADF Salesforce connector (https://learn.microsoft.com/en-us/azure/data-factory/connector-salesforce-legacy?tabs=data-factory) supported querying deleted records in Salesforce: But the new version…
Not able to see IP Firewall rules changes under resourcechanges
Hi, Given a Synapse workspace who is associated to an alert and where the alert rule is configured as the Signal "Create/Update server firewall rule (servers/firewallRules)", when the configuration of the Firewall rules under Synapse…
why allocated v-core is always 0?
why allocated v-core is always 0? how to change it?
Azure Synapse pipeline
Hi, I have a question regarding Synapse. I want to create a pipeline that can delta update the target table “quotes_target” from source table “quotes_source” with filtered quotes data. I have a list of quotes id of the updated quotes after I extracted it…
Error on creating Synapse Spark database
Hi every one, I'm trying to create a database in Synapse Spark Notebook, but I'm getting this error: The very same error appears without the keyword LOCATION Regards Jona
Data loading into sql managed instance table taking time
Hi All, we have couple of data loads in which the distribution is taking lot of time. Our source queries are extracting results in and around 15 minutes but as per sys.dm_pdw_sql_requests column operation_type=OnOperation and column…
Azure Synapse Analytics is not getting registered when working with Lab " Explore Azure Synapse Analytics"
getting error while trying the lab Explore Azure Synapse Analytics Registering resource providers... Microsoft.Synapse is not yet registered. Waiting for 30 seconds before rechecking... Microsoft.Synapse is not yet registered. Waiting for 30 seconds…
In Synapse Notebook using pyspark inbuilt functions how to convert country code to country name as description
Hi Team, Could you please help us that how to change country code to country name (as description) for a column in synapse notebook using pyspark (modules or libraries) could you please share the code. we have used below but it is not working. …
I have enabled azure synapse link for a container in dev environemnt. I want to turn off that right now? How do i do it?
I have enabled azure synapse link for a container in dev environment. I want to turn off that right now? I didn't create any workspace for that. i just enabled it for a particualr container.
setting up private endpoint between cosmos db and synapse analytics
hello team, i want to setup private endpoint for synapse workspace and cosmos db but the "managed virtual network" is set as No. how does it affect the private endpoint connection. please let me know if any way to establish the explicit…
How to connect synapse external table using ADF.
I have Azure Synapse external tables and wanted to bring those table data into another adls account using adf. Created Link service in ADF using authentication type as sql authentication. used admin username and password in the same. Test connection…
DP-203 Labs
Is there any way to do all the labs for DP-203 without costing alot of money AND without taking like 10 minutes to install something? For each lab, the ./setup.ps1 file takes like 10 or 15 minutes to load. I'd like to not have to delete the resources…
How to turn off azure synapse link for a container i didn't create it a workspace for it just anabled in azure cosmos db for dev env. My major concern is should i be charged for that?
How to turn off azure synapse link for a container i didn't create it a workspace for it just anabled in azure cosmos db for dev env. My major concern is should i be charged for that?
How to troubleshoot Azure Synapse Link failing to create/modify model.json
Hello, I am having issues with Azure Synapse Link failing to create or modify the model.json file in the blob. This only started happening yesterday. Can someone provide advice on what might be causing this issue and how to resolve it? Thank you. Best…
Power BI error about format of the values
Mdxscript(Model) (264,25) calculatiuon error in measure 'xyz'[outflow]:Function 'CONTAINSROW' doesnot support comparing values of type text with the values of type number.consider using the value or Format function to convert one of the values.