Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,511 questions
0 answers
Getting TokenNotFoundInConfigurationException error when uploading a Python wheel as workspace package in Synpase
Hello Everyone I'm using Azure Synapse to run my Spark pipelines. I've build my pipeline to use a custom library code from utils package of the same project to perform some operation. To access the utils.pipeline file, have packaged my entire project in…
asked 2024-12-25T05:25:33.01+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(83.2, 22%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EM%3C/text%3E%3C/svg%3E)
manigandan
0
Reputation points
edited the question 2024-12-25T05:27:14.8733333+00:00
manigandan
0
Reputation points
1 answer
GIT enabled Synapse Workspace: is there any way to get the current branch name via Python?
Hi, I was wondering if there is any method (or some other way) to retrieve the name of the currently selected GIT branch programmatically within a running Synapse Notebook session using Python. To make thinks even more complicated: the Synapse…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(297.6, 42%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMB%3C/text%3E%3C/svg%3E)
1 answer
Deployment Failed in Azure Synapse: SKU 'name' missing error
"I'm trying to deploy an Azure Synapse Workspace and keep encountering the following error: 'The request content was invalid and could not be deserialized: Required property 'name' not found in 'sku'.' The full error is: { "code":…
asked 2024-12-24T13:05:27.6333333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(57.599999999999994, 40%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
azizure
0
Reputation points
answered 2024-12-24T17:40:01.01+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(201.6, 18%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGG%3C/text%3E%3C/svg%3E)
Ganesh Gurram
2,305
Reputation points Microsoft Vendor
1 answer
Read data from Databricks Delta Sharing to Azure Synapse
Hi, I am trying to read the data from Databricks Delta Sharing and write the data to Azure Synapse by referring this documentation https://docs.databricks.com/en/connect/external-systems/synapse-analytics.html#language-python I have constructed below…
asked 2024-12-18T15:05:16.13+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(313.6, 55.00000000000001%, 40%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECJ%3C/text%3E%3C/svg%3E)
Cheng, Jack
0
Reputation points
edited a comment 2024-12-24T16:13:46.5666667+00:00
Ganesh Gurram
2,305
Reputation points Microsoft Vendor
0 answers
issues in synapse pipelines which accessing the checkpoints key with input parameters
hello team, i am getting synapse analytics pipelines failures with error referring the checkpoint mistaching with the checkpoint in input parameters. tried to check the input as the respective dataflow is fetching data from cosmosDb with CDC approach…
asked 2024-12-20T14:24:05.0233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(3.2, 98%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAG%3C/text%3E%3C/svg%3E)
ANKIT GHENGE
40
Reputation points
commented 2024-12-24T12:20:26.9966667+00:00
Ganesh Gurram
2,305
Reputation points Microsoft Vendor
1 answer
Unable to create synapse workspace - property 'name' not found in 'sku'
I'm trying to create a new synapse workspace and receive the following error. { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for…
asked 2024-12-24T05:57:21.6+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(150.4, 57.99999999999999%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ER%3C/text%3E%3C/svg%3E)
robjkc
0
Reputation points
answered 2024-12-24T12:06:53.6166667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Smaran Thoomu
18,710
Reputation points Microsoft Vendor
1 answer
How to fix 500 error on postman API
Hello Team, I am trying to create external APIs for my serverless SQL pool on postman. So I have created required access tokens using this URL (`https://login.microsoftonline.com/
asked 2024-12-19T18:39:14.1+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(112.00000000000001, 35%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESM%3C/text%3E%3C/svg%3E)
Shrimathi M
40
Reputation points
commented 2024-12-24T11:36:11.2566667+00:00
Shrimathi M
40
Reputation points
1 answer
Issue with Corrupted Azure Synapse Workspace During Creation
An issue has arisen with an Azure Synapse Analytics workspace during its creation process. Due to an error or misconfiguration during setup, the workspace became corrupted. As a result, the workspace is in a non-functional state and cannot be deleted or…
asked 2024-12-23T12:56:24.19+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(128, 68%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBT%3C/text%3E%3C/svg%3E)
Bram Teunis
0
Reputation points
commented 2024-12-24T08:44:36.9066667+00:00
Smaran Thoomu
18,710
Reputation points Microsoft Vendor
1 answer
How to Execute DROP VIEW Command in Synapse Notebook with SQL Serverless Pool Connection?
How to Connect Synapse Notebook to SQL Serverless Pool for Executing DROP VIEW Command? I’m working with Azure Synapse Analytics and need to connect my Synapse Notebook to a SQL Serverless Pool to directly drop and create views. However, when I try…
asked 2024-12-23T13:16:04.3133333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 56.00000000000001%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EM6%3C/text%3E%3C/svg%3E)
MulluriNivas-6816
80
Reputation points
commented 2024-12-24T08:43:13.14+00:00
Smaran Thoomu
18,710
Reputation points Microsoft Vendor
0 answers
Select transformation output schema is empty after renaming columns
I've followed the example from the link: https://learn.microsoft.com/en-us/azure/data-factory/tutorial-data-flow-dynamic-columns It's exactly what I need for my project, but unfortunately, no matter what I do, the output schema of the select…
asked 2024-11-20T16:26:53.2266667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(195.2, 75%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
AdnanT
0
Reputation points
commented 2024-12-24T06:40:50.8266667+00:00
AnnuKumari-MSFT
33,976
Reputation points Microsoft Employee
1 answer
unable to edit dataflow in synapse after creating it.
I have created dataflows in Pipeline but they are not editable. I am clicking on it to edit but it's not opening for me to edit
asked 2024-12-22T14:55:07.7+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(236.8, 39%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ES%3C/text%3E%3C/svg%3E)
Swarnima
0
Reputation points
commented 2024-12-24T02:49:00.27+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(99.2, 65%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECB%3C/text%3E%3C/svg%3E)
Chandra Boorla
5,755
Reputation points Microsoft Vendor
0 answers
How to limit synapse spark to only send WARN/ERROR logs to log analytics workspace ?
I have followed the steps here: https://learn.microsoft.com/en-us/azure/synapse-analytics/spark/apache-spark-azure-log-analytics But now all the internal driver/executor logs are getting sent to log analytics workspace, which is leading to storage…
asked 2024-12-18T16:08:15.2766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(83.2, 65%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3E_%3C/text%3E%3C/svg%3E)
_user_unknown_
1
Reputation point
edited a comment 2024-12-23T18:34:12.6133333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(288, 61%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EP%3C/text%3E%3C/svg%3E)
phemanth
12,575
Reputation points Microsoft Vendor
1 answer
Session failed. Run the notebook to start a new session.
I've recently created a spark pool in Azure Synapse Analytics. However, when i try to run a notebook, i got this error: Spark_Ambiguous_SparkSubmit_SparkSubmitProcessFailedExitCode1: Livy session has failed. Session state: Dead. Error code:…
asked 2024-12-19T19:11:33.6933333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 24%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERE%3C/text%3E%3C/svg%3E)
Roberto Ebratt
5
Reputation points
commented 2024-12-23T01:08:27.29+00:00
Chandra Boorla
5,755
Reputation points Microsoft Vendor
1 answer
How to restore a synapse SQL pool datawarehouse database
Hi All. Working on recovering a deleted synapse analytics workspace which also has a SQL pool, is there a way to recover if its deleted ? At the time, the deletion encountered an error and therefore was not fully deleted. but i was unable to recovery the…
asked 2024-12-18T18:57:26.6266667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(80, 39%, 17%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EM%3C/text%3E%3C/svg%3E)
MrFlinstone
641
Reputation points
commented 2024-12-23T01:02:03.3266667+00:00
Chandra Boorla
5,755
Reputation points Microsoft Vendor
1 answer
One of the answers was accepted by the question author.
Add Synapse Administrator role assgiment for manged identitiy - 403 authorization error
Hey, I am implementing logic that assigns roles in Azure Synapse Workspace. I have the following setup: Marketplace app that deploys resources to customer subscriptions (it has denied assignments) creates Azure Synapse Workspace creates managed…
asked 2024-12-17T21:02:34.68+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(54.400000000000006, 18%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAF%3C/text%3E%3C/svg%3E)
Adrian Flejszer
20
Reputation points
accepted 2024-12-22T20:11:00.56+00:00
Adrian Flejszer
20
Reputation points
1 answer
Servicenow linked service used connectivity vendor
I am interested in using Servicenow Linked Service to extract data from Servicenow. There are two linked services available; the legacy version and version 2 that uses table API. The documentation mentions a built-in driver for enabling connectivity. Can…
asked 2024-06-27T10:50:37.5233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(179.20000000000002, 99%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAB%3C/text%3E%3C/svg%3E)
Amir Bagheripour
0
Reputation points
edited the question 2024-12-22T13:29:20.1733333+00:00
TP
100.9K
Reputation points
1 answer
One of the answers was accepted by the question author.
How to read cosmosdb mongodb API objectId field from a synapse analytical collection link
I am linking Synapse serverless sql pool with Cosmosdb with Mongodb API. For background, MongoDb sets its _id and reference ids to objectId(). To do a SQL join on this field, we need to convert the value to string. This is how the data…
asked 2024-12-21T03:46:47.5433333+00:00
Oscar Garcia @ozkary
21
Reputation points
commented 2024-12-22T02:29:50.59+00:00
VINODH KUMAR T D
26,141
Reputation points MVP
2 answers
Cant find in the metrics about the storage used in dedicated sql pool under Azure Synapse Analytics.
my account have been charged 0.68usd / day when adls gen2 shows me the storage uses 8.7 gb. it does not make sense. are there any way to monitor the exact storage used in Azure Synapse Analytics SQL Storage - Standard - AP Southeast in dedicated sql…
asked 2024-10-14T03:55:16.1433333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(6.4, 13%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EEA%3C/text%3E%3C/svg%3E)
Eddy Au Yeung
0
Reputation points
commented 2024-12-21T09:09:27.0833333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(153.6, 7.000000000000001%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EM%3C/text%3E%3C/svg%3E)
menudale9
75
Reputation points
1 answer
One of the answers was accepted by the question author.
how to update apache spark pool version from3.3 to 3.4 if don't have any spark pools under the synapse workspace
i dont have spark pools configured under synapse analytics workspaces so how can i update syanpse spark pools to 3.4 version. is there any dependency validation required for this?
asked 2024-10-23T09:51:20.06+00:00
ANKIT GHENGE
40
Reputation points
commented 2024-12-20T14:14:00.0033333+00:00
ANKIT GHENGE
40
Reputation points
1 answer
One of the answers was accepted by the question author.
not being able to create azure free account or even to upgrade to pay as u go
how am i suppose to learn the certification if am not being able to create account. i am really frustrated that am not being able to create account. provide me an efficient way to create account to practice for my certification
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(281.6, 81%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(67.2, 19%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESK%3C/text%3E%3C/svg%3E)