Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,354 questions
2 answers
No Support for reading zip files store in Azure Datalake storage using abfss protocol url via python notebook.
Hi, This is so strange that microsoft have created the abfss protocol but have zero support to read zip files using abfss protocol via python notebook. For example I have this sample code that gives me hard time identifying a zip file as a zip…
asked 2025-03-03T11:08:21.7866667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(99.2, 56.00000000000001%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJ%3C/text%3E%3C/svg%3E)
Jeevesh
0
Reputation points
commented 2025-03-05T16:14:21.6066667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(252.8, 99%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJN%3C/text%3E%3C/svg%3E)
J N S S Kasyap
685
Reputation points Microsoft External Staff
0 answers
Azure Databricks Workspace will not open and generates a blank webpage. Console says Error 429
Access to the workspace was fine last Friday, but today the webpage fails to load. I've cleared my cache, tried multiple browsers, restarted my computer and still face the same error. When I open the console in the browser I see a host of 429 errors (Too…
asked 2025-03-03T14:18:38.67+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(172.8, 24%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDR%3C/text%3E%3C/svg%3E)
Devin Robbins
0
Reputation points
commented 2025-03-05T16:13:13.4833333+00:00
J N S S Kasyap
685
Reputation points Microsoft External Staff
0 answers
How to read zip file in Azure Synapse Notebook with extension of .zip.
Hi Team, Could you please advise the pyspark code, how to read zip files in synapse notebook. Example: File_Name - samplefile.zip Note: In the samplefile.zip we have multiple csv files, please let us know. The file Extension is only with .zip. …
asked 2024-11-08T16:44:52.83+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(163.2, 22%, 25%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESM%3C/text%3E%3C/svg%3E)
SaiSekhar, MahasivaRavi (Philadelphia)
100
Reputation points
commented 2025-03-05T07:39:18.4533333+00:00
Jeevesh
0
Reputation points
0 answers
How can I enable the 'SHAREPOINT' type connection in Azure Databricks?
I tried to connect SharePoint using Azure Databricks Lakehouse Federation. First, I select Connection type "Microsoft SharePoint" to create a Lakehouse Federation. Next, I input authentication info and sign in with Microsoft SharePoint. Then,…
asked 2025-03-05T02:35:40.4366667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(208, 50%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPB%3C/text%3E%3C/svg%3E)
Power BI Test User 2
0
Reputation points
edited a comment 2025-03-05T07:08:18.38+00:00
Power BI Test User 2
0
Reputation points
1 answer
One of the answers was accepted by the question author.
Is there any way to export/download queries in order to move queries from one subscription to another??
I have been using Azure Databricks on one subscription and have queries in a workspace. Now I want to move them to another databricks workspace in a different subscription. Is there any way for me to export or download queries? My current solution is to…
asked 2025-03-03T07:53:14.71+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(48, 49%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKK%3C/text%3E%3C/svg%3E)
Kohdai Kurihara
20
Reputation points
accepted 2025-03-05T02:54:40.0166667+00:00
Kohdai Kurihara
20
Reputation points
1 answer
How can I prohibit ordinary users to execute notebooks of shared folder in Azure Databricks?
Hello, How can I prohibit ordinary users to create, modify, and execute notebooks of shared folder in Azure Databricks? For security reasons, I want to prevent ordinary users from accidentally sharing the results of SELECT sensitive data in the Shared…
asked 2025-02-25T04:03:49.2733333+00:00
Power BI Test User 2
0
Reputation points
accepted 2025-03-05T02:12:43.0466667+00:00
Power BI Test User 2
0
Reputation points
1 answer
Creating an Azure Databricks service but get Admin error when I'm an Owner?
Hi Forum, I have an Azure account and I want to do some work with Azure Databricks using my personal email to set it up. I created a pay as you go Azure Databricks workspace in Azure and all is good until I click on Launch. I get a note saying I should…
asked 2025-03-01T21:31:05.39+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(89.60000000000001, 1%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPB%3C/text%3E%3C/svg%3E)
Peter Boothby
1
Reputation point
commented 2025-03-05T01:23:09.8966667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(201.6, 18%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGG%3C/text%3E%3C/svg%3E)
Ganesh Gurram
4,725
Reputation points Microsoft External Staff
1 answer
Your Role: Global Administrator and 1 other roles does not work with Databricks
Hi, Your Role: Global Administrator and 1 other roles. This I can see In Roles and Administrators. But I cannot - from Databricks - get to Manage Account from email on top right, which means I am not Global Administrator. What is the problem? Seems…
asked 2025-02-20T19:46:32.8233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(0, 15%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGA%3C/text%3E%3C/svg%3E)
Ged Alexander
0
Reputation points
commented 2025-03-04T17:53:41.5466667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(99.2, 65%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECB%3C/text%3E%3C/svg%3E)
Chandra Boorla
9,435
Reputation points Microsoft External Staff
1 answer
Users in a specific region are experiencing connection issues to Databricks workspaces
We have users that are experiencing issues with connecting to both our production and development environments of databricks through our Azure subscription. Everything else in Azure is working fine for them, though. We have other users in different…
asked 2025-03-03T18:21:41.94+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(275.2, 47%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKA%3C/text%3E%3C/svg%3E)
Kiel Auer
0
Reputation points
edited the question 2025-03-04T09:55:17.1566667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(166.4, 27%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERP%3C/text%3E%3C/svg%3E)
Raja Pothuraju
15,555
Reputation points Microsoft External Staff
1 answer
One of the answers was accepted by the question author.
Query on connecting SQL server from Databricks
Hi all, We are studying on the methods to read/write data in SQL server from Databricks. I recognized that there are at least two different way to do it. One is the spark connector for SQL server…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(25.6, 87%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EB%3C/text%3E%3C/svg%3E)
1 answer
One of the answers was accepted by the question author.
How to allow Databricks to only read from one storage account and read/write from a different storage account?
RBAC setup: Under the same subscription I have resource group 1 and resource group 2. There is a Databricks instance created in resource group 1 in which a service principal was created. Within the resource group 1 storage account the service principal…
asked 2025-02-27T22:29:11.89+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(224.00000000000003, 37%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBD%3C/text%3E%3C/svg%3E)
Brian Dietrich
20
Reputation points
accepted 2025-03-03T16:18:02.1266667+00:00
Brian Dietrich
20
Reputation points
1 answer
One of the answers was accepted by the question author.
Azure SCIM Provisioning connector for databricks Not working
Team, I have successfully set up and synchronized users from our on-premises Active Directory to Azure AD. As part of the next step, I am working on syncing these users to Azure Databricks. SCIM provisioning has been configured, and a few users have been…
asked 2025-03-03T10:26:24.19+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(211.20000000000002, 67%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESM%3C/text%3E%3C/svg%3E)
Sundarakannan Manoharan
21
Reputation points
accepted 2025-03-03T15:48:46.1033333+00:00
Sundarakannan Manoharan
21
Reputation points
1 answer
Need for volumes in Databricks
Why do we need Volumes when we can access the location using external locations? The doc says it is to add governance, but we can already govern using external locations. So, why add another layer of governance? I am guessing that instead of giving…
asked 2024-09-25T06:47:42.8166667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(166.4, 67%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDS%3C/text%3E%3C/svg%3E)
Dhruv Singla
105
Reputation points
answered 2025-03-03T13:54:55.6+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(102.4, 66%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPV%3C/text%3E%3C/svg%3E)
Paras Vora
0
Reputation points
1 answer
One of the answers was accepted by the question author.
How to move a resource from subscription a to subscription b, and add to vnet subnet
Hi there, I want to move a databricks resource from subscription A to subsciption B , and add it to vnet subnet. How can I do it ? Thanks&Regards, zmsoft
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(64, 53%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EZ%3C/text%3E%3C/svg%3E)
1 answer
One of the answers was accepted by the question author.
Retrieving data from Azure storage account archive tier through Azure Databricks
Hi Community, Recently we are studying the practice to perform data retention in Azure. We are using Databricks and Storage Account as data lake. We are thinking of using Databricks to extract part of the data from delta table and write them to the…
1 answer
One of the answers was accepted by the question author.
Queries regarding Serverless compute in Azure Databricks
We have received a service health advisory from Microsoft with ID "PTC3-9V8" regarding the Serverless compute transition on Azure Databricks by 24 March 2025. After going through the advisory, we have few queries which we want to…
asked 2025-02-26T23:22:03.45+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(284.8, 39%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECS%3C/text%3E%3C/svg%3E)
Chakraborty, Shubham
80
Reputation points
accepted 2025-03-03T04:46:51.2766667+00:00
Chakraborty, Shubham
80
Reputation points
2 answers
Azure databricks does not recognize HNS enabled storage account correctly
Hi, I am trying to create an external location in Azure Databricks, When i point it to a container in a storage account that has HNS enabled it still says that HNS is disabled. See image below. The storage credential being used has 'Storage Blob reader'…
asked 2024-11-28T17:19:01.46+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(217.60000000000002, 71%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EV%3C/text%3E%3C/svg%3E)
vivek
20
Reputation points
answered 2025-03-01T11:43:49.11+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(233.6, 89%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESM%3C/text%3E%3C/svg%3E)
Sahil Mahale
0
Reputation points
1 answer
how to disbale serverless for azure databricks notebook
I want to restrict the serverless in notebook in my dev workspace and i want to disable the feature . i am not getting option where to disable it .
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(208, 28.999999999999996%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAS%3C/text%3E%3C/svg%3E)
1 answer
How to connect On prem tableau server to Azure Databricks
Trying to establish a connection between on prem tableau server to Azure Databricks. Do we have to create App registration for the tableau server?
asked 2025-02-27T20:07:20.87+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(246.4, 88%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERV%3C/text%3E%3C/svg%3E)
Rajagopalan, Valli (She/Her/Hers) (MNIT)
0
Reputation points
answered 2025-02-27T22:11:01.9733333+00:00
Ganesh Gurram
4,725
Reputation points Microsoft External Staff
2 answers
One of the answers was accepted by the question author.
Error "Invalid configuration value detected for fs.azure.account.keyInvalid configuration value detected for fs.azure.account.key" when listing files stored in an Azure Storage account using "dbutils.fs.ls"
Hi, I want to get a list of files stored in an Azure Storage account using "dbutils.fs.ls" command in Databricks. But, I get the following error. Failure to initialize configuration for storage account AAAAAA.dfs.core.windows.net: Invalid…
asked 2023-06-21T11:09:15.6666667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(16, 5%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMS%3C/text%3E%3C/svg%3E)
Mohammad Saber
591
Reputation points
commented 2025-02-26T21:05:32.96+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(259.20000000000005, 22%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EFR%3C/text%3E%3C/svg%3E)
Fredy Rivera
0
Reputation points Microsoft Employee