DP-203 Labs
Is there any way to do all the labs for DP-203 without costing alot of money AND without taking like 10 minutes to install something? For each lab, the ./setup.ps1 file takes like 10 or 15 minutes to load. I'd like to not have to delete the resources…
Facing challenges with Azure databricks cluster spin up
We have opened the firewalls to west us IP addresses and domains for Azure Databricks services and assets - Azure Databricks | Microsoft Learn but still we are not able to spin the cluster the cluster spin up fails with ailure message: Bootstrap script…
How to configure default Lakehouse in notebook in Fabric
I want to configure defualt laekhouse in notebook. i can do it using %%configure command. but i am note able to use variables here to be used in %%configure command. As configure should be the first cell of the notebook and if you put it in middle of the…
Serverless not showing for my notebooks in Databricks
Hi. Serverless option is not showing for my notebooks and I cannot even see it in the feature enablement in accounts administration. In the attached screenshots, you can see that I have unity catalog enable and that serverless does not appear in feature…
Unable to access unity catalogue
Unable to access managed account console, unable to access.azuredatabricks.net its showing that "Selected user account does not exist in tenant 'Microsoft Services' and cannot access the application '2ff814a6-3304-4ab8-85cb-cd0e6f879c1d' in that…
Retrieving files created by Databricks Jobs
I am currently working with a Databricks workspace through Azure and using the Databricks Jobs API to execute Python scripts. These scripts create files during their execution. I would like to understand how to retrieve these files after the job…
Retrieving 'Person or Group' Fields from SharePoint List in Azure Data Factory or Synapse
I'm able to retrieve data from a SharePoint list using Azure Data Factory > Copy Data (via the SharePoint Connector), but the list contains 'Person or Group' type fields that return only 'Id' values in the results. These 'Id' values are not useful,…
Delta Tables in Unity Catalog - My Organization vs Unity Catalog - Legacy - Hive Metastore
We have multiple Databricks Delta Tables that were created before Unity Catalog came into picture. After Unity Catalog got included in our Project, all our Tables are shown in Unity Catalog as part of Legacy. We would like to know if having them as…
Unable to Access Databricks Serverless Compute from CLI and VS Code
The following conditions exist while using Databricks with the premium plan: Unity catalog is enabled. No complaint security profile is enabled. The workspace is located in a supported region for Serverless Notebook compute — West US2. The…
Unable to login to Azure Databricks Account Console
I have a personal Azure pay-as-you-go subscription in which I have the 'Global Administrator' role. I am also the databricks account administrator. Since two weeks I am not able anymore to access the databricks account console.
Unable to remove resource group, and deny assigments, in Azure.
In azure I cant remove a resource group, and I cant remove deny assigments. I think it could be like this example: https://stackoverflow.com/questions/60694149/unable-to-remove-azure-databricks-managed-resource-group
Connecting Databricks through Microsoft Purview by enabling "No Public Access"
Hi, I was able to connect Databricks through Microsoft Purview using Public Network but now the requirement is to connect Databricks through Microsoft Purview by enabling "No Public Access" in Databricks. The Databricks account is created…
In Synapse Notebook using pyspark inbuilt functions how to convert country code to country name as description
Hi Team, Could you please help us that how to change country code to country name (as description) for a column in synapse notebook using pyspark (modules or libraries) could you please share the code. we have used below but it is not working. …
Why am i Getting this error even if i am having subscription?
Azure Quota Exceeded Exception: Hitting Azure quota limits: Error code: QuotaExceeded, error message: Operation could not be completed as it results in exceeding approved standardDADSv5Family Cores quota. Additional details - Deployment Model: Resource…
��������� � in databricks
Hi Expert, how to replace below wild character from databricks ��������� �
Using Microsoft Azure Free Trial for Databricks
I want to try out Databricks using my free trial. I am able to create a workspace, but when I try to create and run a cluster within it I get an error saying I have exceeded my core quota for the free trial. Is there a way I can try out Databricks…
Data factory Copy activity fails when copy the data unity catalog table from databricks to storage account gen2
Data factory Copy activity fails when copy the data unity catalog table from databricks to storage account gen2 How to fix the connectivity issue even after providing all required access on catalog schema and tables level. error details: …
Integrate storage, database, webapp, and databricks into one VNET
We are hardening our ML platform in Azure. Basically, we want to put all the Azure services ( ADLS, PostgreSQL DB, Web App, and Databricks cluster) in one virtural network so all the traffic will be inside the Azure network whenever possible (except the…
unity catalog issue, i build 2 databricks workspace, but can not manage accounts
I created two workspaces in Azure Databricks, but I cannot find the 'Manage Accounts' option in my account. How can I access this service?" I can not use unity catalog service , any action I can fix this issue? thank you
How to resolve New-AzResourceGroupDeployment: - The deployment 'DataBricksDeployment' failed with error(s). Showing 1 out of 1 error(s). Status Message: The definition of application 'Databricks25' cannot be null. (Code:InvalidApplicationDefi
God day Does anyone know what could be causing this error. New-AzResourceGroupDeployment: 10:06:59 - The deployment 'DataBricksDeployment' failed with error(s). Showing 1 out of 1 error(s). Status Message: The definition of application…