Access data products in Databricks Marketplace using external platforms
This article describes how to access data products in Databricks Marketplace without a Unity Catalog-enabled Databricks workspace. You can use Delta Sharing open sharing connectors to access Marketplace data using a number of common platforms, including Microsoft Power BI, Microsoft Excel, pandas, Apache Spark, and non-Unity Catalog Databricks workspaces. Only tabular data sets are available on external platforms (not Databricks notebooks, volumes, or models, for example).
Important
If you have an Azure Databricks workspace that is enabled for Unity Catalog, you should access shared data using Unity Catalog. See Access data products in Databricks Marketplace (Unity Catalog-enabled workspaces).
Before you begin
To browse data product listings on Databricks Marketplace, you can use either of the following:
- The Open Marketplace.
- An Azure Databricks workspace.
To request access to data products, regardless of platform, you must have an Azure Databricks workspace.
If you don’t have one, you can get a free trial. Click Try for free on the Open Marketplace and follow the prompts to start your trial.
Browse Databricks Marketplace listings that are accessible on external platforms
To find a data product you want, simply browse or search the data product listings in Databricks Marketplace. Only Data set (tabular data) product types are available to share using external platforms or non-Unity-Catalog Azure Databricks workspaces.
Go to marketplace.databricks.com or log into your Azure Databricks workspace and click
Marketplace.Note
Alternatively, you can search for Marketplace listings using the global search bar at the top of your Azure Databricks workspace. See Search for workspace objects.
Browse or search for the data product that you want.
You can filter listings by provider name, product type, category, cost (free or paid), or keyword search. Only the Data set product type is available for access using external platforms.
If you are logged into an Azure Databricks workspace, you can also choose to view only the private listings available to you as part of a private exchange. See Participate in private exchanges.
Get access to data products that are accessible on external platforms
To request access to data products, you must be logged into an Azure Databricks workspace, even if you will use the shared data product on an external platform. Some data products are available immediately, and others require provider approval and transaction completion using provider interfaces.
Get access to data products that are instantly available
Data products that are available instantly require only that you request them and agree to terms. These data products are listed under the Free and instantly available heading on the Marketplace landing page, are identified on the listing tile as Free, and are identified as Instantly available on the listing detail page.
When you’ve found a listing you’re interested in on the Marketplace landing page, click the listing to open the listing detail page.
Click the Get instant access button.
Under More options , select On external platforms.
Accept the Databricks terms and conditions.
Click Get instant access.
Click the Download credential file button to get the credential file, which you and your team can use to gain access to shared data using third-party data platforms and non-Unity Catalog Databricks workspaces.
Important
The credential file can only be downloaded once. The download button remains active after you download the file, but subsequent downloads rotate to a new credential. The old credential expires after one day or its original expiration date, whichever is sooner. Only two credentials can be active at the same time.
Store the credential file in a secure location.
Don’t share the credential file with anyone outside the group of users who should have access to the shared data. If you need to share it with someone in your organization, Databricks recommends using a password manager.
To learn how to access the shared data using your platform of choice, see Access shared data using Delta Sharing open sharing connectors.
Request data products that require provider approval
Some data products require provider approval, typically because a commercial transaction is involved, or the provider might prefer to customize data products for you. These listings are identified on the listing detail page as By request and include a Request access button.
When you’ve found a listing you’re interested in on the Marketplace landing page, click the listing to open the listing detail page.
Click the Request access button.
Enter your name, company, and a brief description of your intended use for the data product.
Click More options and select On external platforms.
Accept the Databricks terms and conditions and click Request access.
You will be notified by email when the provider has completed their review of your request.
You can also monitor the progress of your request on the My Requests page in Marketplace. See Manage shared Databricks Marketplace data products. However, any transactions that follow will use provider communications and payment platforms. No commercial transactions are handled directly on Databricks Marketplace.
When your transaction is complete, you will receive a notification email from the data provider, and the listing will display a Download credential file button. Click this button to download the credential file, which you and your team can use to gain access to shared data using third-party data platforms and non-Unity Catalog Databricks workspaces.
You can also find the listing in Marketplace under My requests. When the credential is ready for download, the data product appears on the Installed data products tab.
Important
The credential file can only be downloaded once. The download button remains active after you download the file, but subsequent downloads rotate to a new credential. The old credential expires after one day or its original expiration date, whichever is sooner. Only two credentials can be active at the same time.
Store the credential file in a secure location.
Don’t share the credential file with anyone outside the group of users who should have access to the shared data. If you need to share it with someone in your organization, Databricks recommends using a password manager.
To learn how to access the shared data using your platform of choice, see Access shared data using Delta Sharing open sharing connectors.
Access shared data using Delta Sharing open sharing connectors
To use external platforms or non-Unity-Catalog Azure Databricks workspaces to access datasets that have been shared using Databricks Marketplace, you need the credential file that was downloaded from the Marketplace listing. You use this credential file to access the shared data using Delta Sharing open sharing connectors.
For full instructions for using non-Unity-Catalog Azure Databricks workspaces, Apache Spark, pandas, and Power BI to access and read shared data, see Read data shared using Delta Sharing open sharing (for recipients).
For a full list of Delta Sharing connectors and information about how to use them, see the Delta Sharing open source documentation.
Limitations on sharing to external platforms using Marketplace
Some tables require partition info from the consumer side (country, for example). In the open sharing protocol, this information is not available to the share, and therefore the table is not accessible. The following error is returned: “Recipient authentication failure: the data is restricted by Recipient properties that do not apply to the current recipient in the session. Please contact the data provider to resolve the issue.”