Does Databricks permit an enterprise to maintain multiple Databricks accounts within a single region?

Question

Does Databricks permit an enterprise to maintain multiple Databricks accounts within a single region in Azure? We need two isolated Unity Catalog metastores in the same region.

Answer 1

Hi @Sanju Dabi

Thank you for posting your query!

Does Databricks permit an enterprise to maintain multiple Databricks accounts within a single region in Azure?

Yes, Databricks allows an enterprise to maintain multiple Databricks accounts within a single Azure region. However, it's important to note that Unity Catalog metastores are region-specific, and each Databricks account can have one Unity Catalog metastore per region.

We need two isolated Unity Catalog metastores in the same region.

If you require two isolated Unity Catalog metastores in the same region, here is how you can achieve this:

Create Separate Accounts - Set up different Databricks accounts within your Azure subscription. Each account will have its own isolated resources, allowing you to manage distinct environments within the same region.

Configure Unity Catalog for Each Account - For each account, configure a separate Unity Catalog metastore. This ensures that metadata, permissions, and data governance policies remain isolated and secure for each environment.

Manage Security and Networking - Ensure that network settings and security policies are configured properly to maintain isolation between environments, while allowing any necessary communication between them.

Single Metastore with Namespace Isolation - If only logical isolation is needed (e.g., different teams or projects), you can use Unity Catalog's namespaces and access control features to isolate data within the same metastore. While this won’t provide full physical isolation of the metastores, it allows you to manage access and permissions for different groups or use cases effectively within a single metastore.

For more details, please refer: Unity Catalog best practices

In summary, you can only have one Unity Catalog metastore per region per Databricks account. To work around this limitation, you could create additional Databricks accounts or explore namespace isolation within a single metastore depending on your needs.

I hope this information helps. Please do let us know if you have any further queries.

---

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.