Best option to implement departmental secrecy in Azure databricks resource?

Apurva Tiwari 40 Reputation points
2024-06-13T09:23:30.1066667+00:00

I have an azure databricks resource created in my Azure portal. I want to achieve departmental secracy in a single existing databricks resource. Hence, I am looking for a solution where I can add multiple workspaces to my single Databricks resource. How much will it cost? 

reference: https://video2.skills-academy.com/en-us/azure/databricks/getting-started/concepts In the above link, It is mentioned: in the Accounts and Workspaces section

"In Azure Databricks, a workspace is an Azure Databricks deployment in the cloud that functions as an environment for your team to access Databricks assets. Your organization can choose to have either multiple workspaces or just one, depending on its needs.

An Azure Databricks account represents a single entity that can include multiple workspaces. Accounts enabled for Unity Catalog can be used to manage users and their access to data centrally across all of the workspaces in the account."

Please let me know the best possible way to implement it.

 

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,175 questions
0 comments
Accepted answer
  1. PRADEEPCHEEKATLA-MSFT 89,296 Reputation points Microsoft Employee
    2024-06-14T03:50:14.8866667+00:00

    @Apurva Tiwari - Thanks for the question and using MS Q&A platform.

    Azure Databricks provides a feature called "Workspace ACLs" that can help you achieve departmental secrecy in a single existing Databricks resource. With Workspace ACLs, you can control access to workspaces and folders within a workspace. You can create access control lists (ACLs) for users, groups, and service principals, and assign them to workspaces and folders.

    However, it is not possible to add multiple workspaces to a single Databricks resource. An Azure Databricks account can include multiple workspaces, but each workspace requires its own Databricks resource.

    Unity Catalog provides centralized access control, auditing, lineage, and data discovery capabilities across Azure Databricks workspaces.

    Unity Catalog diagram

    Regarding the cost, the pricing for Azure Databricks is based on the type of instance you choose and the amount of time you use it. You can find more information about pricing on the Azure Databricks pricing page.

    Hope this helps. Do let us know if you any further queries.

    If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

0 additional answers

Sort by: Most helpful
Most helpful Newest Oldest

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.