Can a single instance of Microsoft Purview scan multiple Azure Databricks Unity Catalog instances that exist in different logical data domains?

Erich Huckschlag 20 Reputation points
2024-06-04T21:03:01.6766667+00:00

I am researching a use case where a single instance of Microsoft Purview can be used to scan multiple instances of Azure Databricks Unity Catalogs hosted in multiple logical / geographical domains, including using OpenLineage to provide lineage data to Purview, thus providing an aggregated view of all data assets.

The crux of the question is, can a single instance of Purview connect to and scan multiple instances of Unity Catalog?

PS: None of the articles or answers mention scanning multiple Unity Catalogs.

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,042 questions
Microsoft Purview
Microsoft Purview
A Microsoft data governance service that helps manage and govern on-premises, multicloud, and software-as-a-service data. Previously known as Azure Purview.
1,026 questions
0 comments
Accepted answer
  1. PRADEEPCHEEKATLA-MSFT 84,051 Reputation points Microsoft Employee
    2024-06-05T03:59:37.77+00:00

    @Erich Huckschlag - Thanks for the question and using MS Q&A platform.

    Microsoft Purview currently does not support scanning multiple instances of Azure Databricks Unity Catalogs hosted in different logical or geographical domains.

    Each scan configuration in Microsoft Purview can only be associated with a single instance of Azure Databricks Unity Catalog. If you need to scan multiple instances of Azure Databricks Unity Catalogs hosted in different domains, you will need to create separate scan configurations for each instance.

    For more details, refer to Connect to and manage Azure Databricks Unity Catalog in Microsoft Purview.

    Appreciate if you could share the feedback on our feedback channel. Which would be open for the user community to upvote & comment on. This allows our product teams to effectively prioritize your request against our existing feature backlog and gives insight into the potential impact of implementing the suggested feature.

    Hope this helps. Do let us know if you any further queries.

    If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

    1 person found this answer helpful.

0 additional answers

Sort by: Most helpful
Most helpful Newest Oldest