Azure On-Demand ML cluster from a search in the data catalog

Jairo Melo 31 Reputation points
2021-04-23T20:28:46.297+00:00

I'm trying to implement a self-service solution in Azure so users can run a Jupyter or PySpark notebook on-Demand/automatically with the dataset they found a search in the Azure Data Catalog. I visualize, once the user finds the data in a search, there will be a link that will take him/her to a Notebook and the dataset can be used for analysis. Any suggestion would be very much appreciated!

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
2,852 questions
Azure Data Catalog
Azure Data Catalog
An Azure service that serves as a system of registration and system of discovery for enterprise data assets.
102 questions
Accepted answer
  1. Ramr-msft 17,736 Reputation points
    2021-04-26T10:22:10.247+00:00

    @Jairo Melo Thanks for the question.Azure Purview can find, understand, and consume data sources. Please follow the Azure Purview documentation: https://video2.skills-academy.com/en-us/azure/purview/

    and We have Azure Open Datasets where you can download a Notebook for AML, Databricks or Synapse that explores the data: Azure Open Datasets Catalog | Microsoft Azure. What are open datasets? Curated public datasets - Azure Open Datasets | Microsoft Learn.

    0 comments

1 additional answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. Jairo Melo 31 Reputation points
    2021-04-28T11:51:31.093+00:00

    Thank you very much for your response. I'll look into Azure Purview. Best! J.

    1 person found this answer helpful.
    0 comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.