Azure ML How to retrain published ML WebSerice (end point) using Jupyter Notebooks

M.Zhukov 1 Reputation point
2020-07-20T22:37:49.333+00:00

Hi Azure ML

We are using Azure Notebooks to train ML models. We are able to publish Web services then.(https://video2.skills-academy.com/en-us/azure/machine-learning/tutorial-deploy-models-with-aml)

Out data is stored in Azure Blob Storage. My qustions are:

1- How can i remotely (as from a web point) update the data at Blob Storage?

2- How Can I retrain model on that new data that is already publiched? Here I need some kind separate rest end point to be able to lunch retraining remotely.

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
2,848 questions
0 comments

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. YutongTie-MSFT 50,856 Reputation points
    2020-07-21T01:55:42.433+00:00

    Hi,

    The machine learning model workflow generally follows this sequence:

    Train

    Develop machine learning training scripts in Python, R, or with the visual designer.
    Create and configure a compute target.
    Submit the scripts to a configured compute target to run in that environment. During training, the scripts can read from or write to datastores. The logs and output produced during training are saved as runs in the workspace and grouped under experiments.
    Package - After a satisfactory run is found, register the persisted model in the model registry.

    Validate - Query the experiment for logged metrics from the current and past runs. If the metrics don't indicate a desired outcome, loop back to step 1 and iterate on your scripts.

    Deploy - Develop a scoring script that uses the model and Deploy the model as a web service in Azure, or to an IoT Edge device.

    Monitor - Monitor for data drift between the training dataset and inference data of a deployed model. When necessary, loop back to step 1 to retrain the model with new training data.

    workflow.png

    For your scenario, I would highly recommend you try Azure Machine Learning Designer, which works with Azure Notebook well and easy to use.

    IF you still want to stick with Notebook, I think creating pipelines will be good to you. https://video2.skills-academy.com/en-us/azure/machine-learning/how-to-create-your-first-pipeline?view=azure-devops

    Thanks,
    Yutong

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.