how to productionize custom vision model using Azure MLOPS?

Parthib Rathinam 0 Reputation points
2024-08-31T23:26:29.7966667+00:00

Hi,

I have project requirement to build object detection model using company's dataset for manufacturing defects. I found custom vision is suitable, I trained , results look pretty good. But I have following questions to productionize this model.

  1. In the model response, cannot see the bounding box co-ordinates details as json format, is there any API i can use to fetch these data in the response?
  2. How to put this model into production and build end to end pipeline?.
  3. How to deploy this model on the edge device?
  4. How to monitor the performance of deployed model , for example , show the dashboard which shows how many http requests came in, model accuracy, any data drift, server crash details etc. Thanks,
Azure Computer Vision
Azure Computer Vision
An Azure artificial intelligence service that analyzes content in images and video.
366 questions
{count} votes

1 answer

Sort by: Most helpful
  1. santoshkc 7,865 Reputation points Microsoft Vendor
    2024-09-02T14:14:18.4866667+00:00

    Hi @Parthib Rathinam

    Thanks for the question and using MS Q&A platform. 

    In the model response, cannot see the bounding box co-ordinates details as json format, is there any API i can use to fetch these data in the response?

    You can retrieve bounding box coordinates from your Azure Custom Vision model using the Prediction API. After sending an image for prediction, the API returns a response with the bounding box details. See: custom vision SDK

    How to put this model into production and build end to end pipeline?

    To productionize your Azure Custom Vision model, train and publish it, then integrate it using the Prediction API. Set up Azure Functions or App Service for handling requests, and use Azure Blob Storage for storing images. Automate workflows with Azure Logic Apps and implement CI/CD with Azure DevOps. Ensure scalability and secure access with auto-scaling and Azure Active Directory. This creates a robust and secure end-to-end pipeline for your model in production.

    How to deploy this model on the edge device?

    To deploy your Custom Vision model to an edge device, you can use Azure IoT Edge. Azure IoT Edge is a fully managed service that allows you to deploy and run cloud services, including machine learning models, on edge devices.

    Please see: The edge with Custom Vision Service.

    How to monitor the performance of deployed model , for example , show the dashboard which shows how many http requests came in, model accuracy, any data drift, server crash details etc.

    To monitor the performance of an Azure Custom Vision deployed model, start by leveraging the Azure Portal to access performance metrics such as accuracy, precision, and recall through the "Performance" tab of your Custom Vision resource. Set up Azure Alerts to notify you of any anomalies or performance degradation. Regularly evaluate the model’s predictions with real or sample data and analyze usage patterns to understand how the model is performing under different conditions. By these approaches, you can effectively oversee and enhance the performance of your Custom Vision model.

    See: Azure-monitor and azure-monitor_alerts.

    I hope you understand. Thank you.

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.