3,060 questions with Azure Machine Learning tags

Sort by: Updated
1 answer

What is the latency and cost of A100 gpu

Hi team, I want to deploy fine-tuned model on Azure. If I use llama3.1-8b model, the input is 4k token and output is 512 token. What is the latency if I deploy the model to A100 gpu ? What is the economy cost for each A100 gpu ? Do we support vllm…

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
3,060 questions
asked Jan 1, 2025, 7:18 PM
Michael Dong 40 Reputation points Microsoft Employee
commented Jan 8, 2025, 10:35 AM
AshokPeddakotla-MSFT 35,581 Reputation points
1 answer

How to do A/B test on Azure

Hi Team, I want to deploy fine-tuned Qwen2.5B model on Azure, how do I do A/B test or online experiment for model version A and model version B ?

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
3,060 questions
asked Jan 1, 2025, 7:21 PM
Michael Dong 40 Reputation points Microsoft Employee
edited the question Jan 8, 2025, 10:34 AM
AshokPeddakotla-MSFT 35,581 Reputation points
0 answers

(new)AML Continuous Monitoring | Mapping Ground Truth Data for Model Performance Monitoring in Azure Machine Learning

This is the new post as my first post couldn't be viewed( shown 404 error after I clicked it) Greetings, I am reading the document regarding MLOps and would like to continuously monitor the ML model deployed inside Azure Machine Learning. The goal of…

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
3,060 questions
Azure Functions
Azure Functions
An Azure service that provides an event-driven serverless compute platform.
5,282 questions
Azure Event Grid
Azure Event Grid
An Azure event routing service designed for high availability, consistent performance, and dynamic scale.
411 questions
asked Jan 7, 2025, 8:45 PM
BOON HAWAREE 0 Reputation points
edited a comment Jan 8, 2025, 7:34 AM
Vikram Singh 0 Reputation points Microsoft Employee
2 answers One of the answers was accepted by the question author.

Issue with the sandbox being unavailable on Microsoft Azure Fundamentals

Hey everyone, I’ve been trying to use the MS Learn Sandbox for a module, but I keep running into this annoying error message: “The sandbox for this module is currently unavailable. We're working to resolve this as quickly as possible. In the meantime,…

SQL Server on Azure Virtual Machines
Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
3,060 questions
Azure Virtual Machines
Azure Virtual Machines
An Azure service that is used to provision Windows and Linux virtual machines.
8,202 questions
Microsoft Teams
Microsoft Teams
A Microsoft customizable chat-based workspace.
10,616 questions
Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,490 questions
asked Jan 2, 2025, 9:25 PM
luis baldassari 40 Reputation points
answered Jan 8, 2025, 12:28 AM
Arun Kumar M 0 Reputation points
1 answer One of the answers was accepted by the question author.

Feature request for Azure ML online endpoints

Hi, I use AML online endpoints a lot. The "test" panel is very helpful. However, the data in the test request gets zeroed out when I navigate off this page. I currently duplicate the browser tab and navigate to the "logs" panel so I…

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
3,060 questions
asked Jan 7, 2025, 2:43 PM
Ben Steenhoek 0 Reputation points Microsoft Employee
accepted Jan 7, 2025, 4:06 PM
Ben Steenhoek 0 Reputation points Microsoft Employee
1 answer

How to deploy an LLM in a batch endpoint in Azure Machine Learning? Any alternatives?

Hi, I'm trying to deploy an LLM in Azure Machine Learning in a batch endpoint. I was successful in creating an online endpoint, but facing issues with batch endpoint. The goal of the project is to deploy an LLM that will run every morning and produce…

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
3,060 questions
asked Dec 7, 2024, 6:13 AM
Karlos Muradyan 0 Reputation points
edited the question Jan 7, 2025, 1:25 PM
Nikhil Duserla 3,720 Reputation points Microsoft Vendor
0 answers

AZURE ML STUDIO (FACING PROBLEM IN DEPLOYMENT)

Not enough quota available for Standard_D2as_v4. Current usage/limit: 0/4. Additional requested: 8 (20% more quota than expected may be needed for redundancy purposes on some SKUs) I am facing a problem while deploying model in selecting Virtual machine…

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
3,060 questions
Azure Virtual Machines
Azure Virtual Machines
An Azure service that is used to provision Windows and Linux virtual machines.
8,202 questions
asked Jan 3, 2025, 6:25 PM
srilatha palleti 0 Reputation points
commented Jan 7, 2025, 9:46 AM
kothapally Snigdha 845 Reputation points Microsoft Vendor
0 answers

Automl Model Deploy Fails On Gunicorn Version Conflict

Hello, I am attempting to deploy an automl model to a real time endpoint, when I do I am getting a pip error about dependency conflicts between gunicorn and mlflow. It seems these install are dynamically added by azure? What can I do to get past this…

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
3,060 questions
asked Jan 4, 2025, 12:35 AM
gwinner 0 Reputation points
commented Jan 6, 2025, 1:24 PM
gwinner 0 Reputation points
2 answers

Azure Machine Learning Studio creates v1 deployments that can't be tested in Studio

If you use AutoML in Azure Machine Learning Studio to train a model and then deploy that model to an Azure Container Instance, you can't test the deployment using Studio. When you click on the Test tab, it comes back with "This deployment is based…

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
3,060 questions
asked Dec 30, 2024, 3:33 PM
Guy Hummel 0 Reputation points
answered Jan 6, 2025, 11:29 AM
Guy Hummel 0 Reputation points
1 answer

Not able to subscribe LLama-3.3-70B-Instruct with Microsoft Azure Sponsorship Account

Hello Team, Greetings of the day!! I would like to inform you that one of my customers is not able to subscribe LLama-3.3-70B-Instruct with Microsoft Azure Sponsorship Account. He attempted to subscribe to the LLama-3.3-70B-Instruct via both the…

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
3,060 questions
Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,490 questions
asked Jan 2, 2025, 2:38 AM
Naveen Kottanti (MINDTREE LIMITED) 0 Reputation points Microsoft Vendor
commented Jan 6, 2025, 6:36 AM
Naveen Kottanti (MINDTREE LIMITED) 0 Reputation points Microsoft Vendor
1 answer

what is difference between AKS and machine learning compute

Azure offers managed compute resources, including Azure Kubernetes Service (AKS) or Azure Machine Learning Compute. I want to upload fine-tuned LLM like Qwen2.5 or llama3.1 to Azure and online serving with these fine-tuned models, what is difference…

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
3,060 questions
asked Jan 2, 2025, 5:54 PM
Michael Dong 40 Reputation points Microsoft Employee
edited the question Jan 6, 2025, 4:43 AM
Saideep Anchuri 705 Reputation points Microsoft Vendor
0 answers

"Error 'Resource provider not registered' when deploying model in Azure ML Tutorial (Free Trial)"

Hi, I'm following the Microsoft Learn tutorial "Create a classification model with Azure Machine Learning designer" (https://microsoftlearning.github.io/mslearn-ai-fundamentals/Instructions/Labs/01-machine-learning.html) with an Azure Free…

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
3,060 questions
asked Dec 21, 2024, 1:33 AM
YUTA 5 Reputation points
commented Jan 6, 2025, 4:35 AM
navba-MSFT 27,185 Reputation points Microsoft Employee
1 answer

Private Azure Machine Learning Workspace getting forbidden to reach private Storage Account for SAS

My Azure Machine learning workspace is configured with private endpoint , my aml is configured to a Storage account which is also configured private endpoint and disabled the public access, My Storage Account network will looks like below The…

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
3,060 questions
Azure Storage Accounts
Azure Storage Accounts
Globally unique resources that provide access to data management services and serve as the parent namespace for the services.
3,306 questions
asked Jul 26, 2024, 4:34 AM
Jay 86 Reputation points
commented Jan 4, 2025, 9:29 AM
Marcus Isnard 0 Reputation points
0 answers

Why this error is occuring whille traning custom extraction model ?

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
3,060 questions
asked Jan 2, 2025, 6:33 AM
Ashish Ranjan 20 Reputation points
commented Jan 4, 2025, 2:10 AM
AshokPeddakotla-MSFT 35,581 Reputation points
1 answer

How to rerun successful AzureML Pipeline

I have a successful pipeline that writes files to Blob storage. If I delete the files in blob storage and try to rerun the pipeline, the pipeline run is cached so the pipeline doesn't actually rerun. Is there a way to force rerun the pipeline?

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
3,060 questions
asked May 11, 2023, 10:04 PM
Dance, Cody R. (ALT) 35 Reputation points
commented Jan 3, 2025, 8:00 AM
Ameya Bhave 0 Reputation points
3 answers

I am trying to schedule my azure ml command job. It runs fine the first time but from second occurrence, it directly goes into completed state!

I am trying to schedule a command job using bicep. It gets executed as expected the first time but then from 2nd time the job directly goes into completed state. resource jobResource 'Microsoft.MachineLearningServices/workspaces/schedules@2023-10-01' =…

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
3,060 questions
asked Feb 20, 2024, 3:49 PM
Makarand Batchu 5 Reputation points
commented Jan 3, 2025, 7:43 AM
Ameya Bhave 0 Reputation points
0 answers

Why can't I select Standard_NC6s_v3 as my endpoint Virtual Machine?

I'm trying to deploy my endpoint, and I wish to select Standard_NC6s_v3 as my VM, but the issue is that it only allows me to select up to these VMs. The NC6s falls into the following category (not enough quota). At first, I thought that it was related…

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
3,060 questions
asked Jan 2, 2025, 1:27 AM
Jacky Lee 0 Reputation points
edited the question Jan 2, 2025, 6:57 AM
AshokPeddakotla-MSFT 35,581 Reputation points
0 answers

How to do the load balancer, tracking event and log

Hi Team, I want to deploy my fine-tuned LLM like Qwen2.5 model to Azure: How do you do the load balancer between different host or gpus ? How do you record the tracking and log on the Azure disk space ?

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
3,060 questions
Azure AI services
Azure AI services
A group of Azure services, SDKs, and APIs designed to make apps more intelligent, engaging, and discoverable.
3,033 questions
asked Jan 1, 2025, 7:15 PM
Michael Dong 40 Reputation points Microsoft Employee
commented Jan 2, 2025, 5:47 AM
AshokPeddakotla-MSFT 35,581 Reputation points
1 answer

AzureMLException: Error in Streaming from Input Data Sources

An AzureMLException is encountered with the message "Error Code: ScriptExecution.StreamAccess.Unexpected Native Error: error in streaming from input data sources" when using the 'Apply SQL Transformation' component in the Azure ML designer…

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
3,060 questions
asked Dec 6, 2024, 4:38 PM
Noveen Haseeb 45 Reputation points
commented Jan 2, 2025, 2:54 AM
Noveen Haseeb 45 Reputation points
1 answer One of the answers was accepted by the question author.

In Azure ML studio deploy option is not there

Hi team im new to Azure ML studio in that i done trained data but i would like to deploy im in trial account i dont see option for deploy i can able to see only submit , share like that only please help

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
3,060 questions
asked Apr 1, 2023, 8:41 AM
Manoj P 30 Reputation points
commented Jan 1, 2025, 12:59 PM
Vijayalakshmi Yuvaraj 0 Reputation points