Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
318 questions
1 answer
The specified account has reached core quota
we are reaching issue "reached core quota", but our subscription shows we do have quota and 0 of 100 usesed. we are not able to create vm pool for batchaccount. West US 2 Quota Usage New limit Delete quota Standard Dv3 Family vCPUs 0 of 100
asked 2024-06-28T14:06:44.4733333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(192, 7.000000000000001%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGH%3C/text%3E%3C/svg%3E)
George Hu
16
Reputation points Microsoft Employee
answered 2024-06-28T14:46:41.0033333+00:00
deherman-MSFT
34,841
Reputation points Microsoft Employee
1 answer
The costing for the Batch services and I have trouble running my Python job in Azure Batch because the required directories are not present on the Batch node.
I would like to know how Batch service is charged. When I run my Python jobs through ADF's Batch service, I get som troubles. For example: My test.py script and the utils folder are located in the run_python folder. The test.py script calls the…
asked 2024-06-20T05:46:01.7566667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(278.4, 9%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EZX%3C/text%3E%3C/svg%3E)
谢志青 Zhiqing Xie
40
Reputation points
edited a comment 2024-06-28T06:17:01.17+00:00
谢志青 Zhiqing Xie
40
Reputation points
1 answer
Ubuntu 24.04 image on Azure Batch node - when it will be available?
Hi, I've noticed that it is already available in Azure Virtual Machines image marketplace, but it's not yet in Azure Batch. Is there a known date for the release of this SKU on Azure Batch nodes?
asked 2024-06-24T11:45:54.3366667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(281.6, 62%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESM%3C/text%3E%3C/svg%3E)
Sobczyk Maciej
0
Reputation points
commented 2024-06-28T05:39:46.08+00:00
Deepanshukatara-6769
6,715
Reputation points
1 answer
How to set up ADF Python script to access an external SFTP with Firewall Exceptions (whitelist)?
I am working on an ADF pipeline. One of the steps will include a Python script that connects to an external SFTP, download some files and upload them to my Storage Account. The SFTP owner asked to share the IP that he should add to Firewall exceptions so…
asked 2024-06-24T12:08:45.5766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(99.2, 20%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3E14%3C/text%3E%3C/svg%3E)
11-4688
111
Reputation points
edited the question 2024-06-25T17:05:05.81+00:00
KapilAnanth-MSFT
39,206
Reputation points Microsoft Employee
0 answers
How to fix Cannot find a VM for task 'NFCORE_RNASEQ:RNASEQ:PREPARE_GENOME:UNTAR_SALMON_INDEX (salmon.tar.gz)' matching these requirements: type=Standard_E20ads_v5, cpus=1, mem=6 GB, location=germanywestcentral ?
Bug report I am trying to use Azure batch with Nextflow and Seqera, but I cant initiate any job because of wrong VM name, location name or not matching any VM of this name at the specific region. Expected behavior and actual behavior I am running this…
asked 2024-06-19T14:04:55.2133333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(6.4, 71%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ELA%3C/text%3E%3C/svg%3E)
Lampros Androutsos
0
Reputation points
commented 2024-06-20T04:42:04.8333333+00:00
vipullag-MSFT
25,606
Reputation points
0 answers
Azure Batch - Nodes will not leave the pool (stuck in leaving pool state)
We have had a batch system running for years. Recently we have seen issues where our node pools will scale up no problem, but will fail to scale down for hours stuck in 'leaving' state. This is currently happening and I have no way to remove the nodes…
asked 2024-06-17T16:24:15.8433333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(230.39999999999998, 87%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBB%3C/text%3E%3C/svg%3E)
Brian Bertrand
21
Reputation points
commented 2024-06-19T08:30:13.9233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(105.60000000000001, 79%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3END%3C/text%3E%3C/svg%3E)
Nikhil Duserla
480
Reputation points Microsoft Vendor
0 answers
Azure Batch better handle Unusable nodes
We have an Azure Batch pool with this Scale script: startingNumberOfVMs = 10; minVms = 0; maxNumberofVMs = 1200; maxAdditionalPerInterval = 200; pendingTaskSamplePercent = $PendingTasks.GetSamplePercent(180 * TimeInterval_Second); pendingTaskSamples =…
asked 2024-06-17T17:56:35.3433333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(134.4, 7.000000000000001%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ELS%3C/text%3E%3C/svg%3E)
Lucas Sabalka
0
Reputation points
commented 2024-06-18T16:13:45.48+00:00
Lucas Sabalka
0
Reputation points
1 answer
One of the answers was accepted by the question author.
PoolAddParameter - python add user assigned identity
I am creating Azure Batch Pool using the Python Batch SDK. How can I add user assigned identity when creating the PoolAddParameter? I've tried using BatchPoolIdentity. I've found a workaround, but it is not optimal. Scale down Pool nodes after…
asked 2024-06-17T14:13:24.0033333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(32, 57.00000000000001%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EEO%3C/text%3E%3C/svg%3E)
Emil Obrestad
20
Reputation points
accepted 2024-06-18T10:16:08.93+00:00
Emil Obrestad
20
Reputation points
1 answer
Unable to Create Azure Batch Pool Due to "Pool Quota Reached" Error Despite Having Zero Pools
I'm encountering an issue with Azure Batch where I'm unable to create a new batch pool. The error message I'm receiving is: poolquotaReached: pool quota for the account has been reached. However, when I check the quota, it shows that my current pool size…
asked 2024-06-12T12:48:18.69+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(252.8, 74%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESR%3C/text%3E%3C/svg%3E)
Stanley Ramakrishnan
0
Reputation points
answered 2024-06-13T05:35:14.3+00:00
Nikhil Duserla
480
Reputation points Microsoft Vendor
1 answer
Azure batch Job schedule issue
I need to create a Azure batch job schedule, this schedule should run everyday between 9 AM to 6 PM with recurrence interval of 1 hour, is there any option to achieve this
asked 2024-05-21T11:04:45.9633333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(224.00000000000003, 18%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESP%3C/text%3E%3C/svg%3E)
Sreenidhi Palimar
0
Reputation points
commented 2024-05-21T16:27:07.5733333+00:00
Sreenidhi Palimar
0
Reputation points
1 answer
Batch jobs need to schedule in between specific time
Hi Team, I want schedule azure - batch job between between 6 pm to 10 pm.
asked 2022-12-06T15:04:20.577+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(198.4, 83%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJB%3C/text%3E%3C/svg%3E)
Juturu Bhargav Reddy
1
Reputation point
edited a comment 2024-05-20T09:28:10.4033333+00:00
Sreenidhi Palimar
0
Reputation points
1 answer
Alternative for Azure Batch CLI extensions
Is there any alternative for below https://azure.microsoft.com/en-us/updates/azure-batch-cli-extensions-will-be-retired-on-30-september-2024/ Azure Batch CLI extensions will be retired on 30 September 2024 The Azure Batch CLI extensions override the “az…
asked 2024-05-14T04:43:16.3533333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(22.400000000000002, 40%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EIS%3C/text%3E%3C/svg%3E)
I, Sathavahana SBOBNG-PTIY/CMJ
0
Reputation points
commented 2024-05-15T15:28:55.3133333+00:00
vipullag-MSFT
25,606
Reputation points
0 answers
On Azure Batch for long running tasks the user submitting the task should be notified
Azure Monitor gives alert rules and actions but those are not dynamic enough for this use case. We have multiple users that use Batch to create pools and submit tasks. These jobs can take a long time to run and it would be nice to have a way to get…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(291.2, 52%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EN%3C/text%3E%3C/svg%3E)
1 answer
Attempting to add Storage Account to Batch Account using managed identity fails with 'InvalidAutoStorageAuthenticateMode' error?
We've got an Azure Batch account we'd like to setup with an existing storage account. We want to use managed identity to handle authentication. The storage account in question is within the same subscription and we have a user managed identity which…
Azure Storage Accounts
Azure Storage Accounts
Globally unique resources that provide access to data management services and serve as the parent namespace for the services.
2,854 questions
Azure
Azure
A cloud computing platform and infrastructure for building, deploying and managing applications and services through a worldwide network of Microsoft-managed datacenters.
1,055 questions
Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
318 questions
asked 2024-05-02T14:46:43.3966667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(54.400000000000006, 52%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Samuel Taylor-Hansen
0
Reputation points
commented 2024-05-10T05:17:52.5833333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(150.4, 64%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENR%3C/text%3E%3C/svg%3E)
Nehruji R
3,971
Reputation points Microsoft Vendor
1 answer
Creating Azure Batch Pools using Azure.ResourceManager.Batch package
Is there any sample code available for creating Azure Batch Pools using Azure.ResourceManager.Batch package? https://video2.skills-academy.com/en-us/dotnet/api/azure.resourcemanager.batch.batchaccountpoolresource.createresourceidentifier?view=azure-dotnet
asked 2024-05-08T21:57:03.29+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(236.8, 52%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EZS%3C/text%3E%3C/svg%3E)
ZIA SAEED
0
Reputation points
answered 2024-05-09T02:41:37.4466667+00:00
vipullag-MSFT
25,606
Reputation points
1 answer
One of the answers was accepted by the question author.
How to recover when an Azure batch pool fails to allocate nodes
Our application uses several types of batch pools. There are two fixed pools (for tasks with and w/o MPI) and a continuous web job that manages scaling every minute. For larger tasks, we create a new pool with up to 20 nodes. Occasionally batch fails…
asked 2024-05-06T17:14:28.05+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(275.2, 77%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGJ%3C/text%3E%3C/svg%3E)
Green, Jim
20
Reputation points
accepted 2024-05-08T16:18:27.75+00:00
Green, Jim
20
Reputation points
1 answer
Error in getCluster(clusterName = "myPoolName") : Code: AccountCoreQuotaReached - Message: The specified account has reached core quota Code: AccountLowPriorityCoreQuotaReached - Message: The specified account has reached low priority core quota
In R programming, I am trying doAzureParallel for the first time and I encountered this cluster quota error: Error in getCluster(clusterName = "myPoolName") : Code: AccountCoreQuotaReached - Message: The specified account has reached core…
asked 2024-05-06T03:29:15.14+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(35.2, 81%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMF%3C/text%3E%3C/svg%3E)
Mathew Fok
0
Reputation points
answered 2024-05-06T20:53:27.3033333+00:00
deherman-MSFT
34,841
Reputation points Microsoft Employee
1 answer
The request to update workflow failed. The trigger 'Batch-Trigger' of type 'Batch' cannot be deleted from existing workflow
I have created a Batch Trigger in azure logic apps and named a trigger "Batch-Trigger" , i am trying to change the name of the trigger since it's so generic, but not able to update the trigger name it gives below error. Workflow 'workflow…
asked 2024-04-26T16:47:26.9333333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(227.2, 88%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVP%3C/text%3E%3C/svg%3E)
Vijay Prasath P
0
Reputation points
answered 2024-04-28T17:55:34.71+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(150.4, 28.000000000000004%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESG%3C/text%3E%3C/svg%3E)
Saravanan Ganesan
1,745
Reputation points MVP
0 answers
Azure Batch job creation with ADF pipeline while debug the python script in command line facing issue
Operation on target ForEach1 failed: Activity failed because an inner activity failed Error details Error code 2500 Troubleshooting guide Failure type User configuration issue Details …
asked 2021-09-08T08:26:24.497+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(41.6, 50%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESK%3C/text%3E%3C/svg%3E)
shweta kumari
6
Reputation points
commented 2024-04-22T12:34:23.95+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(262.40000000000003, 8%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ELB%3C/text%3E%3C/svg%3E)
Layla Bitar
0
Reputation points
0 answers
What is the replacement for batch-insights?
I was using batch-insights on azure batch on Centos 7.9. Those scripts don't work on Alma Linux and Centos is EOLd. batch-insights repo is read-only so what is the replacement so that i can see the cpu and io disk usage via Azure BatchExplorer, etc.