Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
320 questions
1 answer
One of the answers was accepted by the question author.
azure MPI inter node communications limit ?
I have just seen this page: https://video2.skills-academy.com/en-us/azure/batch/batch-quota-limit#pool-size-limits does this really mean that you can only run batch jobs that require inter-node communications on pools of no more than 80/100 nodes ? …
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(240, 0%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
1 answer
Azure Batch - Using Python with MPI
Does anyone know what is the best way to set things up to run parallel Python programs that use MPI on Azure Batch? There are obviously a number of things to consider - such as the mix of packages, how to deploy in a simple way, etc It looks like…
1 answer
How do I get an Azure Batch pool to resubmit after more cores become available?
I'm using AutoPools with Jobs in Azure Batch, therefore I have a 1-to-1 ratio of Pools to Jobs. If I submit a few jobs at the same time, one of them may be prevented from starting by the core quota on the Azure Batch account, i.e. the AutoPool would…
asked 2020-08-24T16:23:30.44+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(3.2, 28.999999999999996%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAT%3C/text%3E%3C/svg%3E)
Adam Talbot
1
Reputation point
commented 2020-09-01T15:22:59.803+00:00
prmanhas-MSFT
17,901
Reputation points Microsoft Employee
2 answers
All Pools added to Azure Batch are stuck in resizing
Every pool I add to my Azure Batch account becomes stuck in "resizing". This happens whether I use an autoscale formula or fixed size. It doesn't seem to matter what image or VM size I select. The error is as follows: Code:…
asked 2020-08-26T18:25:38.797+00:00
Adam Talbot
1
Reputation point
commented 2020-08-27T20:39:23.397+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(118.4, 98%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKM%3C/text%3E%3C/svg%3E)
KarishmaTiwari-MSFT
18,747
Reputation points Microsoft Employee
0 answers
Batch account deleting pool
Hi We have a batchaccount pool (it have to idle nodes) witch have had state "Deleting" since 06-08-2020 (18 days). None off the nodes is busy (have no pending jobs) and I can’t delete nodes while the pool is deleting. The pool have an…
asked 2020-08-24T09:50:40.67+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(272, 87%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHM%3C/text%3E%3C/svg%3E)
Henrik Madsen
1
Reputation point
commented 2020-08-25T08:06:54.18+00:00
vipullag-MSFT
25,606
Reputation points
2 answers
How to solve the error message when executing bat automation batch file? B A T C H R E C U R S I O N exceeds STACK limits
How to solve the error message when executing bat automation batch file? B A T C H R E C U R S I O N exceeds STACK limits I wrote a series of automated scripts, but after executing them, error messages will jump. How can I solve him? ****** B A T C…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(307.2, 98%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERR%3C/text%3E%3C/svg%3E)
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(76.8, 73%, 17%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESQ%3C/text%3E%3C/svg%3E)
1 answer
One of the answers was accepted by the question author.
Where could i find the stdout.txt and stderr.txt log files for the Start Task operation when the pool node reboots?
I am trying to install some R packages globally on a Azure -> Batch Account -> Pool -> Node. I have the following lines in the Pool -> Start Task textarea: cmd /c RScript.exe -e "install.packages('rpart',…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(32, 9%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ED%3C/text%3E%3C/svg%3E)
1 answer
Azure Batch : AzureFileShareConfiguration mount drive disconnected
Hello, I am trying to create a Pool using Azure Batch . I have uploaded content to Azure Storage using File Shares. I would like my Pool to mount this Azure File Share as virtual file system (ref:…
asked 2020-06-29T14:36:12.08+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(185.6, 97%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKV%3C/text%3E%3C/svg%3E)
Kale, Vaibhav
41
Reputation points
commented 2020-08-06T10:44:44.917+00:00
Sumarigo-MSFT
44,891
Reputation points Microsoft Employee
2 answers
One of the answers was accepted by the question author.
Determining free tier usage rights
Hi everyone, I went through https://azure.microsoft.com/en-us/free/free-account-faq/ and I can see that Batch service has been provided for free (always free) as per: I tried following all links, but couldn't really see how limited such…
asked 2020-07-22T13:42:05.537+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(265.6, 93%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPD%3C/text%3E%3C/svg%3E)
Pedro Diogo
21
Reputation points
accepted 2020-07-23T11:32:12.61+00:00
Pedro Diogo
21
Reputation points
1 answer
Azure Batch equivalent of FILE.AppendAllText
Hi, Could you please let me know the Azure Batch Service (Storage Account blob processing) equivalent of C# FILE.AppendAllText? Basically, I have an input file. I need to read it line by line with Stream Reader. Do transformation. Write the output…
asked 2020-06-26T16:01:24.083+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(252.8, 85%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EE%3C/text%3E%3C/svg%3E)
etl2016
1
Reputation point
commented 2020-07-13T11:04:57.847+00:00
prmanhas-MSFT
17,901
Reputation points Microsoft Employee
1 answer
Azure Batch Service - splitting or partitioning resource files
hi, Is there a way to split or partition Azure Batch Service's Resource Files (input files) so that the burden of input file processing is load-balanced and distributed among all available compute nodes? For instance, if I have an input file with 100k…
asked 2020-07-06T00:17:37.02+00:00
etl2016
1
Reputation point
commented 2020-07-13T10:58:14.943+00:00
prmanhas-MSFT
17,901
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
Custom Image and number of Pool recommended
Hello, I am building a Azure Batch application. This application is supposed to launch multiple pools using Shared Image Gallery images. As per the link:…
asked 2020-06-30T15:42:39.177+00:00
Kale, Vaibhav
41
Reputation points
accepted 2020-07-06T08:32:59.93+00:00
Kale, Vaibhav
41
Reputation points
0 answers
Accessing Keyvault with Azure Active Directory on Windows Azure Batch Pool Node
So I have a ton of python scripts I'm running on-prem. I want to move them all to Azure and started looking at the steps. Steps I took: I created an Azure Batch account - windows with the science variety so that python and all are already…
asked 2020-06-23T18:39:56.027+00:00
MattChandler-1653
1
Reputation point
commented 2020-06-29T22:47:34.74+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(214.4, 81%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMT%3C/text%3E%3C/svg%3E)
Marilee Turscak-MSFT
35,901
Reputation points Microsoft Employee
2 answers
NSG rule that 'BatchService' pool allocation mode generates in an Azure Batch
Quick question on the NSG rule that 'BatchService' pool allocation mode generates in an Azure Batch: Why is the ssh port 22 opened up to the world, while the VMs are completely hidden from the user? I tried disabling it at subnet level with no loss of…
asked 2020-06-08T01:47:22.727+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(124.80000000000001, 51%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAS%3C/text%3E%3C/svg%3E)
Ankur Soni @4dx
26
Reputation points
answered 2020-06-25T23:55:24.95+00:00
Ankur Soni @4dx
26
Reputation points
1 answer
One of the answers was accepted by the question author.
How can i create a Dynamics 365 Business Central image in a container in Azure ?
I am trying to deploy the image for Business Central , mcr.microsoft.com/businesscentral/sandbox:base in Azure , but get the error Error code ResourceOperationFailure Message The resource operation completed with terminal provisioning…
asked 2020-06-19T08:34:23.87+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(252.8, 92%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ED%3C/text%3E%3C/svg%3E)
Debbie
21
Reputation points
commented 2020-06-19T10:26:38.01+00:00
Leon Laude
85,711
Reputation points
1 answer
One of the answers was accepted by the question author.
How to design HA & DR for batch?
How to design HA & DR for batch? [Note: As we migrate from MSDN, this question has been posted by an Azure Cloud Engineer as a frequently asked question.] Source: FAQ
asked 2020-05-07T07:06:31.193+00:00
vipullag-MSFT
25,606
Reputation points
accepted 2020-06-09T13:28:44.913+00:00
vipullag-MSFT
25,606
Reputation points
1 answer
One of the answers was accepted by the question author.
How to move Batch accounts across regions?
I want to move existing Batch account from one region to another is this possible? [Note: As we migrate from MSDN, this question has been posted by an Azure Cloud Engineer as a frequently asked question.] Source: FAQ
asked 2020-05-07T07:00:38.59+00:00
vipullag-MSFT
25,606
Reputation points
accepted 2020-05-08T04:59:17.003+00:00
vipullag-MSFT
25,606
Reputation points
1 answer
One of the answers was accepted by the question author.
What is the maximum lifetime of a completed task?
What is the maximum lifetime of a completed task? [Note: As we migrate from MSDN, this question has been posted by an Azure Cloud Engineer as a frequently asked question.] Source: FAQ
asked 2020-05-07T06:58:19.42+00:00
vipullag-MSFT
25,606
Reputation points
accepted 2020-05-08T04:59:00.747+00:00
vipullag-MSFT
25,606
Reputation points
1 answer
One of the answers was accepted by the question author.
From Batch task created from portal, how can we redirect the output file to storage account?
From Batch task created from portal, how can we redirect the output file to storage account? [Note: As we migrate from MSDN, this question has been posted by an Azure Cloud Engineer as a frequently asked question] Source: MSDN Thread Link
asked 2020-05-07T06:52:37.207+00:00
vipullag-MSFT
25,606
Reputation points
accepted 2020-05-08T04:58:52.24+00:00
vipullag-MSFT
25,606
Reputation points
1 answer
How to get azure batch to share memory?
Trying to figure out how to get Azure Batch to share memory? Any leads especially sample script is appreciated
asked 2019-11-19T00:33:54.323+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(227.2, 69%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENM%3C/text%3E%3C/svg%3E)
Nicholas Manolakos
6
Reputation points
answered 2019-12-03T18:09:57.21+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(153.6, 92%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
ajkuma
24,151
Reputation points Microsoft Employee