320 questions with Azure Batch tags

Sort by: Updated
1 answer

Azure Data Factory Pipeline Queued status even when batch node is idle

Hi, I have multiple triggers for my data factory jobs, which use integration runtime and run on a dedicated single node. Sometimes, even when the node is idle, the pipeline stays in queued stayed for an hour and then fails due to runtime error. The…

Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
320 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,015 questions
asked 2023-04-26T15:57:32.34+00:00
Muhammad Hamza Shafiq 0 Reputation points
commented 2023-05-11T06:14:32.33+00:00
AnnuKumari-MSFT 31,816 Reputation points Microsoft Employee
0 answers

Can I run a Blender script as an Azure Batch?

I would like to run Blender w/ my input script and input file in Azure Batch just as I do from the command line. My Python script (Python is the built-in scripting language of Blender) takes the input file, does some manipulations and saves a few images…

Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
320 questions
asked 2023-04-21T13:58:21.6766667+00:00
Francesca 5 Reputation points
commented 2023-05-10T05:53:31.0566667+00:00
Prrudram-MSFT 22,941 Reputation points
1 answer

Hi Team, How can I use azure batch to process a large json ,I want to chuck that data and want to process it .

I have a rest end point where I am getting a large json as a request body , I want to process that json using azure batch.

Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
320 questions
asked 2023-04-24T09:04:53.36+00:00
Shailendra Namdeo 0 Reputation points
commented 2023-05-02T08:10:28.9533333+00:00
KarishmaTiwari-MSFT 18,747 Reputation points Microsoft Employee
2 answers

Azure Batch Job Creation using az batch job create --template argument not recgonise

Hi, I try to create task using the job template but the following command no longer supported: az batch job create --template job.json This command will prompt for pool id and job id, but instead the command is now "az batch job…

Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
320 questions
asked 2022-10-27T01:37:09.333+00:00
SoonJoo@Genting 241 Reputation points
commented 2023-04-30T05:55:24.9433333+00:00
Rahl Kumar 0 Reputation points
2 answers One of the answers was accepted by the question author.

Azure CLI DevOps deploy fails with exit code: 1

Hi Q&A, Im having issues with deploying Azure CLI scrips in DevOps. And the only error that im getting is “2023-04-27T07:15:49.8277936Z ##[error]Script failed with exit code: 1” The script I’m trying to initiate is to change the tier on app service…

Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
320 questions
PowerShell
PowerShell
A family of Microsoft task automation and configuration management frameworks consisting of a command-line shell and associated scripting language.
2,272 questions
asked 2023-04-27T07:43:36.3966667+00:00
Nibbler 616 Reputation points
accepted 2023-04-27T19:52:28.5433333+00:00
Nibbler 616 Reputation points
1 answer

Need to understand difference between Total Dedicated vCPUs and Dedicated vCPUs in Azure Batch

Hello All, I am new to Azure and currently in a learning phase. I wanted to know what is the difference between Total Dedicated vCPUs and Dedicated vCPUs in Azure Batch. I have created a Batch account and I see the Total Dedicated vCPUs shows as 10 and…

Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
320 questions
asked 2023-03-15T11:26:41.97+00:00
Learn Cloud 80 Reputation points
commented 2023-03-27T21:10:36.7266667+00:00
deherman-MSFT 34,931 Reputation points Microsoft Employee
0 answers

Hi Team, Try to upload large file > 10 gb on azure blob storage in chunk using rest API from salesfroce using LWC.

Hi Team, Try to upload large file > 10 GB on azure blob storage in chunk using rest API from salesforce using LWC. How to resolve the issues of upload file in chunks in Azure from Salesforce to Azure through Lighting Web Components.

Azure Files
Azure Files
An Azure service that offers file shares in the cloud.
1,213 questions
Azure Storage Accounts
Azure Storage Accounts
Globally unique resources that provide access to data management services and serve as the parent namespace for the services.
2,871 questions
Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
2,576 questions
Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
320 questions
asked 2022-11-29T13:06:03.667+00:00
Sumit Gupta 1 Reputation point
commented 2023-03-27T08:51:58.23+00:00
Sumit Gupta 0 Reputation points
1 answer One of the answers was accepted by the question author.

Retirement Notice: Transition to Simplified compute node communication pools without public IP addresses before 31 March 2023 ???

Hello. I keep getting notices about "Retirement Notice: Transition to Simplified compute node communication pools without public IP addresses before 31 March 2023" (TRACKING ID: BNJ7-HC8 ) and when I go to the portal that exact ID and date…

Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
320 questions
asked 2023-03-24T16:36:31.72+00:00
sakman999 70 Reputation points
accepted 2023-03-24T21:19:20.4433333+00:00
sakman999 70 Reputation points
1 answer One of the answers was accepted by the question author.

Batch using docker image in python

Hi, I'm looking for an example for Azure batch using a docker image. I've found the example below, but I just can't get the syntax right to deploy multiple docker images and the example does not cover…

Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
320 questions
asked 2023-03-16T00:20:59.5233333+00:00
Jose Agraz 20 Reputation points
accepted 2023-03-21T00:31:39.5666667+00:00
Jose Agraz 20 Reputation points
2 answers

Python | Azure Batch

Hi I am trying to run python scripts inside azure batch accounts. I have provided managed identitiy access to batch accounts with permissions to storage in my python scripts, I am accessing azure storage account to list blobs in a container …

Azure Storage Accounts
Azure Storage Accounts
Globally unique resources that provide access to data management services and serve as the parent namespace for the services.
2,871 questions
Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
320 questions
asked 2022-12-13T12:02:18.473+00:00
Abhay Chandramouli 966 Reputation points
edited the question 2023-03-18T13:58:56.6033333+00:00
Sumarigo-MSFT 44,906 Reputation points Microsoft Employee
0 answers

Is anyone else having problems with resizing pools?

Hello There, I have 4 pools all stuck in resizing... is anyone else having this issue? Thanks Greg

Azure
Azure
A cloud computing platform and infrastructure for building, deploying and managing applications and services through a worldwide network of Microsoft-managed datacenters.
1,059 questions
Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
320 questions
asked 2023-03-02T16:40:45.0466667+00:00
Greg Bird 0 Reputation points
commented 2023-03-11T14:57:23.6166667+00:00
Prrudram-MSFT 22,941 Reputation points
0 answers

How to access _azbatch user created files in azure batch from non batch user ?

I have my files from storage account copied to this path in azure batch /mnt/batch/tasks/workitems/job-test/job-1/task-4/wd. But, im in a non batch user and unable to access the files created by the _azure batch user. I have elevatedlevel admin…

Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
320 questions
asked 2023-02-10T08:45:45.2066667+00:00
Samhitha Vootkoor 25 Reputation points
edited a comment 2023-03-11T02:56:26.0733333+00:00
KarishmaTiwari-MSFT 18,747 Reputation points Microsoft Employee
1 answer One of the answers was accepted by the question author.

How to find the Azure Batch Python client library in Conda packaging

I've started working with Azure Batch and use Python, with my Python environment managed by Anaconda. I'd like to install the Azure Batch Client Library and Azure Batch Management Client Library from the Azure SDK for Python in my Anaconda environments,…

Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
320 questions
asked 2023-03-06T20:21:35.05+00:00
Andrew Janke 25 Reputation points
accepted 2023-03-07T16:05:21.6366667+00:00
Andrew Janke 25 Reputation points
1 answer

Python in ADF: How to choose the best approach?

I have a simple python script that does some data processing that I want to run from within an ADF pipeline. I can see that there are multiple ways to do this: Azure Function Azure Batch Pool Databricks Python runbook I am starting from scratch as…

Azure Functions
Azure Functions
An Azure service that provides an event-driven serverless compute platform.
4,566 questions
Azure Virtual Machines
Azure Virtual Machines
An Azure service that is used to provision Windows and Linux virtual machines.
7,472 questions
Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
320 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,015 questions
asked 2023-03-03T11:26:37.73+00:00
ellishar 10 Reputation points
answered 2023-03-06T14:02:06.6433333+00:00
MughundhanRaveendran-MSFT 12,446 Reputation points
1 answer

How to stop an Azure Batch service

Hi, To offload a lot of data processing we have started to use Azure Batch services by creating a dedicated vm for this purpose. This service is going to start the Batch service and process the data for us. But we are not sure how to stop the…

Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
320 questions
Azure ISV (Independent Software Vendors) and Startups
Azure ISV (Independent Software Vendors) and Startups
Azure: A cloud computing platform and infrastructure for building, deploying and managing applications and services through a worldwide network of Microsoft-managed datacenters.ISV (Independent Software Vendors) and Startups: A Microsoft program that helps customers adopt Microsoft Cloud solutions and drive user adoption.
91 questions
asked 2022-07-04T11:15:24.233+00:00
Koteswara Pentakota 71 Reputation points
edited the question 2023-03-02T09:41:25.3333333+00:00
AnuragSingh-MSFT 21,236 Reputation points
1 answer One of the answers was accepted by the question author.

Does Azure Batch support Arm64 VMs?

Hi, does Azure Batch support Arm64 VMs? I don't see any "D2pds" listed in "az batch location list-skus".

Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
320 questions
asked 2023-02-26T16:08:16.91+00:00
Michael 20 Reputation points
accepted 2023-03-01T16:37:12.05+00:00
Michael 20 Reputation points
1 answer

Creating Pool from JSON in Azure Batch GUI: Could not find member 'vmSize' on object of type 'Pool'.

I am trying use a JSON file to create a pool in the Azure Batch Graphical User Interface. I click Add (JSON editor) and then upload the JSON below. I get this error message: "InvalidRequestBody: The specified Request Body is not syntactically valid.…

Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
320 questions
asked 2023-02-27T21:32:40.1866667+00:00
Sarah 0 Reputation points
edited a comment 2023-02-27T22:56:35.6166667+00:00
KarishmaTiwari-MSFT 18,747 Reputation points Microsoft Employee
2 answers

Is a Azure Batch dedicated node always running?

Hello, We use Azure Batch for a very simple task in Azure Data Factory. Recently it occured to us that we have very high VM costs and we're trying to find out why. We know the Azure billing tool might give us more insights, but we're working with a…

Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
320 questions
asked 2022-06-22T16:37:23.827+00:00
Erp, Wessel van 21 Reputation points
edited the question 2023-02-27T09:22:33.9266667+00:00
vipullag-MSFT 25,611 Reputation points
1 answer One of the answers was accepted by the question author.

IoT Device App Simulation In Batch

I want to deploy an IoT device app (. Net SDK ) as a console app or as background service in a batch using Azure Batch, App service, microservice, or any other method. It seems possible, as explained in the archived github projects. …

Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
320 questions
asked 2022-12-16T05:09:02.897+00:00
Chandra Mohan 461 Reputation points
edited the question 2023-02-14T22:18:59.2366667+00:00
QuantumCache 20,186 Reputation points
2 answers

How to solve Azure Batch node out of memory?

We're using Azure Batch to run a large number of custom job (python script) through our Azure Data Factory. We are encountering an issue where our pool node (VM=dsvm-win-2019) will process our datasets, but eventually it crashes with an…

Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
320 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,015 questions
asked 2023-01-17T10:16:34.6933333+00:00
aot 66 Reputation points
commented 2023-02-14T09:54:49.33+00:00
PRADEEPCHEEKATLA-MSFT 84,381 Reputation points Microsoft Employee