Unable to use GPUs in container instances

CD 10 Reputation points
2024-07-01T16:19:17.6166667+00:00

I tried to deploy an image on Azure container instance with 1 GPU instance. It fails with the following error.

Resource type 'Microsoft.ContainerInstance/containerGroups' container group quota 'V100Cores' exceeded in region 'eastus'. Limit: '0', Usage: '0' Requested: '1'

And as I refer to the docs, I see that the GPU limit is 0.
How to deploy the container instance with GPUs?

Azure Container Instances
Azure Container Instances
An Azure service that provides customers with a serverless container experience.
669 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. kobulloc-MSFT 25,731 Reputation points Microsoft Employee
    2024-07-01T17:37:22.5466667+00:00

    Hello, @CD !

    How do I increase the GPU quota for Azure Container Instances?

    It's important to note that not all limit increase requests are guaranteed to be approved. Using GPU resources with Azure Container Instances is still in preview and not fully supported yet. Any support is provided on a best-effort basis.

    https://video2.skills-academy.com/en-us/azure/container-instances/container-instances-resource-and-quota-limits#default-quota-limits

    Make sure you meet the following requirements:

    • Azure virtual network deployment not supported
    • Only available on Linux container groups

    If you meet the requirements you can request an increase by submitting an Azure support request (select "Quota" for Issue type). Remember that using GPU resources (preview) is not fully supported yet and any support is provided on a best-effort basis.

    I hope this has been helpful! Your feedback is important so please take a moment to accept answers.

    If you still have questions, please let us know what is needed in the comments so the question can be answered. Thank you for helping to improve Microsoft Q&A!

    User's image

    0 comments