How is GPU usage billed?

Martin Wackenhut 0 Reputation points
2023-11-20T11:17:21.7566667+00:00

Hi,

could someone please enlighten me on the billing of a gpu container with azure container instance?

I want to deploy a container with an LLM and UI on top. But usage is very minimal, about 1h max per day.

What costs do I have to expect for this setup?

My understanding would be:

  • Some basic infrastructure costs for the container group etc.
  • But how about the running container? Majority of the day the gpu will not be used.
    If I unload the llm as well gpu and VRAM usage would be zero for 23h/day. So I'd assume costs would be ~1€/$ per day
  • What if I keep the llm in VRAM?

Thanks a lot for your help

Azure Container Instances
Azure Container Instances
An Azure service that provides customers with a serverless container experience.
687 questions
Azure Cost Management
Azure Cost Management
A Microsoft offering that enables tracking of cloud usage and expenditures for Azure and other cloud providers.
2,471 questions
0 comments

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. mutaz-msft 2,346 Reputation points Microsoft Employee
    2023-11-20T11:46:40.6033333+00:00

    Hi @Martin Wackenhut,

    This is the cost per hour and you can refer to this link for more details: https://azure.microsoft.com/en-us/pricing/details/container-instances/
    User's image

    0 comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.