OpenAI service - Regional quota limits and availability

Jaroslav Galambosi Greetings & Welcome to Microsoft Q&A forum!

Please see the below answers to youir queries.

I guess TPM limits for LLMs are soft limits. e.g GPT-4-Turbo for region France Central is 80K TPM. I read this could be increased. Can somebody share information about what increase is feasible and how can be increase achieved?

The increase of the TPM limits purely depends on your scenario and needs.

When you create a model deployment, you have the option to assign Tokens-Per-Minute (TPM) to that deployment. TPM can be modified in increments of 1,000, and will map to the TPM and RPM rate limits enforced on your deployment.

If you are not sure about the capacity and would like to increase it dynamically, then you can follow the suggestions provided by Charlie. See Azure OpenAI Dynamic quota (Preview) for more information.

Dynamic quota is useful in most scenarios, particularly when your application can use extra capacity opportunistically or the application itself is driving the rate at which the Azure OpenAI API is called.

Typically, the situation in which you might prefer to avoid dynamic quota is when your application would provide an adverse experience if quota is volatile or increased.

For dynamic quota, consider scenarios such as:

• Bulk processing,
• Creating summarizations or embeddings for Retrieval Augmented Generation (RAG),
• Offline analysis of logs for generation of metrics and evaluations,
• Low-priority research,
• Apps that have a small amount of quota allocated.

Also, If you need to increase the limit for Azure OpenAI Service quotas and limits, you can apply for a quota increase through this form.

Are there anywhere rollout time plans of LLMs to be available in other regions/locations? Interested especially in GPT-4-Turbo.

Please note that model availability varies by different factors and also depends on the capacity constraints. Please see GPT-4 and GPT-4 Turbo Preview model availability for more details.

Currently, there is no exact information which can be shared when will these models be available in other regions.

Once these models are available in different regions, What's new in Azure OpenAI Service and Azure OpenAI Service models page will be updated accordingly with more details.

I would suggest you, keep an eye on the above for more updates.

I hope this answers your query. Do let me know if you have any further queries.

If the response helped, please do click Accept Answer and Yes for was this answer helpful.

Doing so would help other community members with similar issue identify the solution. I highly appreciate your contribution to the community.