Azure OpenAI Fine-Tuning Model Deployment "Model is not ready" Error

Hyo-Jin Jang 0 Reputation points
2024-07-08T23:22:24.7166667+00:00

I conducted fine-tuning of Azure OpenAI. After fine-tuning, I distributed the model and confirmed that the deployment was successful.

Working with PromptFlow to use the deployed model, "openai.NotFoundError: Error code: 404 - {'error': {'message': 'Model is not ready' error continues to occur, but occurs intermittently.

The response comes normally, and then the response doesn't come normally, it keeps repeating itself. What is the solution to this?

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,042 questions
Azure AI services
Azure AI services
A group of Azure services, SDKs, and APIs designed to make apps more intelligent, engaging, and discoverable.
2,833 questions
0 comments

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. hossein jalilian 7,055 Reputation points
    2024-07-08T23:40:18.0366667+00:00

    Thanks for posting your question in the Microsoft Q&A forum.

    Here are steps you can follow to troubleshoot and possibly resolve the issue:

    • Check the deployment status in the Azure OpenAI Studio to ensure it's consistently showing as Succeeded.
    • Ensure that your deployment has sufficient capacity to handle the requests. If you're using a low-capacity deployment, it might struggle during periods of high demand.
    • Intermittent network issues between PromptFlow and Azure OpenAI Service could cause this problem.
    • Ensure that PromptFlow is correctly configured to use your fine-tuned model.
    • Implement retry logic in your PromptFlow setup to handle transient errors.

    Please don't forget to close up the thread here by upvoting and accept it as an answer if it is helpful

    0 comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.