How can I fix my fine tuning failed error? Error: "Fine tune failed during postprocessing"

Kayla Farivar 20 Reputation points
2024-06-27T21:00:07.23+00:00

I started a fine tuning model through the azure openai studio and after an hour saw that my model failed. The studio says close to nothing to help understand the error. I believe my training and validation JSONL file are in correct shape and I'm not sure what else to poke at. The output given from the studio is below:

Screenshot 2024-06-27 at 1.58.44 PM

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
2,528 questions
Azure AI services
Azure AI services
A group of Azure services, SDKs, and APIs designed to make apps more intelligent, engaging, and discoverable.
2,567 questions
0 comments

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. Kamil Krawczyk 80 Reputation points
    2024-06-28T08:25:30.5666667+00:00
    1. Check your training and validation files: Ensure that your JSONL files for training and validation are correctly formatted and free of errors. Data formatting issues often lead to failures in the fine-tuning process.
    2. Verify resource limits: Make sure you have sufficient resources and are not exceeding any limits in your Azure OpenAI plan.
    3. Ensure base model compatibility: Verify that the chosen base model is suitable for fine-tuning and compatible with your training data.

    More:
    https://video2.skills-academy.com/en-us/azure/ai-services/openai/how-to/fine-tuning?tabs=turbo%2Cpython-new&pivots=programming-language-ai-studio#prepare-your-training-and-validation-data

    0 comments