How to use Mistral Endpoint in Prompt Flow?

Henrik Ge 25 Reputation points
2024-03-28T12:07:21.6766667+00:00

Hey!

In Azure ML Studio, I created a mistral large endpoint. The endpoint can be accessed using an api key and a url.

Can I use this endpoint as LLM in a prompt flow, say for example, in the chat flow example? I imagine yes, but how do I have to set up the connection to connect the llm into the flow?

User's image

Thanks in advance!

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
2,833 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. ~ Tony ~ 0 Reputation points
    2024-07-29T10:41:54.23+00:00

    I deployed GPT 3.5 and Mistral-small both for chat.

    Prompt flow doesn't let me use the Mistral-small deployment. So yeah, same question

    0 comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.