Azure OpenAI limiting the search/answer on only 5 documents

Cezar Pimentel 46 Reputation points
2024-07-01T02:52:42.06+00:00

I'm testing Azure OpenAI Studio to check if it would be a possible tool to use on a project.

The problem is, I added my own movie data (100 documents), and when I prompt (for an instance)
"How many movies do you have in your knowledge base?"

It replies answering it knows/has only 5 documents.

Why is this happening? How do I tell it to use all documents instead of only 5?

Thanks in advanceUser's image

Azure AI Search
Azure AI Search
An Azure search service with built-in artificial intelligence capabilities that enrich information to help identify and explore relevant content at scale.
828 questions
Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
2,529 questions
0 comments

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. Sam Cogan 10,332 Reputation points MVP
    2024-07-01T07:27:54.8766667+00:00

    The way bring your own data works, means that the AI doesn't know how many movies it has in it's database, so it can't tell you. When you use bring your own data the process to query it looks like this:

    • You enter your question in the UI
    • Your data is searched for relevant answers to the questions you have asked
    • The results of the search are sent to the AI, along with your question and it provides an answer based on this data only

    So the AI only has access to data that was retrieved from your data store, that is relevant to the question "how many movies do you have in your knowledge based". The actual search that occurs is just looking for data relevant to this in you data, it is not counting your items. The AI is probably getting 5 relevant pieces of data back, and so that is what it knows about.