Question on Sizing Limit for AI Search Index when passed as a parameter to LLM end point

Neeraj Shrivastava 141 Reputation points
2024-09-13T14:28:13.6933333+00:00

Our use case is Text to SQL where the generated SQL follows the data model that we provide as part of AI search index to the LLM API end point

 

For GPT models, we call the API end point and pass the AI search index as parameter

Input to the API is user prompt and API then returns the generated SQL based on the data model we supply via AI search index .

 

My question is what the maximum document size limit for AI Search Index is ( including all the files we upload as part of index)

 

Is it it max 15 MB per document or for overall Search Index that may include more than 1 file.

I have in past uploaded 10 documents where each document was around 5 MBs so total size of index of 50 MB and I did not receive any error when I passed that Search Index as a parameter to the GPT Model end point ( deployed via Model Studio)

 

Can you please provide clarity on maximum size of AI search index that includes all the files uploaded as part of index.

 

Thanks,

Neeraj.

Azure AI Search
Azure AI Search
An Azure search service with built-in artificial intelligence capabilities that enrich information to help identify and explore relevant content at scale.
1,001 questions
Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,054 questions
Azure AI services
Azure AI services
A group of Azure services, SDKs, and APIs designed to make apps more intelligent, engaging, and discoverable.
2,840 questions
{count} votes

1 answer

Sort by: Most helpful
  1. Neeraj Shrivastava 141 Reputation points
    2024-10-04T21:14:14.1266667+00:00

    Hi Is there any update on this question

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.