How do I prevent the Azure cognitive search service from becoming cold after a period of no load?

Hessel Wellema 206 Reputation points
2021-04-09T11:03:55.103+00:00

I use QnaMaker in chatbots. QnaMaker uses Azure Cognitive Search to store and find question\answer pairs.

QnaMaker seems to idle after not being used for a while. The first query takes 7 seconds to complete. Every query after the first one completes within a second.

I think this is because Azure Cognitive Search Service becomes cold when it is not under consistent load. I can see the high latency in the metrics blade of the Search service the first time I use QnaMaker for a certain KB (index). The second query has no latency for that specific KB/Index.

How do I prevent the Azure cognitive search service from becoming cold after a period of no load?

Azure AI Search
Azure AI Search
An Azure search service with built-in artificial intelligence capabilities that enrich information to help identify and explore relevant content at scale.
834 questions
0 comments

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. Ryan Hill 26,866 Reputation points Microsoft Employee
    2021-04-09T17:16:38.737+00:00

    Hi @Hessel Wellema ,

    Azure Cognitive Search Service doesn't idle, it continuously runs once the resources have been created. It appears you have done some performance analysis. Does the individual query in the elapsed time report 7 seconds or just the overall request? Is the 7 seconds both through the bot and a direct request (from Postman).

    Regards,
    Rayn