Run index on modified data from azure blob

Mukesh 21 Reputation points
2021-04-28T12:49:52.81+00:00

Hi Team,

we have created Azure search index using Azure blob storage which contains multiple json files which contains 25 lacs records. This takes nearly 4 - 5 hours to run the indexer which is not preferable from our side. Source for this json file in blob is Snowflake database which runs through the ADF pipeline and runs every day.

We want to track new changes from the blob storage on new or modified files and we need to track those only.

We tried checking the Track changes option but its not available.

Please help us to implement the azure index to run on new/modified records.

Thanks
Mukesh

Azure AI Search
Azure AI Search
An Azure search service with built-in artificial intelligence capabilities that enrich information to help identify and explore relevant content at scale.
834 questions
Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
2,578 questions