Azure Table Storage

Abhay Chandramouli 1,021 Reputation points
2023-05-31T12:28:36.3533333+00:00

Hi I am working with Azure Table Storage

I will have supposedly around 2 million records in my table every day

I want to read all 2 million records in one go..

(I need a mechanism to read all in one go using Azure Logic Apps or any other service)

What I have tried is

Using logic app - Get Entities Action -> Which as per my research can yield a max of 100000 records even after pagination (which is currently not working due to new designer issues)

Using Rest API - SAS Table API - I am able to get but using SAS doesnt feel like the most secure or best way to do this..

Please let me know some other way to achieve this .. I have been stuck for 2 weeks now

Azure Table Storage
Azure Table Storage
An Azure service that stores structured NoSQL data in the cloud.
170 questions
0 comments

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. AirGordon 7,125 Reputation points
    2023-05-31T21:55:28.6766667+00:00

    I'd suggest looking at the Azure SDK for .NET.

    It's simple, there's lots of samples and the code you write can be hosted in many different azure services.

    I'd probably add that pagination isn't a bad thing. It's designed to facilitate faster reliable applications. Loading 2M rows into memory (and doing what with that data), might not be the most effective way to do what you need.

    0 comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.