suppose I have an output to sql server table there is an option "inherit partition scheme of previous query step or input" So the writing to SQL database table is in parallel ? The target SQL database table also required to be partitioned ? and whats the actual meaning of MAX BATCH Size?

Hello @sakuraime , Thanks for the ask and using the forum . I think all three ask of yours is well documented here . Let us know if you have further queries . Thanks Himanshu

Stream analytics Output

sakuraime 2,326

suppose I have an output to sql server table
there is an option
"inherit partition scheme of previous query step or input"

So the writing to SQL database table is in parallel ?
The target SQL database table also required to be partitioned ?
and whats the actual meaning of MAX BATCH Size?

1 answer

HimanshuSinha-msft 19,476 Reputation points Microsoft Employee

2021-01-22T21:56:16.59+00:00

Hello @sakuraime ,
Thanks for the ask and using the forum .

I think all three ask of yours is well documented here .

Let us know if you have further queries .
Thanks
Himanshu
Please sign in to rate this answer.
sakuraime 2,326 Reputation points

2021-01-24T13:14:36.36+00:00

"Batch size is the maximum number of records that sent with every bulk insert transaction"

what's actually mean ?? isn't it REAL time (STREAM ANALYTICS) and why need to do in batch ????

HimanshuSinha-msft 19,476 Reputation points Microsoft Employee

2021-01-27T19:22:19.393+00:00

Hello @sakuraime ,
Batching is done to improve performanace . Since the intend is always to move data as fast as possible , but when the incoming rate is high then moving the data in chunks does improve performance . Batching works well in situations where you don’t need NOT real-time analytics results, and when it is more important to process large volumes of information than it is to get fast analytics . You will not use batching in case like fraud detection when we need the result really fast .
https://video2.skills-academy.com/en-us/azure/stream-analytics/stream-analytics-define-outputs#output-batch-size

Thanks
Himanshu

sakuraime 2,326 Reputation points

2021-01-31T07:53:41.387+00:00

oh ic.. which means if I would like to have a more real time results.... rather I need to set the batch size lower ??

HimanshuSinha-msft 19,476 Reputation points Microsoft Employee

2021-02-02T17:22:05.763+00:00

Thanks right
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

Stream analytics Output

1 answer

Your answer