Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
342 questions
0 answers
watermark keeps increasing and event are not processed in Stream Analytics
I have IoT package data coming in from Event Hub to Stream Analytics and then outputted to a Delta Lake before switching to Delta Lake, I had output as CSV and it worked fine, no watermark delays, resource utilization was stable and low. After switching…
asked 2023-08-08T08:38:14.5+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(256, 32%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
Audrius
1
Reputation point
commented 2023-08-29T04:38:03.6566667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(134.4, 9%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKM%3C/text%3E%3C/svg%3E)
KranthiPakala-MSFT
46,437
Reputation points Microsoft Employee
2 answers
I can't use the Azure Stream analytic no code editor
Hi community, It seems that I can't use the no-code editor in my Azure stream analytic resource. I think I match all the Pre requisites for using No-Code editor. But not aware if input and outputs are something that I can set, as once I set those this…
asked 2023-08-23T20:15:18.47+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(224.00000000000003, 69%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAP%3C/text%3E%3C/svg%3E)
Augusto Piva
15
Reputation points
commented 2023-08-24T18:25:26.26+00:00
Sander van de Velde | MVP
30,866
Reputation points MVP
0 answers
Azure Stream Analytic at-least-once guarantees is not 100% accurate
I have Azure Stream Analytic (ASA) that process data from the event hub as input. And this job is for the finance biz so it is heavily based on Event Delivery Guarantees at least once of Azure Stream Analytic. But recently we found out that some data…
asked 2023-08-22T01:58:01.4166667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(128, 8%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
Anonymous
commented 2023-08-23T05:14:09.71+00:00
PRADEEPCHEEKATLA-MSFT
84,456
Reputation points Microsoft Employee
2 answers
Processing nested JSON data in stream analytics for real-time visualization
Hello, I'm trying to get my sensor data into Power Bi via stream analytics so I can visualize it in real time. I'm getting JSON messages sent to the IoT Hub that are nested. These messages are from two sensors and can be recognized by the nAdr variable…
asked 2023-07-11T14:48:02.4+00:00
Anonymous
commented 2023-08-22T08:26:08.7566667+00:00
PRADEEPCHEEKATLA-MSFT
84,456
Reputation points Microsoft Employee
1 answer
Send an alert email upon a new event in the Azure Auth Methods | Registration and Reset log
Hi folks, I'd like to send an email to my admin team when a user in my org adds a new authentication method. These events appear in the Azure portal in: Azure Active Directory > Security > Authentication Methods > Registration & reset…
asked 2023-08-14T21:58:52.21+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(176, 25%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EIC%3C/text%3E%3C/svg%3E)
Ian Campbell
0
Reputation points
commented 2023-08-17T08:02:03.5366667+00:00
Vasil Michev
99,431
Reputation points MVP
1 answer
One of the answers was accepted by the question author.
Additional device states (say error states), which is the right place device twin or telemetry?
Hello Team, We are setting up IoT solution for our new device. The device is a complex device, hence there would be various states and error-states. I am trying to figure out which is the right place to update the states - device twin or telemetry? As of…
asked 2023-08-09T07:56:01.9566667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(38.4, 80%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAS%3C/text%3E%3C/svg%3E)
Aurovind Sagar Epari
80
Reputation points
commented 2023-08-11T10:02:09.1466667+00:00
Sander van de Velde | MVP
30,866
Reputation points MVP
1 answer
Can we debug the "InputDeserializerError.InvalidData" input JSON
Hi Team, We already have a document for the error "InputDeserializerError.InvalidData": https://video2.skills-academy.com/en-us/azure/stream-analytics/data-errors#inputdeserializererrorinvaliddata Also we have Q&A document for the…
asked 2023-08-07T07:02:29.9+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(166.4, 80%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHK%3C/text%3E%3C/svg%3E)
Harish Kumar
66
Reputation points Microsoft Employee
answered 2023-08-07T20:38:28.1433333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(86.4, 36%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBM%3C/text%3E%3C/svg%3E)
BhargavaGunnam-MSFT
28,616
Reputation points Microsoft Employee
1 answer
Azure Eventhubs Header X-Frame-Options
Hello, I have the following problem in this architecture: Integration: I have connected as output of a Stream Analytics to an Eventhub, this Eventhub is inside a virtual network and is used to send data to an Azure Function that then takes them and sends…
asked 2023-07-26T19:36:26.59+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(67.2, 39%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJO%3C/text%3E%3C/svg%3E)
Jesus Orlando Aguilar Contreras
75
Reputation points
commented 2023-08-07T07:14:57.87+00:00
PRADEEPCHEEKATLA-MSFT
84,456
Reputation points Microsoft Employee
2 answers
One of the answers was accepted by the question author.
If we schedule event hub capture with parquet and delta both in standard tier, will it be charged extra for more than one file format?
I am using Event Hub Standard Tier with 2 TUs with capture enabled. However when enabling capture in parquet, I use stream analytics job created to store same data in delta, json and csv as well. Since in Standard tier it is billed $73/TU/month. If I use…
asked 2023-07-28T07:45:23.76+00:00
Rishabh Tiwari
40
Reputation points
commented 2023-08-04T18:54:59.62+00:00
KranthiPakala-MSFT
46,437
Reputation points Microsoft Employee
1 answer
Do we incur extra charges for using event hup capture to stream data into Cosmos DB?
Do we incur extra charges for using event hup capture to stream data into Cosmos DB? I am using Standard Tier Azure Event Hub with 2 Throughput Units in US East region. I am also capturing data in parquet, JSON, CSV and delta lake format in ADLS Gen2. In…
asked 2023-07-28T09:21:50.9566667+00:00
Rishabh Tiwari
40
Reputation points
commented 2023-08-03T06:23:56.1133333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(54.400000000000006, 38%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EQ%3C/text%3E%3C/svg%3E)
QuantumCache
20,186
Reputation points
2 answers
One of the answers was accepted by the question author.
Is capturing events in Parquet using stream analytics job costs extra on top of standard $73/TU/Month in Event Hub Standard Tier?
Hello People, I am working with Azure Event Hubs to pull data stream and capture it in Parquet format. Parquet is most suitable for my solution. I am using a standard tier Event Hub Namespace with 2 TU with capture enabled on Event Hub. As per the…
asked 2023-07-28T03:31:45.4533333+00:00
Rishabh Tiwari
40
Reputation points
accepted 2023-08-01T12:05:43.5733333+00:00
Rishabh Tiwari
40
Reputation points
1 answer
Azure Stream Analytics reference data input suddenly getting truncated to first 50 records after upgrade to V2 plan
An existing Stream Analytics job which has not been changes for a couple of years and working happily It supports a few hundred IoT devices "in the wild" As part of the job it relies on several (4x) reference data inputs All inputs are…
asked 2023-07-04T10:09:10.76+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(300.8, 72%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3E7%3C/text%3E%3C/svg%3E)
79848876
11
Reputation points
commented 2023-07-31T21:30:30.4866667+00:00
QuantumCache
20,186
Reputation points
1 answer
One of the answers was accepted by the question author.
Struggling with Event Hub Errors: Unable to Trigger Functions After Changing Partition Count
I have built a system where I send messages from devices to IoT Hub, pass them through Stream Analytics, and trigger Functions from Event Hub. I conducted a series of tests at this point and confirmed that Functions were triggered successfully. Later, I…
asked 2023-07-24T10:03:34.3733333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(214.4, 91%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EK3%3C/text%3E%3C/svg%3E)
KURAMOTOAHUJATAIRA-3118
250
Reputation points
commented 2023-07-28T01:34:07.0666667+00:00
KURAMOTOAHUJATAIRA-3118
250
Reputation points
1 answer
Azure Event Hub receiving JSON with extraneous outer array bracket into Stream Analytics
As you can see below my events are being received with an outer array bracket, however they only ever contain 1 actual record (this is desired). I understand that this is probably how the source data comes in, and if were receiving as an actual JSON…
asked 2023-07-25T16:46:20.2966667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(217.60000000000002, 16%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENW%3C/text%3E%3C/svg%3E)
Nathaniel Wolf
0
Reputation points
commented 2023-07-26T06:00:45.1566667+00:00
Wilko van de Velde
2,226
Reputation points
1 answer
One of the answers was accepted by the question author.
Issue with Verifying Execution Count of Functions in Azure Functions
I'm experiencing a problem with verifying the execution count of a function in Azure Functions. I have configured the function to be triggered by data input to Stream Analytics. The number of data inputs and outputs to Stream Analytics is 594, as…
asked 2023-06-22T01:01:58.8733333+00:00
KURAMOTOAHUJATAIRA-3118
250
Reputation points
accepted 2023-07-24T02:07:32.58+00:00
KURAMOTOAHUJATAIRA-3118
250
Reputation points
1 answer
Azure Video Analyzer
Hello Microsoft Community, I've been looking at an outdated use case that leverages Azure Video Analyzer Edge. Since this service is retired and no longer in use, does anyone have an alternative solution/service that will allow me to leverage the same…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(54.400000000000006, 68%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJV%3C/text%3E%3C/svg%3E)
1 answer
Azure Stream Analytics on Edge output to blob on the Edge
I'm trying to configure Azure Stream Analytics(ASA) on Edge output to blob in one the same edge device. Is it supported? When ASA is configured to output to EdgeHub it forks fine. Likewise, the blob storage module is working fine when I'm saving it from…
asked 2023-06-28T12:43:27.5066667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(262.40000000000003, 82%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGM%3C/text%3E%3C/svg%3E)
Grzegorz Mroz
0
Reputation points
commented 2023-07-05T21:04:24.71+00:00
LeelaRajeshSayana-MSFT
13,951
Reputation points
1 answer
One of the answers was accepted by the question author.
Error creating a Stream Analytics job into IoT edge
Good evening, First of all thank you for your support. I'm tying to create a Stream Analytics Job (selected Hosting environment: Edge) through the azure portal but it doesn work. When I press on the "Create" button it goes to the overview…
asked 2023-06-22T15:58:02.7766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(86.4, 84%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJA%3C/text%3E%3C/svg%3E)
julio antonio carbonero reina
20
Reputation points
commented 2023-06-30T17:24:25.7833333+00:00
julio antonio carbonero reina
20
Reputation points
1 answer
Working with Bits in Stream Analytics
I'm hoping someone can help. I have a Byte coming into Azure Stream Analytics. This has a label "Status1" and a value 128 at present, this is RAW data coming from Azure IOT Hub. I need to to split each individual bit out of this Byte and store…
asked 2023-06-26T18:53:46.3566667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(0, 25%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHS%3C/text%3E%3C/svg%3E)
Howes, Stephen
0
Reputation points
answered 2023-06-27T15:47:40.43+00:00
QuantumCache
20,186
Reputation points
1 answer
Azure streaming analytics not outputting to PowerBI
Hey there, Im a student using Azure for a project Im working on. I am having an issue with the output on my Stream Analytics Job. When trying to change the output from "Provide Power BI settings manually" to "Select Power BI from your…
asked 2023-06-20T12:26:21.68+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(140.8, 98%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMM%3C/text%3E%3C/svg%3E)
Meer, Miguel van der
5
Reputation points
commented 2023-06-26T06:28:08.32+00:00
PRADEEPCHEEKATLA-MSFT
84,456
Reputation points Microsoft Employee