Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
342 questions
2 answers
Stream Analytics Output to BlobStorage Folder Structure and Time
We have a stream analytics job that is simply processing json files and passing them into cosmos or to another event hub. On the event hub we have capture events to make avro files for later consumption. We are having an issue there and have thought to…
asked 2021-03-31T16:43:10.957+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(156.8, 38%, 25%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJJ%3C/text%3E%3C/svg%3E)
James "JC" Clark
1
Reputation point
commented 2021-04-02T17:40:32.77+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(32, 44%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESS%3C/text%3E%3C/svg%3E)
Samara Soucy - MSFT
5,051
Reputation points
3 answers
Processing Azure Storage Logs to Azure SQL with Stream Analytics
Hi Azure Community! I have a Storage Account and a CDN to make my images and videos faster to download/view. I would like to count the views/downloads of my files periodically to an azure database, let's say every 2 hours. I was thinking of Azure…
asked 2021-03-25T10:56:45.873+00:00
simon brami
1
Reputation point
answered 2021-04-01T19:45:45.313+00:00
Samara Soucy - MSFT
5,051
Reputation points
1 answer
Temporary Error 504 in Stream Analytics when clicking on "Overview"
Hi, I am getting 504 errors from time to time when clicking on the "Overview" menu. After several seconds or some minutes, all ok... Location of Stream is "West Europe". On 15.03.2021 in the morning, two colleagues were working…
asked 2021-03-23T10:53:39.39+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(204.8, 4%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJT%3C/text%3E%3C/svg%3E)
JohnDoe Testing
6
Reputation points
commented 2021-03-30T01:40:29.823+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(134.4, 9%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKM%3C/text%3E%3C/svg%3E)
KranthiPakala-MSFT
46,437
Reputation points Microsoft Employee
1 answer
Json Parse in Stream Analytics
Hello World, i'm trying to parse some data in Stream Analytics but i don't seem to be successfull. This is what i send into my IoT Hub: look below I want to access the Channel1_Temp and MyVariable2. In my Query Sample the Data Locks…
asked 2021-03-13T08:55:59.617+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(256, 26%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJB%3C/text%3E%3C/svg%3E)
Julian Balles
1
Reputation point
commented 2021-03-29T09:56:04.007+00:00
Julian Balles
1
Reputation point
1 answer
One of the answers was accepted by the question author.
Increase size of ASA Parquet file output
Is there a way to (further) increase the size of the parquet files written by ASA output? The current settings is "minimum rows: 10000" and "maximum time: 2 hours". However the files are written by ASA every 5 seconds and the size per…
asked 2020-09-03T16:00:19.647+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(281.6, 73%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EM%3C/text%3E%3C/svg%3E)
mpoeckl
161
Reputation points Microsoft Employee
commented 2021-03-22T18:51:26.213+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(281.6, 35%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJW%3C/text%3E%3C/svg%3E)
Jason Welch
26
Reputation points
1 answer
One of the answers was accepted by the question author.
How to use Azure Anomaly Detection on IOT edge module?
I want to demo a POC which sends data from SimulatedTemperatureSensor available on Azure Marketplace. This data should be sent to Stream Analytics module on Edge and then Anomaly Detection Module Should send only anomaly data to IOT Hub. I need some…
asked 2021-03-12T12:14:18.453+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(195.2, 38%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAS%3C/text%3E%3C/svg%3E)
Anurag Shelar
181
Reputation points
commented 2021-03-22T11:53:07.517+00:00
Sander van de Velde | MVP
30,866
Reputation points MVP
0 answers
Azure Stream Analytics - SQL - Showing 0 rows joining with reference input with SQL Server Reference input
Even reference data available in joining SQL Server reference input tables, no result and no errors FROM table, Event hub input JOIN tables, SQL Server reference input INTO, SQL Server table SELECT a.Id ,SUM(r.FYQ1__c) AS FYQ1__c …
asked 2021-02-12T03:44:30.003+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(252.8, 46%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAA%3C/text%3E%3C/svg%3E)
Akila Ariyarathne
1
Reputation point
commented 2021-03-02T11:14:57.62+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(64, 33%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAA%3C/text%3E%3C/svg%3E)
Akila Ariyarathne
1
Reputation point
1 answer
Azure Stream Analytics - throwing Unauthorized error
I am trying to set up Azure Stream Analytics for Eventhub, but it keep throwing error - Querying EventHub ---eventhubname--- returned an error: Management operation failed. status-code: 401, status-description: Unauthorized..
asked 2021-02-03T20:31:02.127+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(275.2, 46%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBA%3C/text%3E%3C/svg%3E)
Bee aNad
1
Reputation point
commented 2021-02-17T11:45:57.31+00:00
PRADEEPCHEEKATLA-MSFT
84,456
Reputation points Microsoft Employee
3 answers
One of the answers was accepted by the question author.
SSIS ETL Tool
Is the latest version of SSIS a fully cloud-based ETL tool?
asked 2021-02-05T20:37:45.827+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(243.2, 35%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESV%3C/text%3E%3C/svg%3E)
Sridhar Vuligonda
21
Reputation points
accepted 2021-02-12T14:24:47.13+00:00
Sridhar Vuligonda
21
Reputation points
1 answer
One of the answers was accepted by the question author.
Missing record in table storage (from stream analytics)
Hi everybody, I have a problem of missing records in a table storage account. I use a stream analytics job to send data from an IOTHub to a table storage. The stream analytics job seems working correctly (output event count seems correct). I expect…
asked 2021-02-10T09:25:32.913+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(83.2, 75%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBT%3C/text%3E%3C/svg%3E)
BERNARD Thomas
166
Reputation points
accepted 2021-02-10T15:54:10.157+00:00
BERNARD Thomas
166
Reputation points
2 answers
One of the answers was accepted by the question author.
error: not found: value EventHubsConf
Hi Everyone, I was trying to do some real-time stream analytics using databricks and azure event hub but I keep running into this error even when I have configured everything well. Here is the code snippet : import java.util._ import…
asked 2021-02-08T10:56:02.347+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(256, 61%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESS%3C/text%3E%3C/svg%3E)
snehil singh
21
Reputation points
answered 2021-02-09T06:28:57.547+00:00
snehil singh
21
Reputation points
1 answer
Unable to fetch data from stream analytics job enabled with managed identity
Unable to fetch data from stream analytics job enabled with managed identity getting input from event hub (in other subscription). In "Subscription A", i have a Stream Analytics Job enabled with managed identity. This job is getting its input…
asked 2021-02-01T13:29:40.843+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(115.19999999999999, 44%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAJ%3C/text%3E%3C/svg%3E)
Abhijit Jadhav
1
Reputation point
commented 2021-02-05T07:15:33.287+00:00
PRADEEPCHEEKATLA-MSFT
84,456
Reputation points Microsoft Employee
2 answers
Stream Analytic Partition input
I have set the partition ID for the into with a name "deviceID" And in the query , I find that the build in column partitionID is different from my desired partition column (deviceID). why is that ? IS is normal ? And my table in DB…
asked 2021-01-24T10:24:30.72+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(137.6, 40%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ES%3C/text%3E%3C/svg%3E)
sakuraime
2,321
Reputation points
commented 2021-02-03T18:22:53.457+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(192, 26%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHM%3C/text%3E%3C/svg%3E)
HimanshuSinha-msft
19,376
Reputation points Microsoft Employee
1 answer
Stream analytics Output
suppose I have an output to sql server table there is an option "inherit partition scheme of previous query step or input" So the writing to SQL database table is in parallel ? The target SQL database table also…
asked 2021-01-21T13:39:44.383+00:00
sakuraime
2,321
Reputation points
commented 2021-02-02T17:22:05.763+00:00
HimanshuSinha-msft
19,376
Reputation points Microsoft Employee
0 answers
Disappearing files from Blob Storage
Hi everyone. I have recently set up an Azure IoT Hub that is accepting telemetry data from an MQTT source. I have also set up an Azure Stream Analytics Job which simply takes the input and writes it to a Gen 2 Storage account (Data Lake, Hierarchy…
asked 2021-01-21T11:49:11.787+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(6.4, 40%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ES%3C/text%3E%3C/svg%3E)
Scott
6
Reputation points
commented 2021-02-02T17:21:26.987+00:00
HimanshuSinha-msft
19,376
Reputation points Microsoft Employee
2 answers
Inputs to Streaming Analytics Job
I have an event hub (in other subscription) which is to be used as input to the streaming analytics job. This event hub is configured to allow connections from "Select network only". In such a case is there a way to get data from this event hub…
asked 2020-08-20T08:56:04.717+00:00
Abhijit Jadhav
1
Reputation point
answered 2021-02-01T14:10:13.397+00:00
Abhijit Jadhav
1
Reputation point
1 answer
can i query two time series instances in one request?
{ "aggregateSeries": { "timeSeriesId": [ "PickTime", "EMP010" ], // further logic I am trying to query two time series instances in the single request body through…
asked 2021-01-05T13:20:49.05+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(121.6, 95%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPA%3C/text%3E%3C/svg%3E)
Purohit, Aahana
1
Reputation point
commented 2021-01-14T17:56:27.593+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(54.400000000000006, 38%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EQ%3C/text%3E%3C/svg%3E)
QuantumCache
20,186
Reputation points
1 answer
Stream Analytics output system property override not working
Hello, I have a streams analytics query that is outputting events to a Service Bus Queue. I would like to manually set the "EventEnqueuedUtcTime" system property on the output. In my stream analytics set up, I set the "System…
asked 2020-12-17T18:55:13.927+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(259.20000000000005, 5%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EC%3C/text%3E%3C/svg%3E)
CareyBoldenow
96
Reputation points
commented 2021-01-11T05:58:57.04+00:00
PRADEEPCHEEKATLA-MSFT
84,456
Reputation points Microsoft Employee
2 answers
One of the answers was accepted by the question author.
Rest API Data stream to event hub
Hi Guys, We are using below rest api get method of accuweather to fetch location info curl --location --request GET 'http://dataservice.accuweather.com/locations/v1/adminareas/countryCode?apikey=VU86G' PostMan output: …
asked 2020-12-30T16:21:21.083+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(198.4, 48%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDN%3C/text%3E%3C/svg%3E)
Dondapati, Navin
281
Reputation points
accepted 2021-01-05T16:07:01.147+00:00
Dondapati, Navin
281
Reputation points
0 answers
ASA degraded flag and no output when using JSON_VALUE in query
I get a degraded flag as soon as I use a JSON_VALUE command in my ASA query. The query works fine when I test it and there are no other errors reported when I run the job. Just no output and degraded message.
asked 2020-12-22T20:58:11.92+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(176, 11%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EN%3C/text%3E%3C/svg%3E)
NB
1
Reputation point
commented 2020-12-28T06:19:35.11+00:00
PRADEEPCHEEKATLA-MSFT
84,456
Reputation points Microsoft Employee