Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,409 questions
1 answer
Data Lake Central alerting
Hi Guys We are planning to build centralize alert system on Azure Source systems Splunk Solarwinds SAP Alert Management Oracle Alert log Talend Job Logs Cisco Information Service Azure Logs what would the easy way to gather all the…
asked 2020-12-17T21:42:13.313+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(198.4, 48%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDN%3C/text%3E%3C/svg%3E)
Dondapati, Navin
281
Reputation points
answered 2020-12-18T11:56:52.213+00:00
Pramod Valavala
20,606
Reputation points Microsoft Employee
0 answers
How to troubleshoot UDF error in Stream Analytics?
My Stream Analytics jobs has multiple errors like this: { "Environment": "Prod", "Region": "North Europe", "time": "2020-10-03T00:04:22.9834272Z", "resourceId":…
asked 2020-11-11T14:01:23.453+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(89.60000000000001, 56.00000000000001%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMF%3C/text%3E%3C/svg%3E)
Mikael Falkvidd
1
Reputation point
commented 2020-12-15T18:01:33.457+00:00
Mikael Falkvidd
1
Reputation point
1 answer
Azure Stream Analytics Job Reference Input Join Error
Hi Team My Inputs for Stream Analytics Job: Input 1: Stream Input from IoT Hub Input 2: Reference Data from Azure Blob Storage I am trying to use following query to join stream input (deviceinput) and reference input…
asked 2020-11-18T14:11:41.307+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(204.8, 48%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKK%3C/text%3E%3C/svg%3E)
Kamlesh Khollam
21
Reputation points
answered 2020-12-10T06:20:46.003+00:00
Kamlesh Khollam
21
Reputation points
1 answer
One of the answers was accepted by the question author.
Azure Stream Analytics Job Reference Input SQL DB error
Hi Team, I have added SQL DB as Reference Input for Stream Analytic job. After adding on Query window its giving error: Cannot read property 'resourceId' of null Following is the screenshot for the same: Please refer the Red highlighted info:…
asked 2020-11-24T12:08:39.433+00:00
Kamlesh Khollam
21
Reputation points
accepted 2020-12-10T06:15:37.46+00:00
Kamlesh Khollam
21
Reputation points
0 answers
Azure Stream Analytics Reference Input: SQL DB Snapshot Error
Hi Team, I am using SQL DB as Reference Input in Stream Analytics Job. When I Start the stream analytics job, Reference Input(SQL DB) shows following error: I did check my Storage Account Details and it looks correct. But not sure why…
asked 2020-11-25T18:56:23.713+00:00
Kamlesh Khollam
21
Reputation points
commented 2020-12-08T10:46:38.66+00:00
PRADEEPCHEEKATLA-MSFT
84,456
Reputation points Microsoft Employee
1 answer
Azure Stream Analytics
I was just wondering if we should just let the Stream Analytics running continuously so the data from the storage gets fed into out SQL database continuously (so every time new events get added onto the storage then the database gets automatically…
asked 2020-11-06T16:03:17.93+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(128, 8%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
Anonymous
commented 2020-11-17T09:36:45.127+00:00
PRADEEPCHEEKATLA-MSFT
84,456
Reputation points Microsoft Employee
1 answer
Failed to Locate a Column at Position x in the Output Event
Hi all I'm running an export job out of IOTCentral for measurements data and that is going into an Event Hub. I'm then using Stream Analytics to move the data into an Azure SQL table. I've switched on the error tracking in the Stream Analytics log and…
asked 2020-11-02T13:11:27.533+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(124.80000000000001, 62%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJC%3C/text%3E%3C/svg%3E)
John Clifford
21
Reputation points
commented 2020-11-16T22:06:10.853+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(192, 26%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHM%3C/text%3E%3C/svg%3E)
HimanshuSinha-msft
19,376
Reputation points Microsoft Employee
1 answer
ASA UDA deaccumulateState not firing?
Hi, According to the documentation ASA javascript UDAs can be used for deaccumulation. It states -The deaccumulateState() method recalculates state based on the previous state and the state of a hop. This method is called when a set of events leave a…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(156.8, 98%, 25%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EE%3C/text%3E%3C/svg%3E)
2 answers
Azure Stream Analytics Job cannot detect either input table or output table
I'm new to the Azure Stream Job, and I want to use the reference data from Azure SQL DB to load into Power BI to have streaming data. I've set up the storage account when setting up the SQL input table. I test the output table (Power BI) which is also…
asked 2020-10-13T22:40:13.047+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(48, 24%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EB%3C/text%3E%3C/svg%3E)
bptsai
1
Reputation point
commented 2020-11-09T07:31:49.687+00:00
PRADEEPCHEEKATLA-MSFT
84,456
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
Single source of streaming input for multiple stream analytics jobs
Hi, Is it possible to have 2 stream analytics jobs configured with same input (Say Blob storage for example). I have a situation where for different business needs, we want to create 2 stream analytics jobs. Both jobs will connect to same blob input…
asked 2020-11-02T13:39:52.677+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(121.6, 57.99999999999999%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPR%3C/text%3E%3C/svg%3E)
Priyanka Ranganath
21
Reputation points
accepted 2020-11-06T03:46:38.25+00:00
Priyanka Ranganath
21
Reputation points
1 answer
One of the answers was accepted by the question author.
OutputDataConversionError in Stream Analytics
Hi all I'm running an export job out of IOTCentral for measurements data and that is going into an Event Hub. I'm then using Stream Analytics to move the data into an Azure SQL table. Trouble is, i'm getting the following error when i start the job: …
asked 2020-10-30T21:22:05.717+00:00
John Clifford
21
Reputation points
commented 2020-11-02T13:00:07.327+00:00
John Clifford
21
Reputation points
0 answers
Delete specific contents of file in blob container
I have log files in container, I want to search a list of strings in the log file and delete the specific record of the file matching with the string and save the file in same container with same name. Say the log file is abc.txt 10/20/2020 …
asked 2020-10-23T19:00:04.617+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(294.40000000000003, 2%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAP%3C/text%3E%3C/svg%3E)
Amey Pimpley
1
Reputation point
commented 2020-10-23T20:59:45.92+00:00
Amey Pimpley
1
Reputation point
1 answer
Azure Stream Analytics Job has water mark delay consistenly over 1 hour
Hi, We are consistently facing a watermark delay issue in one of our stream analytics job in productions, the SU% utilization seems below 10%. Due to this there is a latency of up to 4 hours in our NRT pipeline. The Stream analytic job reads from an…
asked 2020-10-14T19:50:11.527+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(105.60000000000001, 74%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAP%3C/text%3E%3C/svg%3E)
Anand Pangare (Tata Consultancy Services)
1
Reputation point Microsoft Vendor
commented 2020-10-21T18:08:13.85+00:00
Anand Pangare (Tata Consultancy Services)
1
Reputation point Microsoft Vendor
3 answers
Azure Logic App : Logs not showing in Log Analytics workspace and AzureDiagnostics log table
I have been following the following article : https://video2.skills-academy.com/en-gb/azure/logic-apps/monitor-logic-apps-log-analytics But even after following all the steps in the article , I cant see any data in Logic Apps Management section of my…
asked 2020-08-26T17:02:29.473+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(67.2, 16%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMJ%3C/text%3E%3C/svg%3E)
Mulchandani, Jaideep
1
Reputation point
commented 2020-10-20T07:20:56.967+00:00
MayankBargali-MSFT
69,946
Reputation points
2 answers
Handling If else conditions in stream analytics query
Hi, I have one stream analytics query where i want to handle the condition like If today is a weekday then execute code1 else code2. As stream analytics is not supporting IF else or subquery in Case statement how to handle this? Can I get some guidance…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(278.4, 76%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ER%3C/text%3E%3C/svg%3E)
1 answer
Stream Analytics Job Failed - Query Compilation error (Incorrect Syntax?)
Hello, I am having issues sending my MX Chip data from an IoT Hub > through Stream Analytics > into PowerBI It appears that when I create an Input from the IoT hub, it confirms: Testing Input, mxchip-bulk = Successful When I create…
asked 2020-10-02T14:09:28.96+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(67.2, 55.00000000000001%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EM%3C/text%3E%3C/svg%3E)
MS
21
Reputation points
commented 2020-10-02T14:25:13.573+00:00
António Sérgio Azevedo
7,666
Reputation points Microsoft Employee
1 answer
Streaming ETL with eventhub
We have SAP and Hybris hosted onprem, which are the book of record for product and promo. The goal is to build a ETL solution to send to partner systems on products on promotion (effectively joining the feeds from both systems), the technical…
asked 2020-09-17T02:38:36.127+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(19.2, 28.999999999999996%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ETW%3C/text%3E%3C/svg%3E)
Tommy Wang
1
Reputation point
commented 2020-10-01T02:28:00.367+00:00
Tommy Wang
1
Reputation point
0 answers
Struggling with geting data into table via streaming job.
A total newbie question here. I have successfully set up a job to stream data directly to PowerBI. That is working correctly. However, I also need to gather some analytics to display in somewhat realtime. I created a second stream job with an output…
asked 2020-09-04T13:30:23.867+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(313.6, 89%, 40%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECS%3C/text%3E%3C/svg%3E)
Charles Sutton
1
Reputation point
commented 2020-09-30T15:58:09.847+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(172.8, 70%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMM%3C/text%3E%3C/svg%3E)
MartinJaffer-MSFT
26,051
Reputation points
2 answers
One of the answers was accepted by the question author.
Azure Powershell - Test Stream analytics job refererence input
Hi, I'm trying to test Stream analytics job inputs and outputs from Powershell (it is part of release pipeline). Everything is fine unless I come across an input of type "reference" (eg. SQL database). I'm using command…
asked 2020-09-23T10:03:53.897+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(236.8, 41%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ED%3C/text%3E%3C/svg%3E)
DeeplyGrow
21
Reputation points
commented 2020-09-29T00:25:22.967+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(134.4, 9%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKM%3C/text%3E%3C/svg%3E)
KranthiPakala-MSFT
46,437
Reputation points Microsoft Employee
0 answers
Realtime time data from on premise databases
Hi Suppose I have 8 databases on premise and if i want to implement the lambda architecture then How can i ETL the data from these on-premise databases into cloud databases/storage in realtime. Can i use the Event hub for this? Is there any…
asked 2020-09-22T11:49:17.047+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(80, 44%, 17%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKC%3C/text%3E%3C/svg%3E)
Kuldeep Chitrakar
1
Reputation point
commented 2020-09-25T19:14:42.01+00:00
MartinJaffer-MSFT
26,051
Reputation points