502 questions with Azure Data Explorer tags

Sort by: Updated
Updated Created Answers
1 answer

How to tain a ML model with CSV filles and not dataframes?

Hello, I have a dataset composed of different csv files (a lot of them) with the same metadata that I have added to the Azure blob storage and now I would like to run a regression ML model with this data in Azure ML, however I want to train the model…

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
2,687 questions
Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
2,576 questions
Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
502 questions
asked 2022-01-10T15:28:40.987+00:00
Anonymous
answered 2022-01-10T22:42:30.247+00:00
GiftA-MSFT 11,161 Reputation points
1 answer

Quantify conformity or compliance between different datasets

Hello, I have generated regression model using Azure design for a specific dataset of which I know the value to be predicted so I can evaluate the model performance and tune hyper-parameters. But now I would like to apply this trained model to a new…

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
2,687 questions
Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
2,576 questions
Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
502 questions
asked 2022-01-03T16:05:21.097+00:00
Anonymous
answered 2022-01-03T21:26:01.087+00:00
GiftA-MSFT 11,161 Reputation points
0 answers

diagnostic settings for Azure Data Explorer (ADX) and have done the changes in ARM Template but the CI/CD pipeline is failing at Validate ARM Templates step in Dev.Request you to kindly provide suggestions in order to fix this issue.

We are trying to enable diagnostic settings for Azure Data Explorer (ADX) and have done the changes in ARM Template but the CI/CD pipeline is failing at Validate ARM Templates step in Dev. Request you to kindly provide suggestions in order to fix this…

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
502 questions
asked 2021-12-16T08:22:10.26+00:00
Eshan Gangwar [ESHN] 1 Reputation point
commented 2021-12-31T01:05:31.363+00:00
Saurabh Sharma 23,776 Reputation points Microsoft Employee
1 answer

.set-or-append command Log in Kusto

Hi I have a query like below. .set-or-append async Test with(distributed=true) <| stg_test when i am running the above query thorigh Azure Data Explorer command activity from ADF pipeline the data is appending but in the output of activity it…

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
502 questions
asked 2021-12-16T04:21:58.403+00:00
ADX 156 Reputation points
commented 2021-12-23T16:54:12.79+00:00
ShaikMaheer-MSFT 38,321 Reputation points Microsoft Employee
0 answers

How to know update policies are working fine in Kusto

Hi , I have two tables mentioned below. Stage table : stg_test (Columns: Id:int, Name:string, Location:string) Final Table: fnl_test (Columns: Id:int, Name:string, Location:string) stg_test table is always truncate and load on daily basis and…

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
502 questions
asked 2021-12-16T04:16:41.857+00:00
ADX 156 Reputation points
commented 2021-12-23T10:41:25.743+00:00
ADX 156 Reputation points
1 answer

Kusto nested logs inside other logs

Hello, I hope that you are doing fine and that this question isn't already answered in another topic (I've searched many other topics without finding the answer) I have this log : I need to query the results of Response of the main…

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
502 questions
asked 2021-12-03T11:00:17.95+00:00
TAHRI Ahmed 1 Reputation point
commented 2021-12-22T01:37:05.593+00:00
KranthiPakala-MSFT 46,437 Reputation points Microsoft Employee
1 answer

How to check the Data quality in azure sysnapse

I have a file how to check the data quality things in that file, like row count and how much data is perfect in all the columns. for example take a date column, format of the date should be same in all the rows if any different format is there it…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,409 questions
.NET
.NET
Microsoft Technologies based on the .NET software framework.
3,573 questions
Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
502 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,621 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,015 questions
asked 2021-11-12T14:17:42.577+00:00
Tharun Palakonda 1 Reputation point
commented 2021-12-07T18:15:22.613+00:00
Saurabh Sharma 23,776 Reputation points Microsoft Employee
1 answer One of the answers was accepted by the question author.

how do one can add the column to existing ADX table which will be auto-populated with the current datetime when the row is inserted?

I have a table in azure data explorer which is storing the API response. Unfortunately the API response doesn't have Date and time combination. Is there any way to create a datetime column in ADX which shows the date and time when the new row get…

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
502 questions
asked 2021-12-04T09:47:25.033+00:00
Sahu, Divya 106 Reputation points
commented 2021-12-07T17:22:12.663+00:00
MartinJaffer-MSFT 26,051 Reputation points
1 answer

Extract the matching word from the table column

Hi I have table called "Test" and only one column like "Col1" and it has values like Col1 Test_AA_One Test_Check_BB_One Test_Check_Another_CC_One Test_DD_One Test_New_EE_One I want to check if the column value has any…

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
502 questions
asked 2021-11-15T09:36:32.707+00:00
ADX 156 Reputation points
commented 2021-11-24T20:00:26.827+00:00
HimanshuSinha-msft 19,376 Reputation points Microsoft Employee
0 answers

Column Mismatch in ADF copy activity with explicit mapping

With explicit mapping on the ADF copy activity(Kusto -- ADF -- Kusto), there is also a column mismatch happened. Some columns of data are copied from the previous to the subsequent column. the pipeline runID : 587a6b05-cc52-4ae6-87ab-b25ec58e5c09 …

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
502 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,015 questions
asked 2021-10-29T05:05:23.12+00:00
Zhen Chen 6 Reputation points Microsoft Employee
commented 2021-11-24T19:26:02.017+00:00
HimanshuSinha-msft 19,376 Reputation points Microsoft Employee
0 answers

Update Policy in Azure Data Explorer

Hi I have created a table called SalesTransaction & SalesDim tables in the ADX SalesTransaction: Table holds the daily transaction data which we get on daily basis and it will be loaded through ADF pipeline (It always truncate & load…

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
502 questions
asked 2021-11-19T12:45:44.613+00:00
ADX 156 Reputation points
commented 2021-11-24T03:27:57.583+00:00
ADX 156 Reputation points
0 answers

Azure Data Explorer: How The data from App Insights and Log analytics is pulled in Azure Data Explorer Cluster, is it user specific?

When we add App Insights resource link in Azure Data Explorer , is it added specific to the user? Is it possible, that it can be applied to all users viewing the Azure Data Explorer Web UI? Ref Link:…

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
502 questions
asked 2021-11-15T12:01:52.487+00:00
Karandikar, Varsha 1 Reputation point
commented 2021-11-22T08:03:43.437+00:00
PRADEEPCHEEKATLA-MSFT 84,381 Reputation points Microsoft Employee
1 answer One of the answers was accepted by the question author.

Execute the ingestion statment Based on If condition result

Hi, Can someone answer how we can write the similar query in ADX. Sample SQL Server query: INSERT INTO TestTable(Col1,Col2) Values(1,10) Where NOT EXISTS ( SELECT 1 FROM TestTable WHERE col1 =1 and Col2=10) Thanks

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
502 questions
asked 2021-11-10T10:55:13.717+00:00
ADX 156 Reputation points
commented 2021-11-16T12:38:05.983+00:00
PRADEEPCHEEKATLA-MSFT 84,381 Reputation points Microsoft Employee
1 answer One of the answers was accepted by the question author.

Not able to add additional column to the sink `Azure Data Explorer` in the Copy Activity of Azure Data Factory.

Hi, I am trying to add an additional column to the Azure Data Explorer sink from the source Blob Storage using the "Additional columns" in the Copy Activity "Source" tab, but I am getting the following error: "Additional…

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
502 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,015 questions
asked 2021-11-15T20:20:11.513+00:00
Bhagyesh Patil 21 Reputation points Microsoft Employee
accepted 2021-11-16T12:02:11.97+00:00
Bhagyesh Patil 21 Reputation points Microsoft Employee
2 answers

SQL Query Help need on Train data

NA-----------

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
502 questions
asked 2021-10-25T06:41:41.54+00:00
ADX 156 Reputation points
commented 2021-11-16T08:16:39.023+00:00
ADX 156 Reputation points
1 answer One of the answers was accepted by the question author.

union all in azure data explorer

Hi Team, I have a data from two queries: let query1=view() { let source1=(a|project col1,col2); source1 }; let query2=view() { let source2=(b|project col1,col2); source1 }; and the query1 results set data is like 1,hyd and the…

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
502 questions
asked 2021-11-05T08:58:03.71+00:00
ADX 156 Reputation points
accepted 2021-11-10T12:23:21.64+00:00
ADX 156 Reputation points
2 answers One of the answers was accepted by the question author.

Unpivoting the Data in Azure Data Explorer

Hi I have a data like mentioned on below Date,Col1,Col2 2021-11-02,a,b 2021-11-02,c,d Unpivoted data should look like mentioned below. Date,ColumnName,ColumnValue 2021-11-02,Col1,a 2021-11-02,Col1,b 021-11-02,Col2,c 2021-11-02,Col2,d …

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
502 questions
asked 2021-11-02T12:16:56.273+00:00
ADX 156 Reputation points
commented 2021-11-08T04:17:42.777+00:00
BhargaviAnnadevara-MSFT 5,466 Reputation points
1 answer

Azure Data Explorer Function to insert the data into Azure Data Explorer table

Hi, I have a requirement to insert the data into azure data explorer table that the data received from the input parameters. My Table structure: Table Name: AlarmReview Table Columns: AlarmId:int,Reviewed:int,CreatedDate:datetime I was able to…

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
502 questions
asked 2021-10-27T09:13:49.09+00:00
ADX 156 Reputation points
commented 2021-10-29T03:52:38.707+00:00
ADX 156 Reputation points
1 answer One of the answers was accepted by the question author.

can we use azure data explorer function (for example series_decompose() ) locally or anywhere in python program

There is function in azure data explorer i.e. series_decompose() , so I need to use this function in my python program locally with data from my local csv. So can I do it, and if yes then how?

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
502 questions
Azure Time Series Insights
Azure Time Series Insights
An Azure internet of things (IoT) analytics platform to monitor, analyze, and visualize industrial IoT analytics data at scale.
78 questions
asked 2021-10-27T19:09:21.883+00:00
Vishal Suryavanshi 21 Reputation points
accepted 2021-10-28T04:39:54.95+00:00
Vishal Suryavanshi 21 Reputation points
1 answer

union operation with sum

I am looking for a way to combine two tables with the same fields in a way that the devicename which is common between the two gets added See below example 2 tables a and b, with identical columns, I want to union them, so one column is device name…

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
502 questions
asked 2021-10-20T20:59:26.02+00:00
Atherr Alam 1 Reputation point Microsoft Employee
commented 2021-10-26T12:03:40.35+00:00
PRADEEPCHEEKATLA-MSFT 84,381 Reputation points Microsoft Employee