501 questions with Azure Data Explorer tags

Sort by: Updated
2 answers

How can I optimize ADX query performance to find last timestamp of a specific timeseries id ?

Hi community, I have a Telemetry table as followed: The partition is applied only on TimeseriesId field and the default on ingest_time I have an use case where I need to find the last ServerTimeStamp of a specific TimeseriesId When I have performed…

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
501 questions
asked 2023-11-06T17:33:45.7433333+00:00
Galgani, Stefano 205 Reputation points
edited a comment 2023-12-15T13:10:24.3833333+00:00
Galgani, Stefano 205 Reputation points
1 answer One of the answers was accepted by the question author.

Azure data explorer dashboard is not loading in iframe

I am trying to embed azure data explorer dashboard in an iframe. For this i followed code samples provided by microsoft. Till yesterday the dashboard were able to load fine but from today instead of loading the dashboard, azure query explorer is getting…

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
501 questions
asked 2023-12-01T15:13:02.3633333+00:00
Sunil K 30 Reputation points
commented 2023-12-12T14:36:56.5+00:00
BhargavaGunnam-MSFT 28,526 Reputation points Microsoft Employee
1 answer One of the answers was accepted by the question author.

load data from tempview to table in databricks

Hi Expert, How to load the data from temp_view to table in databricks ---View Creation %sql create or replace view test as select * from table1 now how to load the data from view to table level

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,409 questions
Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
501 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,042 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,994 questions
asked 2023-12-06T11:37:16.04+00:00
Shambhu Rai 1,406 Reputation points
accepted 2023-12-07T10:06:02.7166667+00:00
Shambhu Rai 1,406 Reputation points
1 answer

Need Help with KQL Query for Software Update Information in Log Analytics

Hello Everyone, I hope this message finds you well. I'm currently working on retrieving software update information from Log Analytics in Azure using Kusto Query Language (KQL). Unfortunately, my lack of experience in KQL is making it challenging for me…

Azure Monitor
Azure Monitor
An Azure service that is used to collect, analyze, and act on telemetry data from Azure and on-premises environments.
2,960 questions
Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
501 questions
asked 2023-11-28T07:26:41.5+00:00
Swahela Mulla 90 Reputation points
commented 2023-12-05T08:01:39.9066667+00:00
Swahela Mulla 90 Reputation points
1 answer

IoT Hub ingestion into Azure Data Explorer runs at 100% avg ingestion utilization

My setup consists of several databases in a single Kusto cluster, each having a landing table with ingestion mapping configured from IoT Hubs. The data in the landing table is then split with update policies into specialized tables. I have no ingestion…

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
501 questions
asked 2023-12-04T18:49:34.9866667+00:00
Kovács, Ferenc 61 Reputation points
answered 2023-12-04T23:11:22.78+00:00
Sander van de Velde | MVP 30,711 Reputation points MVP
2 answers

Copy data from azure select server to adls

Hi expert, How to copy data from SQL server db tables to in paraquat format in adls using one copy pipeline

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
501 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,613 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,042 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,994 questions
asked 2023-12-02T19:10:06.3566667+00:00
Shambhu Rai 1,406 Reputation points
commented 2023-12-04T18:15:16.1066667+00:00
Shambhu Rai 1,406 Reputation points
0 answers

How to save forecasting result after using series_decompose_forecast in Kusto?

I am generating a time chart in Kusto using the code below, but when I view the data points, only the first 7 data points are shown. I need to use the forecasted data somewhere else, but I am unable to do so due to this issue. How can I save the forecast…

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
501 questions
asked 2023-11-27T12:09:27.05+00:00
Vishal Vyas 0 Reputation points
commented 2023-12-01T10:41:13.0933333+00:00
Vishal Vyas 0 Reputation points
1 answer

Load files in appending in databricks

Hi Expert, I have 2 files in blob storage . file1.csv, file2.csv how will i load it in a view using appending order using *.csv extension using temp view file_list = dbutils.fs.ls("/mnt/mount/test/file")

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
501 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,042 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,994 questions
Azure Data Lake Analytics
asked 2023-11-29T05:48:38.4166667+00:00
Shambhu Rai 1,406 Reputation points
commented 2023-11-30T12:32:49.06+00:00
Shambhu Rai 1,406 Reputation points
1 answer One of the answers was accepted by the question author.

Seeking Guidance on Materialized Views Update Challenges

Hello Forum Members, Our team relies on materialized views to facilitate joins between our main table and multiple dimension tables. Due to the significant size of the main table, we've implemented 12 materialized views, each corresponding to a different…

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
501 questions
asked 2023-11-29T08:15:23.4866667+00:00
Amir Meshkati 61 Reputation points
accepted 2023-11-30T09:00:14.4433333+00:00
Amir Meshkati 61 Reputation points
0 answers

Cosmosdb_sq_request plugin not working for service to service authentication.

Cosmosdb_sq_request plugin not working for service to service authentication. In …

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
501 questions
asked 2023-11-07T07:18:53.6833333+00:00
DEVESH KUMAR 0 Reputation points Microsoft Employee
commented 2023-11-28T20:21:17.89+00:00
KranthiPakala-MSFT 46,437 Reputation points Microsoft Employee
1 answer

MULTIJSON data format missing when creating a Data Explorer data connection in the Azure Portal

When creating a data connection from ADX/Kusto to EventHub, I would like to choose the MULTIJSON data format. If I recall correctly, this option was available in the Azure Portal, but there is only the JSON format now (see screenshot). The docs still…

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
501 questions
Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
586 questions
asked 2023-11-01T20:42:29.5433333+00:00
J-C 5 Reputation points
commented 2023-11-28T14:46:32.53+00:00
J-C 5 Reputation points
1 answer

how to delete a table in azure data explorer using kql query?

I was trying to delete a table called Heartbeat from Azure Data Explorer DB using a KQL script. The contents of the kql script is: .drop table Heartbeat ifexists On executing the kql script using github workflows, Im getting the following error: The…

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
501 questions
asked 2023-11-24T12:40:50.0566667+00:00
PRIYANKA S NAIR 20 Reputation points
commented 2023-11-27T23:25:23.27+00:00
KranthiPakala-MSFT 46,437 Reputation points Microsoft Employee
1 answer One of the answers was accepted by the question author.

How can we achieve real-time import, processing, and export of streaming data by using ADX?

The streaming data comes from Azure iothub, and I would like to process and export each data from iothub in the form of streaming data by using ADX to other containers, such as ADLS, CosmosDB, etc. Due to ASA's lack of flexibility, I am considering…

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
501 questions
asked 2023-11-24T07:52:14.11+00:00
jane 60 Reputation points
accepted 2023-11-27T08:45:49.6066667+00:00
jane 60 Reputation points
1 answer One of the answers was accepted by the question author.

Is recreate_schema supported in CslCommandGenerator.GenerateTableSetOrReplaceCommand(......) . I can see extend_schema is supported.[KustoClientFactory ]

public static string GenerateTableSetOrReplaceCommand(string tableName, string innerQuery, bool isAsync, IEnumerable<string> tags = null, IEnumerable<string> ingestIfNotExistsValues = null, DateTime? creationTime = default, string folderName…

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
501 questions
asked 2022-12-05T22:53:22.617+00:00
Sumier Sumier Mustafa 21 Reputation points Microsoft Employee
accepted 2023-11-26T00:18:41.61+00:00
Sumier Sumier Mustafa 21 Reputation points Microsoft Employee
1 answer One of the answers was accepted by the question author.

timefromparts in databricks

Hi Expert, Sql server query: create table table12(col varchar(25),col1 nchar(1000)) insert into table12 values('0','620') select TIMEFROMPARTS (620/100, 620%100,0,0,0) ,620 as col1 from table12 Expected output:: 06:20:00 620 How we can get this field in…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,409 questions
Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
501 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,042 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,994 questions
asked 2023-11-22T07:30:24.16+00:00
Shambhu Rai 1,406 Reputation points
accepted 2023-11-23T07:41:05.4266667+00:00
Shambhu Rai 1,406 Reputation points
1 answer

Need support on satelite when used ODK to capture time

OLE DB or ODBC error: [DataSource.Error] OData: Cannot convert the literal '2023-11-22T5:56:50.104+03:00' to the expected type 'Edm.DateTimeOffset

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
501 questions
Windows Server
Windows Server
A family of Microsoft server operating systems that support enterprise-level management, data storage, applications, and communications.
12,507 questions
SharePoint Server Management
SharePoint Server Management
SharePoint Server: A family of Microsoft on-premises document management and storage systems.Management: The act or process of organizing, handling, directing or controlling something.
2,874 questions
Not Monitored
Not Monitored
Tag not monitored by Microsoft.
37,333 questions
PowerShell
PowerShell
A family of Microsoft task automation and configuration management frameworks consisting of a command-line shell and associated scripting language.
2,265 questions
asked 2023-11-22T19:56:22.19+00:00
Joshua Kamulegeya 0 Reputation points
commented 2023-11-22T20:57:01.67+00:00
Sander van de Velde | MVP 30,711 Reputation points MVP
1 answer

Need Assistance Redirecting O365 Logs to Event Hub (using azure function), then visualize with data explorer

Hello, I've been working on a project involving eventhub, function apps and O365 logs, and I've hit a bit of a roadblock. I'm using the Azure-Sentinel GitHub repository (link:…

Azure Functions
Azure Functions
An Azure service that provides an event-driven serverless compute platform.
4,556 questions
Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
501 questions
Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
586 questions
asked 2023-11-16T19:02:35.7633333+00:00
Riya Aggarwal 25 Reputation points
commented 2023-11-22T10:38:53.01+00:00
MayankBargali-MSFT 69,941 Reputation points
1 answer

Remove 'Z' in datetime column that is not UTC

Hi Team, Good morning! We have an issue which is in an ADX table, we have a column which is not UTC time (for example EST timezone), in the source json file, we remove 'Z' after the datetime value (for exmaple: {'localtime': '2023-10-20T22:22:22.365'}…

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
501 questions
asked 2023-11-20T16:24:50.7866667+00:00
Jiacheng Zhang 20 Reputation points
commented 2023-11-22T10:20:27.4+00:00
ShaikMaheer-MSFT 38,321 Reputation points Microsoft Employee
1 answer One of the answers was accepted by the question author.

How to ingest dynamic data to ADX?

I am connecting to Azure IoT Hub through Azure Data Explorer (ADX) to get JSON-formatted streaming data. However, this JSON is in a nested format, and the fields of the nested objects are not fixed. How can I flatten and store it in ADX? The JSON data…

Azure IoT Hub
Azure IoT Hub
An Azure service that enables bidirectional communication between internet of things (IoT) devices and applications.
1,148 questions
Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
501 questions
asked 2023-11-17T07:47:58.6866667+00:00
jane 60 Reputation points
accepted 2023-11-22T06:39:25.7433333+00:00
jane 60 Reputation points
1 answer

Pre-copy script in Copy Activity is not available in Azure Data Factory when Sink is ADX Azure Data Explorer

Data is ingested using Copy Activity of Azure Data Factory into Azure Data Explorer table. Need to clear/truncate the data from ADX table before load. But Pre-copy script feature not available when ADX is used as sink in copy Activity.

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
501 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,994 questions
asked 2023-11-16T11:14:39.32+00:00
Anonymous
edited a comment 2023-11-21T17:55:39.38+00:00
KranthiPakala-MSFT 46,437 Reputation points Microsoft Employee