How can I optimize ADX query performance to find last timestamp of a specific timeseries id ?
Hi community, I have a Telemetry table as followed: The partition is applied only on TimeseriesId field and the default on ingest_time I have an use case where I need to find the last ServerTimeStamp of a specific TimeseriesId When I have performed…
Azure data explorer dashboard is not loading in iframe
I am trying to embed azure data explorer dashboard in an iframe. For this i followed code samples provided by microsoft. Till yesterday the dashboard were able to load fine but from today instead of loading the dashboard, azure query explorer is getting…
load data from tempview to table in databricks
Hi Expert, How to load the data from temp_view to table in databricks ---View Creation %sql create or replace view test as select * from table1 now how to load the data from view to table level
Need Help with KQL Query for Software Update Information in Log Analytics
Hello Everyone, I hope this message finds you well. I'm currently working on retrieving software update information from Log Analytics in Azure using Kusto Query Language (KQL). Unfortunately, my lack of experience in KQL is making it challenging for me…
IoT Hub ingestion into Azure Data Explorer runs at 100% avg ingestion utilization
My setup consists of several databases in a single Kusto cluster, each having a landing table with ingestion mapping configured from IoT Hubs. The data in the landing table is then split with update policies into specialized tables. I have no ingestion…
Copy data from azure select server to adls
Hi expert, How to copy data from SQL server db tables to in paraquat format in adls using one copy pipeline
How to save forecasting result after using series_decompose_forecast in Kusto?
I am generating a time chart in Kusto using the code below, but when I view the data points, only the first 7 data points are shown. I need to use the forecasted data somewhere else, but I am unable to do so due to this issue. How can I save the forecast…
Load files in appending in databricks
Hi Expert, I have 2 files in blob storage . file1.csv, file2.csv how will i load it in a view using appending order using *.csv extension using temp view file_list = dbutils.fs.ls("/mnt/mount/test/file")
Seeking Guidance on Materialized Views Update Challenges
Hello Forum Members, Our team relies on materialized views to facilitate joins between our main table and multiple dimension tables. Due to the significant size of the main table, we've implemented 12 materialized views, each corresponding to a different…
Cosmosdb_sq_request plugin not working for service to service authentication.
Cosmosdb_sq_request plugin not working for service to service authentication. In …
MULTIJSON data format missing when creating a Data Explorer data connection in the Azure Portal
When creating a data connection from ADX/Kusto to EventHub, I would like to choose the MULTIJSON data format. If I recall correctly, this option was available in the Azure Portal, but there is only the JSON format now (see screenshot). The docs still…
how to delete a table in azure data explorer using kql query?
I was trying to delete a table called Heartbeat from Azure Data Explorer DB using a KQL script. The contents of the kql script is: .drop table Heartbeat ifexists On executing the kql script using github workflows, Im getting the following error: The…
How can we achieve real-time import, processing, and export of streaming data by using ADX?
The streaming data comes from Azure iothub, and I would like to process and export each data from iothub in the form of streaming data by using ADX to other containers, such as ADLS, CosmosDB, etc. Due to ASA's lack of flexibility, I am considering…
Is recreate_schema supported in CslCommandGenerator.GenerateTableSetOrReplaceCommand(......) . I can see extend_schema is supported.[KustoClientFactory ]
public static string GenerateTableSetOrReplaceCommand(string tableName, string innerQuery, bool isAsync, IEnumerable<string> tags = null, IEnumerable<string> ingestIfNotExistsValues = null, DateTime? creationTime = default, string folderName…
timefromparts in databricks
Hi Expert, Sql server query: create table table12(col varchar(25),col1 nchar(1000)) insert into table12 values('0','620') select TIMEFROMPARTS (620/100, 620%100,0,0,0) ,620 as col1 from table12 Expected output:: 06:20:00 620 How we can get this field in…
Need support on satelite when used ODK to capture time
OLE DB or ODBC error: [DataSource.Error] OData: Cannot convert the literal '2023-11-22T5:56:50.104+03:00' to the expected type 'Edm.DateTimeOffset
Need Assistance Redirecting O365 Logs to Event Hub (using azure function), then visualize with data explorer
Hello, I've been working on a project involving eventhub, function apps and O365 logs, and I've hit a bit of a roadblock. I'm using the Azure-Sentinel GitHub repository (link:…
Remove 'Z' in datetime column that is not UTC
Hi Team, Good morning! We have an issue which is in an ADX table, we have a column which is not UTC time (for example EST timezone), in the source json file, we remove 'Z' after the datetime value (for exmaple: {'localtime': '2023-10-20T22:22:22.365'}…
How to ingest dynamic data to ADX?
I am connecting to Azure IoT Hub through Azure Data Explorer (ADX) to get JSON-formatted streaming data. However, this JSON is in a nested format, and the fields of the nested objects are not fixed. How can I flatten and store it in ADX? The JSON data…
Pre-copy script in Copy Activity is not available in Azure Data Factory when Sink is ADX Azure Data Explorer
Data is ingested using Copy Activity of Azure Data Factory into Azure Data Explorer table. Need to clear/truncate the data from ADX table before load. But Pre-copy script feature not available when ADX is used as sink in copy Activity.