Facing issue while using ADF Copy data activity from Azure to Kusto Bugs table

Vikas Verma (HCL TECHNOLOGIES CORPORATE SER) 25 Reputation points Microsoft Vendor
2024-06-28T09:29:30.76+00:00

Dear Team,

We are experiencing an issue with data transfer from an Azure Storage Table to a Kusto Table using Azure Data Factory (ADF). Specifically, the System_AssignedTo field, which is blank in the Azure Storage Table, is being populated with previous value when inserted into the Kusto Table. We have verified that the column mapping is correct, and there are no discrepancies. Despite this, the incorrect value insertion persists. Could you please assist us in identifying and resolving the issue? Any guidance or steps to troubleshoot this problem would be greatly appreciated. Thank you for your prompt attention to this matter.

Best regards,

Vikas

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,681 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. Amira Bedhiafi 24,531 Reputation points
    2024-07-01T10:44:26.2766667+00:00

    Can you verify that the System_AssignedTo field in both the source Azure Storage Table and the destination Kusto Table have the correct data types and mappings ?

    Maybe you have default values set for the System_AssignedTo column in the Kusto Table schema.

    You can use the Data Preview feature in ADF to inspect the data in the source Azure Storage Table. Confirm that the System_AssignedTo field is indeed blank for the rows in question.

    Run the ADF pipeline in Debug mode and inspect the data as it passes through each activity. This can help identify where the incorrect value might be getting assigned.

    You may contact Azure Support if the issue still persists.

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.