Ingest into Azure Data Explorer failing through Azure Data Factory pipeline

Ashutosh Rai (Tata Consultancy Services Ltd) 1

I have created a Azure Data Factory pipeline to copy data from On- Premise Sql server to a Kusto cluster.I have created a service principal and given it admin permission on the Kusto database in Azure Data Explorer.Also used this service principal for creating Linked Service to connect with Azure Data Explorer. Test Connection for this Linked Service is successful and it also fetches data in Preview.
But when I run the pipeline it fails to copy the data in Azure Data Explorer and throws following error.

Failure happened on 'Sink' side. ErrorCode=UserErrorKustoWriteFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Write to Kusto failed with following error: Kusto client failed to send a request to the service: Unable to connect to the remote server. Please provide the following information when contacting the Kusto team @ https://aka.ms/kustosupport : DataSource='https://ingest-imageops.westus.kusto.windows.net/v1/rest/mgmt', DatabaseName='NetDefaultDB', ClientRequestId='KI.KustoQueuedIngestClient.IngestFromDataReader.2a169fab-7ac5-47cd-85b5-cb18f6300237;8e958787-ad6b-4af5-9aff-64b733a7d1be', Timestamp='2020-11-18T06:51:50.0627927Z'..,Source=Microsoft.DataTransfer.Runtime.KustoConnector,''Type=Kusto.Data.Exceptions.KustoClientException,Message=Kusto client failed to send a request to the service: Unable to connect to the remote server. Please provide the following information when contacting the Kusto team @ https://aka.ms/kustosupport : DataSource='https://ingest-imageops.westus.kusto.windows.net/v1/rest/mgmt', DatabaseName='NetDefaultDB', ClientRequestId='KI.KustoQueuedIngestClient.IngestFromDataReader.2a169fab-7ac5-47cd-85b5-cb18f6300237;8e958787-ad6b-4af5-9aff-64b733a7d1be', Timestamp='2020-11-18T06:51:50.0627927Z'.,Source=Kusto.Data,''Type=System.Net.WebException,Message=Unable to connect to the remote server,Source=System,''Type=System.Net.Sockets.SocketException,Message=A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond 20.184.253.224:443,Source=System,'*

HimanshuSinha-msft 19,376 Reputation points Microsoft Employee

2020-11-19T21:03:03.703+00:00

Hello @Ashutosh Rai (Tata Consultancy Services Ltd)

Thanks for the ask and using the forum . In our scenario is source is In perm SQL and sink in ADx . when you say that you can preview the data , is it not the data for the SQL ? I think that the issue is that you are not able to connect to Adx cluster . Have you checked the permission on the Adx . This link may help you .

Thanks
Himasnhu
HimanshuSinha-msft 19,376 Reputation points Microsoft Employee

2020-11-30T20:55:21.167+00:00

Hello @Ashutosh Rai (Tata Consultancy Services Ltd) ,

We have not heard back from you on this and was just following up ,if the issue is resolved .
In case if you have a resolution we request you to share that with the community .

Thanks
Himanshu
HimanshuSinha-msft 19,376 Reputation points Microsoft Employee

2020-12-02T19:57:26.997+00:00

Hello @Ashutosh Rai (Tata Consultancy Services Ltd) ,

We have not heard back from you yet on this and was just following up ,if the issue is resolved .
In case if you have a resolution we request you to share that with the community .

Thanks
Himanshu
Ashutosh Rai (Tata Consultancy Services Ltd) 1 Reputation point

2020-12-04T19:53:17.9+00:00

Hi @HimanshuSinha-msft ,
The issue is with connecting to Kusto cluster from ADF pipeline.I have checked the permissions for service principal used for connection and it is as expected. Infact using this service principal I can connect to Kusto Cluster and read the data from a .Net application but the connection fails when ADF pipeline is triggered.
I have verified Test Connection for Linked Service separately to connect with Kusto Cluster and that also works.
But when I trigger the pipeline it fails with following error.
Ashutosh Rai (Tata Consultancy Services Ltd) 1 Reputation point

2020-12-04T19:55:02.427+00:00

Failure happened on 'Source' side. ErrorCode=UserErrorKustoReadFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Read from Kusto failed with following error: Kusto client failed to send a request to the service: Unable to connect to the remote server. Please provide the following information when contacting the Kusto team @ https://aka.ms/kustosupport : DataSource='https://imageops.westus.kusto.windows.net/v1/rest/query', DatabaseName='ImagingArchive'
Query: Signals | take 10.,Source=Kusto.Data,''Type=System.Net.WebException,Message=Unable to connect to the remote server,Source=System,''Type=System.Net.Sockets.SocketException,Message=A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond 20.184.253.128:443,Source=System,
Vladik Branevich 1 Reputation point Microsoft Employee

2020-12-15T08:29:30.097+00:00

This error indicates that the ADF activity failed to establish connection to the ADX cluster.
Possible reasons could be temporary unavailability of the cluster.
Going forward we will add some resiliency to this type of errors for ADX connector in ADF.

Share via

Ingest into Azure Data Explorer failing through Azure Data Factory pipeline