How to troubleshoot UDF error in Stream Analytics?

Mikael Falkvidd 1

My Stream Analytics jobs has multiple errors like this:

{ "Environment": "Prod", "Region": "North Europe", "time": "2020-10-03T00:04:22.9834272Z", "resourceId": "/SUBSCRIPTIONS/5B..08/RESOURCEGROUPS/O...A/PROVIDERS/MICROSOFT.STREAMANALYTICS/STREAMINGJOBS/SIGFOXTOSQL", "operationName": "Process Events", "category": "Execution", "status": "Failed", "level": "Error", "properties": "{\"ErrorCode\":null,\"Message\":\"Encountered error while executing user code in class: s...1. Error: item: 1304459103 hex: 4dc0775f\",\"Source\":{\"Name\":null,\"Type\":null},\"Type\":127,\"Data\":\"item: 1304459103 hex: 4dc0775f\"}"}
{ "Environment": "Prod", "Region": "North Europe", "time": "2020-10-03T00:17:07.5690012Z", "resourceId": "/SUBSCRIPTIONS/5B..08/RESOURCEGROUPS/O...A/PROVIDERS/MICROSOFT.STREAMANALYTICS/STREAMINGJOBS/SIGFOXTOSQL", "operationName": "Process Events", "category": "Execution", "status": "Failed", "level": "Error", "properties": "{\"ErrorCode\":null,\"Message\":\"Encountered error while executing user code in class: s...1. Error: item: -20744353 hex: fec3775f\",\"Source\":{\"Name\":null,\"Type\":null},\"Type\":127,\"Data\":\"item: -20744353 hex: fec3775f\"}"}
{ "Environment": "Prod", "Region": "North Europe", "time": "2020-10-03T00:43:48.0049244Z", "resourceId": "/SUBSCRIPTIONS/5B..08/RESOURCEGROUPS/O...A/PROVIDERS/MICROSOFT.STREAMANALYTICS/STREAMINGJOBS/SIGFOXTOSQL", "operationName": "Process Events", "category": "Execution", "status": "Failed", "level": "Error", "properties": "{\"ErrorCode\":null,\"Message\":\"Encountered error while executing user code in class: s...1. Error: item: -1412860065 hex: abc9775f\",\"Source\":{\"Name\":null,\"Type\":null},\"Type\":127,\"Data\":\"item: -1412860065 hex: abc9775f\"}"}

Is there a way to find out which line of my UDF caused the error?
Is there a way to find which message caused the error? The error message does not contain a correlation ID unfortunately.

Saurabh Sharma 23,816 Reputation points Microsoft Employee

2020-11-11T22:33:40.847+00:00

@Mikael Falkvidd Have you tried debugging your UDF locally ?
Mikael Falkvidd 1 Reputation point

2020-11-11T22:53:18.213+00:00

Since I don’t know which message causes the error, I can not run it locally. The udf executes successfully for more than 99% of the received messages.
Saurabh Sharma 23,816 Reputation points Microsoft Employee

2020-11-12T20:09:01.613+00:00

@Mikael Falkvidd ok. There might be a chance that nulls are being sent occasionally which the udf is not able to execute properly. Are you using a create table in the query to verify all columns exist with the proper data type ? and skip any required columns with null values ?
Also, are you using any diagnostic logs. It will perhaps provide more information about the event that failed ?
Mikael Falkvidd 1 Reputation point

2020-11-12T20:40:15.517+00:00

@Saurabh Sharma To my knowledge, what I posted in my initial post is the full diagnostic log. There is nothing else beneath the insights-logs-execution container.
Saurabh Sharma 23,816 Reputation points Microsoft Employee

2020-11-17T21:15:25.217+00:00

@Mikael Falkvidd ok.. got it. I suggest you to please to open an Azure Support ticket so that a data engineer can review your UDF, query and further investigate your issue. Please let me know if you have any issues opening a support ticket and I will help creating a one-time free support ticket for you.
Saurabh Sharma 23,816 Reputation points Microsoft Employee

2020-11-19T18:02:00.027+00:00

@Mikael Falkvidd Please let me know if you need any help opening the support ticket.
Mikael Falkvidd 1 Reputation point

2020-12-15T18:01:33.457+00:00

Thanks for the offer. Troubleshooting this seems to require a lot of resources. Considering that this only affects a very small percentage of our messages, I am unable to find sufficient return of investment to prioritize those resources. I have tried, but the effort required is too high.

Share via

How to troubleshoot UDF error in Stream Analytics?

Your answer