azure datalake

José Armando Díaz Torres 1

Hi,

Could you help me, I am currently getting the following error: HTTP/1.1 401 Server failed to authenticate the request. Please refer to the information in the www-authenticate header. this when trying to perform an upload to azure datalake of more than 10 million records.

Regards.

KranthiPakala-MSFT 46,487 Reputation points Microsoft Employee

2022-04-08T20:43:57.477+00:00

Hello @José Armando Díaz Torres ,

Thanks for the question and using MS Q&A platform.

To better assist on this query, could you please elaborate on what is the azure service you are using? What is your overall goal/requirement? What are steps you have performed so far and at which point you got stuck with the above error?

A few detailed steps would give us more context of what you are trying to accomplish, and we would be able to assist further.
José Armando Díaz Torres 1 Reputation point

2022-04-12T14:52:31.02+00:00

Hi!

The Azure Datalake gen2 is being used, the requirement is that you are trying to
trying to load sales information using an ETL (Datastage).
The problem occurs intermittently. You connect using
WebHDFS URL,ClientID, TenantID, SecretKey. Normally the problem occurs
when trying to load more than 10 million records.

Regards
KranthiPakala-MSFT 46,487 Reputation points Microsoft Employee

2022-04-14T04:01:02.323+00:00

Hello @José Armando Díaz Torres ,

Thanks for the response. I'm not familiar with Datastage but at this point we are not sure if the issue is from ADLS gen2 or from your ETL service Datastage. Could you please confirm that there is nothing with DataStage ? Also please share the complete error message that you are receiving?
José Armando Díaz Torres 1 Reputation point

2022-05-02T23:38:49.91+00:00

Hi!

I can tell you that on the datastage side we have already ruled out any problem. Attached image with the complete error when trying to upload the file to azure datalake.

Regards.

Share via

azure datalake

Your answer