ADF pipeline sink not showing any directory while browsing.

Ridhima Verma 25

I have created a azure pipeline to connect azure blob storage to sftp server.

The linked services are created and tested successfully with proper IP whitelisting.

But when I am creating the azue pipeline and configuring the sink, I get connection successful when tested(screenshot below).

But when I try to browse the folder, it is showing error as per screenshot 2.

Can you please help here.

Screenshot 1

User's image

Screenshot 2

prod issue

Bhargava-MSFT 30,816 Reputation points Microsoft Employee

2024-09-05T18:13:30.17+00:00

Hello Ridhima Verma,

It seems like there is a connectivity issue between ADF IR and the SFTP server or the throttling issue.

Since you mentioned that while listing is in place, you can ignore the connectivity issue

Regarding throttling issue:

ADF will create multiple connection to download from sftp server in parallel. Sometimes it will hit sftp server throttling and lead to this error.

To verify the throttling issue: Can you specify max concurrent connection of SFTP dataset to 1 and test again?

also please contact your sftp admin to increase the concurrent connection count limit
Ridhima Verma 25 Reputation points

2024-09-05T19:59:47.9033333+00:00

Hello Bhargava,

As suggested, I changed max concurrent connection to 1 and again tried to load the root directory, but no luck. attahcing screenshot below.

Do you have any more suggestions.?
Bhargava-MSFT 30,816 Reputation points Microsoft Employee

2024-09-09T15:47:02.62+00:00

Hello Ridhima Verma,

After further checking with my internal team, they have confirmed that this is a SFTP server-side issue.

Could you please involve your SFTP server admin to check whether there is a permission or other setting causing this issue? On the server side, please check user working directory.

Your answer