Open folder with large number of files and large size error

Advertisement

riko
Joined:
Posts:
2

Open folder with large number of files and large size error

Hello

So this error happen when I try to access this two folder with large number of files, the first one is /Shared Inbox/storage/mss_wvfw_sftp/incoming/fdrs have 402 files and total size 66.0MB when access it have some error, but the SFTP connection remains here is the error logs
. 2022-06-10 15:39:02.168 Read file 'GFWED_BUI_20220518_000000.png' from listing
. 2022-06-10 15:39:02.168 Read file 'GFWED_BUI_20220519_000000.png' from listing
. 2022-06-10 15:39:02.168 Read file 'GFWED_BUI_20220520_000000.png' from listing
. 2022-06-10 15:39:02.168 Strings received in non-UTF-8 encoding in a previous packet, will not use UTF-8 anymore
> 2022-06-10 15:39:02.168 Type: SSH_FXP_CLOSE, Size: 10, Number: 7172
> 2022-06-10 15:39:02.168 04,00,00,1C,04,00,00,00,01,36,
. 2022-06-10 15:39:02.168 Sent 14 bytes
. 2022-06-10 15:39:02.168 There are 0 bytes remaining in the send buffer
. 2022-06-10 15:39:02.168 Looking for network events
. 2022-06-10 15:39:02.168 Timeout waiting for network events
. 2022-06-10 15:39:02.168 Session is open, will not retry transfer
* 2022-06-10 15:39:02.543 (ECommand) Error listing directory '/Shared Inbox/storage/mss_wvfw_sftp/incoming/fdrs'.
* 2022-06-10 15:39:02.543 Error decoding SFTP packet (41011, 1230975536, 60279).
The other one is /Shared Inbox/storage/mss_wvfw_sftp/incoming/polarsat have 8861 files with total size 29.4GB when access it throw an error and cause the connection to abort. Here is the error logs:
. 2022-06-10 15:39:09.321 Detected network event
. 2022-06-10 15:39:09.321 Enumerating network events for socket 3676
. 2022-06-10 15:39:09.321 Enumerated 32 network events making 32 cumulative events for socket 3676
. 2022-06-10 15:39:09.321 Handling network close event on socket 3676 with error 10053
. 2022-06-10 15:39:09.321 Selecting events 0 for socket 3676
. 2022-06-10 15:39:09.321 Network error: Software caused connection abort
. 2022-06-10 15:39:09.321 Connection was lost, asking what to do.
. 2022-06-10 15:39:09.321 Asking user:
. 2022-06-10 15:39:09.321 Network error: Software caused connection abort ()
. 2022-06-10 15:39:11.323 Answer: Abort
* 2022-06-10 15:39:11.347 (ESshFatal) Network error: Software caused connection abort
* 2022-06-10 15:39:11.347 Error listing directory '/Shared Inbox/storage/mss_wvfw_sftp/incoming/polarsat'.
* 2022-06-10 15:39:11.347 Error changing directory to 'polarsat'.
When I access the folder with smaller size like this /Shared Inbox/storage/mss_wvfw_sftp/incoming/eval it have 205 files and total size 233.3KB it works with no issue. Here is the logs
. 2022-06-10 15:38:57.650 202204_mon_eval_rmse.txt;-;1226;2022-06-10T07:06:30.000Z;3;"-" [0];"-" [0];rwxr--r--;0
. 2022-06-10 15:38:57.650 202205_mon_eval_be.txt;-;1320;2022-06-10T07:06:33.000Z;3;"-" [0];"-" [0];rwxr--r--;0
. 2022-06-10 15:38:57.650 202205_mon_eval_corr.txt;-;1240;2022-06-10T07:06:19.000Z;3;"-" [0];"-" [0];rwxr--r--;0
. 2022-06-10 15:38:57.650 202205_mon_eval_fge.txt;-;1218;2022-06-10T07:06:38.000Z;3;"-" [0];"-" [0];rwxr--r--;0
. 2022-06-10 15:38:57.650 202205_mon_eval_num.txt;-;846;2022-06-10T07:06:43.000Z;3;"-" [0];"-" [0];rwxr--r--;0
. 2022-06-10 15:38:57.650 202205_mon_eval_rmse.txt;-;1218;2022-06-10T07:06:40.000Z;3;"-" [0];"-" [0];rwxr--r--;0
. 2022-06-10 15:38:57.650 ..;D;0;1899-12-30T08:00:00.000Z;0;"" [0];"" [0];---------;0
. 2022-06-10 15:38:57.892 Session upkeep
. 2022-06-10 15:38:57.892 Looking for network events
. 2022-06-10 15:38:57.892 Timeout waiting for network events
. 2022-06-10 15:38:58.150 Session upkeep
. 2022-06-10 15:38:58.150 Looking for network events
. 2022-06-10 15:38:58.150 Timeout waiting for network events
. 2022-06-10 15:38:58.648 Session upkeep
. 2022-06-10 15:38:58.648 Looking for network events
. 2022-06-10 15:38:58.648 Timeout waiting for network events
. 2022-06-10 15:38:59.158 Session upkeep
. 2022-06-10 15:38:59.158 Looking for network events
. 2022-06-10 15:38:59.158 Detected network event
. 2022-06-10 15:38:59.158 Enumerating network events for socket 3676
. 2022-06-10 15:38:59.158 Enumerated 1 network events making 1 cumulative events for socket 3676
. 2022-06-10 15:38:59.158 Handling network read event on socket 3676 with error 0
. 2022-06-10 15:38:59.628 Cached directory change via ".." to "/Shared Inbox/storage/mss_wvfw_sftp/incoming".
. 2022-06-10 15:38:59.628 Getting current directory name.
. 2022-06-10 15:38:59.664 Directory content loaded from cache.
I've already used the latest WinSCP version, Kindly advice on what to do to fix this issue
Thanks

Reply with quote

Advertisement

martin
Site Admin
martin avatar
Joined:
Posts:
41,034
Location:
Prague, Czechia

Re: Open folder with large number of files and large size error

What SFTP server is that?
Please post complete logs.
Can you access those folders using any other SFTP client?

Reply with quote

riko

SFTP server is AWS Transfer family the folder is in S3, I've tried to use FileZilla still have the same error. Sure I attach send the full logs.
Last edited by riko on 2022-06-24 05:49; edited 1 time in total

Reply with quote

martin
Site Admin
martin avatar

Then it looks like a problem on Amazon side. Can you also try OpenSSH sftp client? If it has the same problem, please contact Amazon support.

Reply with quote

Advertisement

You can post new topics in this forum