limited number of files in a remote sftp directory
Remote SFTP directory can not be opened if contains a lot of files.
I use the latest version on Windows 2008 R2 RTM 64-bit.
There is no special characters in the filenames transferred. I used name convention as following during the tests: file0001.txt, file0002.txt, file000n.txt
I've tried with lower version of ssh protocols, but the situation is the same.
It is independent that i use gui or scripting interface.
Is there any limit for files in a folder?
Symptom:
I got the following popup window when changing into directory with more than 337 small files (no error occurs during the update):
---------------------------
Error
---------------------------
No valid incoming packet found
---------------------------
Error listing directory '/test/FileNrTest'.
Error changing directory to '/test/FileNrTest'.
---------------------------
OK Reconnect (1 s) Help
---------------------------
I can log in to that directory with another sftp clients or switching ON SSH protocol compression. I've tested directories up to 1024 files without problem with switched on ssh compression. Maybe there is no limit with compression?
(Sensitive information have been masked with ****** in the logs)
Here are the Server and protocol information:
Session protocol = SSH-2
SSH implementation = 1.36_sshlib GlobalSCAPE
Encryption algorithm = aes
Compression = No
File transfer protocol = SFTP-3
------------------------------------------------------------
Server host key fingerprint
ssh-dss 2048 ***********************************************
------------------------------------------------------------
Can change permissions = Yes
Can change owner/group = Yes
Can execute arbitrary command = No
Can create symlink/hardlink = Yes/No
Can lookup user groups = No
Can duplicate remote files = No
Can check available space = No
Can calculate file checksum = No
Native text (ASCII) mode transfers = No
------------------------------------------------------------
Additional information
The server does not support any SFTP extension.
Here are the log ( using scripting interface configured session with ssh compression off):
. 2011-08-01 15:30:21.048 --------------------------------------------------------------------------
. 2011-08-01 15:30:21.050 WinSCP Version 4.3.4 (Build 1428) (OS 6.1.7600)
. 2011-08-01 15:30:21.065 Configuration: c:\NewVersionTEST\WinSCP.ini
. 2011-08-01 15:30:21.068 Login time: Monday, August 01, 2011 3:30:21 PM
. 2011-08-01 15:30:21.071 --------------------------------------------------------------------------
. 2011-08-01 15:30:21.072 Session name: dev_session (Stored session)
. 2011-08-01 15:30:21.075 Host name: ***.***.com (Port: 22)
. 2011-08-01 15:30:21.078 User name: **************** (Password: Yes, Key file: No)
. 2011-08-01 15:30:21.080 Tunnel: No
. 2011-08-01 15:30:21.088 Transfer Protocol: SFTP (SCP)
. 2011-08-01 15:30:21.091 Ping type: N, Ping interval: 30 sec; Timeout: 60 sec
. 2011-08-01 15:30:21.094 Proxy: none
. 2011-08-01 15:30:21.097 SSH protocol version: 2; Compression: No
. 2011-08-01 15:30:21.100 Bypass authentication: No
. 2011-08-01 15:30:21.103 Try agent: Yes; Agent forwarding: No; TIS/CryptoCard: No; KI: Yes; GSSAPI: No
. 2011-08-01 15:30:21.105 Ciphers: aes,blowfish,3des,WARN,arcfour,des; Ssh2DES: No
. 2011-08-01 15:30:21.108 SSH Bugs: -,-,-,-,-,-,-,-,-
. 2011-08-01 15:30:21.110 SFTP Bugs: -,-
. 2011-08-01 15:30:21.113 Return code variable: Autodetect; Lookup user groups: Yes
. 2011-08-01 15:30:21.117 Shell: default
. 2011-08-01 15:30:21.120 EOL: 0, UTF: 2
. 2011-08-01 15:30:21.123 Clear aliases: Yes, Unset nat.vars: Yes, Resolve symlinks: Yes
. 2011-08-01 15:30:21.127 LS: ls -la, Ign LS warn: Yes, Scp1 Comp: No
. 2011-08-01 15:30:21.131 Local directory: default, Remote directory: home, Update: No, Cache: Yes
. 2011-08-01 15:30:21.134 Cache directory changes: Yes, Permanent: Yes
. 2011-08-01 15:30:21.137 DST mode: 1
. 2011-08-01 15:30:21.139 --------------------------------------------------------------------------
. 2011-08-01 15:30:21.181 Looking up host "*******.com"
. 2011-08-01 15:30:21.210 Connecting to *.*.*.* port 22
. 2011-08-01 15:30:21.420 Server version: SSH-2.0-1.36_sshlib GlobalSCAPE
. 2011-08-01 15:30:21.460 We believe remote version ignores SSH-2 maximum packet size
. 2011-08-01 15:30:21.507 We believe remote version has SSH-2 ignore bug
. 2011-08-01 15:30:21.550 Using SSH protocol version 2
. 2011-08-01 15:30:21.579 We claim version: SSH-2.0-WinSCP_release_4.3.4
. 2011-08-01 15:30:21.709 Using Diffie-Hellman with standard group "group1"
. 2011-08-01 15:30:21.713 Doing Diffie-Hellman key exchange with hash SHA-1
. 2011-08-01 15:30:22.266 Host key fingerprint is:
. 2011-08-01 15:30:22.270 ssh-dss 2048 ************************************
. 2011-08-01 15:30:22.273 Initialised AES-256 CBC client->server encryption
. 2011-08-01 15:30:22.276 Initialised HMAC-SHA1 client->server MAC algorithm
. 2011-08-01 15:30:22.279 Initialised AES-256 CBC server->client encryption
. 2011-08-01 15:30:22.281 Initialised HMAC-SHA1 server->client MAC algorithm
! 2011-08-01 15:30:22.707 Using username "*******************".
. 2011-08-01 15:30:22.820 Prompt (7, SSH password, , &Password: )
. 2011-08-01 15:30:22.823 Using stored password.
. 2011-08-01 15:30:22.827 Sent password
. 2011-08-01 15:30:27.098 Access granted
. 2011-08-01 15:30:27.203 Opened channel for session
. 2011-08-01 15:30:27.708 Started a shell/command
. 2011-08-01 15:30:27.714 --------------------------------------------------------------------------
. 2011-08-01 15:30:27.720 Using SFTP protocol.
. 2011-08-01 15:30:27.934 Doing startup conversation with host.
> 2011-08-01 15:30:27.944 Type: SSH_FXP_INIT, Size: 5, Number: -1
< 2011-08-01 15:30:28.047 Type: SSH_FXP_VERSION, Size: 5, Number: -1
. 2011-08-01 15:30:28.057 SFTP version 3 negotiated.
. 2011-08-01 15:30:28.061 We believe the server has signed timestamps bug
. 2011-08-01 15:30:28.065 We will use UTF-8 strings for status messages only
. 2011-08-01 15:30:28.075 Getting current directory name.
. 2011-08-01 15:30:28.091 Getting real path for '.'
> 2011-08-01 15:30:28.111 Type: SSH_FXP_REALPATH, Size: 10, Number: 16
< 2011-08-01 15:30:28.250 Type: SSH_FXP_NAME, Size: 23, Number: 16
. 2011-08-01 15:30:28.254 Real path is '/'
. 2011-08-01 15:30:28.258 Listing directory "/".
> 2011-08-01 15:30:28.261 Type: SSH_FXP_OPENDIR, Size: 10, Number: 267
< 2011-08-01 15:30:28.380 Type: SSH_FXP_HANDLE, Size: 10, Number: 267
> 2011-08-01 15:30:28.385 Type: SSH_FXP_READDIR, Size: 10, Number: 524
< 2011-08-01 15:30:28.423 Type: SSH_FXP_NAME, Size: 264, Number: 524
> 2011-08-01 15:30:28.580 Type: SSH_FXP_READDIR, Size: 10, Number: 780
< 2011-08-01 15:30:28.715 Type: SSH_FXP_STATUS, Size: 22, Number: 780
< 2011-08-01 15:30:28.719 Status code: 1
> 2011-08-01 15:30:28.722 Type: SSH_FXP_CLOSE, Size: 10, Number: 1028
. 2011-08-01 15:30:28.725 Startup conversation with host finished.
. 2011-08-01 15:30:31.838 Changing directory to "test".
. 2011-08-01 15:30:31.840 Getting real path for '/test'
> 2011-08-01 15:30:31.843 Type: SSH_FXP_REALPATH, Size: 14, Number: 1296
< 2011-08-01 15:30:31.845 Type: SSH_FXP_STATUS, Size: 21, Number: 1028
. 2011-08-01 15:30:31.848 Discarding reserved response
< 2011-08-01 15:30:31.957 Type: SSH_FXP_NAME, Size: 31, Number: 1296
. 2011-08-01 15:30:31.961 Real path is '/test'
. 2011-08-01 15:30:31.963 Trying to open directory "/test".
> 2011-08-01 15:30:31.964 Type: SSH_FXP_LSTAT, Size: 14, Number: 1543
< 2011-08-01 15:30:32.072 Type: SSH_FXP_ATTRS, Size: 21, Number: 1543
. 2011-08-01 15:30:32.076 Getting current directory name.
. 2011-08-01 15:30:32.078 Listing directory "/test".
> 2011-08-01 15:30:32.080 Type: SSH_FXP_OPENDIR, Size: 14, Number: 1803
< 2011-08-01 15:30:32.495 Type: SSH_FXP_HANDLE, Size: 10, Number: 1803
> 2011-08-01 15:30:32.532 Type: SSH_FXP_READDIR, Size: 10, Number: 2060
< 2011-08-01 15:30:32.693 Type: SSH_FXP_NAME, Size: 12159, Number: 2060
> 2011-08-01 15:30:32.698 Type: SSH_FXP_READDIR, Size: 10, Number: 2316
< 2011-08-01 15:30:32.800 Type: SSH_FXP_STATUS, Size: 22, Number: 2316
< 2011-08-01 15:30:32.803 Status code: 1
> 2011-08-01 15:30:32.806 Type: SSH_FXP_CLOSE, Size: 10, Number: 2564
. 2011-08-01 15:30:33.815 Changing directory to "FileNrTest".
. 2011-08-01 15:30:33.817 Getting real path for '/test/FileNrTest'
> 2011-08-01 15:30:33.820 Type: SSH_FXP_REALPATH, Size: 25, Number: 2832
< 2011-08-01 15:30:33.822 Type: SSH_FXP_STATUS, Size: 21, Number: 2564
. 2011-08-01 15:30:33.825 Discarding reserved response
< 2011-08-01 15:30:33.934 Type: SSH_FXP_NAME, Size: 53, Number: 2832
. 2011-08-01 15:30:33.940 Real path is '/test/FileNrTest'
. 2011-08-01 15:30:33.943 Trying to open directory "/test/FileNrTest".
> 2011-08-01 15:30:33.945 Type: SSH_FXP_LSTAT, Size: 25, Number: 3079
< 2011-08-01 15:30:34.054 Type: SSH_FXP_ATTRS, Size: 21, Number: 3079
. 2011-08-01 15:30:34.069 Getting current directory name.
. 2011-08-01 15:30:34.077 Listing directory "/test/FileNrTest".
> 2011-08-01 15:30:34.081 Type: SSH_FXP_OPENDIR, Size: 25, Number: 3339
< 2011-08-01 15:30:38.150 Type: SSH_FXP_HANDLE, Size: 10, Number: 3339
> 2011-08-01 15:30:38.156 Type: SSH_FXP_READDIR, Size: 10, Number: 3596
. 2011-08-01 15:30:38.712 No valid incoming packet found
* 2011-08-01 15:30:38.725 (ESshFatal) No valid incoming packet found
* 2011-08-01 15:30:38.731 Error listing directory '/test/FileNrTest'.
* 2011-08-01 15:30:38.734 Error changing directory to 'FileNrTest'.
Thank you for your kind help.
Aside from that i'm very satisfied with winscp, especially scripting interface. It is very robust.
I use the latest version on Windows 2008 R2 RTM 64-bit.
There is no special characters in the filenames transferred. I used name convention as following during the tests: file0001.txt, file0002.txt, file000n.txt
I've tried with lower version of ssh protocols, but the situation is the same.
It is independent that i use gui or scripting interface.
Is there any limit for files in a folder?
Symptom:
I got the following popup window when changing into directory with more than 337 small files (no error occurs during the update):
---------------------------
Error
---------------------------
No valid incoming packet found
---------------------------
Error listing directory '/test/FileNrTest'.
Error changing directory to '/test/FileNrTest'.
---------------------------
OK Reconnect (1 s) Help
---------------------------
I can log in to that directory with another sftp clients or switching ON SSH protocol compression. I've tested directories up to 1024 files without problem with switched on ssh compression. Maybe there is no limit with compression?
(Sensitive information have been masked with ****** in the logs)
Here are the Server and protocol information:
Session protocol = SSH-2
SSH implementation = 1.36_sshlib GlobalSCAPE
Encryption algorithm = aes
Compression = No
File transfer protocol = SFTP-3
------------------------------------------------------------
Server host key fingerprint
ssh-dss 2048 ***********************************************
------------------------------------------------------------
Can change permissions = Yes
Can change owner/group = Yes
Can execute arbitrary command = No
Can create symlink/hardlink = Yes/No
Can lookup user groups = No
Can duplicate remote files = No
Can check available space = No
Can calculate file checksum = No
Native text (ASCII) mode transfers = No
------------------------------------------------------------
Additional information
The server does not support any SFTP extension.
Here are the log ( using scripting interface configured session with ssh compression off):
. 2011-08-01 15:30:21.048 --------------------------------------------------------------------------
. 2011-08-01 15:30:21.050 WinSCP Version 4.3.4 (Build 1428) (OS 6.1.7600)
. 2011-08-01 15:30:21.065 Configuration: c:\NewVersionTEST\WinSCP.ini
. 2011-08-01 15:30:21.068 Login time: Monday, August 01, 2011 3:30:21 PM
. 2011-08-01 15:30:21.071 --------------------------------------------------------------------------
. 2011-08-01 15:30:21.072 Session name: dev_session (Stored session)
. 2011-08-01 15:30:21.075 Host name: ***.***.com (Port: 22)
. 2011-08-01 15:30:21.078 User name: **************** (Password: Yes, Key file: No)
. 2011-08-01 15:30:21.080 Tunnel: No
. 2011-08-01 15:30:21.088 Transfer Protocol: SFTP (SCP)
. 2011-08-01 15:30:21.091 Ping type: N, Ping interval: 30 sec; Timeout: 60 sec
. 2011-08-01 15:30:21.094 Proxy: none
. 2011-08-01 15:30:21.097 SSH protocol version: 2; Compression: No
. 2011-08-01 15:30:21.100 Bypass authentication: No
. 2011-08-01 15:30:21.103 Try agent: Yes; Agent forwarding: No; TIS/CryptoCard: No; KI: Yes; GSSAPI: No
. 2011-08-01 15:30:21.105 Ciphers: aes,blowfish,3des,WARN,arcfour,des; Ssh2DES: No
. 2011-08-01 15:30:21.108 SSH Bugs: -,-,-,-,-,-,-,-,-
. 2011-08-01 15:30:21.110 SFTP Bugs: -,-
. 2011-08-01 15:30:21.113 Return code variable: Autodetect; Lookup user groups: Yes
. 2011-08-01 15:30:21.117 Shell: default
. 2011-08-01 15:30:21.120 EOL: 0, UTF: 2
. 2011-08-01 15:30:21.123 Clear aliases: Yes, Unset nat.vars: Yes, Resolve symlinks: Yes
. 2011-08-01 15:30:21.127 LS: ls -la, Ign LS warn: Yes, Scp1 Comp: No
. 2011-08-01 15:30:21.131 Local directory: default, Remote directory: home, Update: No, Cache: Yes
. 2011-08-01 15:30:21.134 Cache directory changes: Yes, Permanent: Yes
. 2011-08-01 15:30:21.137 DST mode: 1
. 2011-08-01 15:30:21.139 --------------------------------------------------------------------------
. 2011-08-01 15:30:21.181 Looking up host "*******.com"
. 2011-08-01 15:30:21.210 Connecting to *.*.*.* port 22
. 2011-08-01 15:30:21.420 Server version: SSH-2.0-1.36_sshlib GlobalSCAPE
. 2011-08-01 15:30:21.460 We believe remote version ignores SSH-2 maximum packet size
. 2011-08-01 15:30:21.507 We believe remote version has SSH-2 ignore bug
. 2011-08-01 15:30:21.550 Using SSH protocol version 2
. 2011-08-01 15:30:21.579 We claim version: SSH-2.0-WinSCP_release_4.3.4
. 2011-08-01 15:30:21.709 Using Diffie-Hellman with standard group "group1"
. 2011-08-01 15:30:21.713 Doing Diffie-Hellman key exchange with hash SHA-1
. 2011-08-01 15:30:22.266 Host key fingerprint is:
. 2011-08-01 15:30:22.270 ssh-dss 2048 ************************************
. 2011-08-01 15:30:22.273 Initialised AES-256 CBC client->server encryption
. 2011-08-01 15:30:22.276 Initialised HMAC-SHA1 client->server MAC algorithm
. 2011-08-01 15:30:22.279 Initialised AES-256 CBC server->client encryption
. 2011-08-01 15:30:22.281 Initialised HMAC-SHA1 server->client MAC algorithm
! 2011-08-01 15:30:22.707 Using username "*******************".
. 2011-08-01 15:30:22.820 Prompt (7, SSH password, , &Password: )
. 2011-08-01 15:30:22.823 Using stored password.
. 2011-08-01 15:30:22.827 Sent password
. 2011-08-01 15:30:27.098 Access granted
. 2011-08-01 15:30:27.203 Opened channel for session
. 2011-08-01 15:30:27.708 Started a shell/command
. 2011-08-01 15:30:27.714 --------------------------------------------------------------------------
. 2011-08-01 15:30:27.720 Using SFTP protocol.
. 2011-08-01 15:30:27.934 Doing startup conversation with host.
> 2011-08-01 15:30:27.944 Type: SSH_FXP_INIT, Size: 5, Number: -1
< 2011-08-01 15:30:28.047 Type: SSH_FXP_VERSION, Size: 5, Number: -1
. 2011-08-01 15:30:28.057 SFTP version 3 negotiated.
. 2011-08-01 15:30:28.061 We believe the server has signed timestamps bug
. 2011-08-01 15:30:28.065 We will use UTF-8 strings for status messages only
. 2011-08-01 15:30:28.075 Getting current directory name.
. 2011-08-01 15:30:28.091 Getting real path for '.'
> 2011-08-01 15:30:28.111 Type: SSH_FXP_REALPATH, Size: 10, Number: 16
< 2011-08-01 15:30:28.250 Type: SSH_FXP_NAME, Size: 23, Number: 16
. 2011-08-01 15:30:28.254 Real path is '/'
. 2011-08-01 15:30:28.258 Listing directory "/".
> 2011-08-01 15:30:28.261 Type: SSH_FXP_OPENDIR, Size: 10, Number: 267
< 2011-08-01 15:30:28.380 Type: SSH_FXP_HANDLE, Size: 10, Number: 267
> 2011-08-01 15:30:28.385 Type: SSH_FXP_READDIR, Size: 10, Number: 524
< 2011-08-01 15:30:28.423 Type: SSH_FXP_NAME, Size: 264, Number: 524
> 2011-08-01 15:30:28.580 Type: SSH_FXP_READDIR, Size: 10, Number: 780
< 2011-08-01 15:30:28.715 Type: SSH_FXP_STATUS, Size: 22, Number: 780
< 2011-08-01 15:30:28.719 Status code: 1
> 2011-08-01 15:30:28.722 Type: SSH_FXP_CLOSE, Size: 10, Number: 1028
. 2011-08-01 15:30:28.725 Startup conversation with host finished.
. 2011-08-01 15:30:31.838 Changing directory to "test".
. 2011-08-01 15:30:31.840 Getting real path for '/test'
> 2011-08-01 15:30:31.843 Type: SSH_FXP_REALPATH, Size: 14, Number: 1296
< 2011-08-01 15:30:31.845 Type: SSH_FXP_STATUS, Size: 21, Number: 1028
. 2011-08-01 15:30:31.848 Discarding reserved response
< 2011-08-01 15:30:31.957 Type: SSH_FXP_NAME, Size: 31, Number: 1296
. 2011-08-01 15:30:31.961 Real path is '/test'
. 2011-08-01 15:30:31.963 Trying to open directory "/test".
> 2011-08-01 15:30:31.964 Type: SSH_FXP_LSTAT, Size: 14, Number: 1543
< 2011-08-01 15:30:32.072 Type: SSH_FXP_ATTRS, Size: 21, Number: 1543
. 2011-08-01 15:30:32.076 Getting current directory name.
. 2011-08-01 15:30:32.078 Listing directory "/test".
> 2011-08-01 15:30:32.080 Type: SSH_FXP_OPENDIR, Size: 14, Number: 1803
< 2011-08-01 15:30:32.495 Type: SSH_FXP_HANDLE, Size: 10, Number: 1803
> 2011-08-01 15:30:32.532 Type: SSH_FXP_READDIR, Size: 10, Number: 2060
< 2011-08-01 15:30:32.693 Type: SSH_FXP_NAME, Size: 12159, Number: 2060
> 2011-08-01 15:30:32.698 Type: SSH_FXP_READDIR, Size: 10, Number: 2316
< 2011-08-01 15:30:32.800 Type: SSH_FXP_STATUS, Size: 22, Number: 2316
< 2011-08-01 15:30:32.803 Status code: 1
> 2011-08-01 15:30:32.806 Type: SSH_FXP_CLOSE, Size: 10, Number: 2564
. 2011-08-01 15:30:33.815 Changing directory to "FileNrTest".
. 2011-08-01 15:30:33.817 Getting real path for '/test/FileNrTest'
> 2011-08-01 15:30:33.820 Type: SSH_FXP_REALPATH, Size: 25, Number: 2832
< 2011-08-01 15:30:33.822 Type: SSH_FXP_STATUS, Size: 21, Number: 2564
. 2011-08-01 15:30:33.825 Discarding reserved response
< 2011-08-01 15:30:33.934 Type: SSH_FXP_NAME, Size: 53, Number: 2832
. 2011-08-01 15:30:33.940 Real path is '/test/FileNrTest'
. 2011-08-01 15:30:33.943 Trying to open directory "/test/FileNrTest".
> 2011-08-01 15:30:33.945 Type: SSH_FXP_LSTAT, Size: 25, Number: 3079
< 2011-08-01 15:30:34.054 Type: SSH_FXP_ATTRS, Size: 21, Number: 3079
. 2011-08-01 15:30:34.069 Getting current directory name.
. 2011-08-01 15:30:34.077 Listing directory "/test/FileNrTest".
> 2011-08-01 15:30:34.081 Type: SSH_FXP_OPENDIR, Size: 25, Number: 3339
< 2011-08-01 15:30:38.150 Type: SSH_FXP_HANDLE, Size: 10, Number: 3339
> 2011-08-01 15:30:38.156 Type: SSH_FXP_READDIR, Size: 10, Number: 3596
. 2011-08-01 15:30:38.712 No valid incoming packet found
* 2011-08-01 15:30:38.725 (ESshFatal) No valid incoming packet found
* 2011-08-01 15:30:38.731 Error listing directory '/test/FileNrTest'.
* 2011-08-01 15:30:38.734 Error changing directory to 'FileNrTest'.
Thank you for your kind help.
Aside from that i'm very satisfied with winscp, especially scripting interface. It is very robust.
