Forum » Support and Bug Reports »

Received incomplete data packet before end of file

Advertisement

selappi
Joined:
Posts:
3
Location:
North Carolina State University

Received incomplete data packet before end of file

I have tried to transfer files for two different High performance computing systems both use SFTP transfer protocols. The logs of both systems are attached below. The first system is located within the university network, but the second is located outside this universities network.

The problem as is indicated in the subject line occurs ONLY when transfering from the system OUTSIDE this universities network to my computer inside the network.

Any suggestions would be of great help.

FIRST COMPUTER (INSIDE THE UNIVERSITY NETWORK)
@sessionlog@
--------------------------------------------------------------------------
WinSCP Version 3.4.2 (Build 197)
Login time: Wednesday, January 14, 2004 2:21:42 PM
--------------------------------------------------------------------------
Session name: selappi@henry2.hpc.ncsu.edu
Host name: henry2.hpc.ncsu.edu (Port: 22)
User name: selappi (Password: No, Key file: No)
Transfer Protocol: SFTP
SSH protocol version: 2; Compression: No
Agent forwarding: No; TIS/CryptoCard: No; KI: Yes
Ciphers: aes,blowfish,3des,WARN,des; Ssh2DES: No
Ping interval: 0 sec (0 = off); Timeout: 15 sec
SSH Bugs: -,-,-,-,-,-,-,-,
Proxy: none
Return code variable: Autodetect; Lookup user groups: Yes
Shell: default, EOL: 0
Local directory: C:\Documents and Settings\Simon Lappi\My Documents\SIMON\Q-Chemistry, Remote directory: home, Update: No, Cache: Yes
Clear aliases: Yes, Unset nat.vars: Yes, Resolve symlinks: Yes
Alias LS: No, Ign LS warn: Yes, Scp1 Comp: No
--------------------------------------------------------------------------
Looking up host "henry2.hpc.ncsu.edu"
Connecting to 152.1.14.110 port 22
Server version: SSH-1.99-OpenSSH_3.1p1
We believe remote version has SSH2 RSA padding bug
We claim version: SSH-2.0-WinSCP-release-3.4.2.197
Using SSH protocol version 2
Doing Diffie-Hellman group exchange
Doing Diffie-Hellman key exchange
Host key fingerprint is:
ssh-rsa 1024 b2:9c:4f:ce:1a:c0:0e:fb:bd:81:d6:74:f4:09:34:4e
Initialised AES-256 client->server encryption
Initialised AES-256 server->client encryption
Using username "selappi".
Keyboard-interactive authentication refused
Session password prompt (selappi@henry2.hpc.ncsu.edu's password: )
Asking user for password.
Sent password
Access granted
Opened channel for session
Started a shell/command
--------------------------------------------------------------------------
Using SFTP protocol.
Doing startup conversation with host.
Type: SSH_FXP_INIT, Size: 5, Number: -1
Type: SSH_FXP_VERSION, Size: 5, Number: -1
SFTP version 3 negotiated.
Type: SSH_FXP_EXTENDED, Size: 38, Number: 6600
Type: SSH_FXP_STATUS, Size: 38, Number: 6600
Status/error code: 8
Server does not recognise WinSCP.
Getting current directory name.
Getting real path for '.'
Type: SSH_FXP_REALPATH, Size: 10, Number: 6672
Type: SSH_FXP_NAME, Size: 47, Number: 6672
Real path is '/home/selappi'
Listing directory "/home/selappi".
Type: SSH_FXP_OPENDIR, Size: 22, Number: 6923
Type: SSH_FXP_HANDLE, Size: 13, Number: 6923
Type: SSH_FXP_READDIR, Size: 13, Number: 7180
Type: SSH_FXP_NAME, Size: 2617, Number: 7180
Type: SSH_FXP_READDIR, Size: 13, Number: 7436
Type: SSH_FXP_STATUS, Size: 28, Number: 7436
Status/error code: 1
Type: SSH_FXP_CLOSE, Size: 13, Number: 7684
Type: SSH_FXP_STATUS, Size: 24, Number: 7684
Status/error code: 0
Startup conversation with host finished.
File: "/home/selappi/sofi3c_vib.input"
Copying "/home/selappi/sofi3c_vib.input" to local directory started.
Ascii transfer mode selected.
Checking existence of file.
Asking user:
File 'sofi3c_vib.input' already exists. Overwrite? ()
Opening remote file.
Type: SSH_FXP_OPEN, Size: 47, Number: 7939
Type: SSH_FXP_HANDLE, Size: 13, Number: 7939
Type: SSH_FXP_READ, Size: 25, Number: 8197
Status/error code: 1
7 skipped SSH_FXP_WRITE, SSH_FXP_READ, SSH_FXP_DATA and SSH_FXP_STATUS packets.
Type: SSH_FXP_CLOSE, Size: 13, Number: 9220
Type: SSH_FXP_STATUS, Size: 24, Number: 9220
Status/error code: 0
(EAbort) Operation aborted

SECOND COMPUTER (OUTSIDE THE UNIVERSITY NETWORK)

Looking up host "chastity.isis.unc.edu"
Connecting to 152.2.1.128 port 22
Server version: SSH-1.99-OpenSSH_3.6.1p2
We claim version: SSH-2.0-WinSCP-release-3.4.2.197
Using SSH protocol version 2
Doing Diffie-Hellman group exchange
Doing Diffie-Hellman key exchange
Host key fingerprint is:
ssh-rsa 1024 32:c4:a5:89:54:10:5a:c1:a8:62:e0:11:75:47:a9:ff
Initialised AES-256 client->server encryption
Initialised AES-256 server->client encryption
Initialised zlib (RFC1950) compression
Initialised zlib (RFC1950) decompression
Using username "selappi".
Keyboard-interactive authentication refused
Session password prompt (selappi@chastity.isis.unc.edu's password: )
Asking user for password.
Sent password
Access granted
Opened channel for session
Started a shell/command
--------------------------------------------------------------------------
Using SFTP protocol.
Doing startup conversation with host.
Type: SSH_FXP_INIT, Size: 5, Number: -1
Type: SSH_FXP_VERSION, Size: 5, Number: -1
SFTP version 3 negotiated.
Type: SSH_FXP_EXTENDED, Size: 38, Number: 9672
Type: SSH_FXP_STATUS, Size: 38, Number: 9672
Status/error code: 8
Server does not recognise WinSCP.
Changing directory to "/afs/isis.unc.edu/home/s/e/selappi".
Getting real path for '/afs/isis.unc.edu/home/s/e/selappi'
Type: SSH_FXP_REALPATH, Size: 43, Number: 9744
Type: SSH_FXP_NAME, Size: 89, Number: 9744
Real path is '/afs/isis.unc.edu/home/s/e/selappi'
Trying to open directory "/afs/isis.unc.edu/home/s/e/selappi".
Type: SSH_FXP_OPENDIR, Size: 43, Number: 9995
Type: SSH_FXP_HANDLE, Size: 13, Number: 9995
Type: SSH_FXP_CLOSE, Size: 13, Number: 10244
Type: SSH_FXP_STATUS, Size: 24, Number: 10244
Status/error code: 0
Getting current directory name.
Listing directory "/afs/isis.unc.edu/home/s/e/selappi".
Type: SSH_FXP_OPENDIR, Size: 43, Number: 10507
Type: SSH_FXP_HANDLE, Size: 13, Number: 10507
Type: SSH_FXP_READDIR, Size: 13, Number: 10764
Type: SSH_FXP_NAME, Size: 4101, Number: 10764
Type: SSH_FXP_READDIR, Size: 13, Number: 11020
Reading symlink ".kshrc".
Type: SSH_FXP_READLINK, Size: 50, Number: 11283
Type: SSH_FXP_STAT, Size: 50, Number: 11537
Type: SSH_FXP_STATUS, Size: 28, Number: 11020
Type: SSH_FXP_NAME, Size: 115, Number: 11283
Type: SSH_FXP_ATTRS, Size: 37, Number: 11537
Reading symlink ".profile".
Type: SSH_FXP_READLINK, Size: 52, Number: 11795
Type: SSH_FXP_STAT, Size: 52, Number: 12049
Type: SSH_FXP_NAME, Size: 119, Number: 11795
Type: SSH_FXP_ATTRS, Size: 37, Number: 12049
Reading symlink ".plan".
Type: SSH_FXP_READLINK, Size: 49, Number: 12307
Type: SSH_FXP_STAT, Size: 49, Number: 12561
Type: SSH_FXP_NAME, Size: 45, Number: 12307
Type: SSH_FXP_ATTRS, Size: 37, Number: 12561
Reading symlink ".project".
Type: SSH_FXP_READLINK, Size: 52, Number: 12819
Type: SSH_FXP_STAT, Size: 52, Number: 13073
Type: SSH_FXP_NAME, Size: 51, Number: 12819
Type: SSH_FXP_ATTRS, Size: 37, Number: 13073
Reading symlink ".cshrc".
Type: SSH_FXP_READLINK, Size: 50, Number: 13331
Type: SSH_FXP_STAT, Size: 50, Number: 13585
Type: SSH_FXP_NAME, Size: 115, Number: 13331
Type: SSH_FXP_ATTRS, Size: 37, Number: 13585
Reading symlink ".login".
Type: SSH_FXP_READLINK, Size: 50, Number: 13843
Type: SSH_FXP_STAT, Size: 50, Number: 14097
Type: SSH_FXP_NAME, Size: 115, Number: 13843
Type: SSH_FXP_ATTRS, Size: 37, Number: 14097
Status/error code: 1
Type: SSH_FXP_CLOSE, Size: 13, Number: 14340
Type: SSH_FXP_STATUS, Size: 24, Number: 14340
Status/error code: 0
Startup conversation with host finished.
File: "/afs/isis.unc.edu/home/s/e/selappi/dmanba2b.car"
Copying "/afs/isis.unc.edu/home/s/e/selappi/dmanba2b.car" to local directory started.
Ascii transfer mode selected.
Opening remote file.
Type: SSH_FXP_OPEN, Size: 64, Number: 14595
Type: SSH_FXP_HANDLE, Size: 13, Number: 14595
Type: SSH_FXP_READ, Size: 25, Number: 14853
Received incomplete data packet before end of file, offset: 2998, size: 2998, requested: 4096
5 skipped SSH_FXP_WRITE, SSH_FXP_READ, SSH_FXP_DATA and SSH_FXP_STATUS packets.
Type: SSH_FXP_CLOSE, Size: 13, Number: 15620
Type: SSH_FXP_STATUS, Size: 24, Number: 15620
Status/error code: 0
(ECommand) Copying files from remote side failed.
Received incomplete data packet before end of file.
(EAbort) Operation aborted

Reply with quote

Advertisement

martin◆
Site Admin
martin avatar
Joined:
Posts:
41,518
Location:
Prague, Czechia

Re: Received incomplete data packet before end of file

You server has read less bytes that WinSCP has requested. This is in fact permitted by the standards as I was told, but it is very unsual. Is it reqular *nix server or is it some special kind?

To the error: Does it happen with every file greater than 4kB?

You may try new version 3.5, there were some changes to the topic. But I do not believe it would help. If it does or if error message is different (even if there are different numbers in the same message), please post a log file.

Reply with quote

selappi
Joined:
Posts:
3
Location:
North Carolina State University

Martin:

Thank you the quick response. I have download and installed v3.5 and as you stated nothing obvious changed.

In response to your first question the server I am logging into it is an SGI Origin 3800.

In response to the second question, Yes, but it takes longer for the error to appear (on screen, no surprise there), see log below
@sessionlog@
--------------------------------------------------------------------------
WinSCP Version 3.5.0 (Build 204)
Login time: Friday, January 16, 2004 3:06:00 PM
--------------------------------------------------------------------------
Session name: selappi@chastity.isis.unc.edu
Host name: chastity.isis.unc.edu (Port: 22)
User name: selappi (Password: No, Key file: No)
Transfer Protocol: SFTP (SCP)
SSH protocol version: 2; Compression: Yes
Agent forwarding: No; TIS/CryptoCard: No; KI: Yes
Ciphers: aes,blowfish,3des,WARN,des; Ssh2DES: No
Ping type: -, Ping interval: 60 sec; Timeout: 15 sec
SSH Bugs: -,-,-,-,-,-,-,-,
Proxy: none
Return code variable: Autodetect; Lookup user groups: Yes
Shell: default, EOL: 0
Local directory: C:\Documents and Settings\Simon Lappi\My Documents\SIMON\Q-Chemistry\selium\C6, Remote directory: /afs/isis.unc.edu/home/s/e/selappi, Update: Yes, Cache: Yes
Cache directory changes: Yes, Permanent: Yes
Clear aliases: Yes, Unset nat.vars: Yes, Resolve symlinks: Yes
Alias LS: No, Ign LS warn: Yes, Scp1 Comp: No
--------------------------------------------------------------------------
Looking up host "chastity.isis.unc.edu"
Connecting to 152.2.1.128 port 22
Server version: SSH-1.99-OpenSSH_3.6.1p2
We claim version: SSH-2.0-WinSCP-release-3.5
Using SSH protocol version 2
Doing Diffie-Hellman group exchange
Doing Diffie-Hellman key exchange
Host key fingerprint is:
ssh-rsa 1024 32:c4:a5:89:54:10:5a:c1:a8:62:e0:11:75:47:a9:ff
Initialised AES-256 client->server encryption
Initialised AES-256 server->client encryption
Initialised zlib (RFC1950) compression
Initialised zlib (RFC1950) decompression
Using username "selappi".
Keyboard-interactive authentication refused
Session password prompt (selappi@chastity.isis.unc.edu's password: )
Asking user for password.
Sent password
Access granted
Opened channel for session
Started a shell/command
--------------------------------------------------------------------------
Using SFTP protocol.
Doing startup conversation with host.
Type: SSH_FXP_INIT, Size: 5, Number: -1
Type: SSH_FXP_VERSION, Size: 5, Number: -1
SFTP version 3 negotiated.
Type: SSH_FXP_EXTENDED, Size: 38, Number: 200
Type: SSH_FXP_STATUS, Size: 38, Number: 200
Status/error code: 8
Server does not recognise WinSCP.
Changing directory to "/afs/isis.unc.edu/home/s/e/selappi".
Getting real path for '/afs/isis.unc.edu/home/s/e/selappi'
Type: SSH_FXP_REALPATH, Size: 43, Number: 272
Type: SSH_FXP_NAME, Size: 89, Number: 272
Real path is '/afs/isis.unc.edu/home/s/e/selappi'
Trying to open directory "/afs/isis.unc.edu/home/s/e/selappi".
Type: SSH_FXP_OPENDIR, Size: 43, Number: 523
Type: SSH_FXP_HANDLE, Size: 13, Number: 523
Type: SSH_FXP_CLOSE, Size: 13, Number: 772
Type: SSH_FXP_STATUS, Size: 24, Number: 772
Status/error code: 0
Getting current directory name.
Listing directory "/afs/isis.unc.edu/home/s/e/selappi".
Type: SSH_FXP_OPENDIR, Size: 43, Number: 1035
Type: SSH_FXP_HANDLE, Size: 13, Number: 1035
Type: SSH_FXP_READDIR, Size: 13, Number: 1292
Type: SSH_FXP_NAME, Size: 4599, Number: 1292
Type: SSH_FXP_READDIR, Size: 13, Number: 1548
Reading symlink ".kshrc".
Type: SSH_FXP_READLINK, Size: 50, Number: 1811
Type: SSH_FXP_STAT, Size: 50, Number: 2065
Type: SSH_FXP_STATUS, Size: 28, Number: 1548
Type: SSH_FXP_NAME, Size: 115, Number: 1811
Type: SSH_FXP_ATTRS, Size: 37, Number: 2065
Reading symlink ".profile".
Type: SSH_FXP_READLINK, Size: 52, Number: 2323
Type: SSH_FXP_STAT, Size: 52, Number: 2577
Type: SSH_FXP_NAME, Size: 119, Number: 2323
Type: SSH_FXP_ATTRS, Size: 37, Number: 2577
Reading symlink ".plan".
Type: SSH_FXP_READLINK, Size: 49, Number: 2835
Type: SSH_FXP_STAT, Size: 49, Number: 3089
Type: SSH_FXP_NAME, Size: 45, Number: 2835
Type: SSH_FXP_ATTRS, Size: 37, Number: 3089
Reading symlink ".project".
Type: SSH_FXP_READLINK, Size: 52, Number: 3347
Type: SSH_FXP_STAT, Size: 52, Number: 3601
Type: SSH_FXP_NAME, Size: 51, Number: 3347
Type: SSH_FXP_ATTRS, Size: 37, Number: 3601
Reading symlink ".cshrc".
Type: SSH_FXP_READLINK, Size: 50, Number: 3859
Type: SSH_FXP_STAT, Size: 50, Number: 4113
Type: SSH_FXP_NAME, Size: 115, Number: 3859
Type: SSH_FXP_ATTRS, Size: 37, Number: 4113
Reading symlink ".login".
Type: SSH_FXP_READLINK, Size: 50, Number: 4371
Type: SSH_FXP_STAT, Size: 50, Number: 4625
Type: SSH_FXP_NAME, Size: 115, Number: 4371
Type: SSH_FXP_ATTRS, Size: 37, Number: 4625
Status/error code: 1
Type: SSH_FXP_CLOSE, Size: 13, Number: 4868
Type: SSH_FXP_STATUS, Size: 24, Number: 4868
Status/error code: 0
Startup conversation with host finished.
Copying 1 files/directories to remote directory "/afs/isis.unc.edu/home/s/e/selappi/"
PrTime: Yes; PrRO: Yes; Rght: rw-r--r--; PrR: No; FnCs: N; RIC: Yes; Resume: S (102400); CalcS: Yes; Mask: *.*
TM: A; AscM: *.*htm*; *.txt; *.php*; *.cgi; *.c; *.cpp; *.h; *.pas; *.bas; *.tex; *.pl; .htaccess; *.xtml; *.css; *.cfg; *.ini; *.sh; *.xml
File: "C:\Documents and Settings\Simon Lappi\My Documents\SIMON\Q-Chemistry\betaine\betaine_30e.out"
Copying "C:\Documents and Settings\Simon Lappi\My Documents\SIMON\Q-Chemistry\betaine\betaine_30e.out" to remote directory started.
Ascii transfer mode selected.
Opening remote file.
Type: SSH_FXP_OPEN, Size: 67, Number: 5123
Type: SSH_FXP_HANDLE, Size: 13, Number: 5123
Type: SSH_FXP_WRITE, Size: 4034, Number: 5382
1863 skipped SSH_FXP_WRITE, SSH_FXP_READ, SSH_FXP_DATA and SSH_FXP_STATUS packets.
Type: SSH_FXP_CLOSE, Size: 13, Number: 243972
Type: SSH_FXP_STATUS, Size: 24, Number: 243972
Status/error code: 0
Type: SSH_FXP_SETSTAT, Size: 71, Number: 244233
Type: SSH_FXP_STATUS, Size: 24, Number: 244233
Status/error code: 0
Listing directory "/afs/isis.unc.edu/home/s/e/selappi".
Type: SSH_FXP_OPENDIR, Size: 43, Number: 244491
Type: SSH_FXP_HANDLE, Size: 13, Number: 244491
Type: SSH_FXP_READDIR, Size: 13, Number: 244748
Type: SSH_FXP_NAME, Size: 4725, Number: 244748
Type: SSH_FXP_READDIR, Size: 13, Number: 245004
Reading symlink ".kshrc".
Type: SSH_FXP_READLINK, Size: 50, Number: 245267
Type: SSH_FXP_STAT, Size: 50, Number: 245521
Type: SSH_FXP_STATUS, Size: 28, Number: 245004
Type: SSH_FXP_NAME, Size: 115, Number: 245267
Type: SSH_FXP_ATTRS, Size: 37, Number: 245521
Reading symlink ".profile".
Type: SSH_FXP_READLINK, Size: 52, Number: 245779
Type: SSH_FXP_STAT, Size: 52, Number: 246033
Type: SSH_FXP_NAME, Size: 119, Number: 245779
Type: SSH_FXP_ATTRS, Size: 37, Number: 246033
Reading symlink ".plan".
Type: SSH_FXP_READLINK, Size: 49, Number: 246291
Type: SSH_FXP_STAT, Size: 49, Number: 246545
Type: SSH_FXP_NAME, Size: 45, Number: 246291
Type: SSH_FXP_ATTRS, Size: 37, Number: 246545
Reading symlink ".project".
Type: SSH_FXP_READLINK, Size: 52, Number: 246803
Type: SSH_FXP_STAT, Size: 52, Number: 247057
Type: SSH_FXP_NAME, Size: 51, Number: 246803
Type: SSH_FXP_ATTRS, Size: 37, Number: 247057
Reading symlink ".cshrc".
Type: SSH_FXP_READLINK, Size: 50, Number: 247315
Type: SSH_FXP_STAT, Size: 50, Number: 247569
Type: SSH_FXP_NAME, Size: 115, Number: 247315
Type: SSH_FXP_ATTRS, Size: 37, Number: 247569
Reading symlink ".login".
Type: SSH_FXP_READLINK, Size: 50, Number: 247827
Type: SSH_FXP_STAT, Size: 50, Number: 248081
Type: SSH_FXP_NAME, Size: 115, Number: 247827
Type: SSH_FXP_ATTRS, Size: 37, Number: 248081
Status/error code: 1
Type: SSH_FXP_CLOSE, Size: 13, Number: 248324
Type: SSH_FXP_STATUS, Size: 24, Number: 248324
Status/error code: 0
File: "/afs/isis.unc.edu/home/s/e/selappi/betaine_30e.out"
Copying "/afs/isis.unc.edu/home/s/e/selappi/betaine_30e.out" to local directory started.
Ascii transfer mode selected.
Checking existence of file.
Asking user:
File 'betaine_30e.out' already exists. Overwrite?

New: 3767425 bytes, 1/14/2000 1:26:54 PM
Existing: 3815595 bytes, 1/14/2000 1:26:54 PM ()
Opening remote file.
Type: SSH_FXP_OPEN, Size: 67, Number: 248579
Type: SSH_FXP_HANDLE, Size: 13, Number: 248579
Type: SSH_FXP_READ, Size: 25, Number: 248837
Received incomplete data packet before end of file, offset: 3767425, size: 3201, requested: 4096
1849 skipped SSH_FXP_WRITE, SSH_FXP_READ, SSH_FXP_DATA and SSH_FXP_STATUS packets.
Type: SSH_FXP_CLOSE, Size: 13, Number: 485636
Type: SSH_FXP_STATUS, Size: 24, Number: 485636
Status/error code: 0
(ECommand) Copying files from remote side failed.
Received incomplete data packet before end of file.
(EAbort) Operation aborted
Closing connection.

Reply with quote

martin◆
Site Admin
martin avatar
Joined:
Posts:
41,518
Location:
Prague, Czechia

selappi wrote:

In response to the second question, Yes, but it takes longer for the error to appear (on screen, no surprise there), see log below
Well this is suprise for me. I've understood it in the first case, when problem occured immediatelly. But I do not understand, why your server has read requested number of bytes for the 3.5 Mb of data and only then it decided to return less. Does the problem occur with every file? By change: is the file changing on the server while you download it?

Reply with quote

selappi
Joined:
Posts:
3
Location:
North Carolina State University

Sorry about the previous response being a little flippant concerning the delay, I was specifically referring the delay as being caused by the SIZE of the file and NOT by a programming change.

In response to the first question, YES! All files tested will cause the response (see log below) and as with the last tests there is a visible delay (meaning that after the copying file window pops up there is a small delay of maybe a couple of seconds, this appears to be related to the size of the file, the larger the file the longer the delay)

In response to the second question, NO or more correctly not to my knowledge or in anyway that I can tell, Change only referred to the upgrade not correcting the problem as you had hinted at in the first reply.

Question: I do not know the exact process by which the two computers are talking to each other, but is it possible that the "transfer buffer" on the remote computer is reporting that it's buffer is empty BEFORE the buffer on the my computer has received all of the data packet and therefore the software responds with the error of an incomplete transfer?
--------------------------------------------------------------------------
WinSCP Version 3.5.0 (Build 204)
Login time: Wednesday, January 21, 2004 2:30:11 PM
--------------------------------------------------------------------------
Session name: selappi@chastity.isis.unc.edu
Host name: chastity.isis.unc.edu (Port: 22)
User name: selappi (Password: No, Key file: No)
Transfer Protocol: SFTP (SCP)
SSH protocol version: 2; Compression: Yes
Agent forwarding: No; TIS/CryptoCard: No; KI: Yes
Ciphers: aes,blowfish,3des,WARN,des; Ssh2DES: No
Ping type: -, Ping interval: 60 sec; Timeout: 15 sec
SSH Bugs: -,-,-,-,-,-,-,-,
Proxy: none
Return code variable: Autodetect; Lookup user groups: Yes
Shell: default, EOL: 0
Local directory: C:\Documents and Settings\Simon Lappi\My Documents\SIMON\Q-Chemistry\betaine, Remote directory: /afs/isis.unc.edu/home/s/e/selappi, Update: Yes, Cache: Yes
Cache directory changes: Yes, Permanent: Yes
Clear aliases: Yes, Unset nat.vars: Yes, Resolve symlinks: Yes
Alias LS: No, Ign LS warn: Yes, Scp1 Comp: No
--------------------------------------------------------------------------
Looking up host "chastity.isis.unc.edu"
Connecting to 152.2.1.128 port 22
Server version: SSH-1.99-OpenSSH_3.6.1p2
We claim version: SSH-2.0-WinSCP-release-3.5
Using SSH protocol version 2
Doing Diffie-Hellman group exchange
Doing Diffie-Hellman key exchange
Host key fingerprint is:
ssh-rsa 1024 32:c4:a5:89:54:10:5a:c1:a8:62:e0:11:75:47:a9:ff
Initialised AES-256 client->server encryption
Initialised AES-256 server->client encryption
Initialised zlib (RFC1950) compression
Initialised zlib (RFC1950) decompression
Using username "selappi".
Keyboard-interactive authentication refused
Session password prompt (selappi@chastity.isis.unc.edu's password: )
Asking user for password.
Sent password
Access granted
Opened channel for session
Started a shell/command
--------------------------------------------------------------------------
Using SFTP protocol.
Doing startup conversation with host.
Type: SSH_FXP_INIT, Size: 5, Number: -1
Type: SSH_FXP_VERSION, Size: 5, Number: -1
SFTP version 3 negotiated.
Type: SSH_FXP_EXTENDED, Size: 38, Number: 200
Type: SSH_FXP_STATUS, Size: 38, Number: 200
Status/error code: 8
Server does not recognise WinSCP.
Cached directory change via "/afs/isis.unc.edu/home/s/e/selappi" to "/afs/isis.unc.edu/home/s/e/selappi".
Getting current directory name.
Listing directory "/afs/isis.unc.edu/home/s/e/selappi".
Type: SSH_FXP_OPENDIR, Size: 43, Number: 267
Type: SSH_FXP_HANDLE, Size: 13, Number: 267
Type: SSH_FXP_READDIR, Size: 13, Number: 524
Type: SSH_FXP_NAME, Size: 4725, Number: 524
Type: SSH_FXP_READDIR, Size: 13, Number: 780
Reading symlink ".kshrc".
Type: SSH_FXP_READLINK, Size: 50, Number: 1043
Type: SSH_FXP_STAT, Size: 50, Number: 1297
Type: SSH_FXP_STATUS, Size: 28, Number: 780
Type: SSH_FXP_NAME, Size: 115, Number: 1043
Type: SSH_FXP_ATTRS, Size: 37, Number: 1297
Reading symlink ".profile".
Type: SSH_FXP_READLINK, Size: 52, Number: 1555
Type: SSH_FXP_STAT, Size: 52, Number: 1809
Type: SSH_FXP_NAME, Size: 119, Number: 1555
Type: SSH_FXP_ATTRS, Size: 37, Number: 1809
Reading symlink ".plan".
Type: SSH_FXP_READLINK, Size: 49, Number: 2067
Type: SSH_FXP_STAT, Size: 49, Number: 2321
Type: SSH_FXP_NAME, Size: 45, Number: 2067
Type: SSH_FXP_ATTRS, Size: 37, Number: 2321
Reading symlink ".project".
Type: SSH_FXP_READLINK, Size: 52, Number: 2579
Type: SSH_FXP_STAT, Size: 52, Number: 2833
Type: SSH_FXP_NAME, Size: 51, Number: 2579
Type: SSH_FXP_ATTRS, Size: 37, Number: 2833
Reading symlink ".cshrc".
Type: SSH_FXP_READLINK, Size: 50, Number: 3091
Type: SSH_FXP_STAT, Size: 50, Number: 3345
Type: SSH_FXP_NAME, Size: 115, Number: 3091
Type: SSH_FXP_ATTRS, Size: 37, Number: 3345
Reading symlink ".login".
Type: SSH_FXP_READLINK, Size: 50, Number: 3603
Type: SSH_FXP_STAT, Size: 50, Number: 3857
Type: SSH_FXP_NAME, Size: 115, Number: 3603
Type: SSH_FXP_ATTRS, Size: 37, Number: 3857
Status/error code: 1
Type: SSH_FXP_CLOSE, Size: 13, Number: 4100
Type: SSH_FXP_STATUS, Size: 24, Number: 4100
Status/error code: 0
Startup conversation with host finished.
File: "/afs/isis.unc.edu/home/s/e/selappi/insight.log"
Copying "/afs/isis.unc.edu/home/s/e/selappi/insight.log" to local directory started.
Ascii transfer mode selected.
Opening remote file.
Type: SSH_FXP_OPEN, Size: 63, Number: 4355
Type: SSH_FXP_HANDLE, Size: 13, Number: 4355
Type: SSH_FXP_READ, Size: 25, Number: 4613
Received incomplete data packet before end of file, offset: 1020, size: 1020, requested: 4096
5 skipped SSH_FXP_WRITE, SSH_FXP_READ, SSH_FXP_DATA and SSH_FXP_STATUS packets.
Type: SSH_FXP_CLOSE, Size: 13, Number: 5380
Type: SSH_FXP_STATUS, Size: 24, Number: 5380
Status/error code: 0
(ECommand) Copying files from remote side failed.
Received incomplete data packet before end of file.
(EAbort) Operation aborted
File: "/afs/isis.unc.edu/home/s/e/selappi/insight_logon"
Copying "/afs/isis.unc.edu/home/s/e/selappi/insight_logon" to local directory started.
Ascii transfer mode selected.
Opening remote file.
Type: SSH_FXP_OPEN, Size: 65, Number: 5635
Type: SSH_FXP_HANDLE, Size: 13, Number: 5635
Type: SSH_FXP_READ, Size: 25, Number: 5893
Received incomplete data packet before end of file, offset: 46, size: 46, requested: 4096
5 skipped SSH_FXP_WRITE, SSH_FXP_READ, SSH_FXP_DATA and SSH_FXP_STATUS packets.
Type: SSH_FXP_CLOSE, Size: 13, Number: 6660
Type: SSH_FXP_STATUS, Size: 24, Number: 6660
Status/error code: 0
(ECommand) Copying files from remote side failed.
Received incomplete data packet before end of file.
(EAbort) Operation aborted
Changing directory to "documents".
Getting real path for '/afs/isis.unc.edu/home/s/e/selappi/documents'
Type: SSH_FXP_REALPATH, Size: 53, Number: 6928
Type: SSH_FXP_NAME, Size: 109, Number: 6928
Real path is '/afs/isis.unc.edu/home/s/e/selappi/documents'
Trying to open directory "/afs/isis.unc.edu/home/s/e/selappi/documents".
Type: SSH_FXP_OPENDIR, Size: 53, Number: 7179
Type: SSH_FXP_HANDLE, Size: 13, Number: 7179
Type: SSH_FXP_CLOSE, Size: 13, Number: 7428
Type: SSH_FXP_STATUS, Size: 24, Number: 7428
Status/error code: 0
Getting current directory name.
Listing directory "/afs/isis.unc.edu/home/s/e/selappi/documents".
Type: SSH_FXP_OPENDIR, Size: 53, Number: 7691
Type: SSH_FXP_HANDLE, Size: 13, Number: 7691
Type: SSH_FXP_READDIR, Size: 13, Number: 7948
Type: SSH_FXP_NAME, Size: 207, Number: 7948
Type: SSH_FXP_READDIR, Size: 13, Number: 8204
Type: SSH_FXP_STATUS, Size: 28, Number: 8204
Status/error code: 1
Type: SSH_FXP_CLOSE, Size: 13, Number: 8452
Type: SSH_FXP_STATUS, Size: 24, Number: 8452
Status/error code: 0
Cached directory change via ".." to "/afs/isis.unc.edu/home/s/e/selappi".
Getting current directory name.
Directory content loaded from cache.
File: "/afs/isis.unc.edu/home/s/e/selappi/dmanba2b.car"
Copying "/afs/isis.unc.edu/home/s/e/selappi/dmanba2b.car" to local directory started.
Ascii transfer mode selected.
Opening remote file.
Type: SSH_FXP_OPEN, Size: 64, Number: 8707
Type: SSH_FXP_HANDLE, Size: 13, Number: 8707
Type: SSH_FXP_READ, Size: 25, Number: 8965
Received incomplete data packet before end of file, offset: 2998, size: 2998, requested: 4096
5 skipped SSH_FXP_WRITE, SSH_FXP_READ, SSH_FXP_DATA and SSH_FXP_STATUS packets.
Type: SSH_FXP_CLOSE, Size: 13, Number: 9732
Type: SSH_FXP_STATUS, Size: 24, Number: 9732
Status/error code: 0
(ECommand) Copying files from remote side failed.
Received incomplete data packet before end of file.
(EAbort) Operation aborted
Closing connection.

Reply with quote

Advertisement

martin◆
Site Admin
martin avatar
Joined:
Posts:
41,518
Location:
Prague, Czechia

selappi wrote:

Sorry about the previous response being a little flippant concerning the delay, I was specifically referring the delay as being caused by the SIZE of the file and NOT by a programming change.
No problem, I've undestood it. I was refering to your previous log:
Received incomplete data packet before end of file, offset: 3767425, size: 3201, requested: 4096
From the offset I can see that more that 3mb was already transfered corretly. In all your other logs I see that even the first packet (few kilobytes) was smaller than requested. The second case I can understand, I just wonder what conditions caused the succesful transfer of 3mb in the first case. If I know it I may be able to make modification, so it works always.

In response to the first question, YES! All files tested will cause the response (see log below) and as with the last tests there is a visible delay (meaning that after the copying file window pops up there is a small delay of maybe a couple of seconds, this appears to be related to the size of the file, the larger the file the longer the delay)
But I suppose that in the case when 3mb were transfered, you must have seen copy progress dialog for some time before the error happened?

Question: I do not know the exact process by which the two computers are talking to each other, but is it possible that the "transfer buffer" on the remote computer is reporting that it's buffer is empty BEFORE the buffer on the my computer has received all of the data packet and therefore the software responds with the error of an incomplete transfer?
It is not so. The error happens on high level protocol (SFTP, not underlying SSH). SFTP packet starts with number indicating its length. So the packet smaller than requested is sent deliberately by your server. But not always (the 3mb case). As I have already said, it is not a bug of your server, it is just very unusual. I have never met this before, with exception of one special case of SSH server on embedded devbice with limited memory).

Anyway you can try older version of WinSCP prior to 3.4, which introduced "Significant acceleration of SFTP transfer performance." These older versions may work with your server. Or use the lastest version, but SCP protocol, if possible.

Reply with quote

Advertisement

You can post new topics in this forum

Documentation

Support

Associations

Follow Us