Syncronize Command failing / Large Files

Hi,

I am using the following script to syncronize 2 locations:

option batch abort
option confirm off
open wolfe
option transfer binary
synchronize local -delete -speed=2048 D:\IRIS2DBBackup\DBBackup\backup\ //srv/nfs/backup
close
exit

The remote location consists of 5 files of between 60MB and 10MB, 2x 0KB files and 4x files of 20GB each.

A couple of weeks ago it just stopped copying the large files (the 20GB ones)- everything else copies successfully.

I initially thought it was being caused by slowness re-exchanging the SSH keys so I changed the Max minues and Max data settings to 0. That hasn't helped.

The end of the log files is below.

Any help / ideas greatly appreciated.

Thanks

. 2012-03-15 02:01:20.185 File: "//srv/nfs/backup/rman_bckup_db_IRISDB_777938597_15019_1"
. 2012-03-15 02:01:20.185 Copying "//srv/nfs/backup/rman_bckup_db_IRISDB_777938597_15019_1" to local directory started.
. 2012-03-15 02:01:20.185 Binary transfer mode selected.
. 2012-03-15 02:01:20.185 Checking existence of partially transfered file.
. 2012-03-15 02:01:20.185 Opening remote file.
> 2012-03-15 02:01:20.185 Type: SSH_FXP_OPEN, Size: 72, Number: 1327619
< 2012-03-15 02:01:20.185 Type: SSH_FXP_STATUS, Size: 24, Number: 1327364
. 2012-03-15 02:01:20.185 Discarding reserved response
< 2012-03-15 02:01:20.200 Type: SSH_FXP_HANDLE, Size: 13, Number: 1327619
> 2012-03-15 02:01:20.200 Type: SSH_FXP_FSTAT, Size: 13, Number: 1327880
> 2012-03-15 02:01:20.200 Type: SSH_FXP_READ, Size: 25, Number: 1328133
. 2012-03-15 02:01:20.200 3 skipped SSH_FXP_WRITE, SSH_FXP_READ, SSH_FXP_DATA and SSH_FXP_STATUS packets.
< 2012-03-15 02:01:20.200 Type: SSH_FXP_ATTRS, Size: 37, Number: 1327880
. 2012-03-15 02:01:20.200 Storing reserved response
. 2012-03-15 02:52:31.469 376712 skipped SSH_FXP_WRITE, SSH_FXP_READ, SSH_FXP_DATA and SSH_FXP_STATUS packets.
> 2012-03-15 02:52:31.469 Type: SSH_FXP_CLOSE, Size: 13, Number: 49547780
* 2012-03-15 02:52:31.469 (ECommand) Copying files from remote side failed.
* 2012-03-15 02:52:31.469 Timeout waiting for external console to complete the command.
< 2012-03-15 02:52:37.469 Script: 'D:\IRIS2DBBackup\DBBackup\backup\RECOVER_DB_UNTIL_SCN_5507606078' deleted
< 2012-03-15 02:52:37.766 Script: 'D:\IRIS2DBBackup\DBBackup\backup\rman_bckup_arc_IRISDB_777856754_15003_1' deleted
< 2012-03-15 02:52:37.985 Script: 'D:\IRIS2DBBackup\DBBackup\backup\rman_bckup_arc_IRISDB_777856754_15004_1' deleted
< 2012-03-15 02:52:38.204 Script: 'D:\IRIS2DBBackup\DBBackup\backup\rman_bckup_arc_IRISDB_777856754_15005_1' deleted
. 2012-03-15 02:52:38.204 Script: Failed
. 2012-03-15 02:52:38.204 Closing connection.
. 2012-03-15 02:52:38.204 Sending special code: 12
. 2012-03-15 02:52:38.204 Sent EOF message

Sorry - should have said that that I am using SFTP (although SCP fallback is ticked too).

. 2012-03-15 02:00:01.186 --------------------------------------------------------------------------
. 2012-03-15 02:00:01.186 Session name: wolfe (Stored session)
. 2012-03-15 02:00:01.186 Host name: wolfe.iris.bh.uk (Port: 22)
. 2012-03-15 02:00:01.186 User name: root (Password: Yes, Key file: No)
. 2012-03-15 02:00:01.186 Tunnel: No
. 2012-03-15 02:00:01.186 Transfer Protocol: SFTP (SCP)
. 2012-03-15 02:00:01.186 Ping type: -, Ping interval: 30 sec; Timeout: 15 sec
. 2012-03-15 02:00:01.186 Proxy: none
. 2012-03-15 02:00:01.186 SSH protocol version: 2; Compression: No
. 2012-03-15 02:00:01.186 Bypass authentication: No
. 2012-03-15 02:00:01.186 Try agent: Yes; Agent forwarding: No; TIS/CryptoCard: No; KI: Yes; GSSAPI: No
. 2012-03-15 02:00:01.186 Ciphers: aes,blowfish,3des,WARN,arcfour,des; Ssh2DES: No
. 2012-03-15 02:00:01.186 SSH Bugs: -,-,-,-,-,-,-,-,-
. 2012-03-15 02:00:01.186 SFTP Bugs: -,-
. 2012-03-15 02:00:01.186 Return code variable: Autodetect; Lookup user groups: Yes
. 2012-03-15 02:00:01.186 Shell: default
. 2012-03-15 02:00:01.186 EOL: 0, UTF: 2
. 2012-03-15 02:00:01.186 Clear aliases: Yes, Unset nat.vars: Yes, Resolve symlinks: Yes
. 2012-03-15 02:00:01.186 LS: ls -la, Ign LS warn: Yes, Scp1 Comp: No
. 2012-03-15 02:00:01.186 Local directory: default, Remote directory: home, Update: No, Cache: Yes
. 2012-03-15 02:00:01.186 Cache directory changes: Yes, Permanent: Yes
. 2012-03-15 02:00:01.186 DST mode: 1
. 2012-03-15 02:00:01.186 --------------------------------------------------------------------------
. 2012-03-15 02:00:01.202 Looking up host "wolfe.<removed>"
. 2012-03-15 02:00:01.264 Connecting to 10.<removed> port 22
. 2012-03-15 02:00:01.561 Server version: SSH-2.0-OpenSSH_4.3
. 2012-03-15 02:00:01.561 Using SSH protocol version 2
. 2012-03-15 02:00:01.561 We claim version: SSH-2.0-WinSCP_release_4.3.6
. 2012-03-15 02:00:01.577 Doing Diffie-Hellman group exchange
. 2012-03-15 02:00:01.733 Doing Diffie-Hellman key exchange with hash SHA-1
. 2012-03-15 02:00:02.108 Host key fingerprint is:
. 2012-03-15 02:00:02.108 ssh-rsa 2048 11:a0:53:fa:19:d6:97:a4:b8:68:2d:2d:cf:52:7c:49
. 2012-03-15 02:00:02.108 Initialised AES-256 SDCTR client->server encryption
. 2012-03-15 02:00:02.108 Initialised HMAC-SHA1 client->server MAC algorithm
. 2012-03-15 02:00:02.108 Initialised AES-256 SDCTR server->client encryption
. 2012-03-15 02:00:02.108 Initialised HMAC-SHA1 server->client MAC algorithm
! 2012-03-15 02:00:02.155 Using username "<removed>".
. 2012-03-15 02:00:02.170 Prompt (7, SSH password, , &Password: )
. 2012-03-15 02:00:02.170 Using stored password.
. 2012-03-15 02:00:02.170 Sent password
. 2012-03-15 02:00:02.202 Access granted
. 2012-03-15 02:00:02.249 Opened channel for session
. 2012-03-15 02:00:02.264 Started a shell/command
. 2012-03-15 02:00:02.264 --------------------------------------------------------------------------

This is with WinSCP 4.3.6 (Build 1655) on Windows Server 2008.

I'll contact you shortly via email.

Email sent.

martin wrote:

Email sent.

What is the fix for this? I have encounter the same problem.
winscp438.

Thanks,
Mav

Hi Can you let me know the fix too we are having the same problem

AS wrote:

Hi Can you let me know the fix too we are having the same problem

Email address enclosed asims@hotmail.com

asims@hotmail.com wrote:

AS wrote:

Hi Can you let me know the fix too we are having the same problem

Email address enclosed asims@hotmail.com

The error message is as follows

2013-05-21 15:52:33.014 15 skipped SSH_FXP_WRITE, SSH_FXP_READ, SSH_FXP_DATA and SSH_FXP_STATUS packets.

Thanks

AS wrote:

2013-05-21 15:52:33.014 15 skipped SSH_FXP_WRITE, SSH_FXP_READ, SSH_FXP_DATA and SSH_FXP_STATUS packets.

This is not an error message. Please attach a complete session log file and describe your problem.

prikryl,

Please let us know how this is resolved.

Samour wrote:

prikryl,

Please let us know how this is resolved.

. 2015-06-18 06:14:51.610 Using SFTP protocol.
. 2015-06-18 06:14:51.610 Doing startup conversation with host.
> 2015-06-18 06:14:51.610 Type: SSH_FXP_INIT, Size: 5, Number: -1
< 2015-06-18 06:14:51.688 Type: SSH_FXP_VERSION, Size: 33, Number: -1
. 2015-06-18 06:14:51.688 SFTP version 3 negotiated.
. 2015-06-18 06:14:51.688 Unknown server extension newline@vandyke.com="\n"
. 2015-06-18 06:14:51.688 We believe the server has signed timestamps bug
. 2015-06-18 06:14:51.688 We will use UTF-8 strings for status messages only
. 2015-06-18 06:14:51.688 Getting current directory name.
. 2015-06-18 06:14:51.688 Getting real path for '.'
> 2015-06-18 06:14:51.688 Type: SSH_FXP_REALPATH, Size: 10, Number: 16
< 2015-06-18 06:14:51.781 Type: SSH_FXP_NAME, Size: 43, Number: 16
. 2015-06-18 06:14:51.781 Real path is '/'
. 2015-06-18 06:14:51.781 Startup conversation with host finished.
. 2015-06-18 06:14:51.781 Listing directory "/Out".
> 2015-06-18 06:14:51.781 Type: SSH_FXP_OPENDIR, Size: 13, Number: 267
< 2015-06-18 06:14:51.875 Type: SSH_FXP_HANDLE, Size: 10, Number: 267
> 2015-06-18 06:14:51.875 Type: SSH_FXP_READDIR, Size: 10, Number: 524
< 2015-06-18 06:14:52.016 Type: SSH_FXP_NAME, Size: 3096, Number: 524
> 2015-06-18 06:14:52.016 Type: SSH_FXP_READDIR, Size: 10, Number: 780
< 2015-06-18 06:14:52.078 Type: SSH_FXP_STATUS, Size: 17, Number: 780
< 2015-06-18 06:14:52.078 Status code: 1
> 2015-06-18 06:14:52.078 Type: SSH_FXP_CLOSE, Size: 10, Number: 1028
. 2015-06-18 06:14:52.078 File: "/Out/extract_CES_SAE_v2_p0085529wjue_20150617111646.txt.pgp"
. 2015-06-18 06:14:52.078 Copying "/Out/extract_CES_SAE_v2_p0085529wjue_20150617111646.txt.pgp" to local directory started.
. 2015-06-18 06:14:52.078 Binary transfer mode selected.
. 2015-06-18 06:14:52.078 Confirming overwriting of file.
. 2015-06-18 06:14:52.078 Opening remote file.
> 2015-06-18 06:14:52.078 Type: SSH_FXP_OPEN, Size: 76, Number: 1283
< 2015-06-18 06:14:52.156 Type: SSH_FXP_STATUS, Size: 40, Number: 1028
. 2015-06-18 06:14:52.156 Discarding reserved response
< 2015-06-18 06:14:52.375 Type: SSH_FXP_HANDLE, Size: 10, Number: 1283
> 2015-06-18 06:14:52.375 Type: SSH_FXP_FSTAT, Size: 10, Number: 1544
> 2015-06-18 06:14:52.375 Type: SSH_FXP_READ, Size: 22, Number: 1797
< 2015-06-18 06:14:52.453 Type: SSH_FXP_ATTRS, Size: 29, Number: 1544
. 2015-06-18 06:14:52.453 Storing reserved response
< 2015-06-18 06:14:52.594 Status code: 1
. 2015-06-18 06:14:52.594 1 skipped SSH_FXP_WRITE, SSH_FXP_READ, SSH_FXP_DATA and SSH_FXP_STATUS packets.
> 2015-06-18 06:14:52.594 Type: SSH_FXP_CLOSE, Size: 10, Number: 2052
. 2015-06-18 06:14:52.594 Closing connection.
. 2015-06-18 06:14:52.594 Sending special code: 12
. 2015-06-18 06:14:52.594 Sent EOF message

Samour wrote:

Please let us know how this is resolved.

What problem are you having?

The connection succeeded but the file failed to move, actually it move as 0% and file size is 0.
thanks,

Samour wrote:

The connection succeeded but the file failed to move, actually it move as 0% and file size is 0.
thanks,

This is the output

Authenticating...
Using username "p0085529wjue".
Authenticating with pre-entered password.
Authenticated.
Starting the session...
Session started.
Active session: [1] p0085529wjue@st.concursolutions.com
batch continue
reconnecttime 120
confirm off
transfer binary
Using configured transfer settings different from factory defaults.
extract_CES_SAE_v2_p0085529wjue_20150618111855.txt.pgp | 0 B | 0.0 KB/s | binary | 0%

Finished at: 06/19/2015 03:30:05 with code 0

Please attach a full log file showing the problem (using the latest version of WinSCP).

martin wrote:

Please attach a full log file showing the problem (using the latest version of WinSCP).

To generate log file, use /log=path_to_log_file command-line argument. Submit the log with your post as an attachment. Note that passwords and passphrases not stored in the log. You may want to remove other data you consider sensitive though, such as host names, IP addresses, account names or file names (unless they are relevant to the problem). If you do not want to post the log publicly, you can mark the attachment as private.

Please find the attached,

This is not a log file. Please follow the instructions in my post.

martin wrote:

This is not a log file. Please follow the instructions in my post.

Please find the attached file.

The server does not return any data for the file:

> 2015-07-08 05:10:06.999 Type: SSH_FXP_READ, Size: 22, Number: 1797
< 2015-07-08 05:10:07.077 Status code: 1

So WinSCP behaves correctly. You have to contact the server administrator or SFTP server vendor for an assistance.

martin wrote:

The server does not return any data for the file:

> 2015-07-08 05:10:06.999 Type: SSH_FXP_READ, Size: 22, Number: 1797
< 2015-07-08 05:10:07.077 Status code: 1

So WinSCP behaves correctly. You have to contact the server administrator or SFTP server vendor for an assistance.

Thank you.