Topic "Synchronize failing at 99% on large file"

Author Message
GreenWaterboy
[View user's profile]

Joined: 2013-01-02
Posts: 1
Hello

I have a script that executes the synchronize command to sync up a folder. I have been tinkering with it over 2 weeks changing timeout values and stuff and the script consistently will download all the small files, but fails at 99% when downloading the Large file (67 GB). If I do not manually delete the incomplete large file it will skip it the next to the script runs.

Here is my script

Code:

// Configuration
 
// Session to connect to
var SESSION = "";
// Path to winscp.com
var WINSCP = "C:\\WinSCP\\winscp.com";
 
var filesys = WScript.CreateObject("Scripting.FileSystemObject");
var shell = WScript.CreateObject("WScript.Shell");
   
var logfilepath = filesys.GetSpecialFolder(2) + "\\" + filesys.GetTempName() + ".xml";
 
var exec;
 
// run winscp to sync folders
exec = shell.Exec("\"" + WINSCP + "\" /log=\"" + logfilepath + "\"");
exec.StdIn.Write(
    "option batch abort\n" +
    "open \"" + SESSION + "\"\n" +
    "synchronize local -delete c:\localfolder /hostfolder \n" +
    "exit\n");
 
// wait until the script finishes
while (!exec.StdOut.AtEndOfStream)
{
    WScript.Echo(exec.StdOut.ReadAll());
}
 
if (exec.ExitCode != 0)
{
    WScript.Echo("Error downloading " + filenameLatest);
    WScript.Quit(1);
}


This is the output I am getting on the transfer for that file
Code:

'/hostfolder'  Synchronizing...  Local 'C:localfolder' <= Remote '/hostfolder'  bigfile.bigfile |   64756707 KiB |   70.8 KiB/s | binary |  99%  Lost connection.  12-29-12  07:48PM


I have other scripts that pull larger files down using a modified version of this script https://winscp.net/eng/docs/script_download_most_recent_file

I would like to keep using synchronize though because the folders contents are constantly changing and writing a script to synchronize it would be a pain.

Here is the information for the Host and Client

Host
------
IIS7 FTP
Windows Server 2008 R2

Client
-------
Windows Server 2008 R2
WinSCP version 5.1.2 (Build 2816) portable
File protocol: FTP
Encryption: SSL/TLS Implicit encryption
Connection: passive mode
Timeouts: 200 seconds
Keep Alives: Executing Dummy... 31 second (originally was off, turning it on didnt change anything)[/list][/code]
Advertisements
martin
[View user's profile]
Site Admin
Joined: 2002-12-10
Posts: 24994
Location: Prague, Czechia
Please attach a full log file showing the problem (using the latest version of WinSCP).

To generate log file, use /log=path_to_log_file command-line argument. Submit the log with your post as an attachment. Note that passwords and passphrases not stored in the log. You may want to remove other data you consider sensitive though, such as host names, IP addresses, account names or file names (unless they are relevant to the problem). If you do not want to post the log publicly, you may email it to me. You will find my address (if you log in) in my forum profile. Please include link back to this topic in your email. Also note in this topic that you have emailed the log.
JSMTNY
[View user's profile]

Joined: 2013-02-03
Posts: 1
Location: USA
I am having the same issue with sync of large files upload failure when reaching 99% progress
Script Used:

option batch abort
option confirm off
open ftp://<Server>:<Pwd>@<IP>
option transfer binary
synchronize -filemask="*.bak" -criteria=none -speed=600 remote "c:\backup\" "/Backup/"
close
exit


when reaching 99% winscp loose the connection, then retry to connect and report 100%
This happens on large files > 100mb

The FTP server used is QNAP Turbo NAS.

I use the console command line winscp.com version 3.2.1.2735 (provided with winscp 5.1.1)

Thank you,
john
martin
[View user's profile]
Site Admin
Joined: 2002-12-10
Posts: 24994
Location: Prague, Czechia
The same response as above:
Please attach a full log file showing the problem (using the latest version of WinSCP).

To generate log file, use /log=path_to_log_file command-line argument. Submit the log with your post as an attachment. Note that passwords and passphrases not stored in the log. You may want to remove other data you consider sensitive though, such as host names, IP addresses, account names or file names (unless they are relevant to the problem). If you do not want to post the log publicly, you may email it to me. You will find my address (if you log in) in my forum profile. Please include link back to this topic in your email. Also note in this topic that you have emailed the log.
Advertisements

You can post new topics in this forum






Search Site

What is WinSCP?

It is award-winning SFTP client, SCP client, FTPS client and FTP client integrated into one software program for file transfer to FTP server or secure SFTP server. [More]

And it's free!

Donate

About donations

$9   $19   $49   $99

About donations

Recommend

WinSCP Privacy Policy

WinSCP License