Synchronizing 400k records - best options?

tiesteaz
Joined:: 2016-06-12
Posts:: 2

Synchronizing 400k records - best options?

2016-06-12 21:01

Fellow WinSCP gurus, I need help.

I have pretty simple task - to synchronize local folder from remote SFTP folder, the only nuance here is that remote folder contains about 400000 files of total size about 30Gb, and this number will grow 5GB per month.

So far I wasn't successful - session is started from reading the contents of the external folder, it takes ~30 minutes. When it is done, session is just closed and I need to reconnect again.

Could you please advise - can WinSCP handle synchronization of such volume of files at all? What are the settings to make it working?

BR,
Andrey

Reply with quote

martin◆ Site Admin
Joined:: 2002-12-10
Posts:: 40,567
Location:: Prague, Czechia

Re: Synchronizing 400k records - best options?

2016-06-13

Please attach a full log file showing the problem (using the latest version of WinSCP).

To generate log file, use /log=path_to_log_file command-line argument. Submit the log with your post as an attachment. Note that passwords and passphrases not stored in the log. You may want to remove other data you consider sensitive though, such as host names, IP addresses, account names or file names (unless they are relevant to the problem). If you do not want to post the log publicly, you can mark the attachment as private.

Reply with quote

You can post new topics in this forum

Synchronizing 400k records - best options?

Synchronizing 400k records - best options?

Re: Synchronizing 400k records - best options?

Documentation

Support

Associations

Follow Us