Topic "synchronization of new files only with filemask"

Author Message
Guy2

Guest


Hi,

Situation:
The remote location has following structure:
root\export_<date>\subfolders

Every hour thousands of files are added to the subfolders. The server keeps all files for about 8 days... resulting in over 500k files.

Now i have a synchronization job running to download these files (to process them lateron). Due to the high number of files, the synchronization process is too slow to be comfortable. So i've tried to change the filemask to filter as such that i get only files that are newer than 3 days

The filemask looks like this:
synchronize local -filemask="A*.gz>3D" D:\DROPZONE\

This doesnt seem to work. The synchronization process still reads all folders and files available on the server...

Am i doing something wrong?

Thanks,
Guy
Advertisements
martin
[View user's profile]
Site Admin
Joined: 2002-12-10
Posts: 24512
Location: Prague, Czechia
You are not doing anything wrong. The file mask would only prevent download of older files. I assume there are no not-synchronized files older than 3 days.

WinSCP still needs to list the directories to tell what the file time is.

Possibly you want to exclude some export_<date> folders completely.
_________________
Martin Prikryl
Guy2

Guest


prikryl wrote:
You are not doing anything wrong. The file mask would only prevent download of older files. I assume there are no not-synchronized files older than 3 days.

WinSCP still needs to list the directories to tell what the file time is.

Possibly you want to exclude some export_<date> folders completely.



Thanks Martin.
Excluding old folders would be ideal.. but how can i achieve this using normal script. the <date> is dynamic (every day a new date Smile)
martin
[View user's profile]
Site Admin
Joined: 2002-12-10
Posts: 24512
Location: Prague, Czechia
Did you try -filemask="export_*>3D"?
Advertisements

You can post new topics in this forum






Search Site

What is WinSCP?

It is award-winning SFTP client, SCP client, FTPS client and FTP client integrated into one software program for file transfer to FTP server or secure SFTP server. [More]

And it's free!

Donate

About donations

$9   $19   $49   $99

About donations

Recommend

WinSCP Privacy Policy

WinSCP License