Exclude certain file on Synchronize :: Support Forum

joeahn Guest

Exclude certain file on Synchronize

2012-01-04 16:56

Hi,

Is there a way to exclude certain file when using synchronize. If yes, could you give me a simple example code.

Thanks

Reply with quote

martin◆ Site Admin
Joined:: 2002-12-10
Posts:: 42,172
Location:: Prague, Czechia

Re: Exclude certain file on Synchronize

2012-01-05

synchronize -filemask=|<yourfilename> ...

https://winscp.net/eng/docs/scriptcommand_synchronize#filemask
https://winscp.net/eng/docs/file_mask#include_exclude

Reply with quote

3K Donor
Joined:: 2012-01-20
Posts:: 32
Location:: Geneva

Synchronize files from specified date stamp?

2012-01-20 11:18

Hi,

Is there a command to synchronize files starting from a specified date stamp? I would like to exclude files if their file's modified dates is before 1 Jan 2012.

Thanks.

Reply with quote

martin◆ Site Admin
Joined:: 2002-12-10
Posts:: 42,172
Location:: Prague, Czechia

Re: Synchronize files from specified date stamp?

2012-01-23

Thanks for your post.

This request is being tracked already:
Issue 672 – Allow selecting files with file mask using modification timestamp

Edit: This was implemented long time ago:
https://winscp.net/eng/docs/file_mask#size_time

Reply with quote

3K Donor

2012-01-25 16:25

In Tracker Bug 672, the status is Fixed in: 5.0.6. Does it mean version 5.0.6? Is it possible to download this version and know the command to exclude by time stamp? Currently, in the download page, we can see 5.0.5 but not 5.0.6.

Thanks.

Reply with quote

3K Donor

2012-02-17 12:04

Is it possible to request pre-release version (5.0.6) of WinSCP? I recently donated a small amount. Thanks. :)

Reply with quote

martin◆ Site Admin
Joined:: 2002-12-10
Posts:: 42,172
Location:: Prague, Czechia

2012-02-20

I have emailed you a link to development version of WinSCP.

Syntax file mask with timestamp is:

-filemask=<2012-02-01 00:00:00

Reply with quote

3K Donor
Joined:: 2012-01-20
Posts:: 32
Location:: Geneva

2012-02-20 14:34

Thanks a lot @Martin, got the development version. In my script below, if I wanted to synchronize documents posted >= 2012-01-01 00:00:00, where will I insert the command:

open ftp://username:password@ftpserver.itu.int
synchronize local C:\TEST\docs /docs
close

Thanks again.
Regards

Reply with quote

martin◆ Site Admin

2012-02-23

synchronize -filemask="<2012-02-01 00:00:00" local C:\TEST\docs /docs

Reply with quote

3K Donor

2012-02-23 10:10

Thanks @Martin, that command works well, excellent.

Reply with quote

3K Donor
Joined:: 2012-01-20
Posts:: 32
Location:: Geneva

2012-02-28 09:01

Hi Martin,

I was trying to synchronize with filemask and include Word documents (*.doc*) only using the commands below, but it seems, it doesn't work:

option include=*.doc*
synchronize -filemask="<2012-02-01 00:00:00" local C:\TEST\docs /docs

synchronize -filemask="<2012-02-01 00:00:00" local C:\TEST\docs /docs -include="*.doc*"

Could you kindly help me.
Thank you.

Reply with quote

martin◆ Site Admin
Joined:: 2002-12-10
Posts:: 42,172
Location:: Prague, Czechia

2012-03-01

The -filemask switch overrides include option (which is obsolete anyway with 5.0.6).
Also there's no -include switch.

The correct syntax is:

synchronize -filemask="*.doc*<2012-02-01 00:00:00" local C:\TEST\docs /docs

Reply with quote

3K Donor
Joined:: 2012-01-20
Posts:: 32
Location:: Geneva

2012-03-01 12:10

Thanks again, it works. That command filters Word doc with timestamp.

Another question, if I would like to include multiple filters, for example, Word (*.doc*) and Powerpoint (*.ppt*) files, what will be the command. I tried the command below, but it doesn't work.

synchronize -filemask="*.doc* *.ppt* <2012-02-01 00:00:00" local C:\TEST\docs /docs

Also, is it possible to have the new switch commands available for synchronize?

Many thanks for your excellent support.
Regards.

Reply with quote

martin◆ Site Admin
Joined:: 2002-12-10
Posts:: 42,172
Location:: Prague, Czechia

2012-03-01

synchronize -filemask="*.doc*<2012-02-01; *.ppt*<2012-02-01" local C:\TEST\docs /docs

Also, is it possible to have the new switch commands available for synchronize?

Do not understand.

Reply with quote

3K Donor
Joined:: 2012-01-20
Posts:: 32
Location:: Geneva

2012-03-01 13:51

Thank again :D , that command worked perfectly.

For my other question, is there a web page describing the new synchronize command, with examples? If there is none yet, it's ok.

Regards.

Reply with quote

martin◆ Site Admin
Joined:: 2002-12-10
Posts:: 42,172
Location:: Prague, Czechia

2012-03-05

3K wrote:

For my other question, is there a web page describing the new synchronize command, with examples? If there is none yet, it's ok.

The up-to-date documentation is on the same page all the time:
https://winscp.net/eng/docs/scriptcommand_synchronize

Reply with quote

Torsten Donor
Joined:: 2020-05-11
Posts:: 9
Location:: Copenhagen

OPTION EXCLUDE with strange results for hidden UNIX files

2020-05-11 12:11

I tried to use the exclude option to exclude a file .protftpd.fifo because the file can for some reason not be transferred. The file is located on a NAS with Linux, where I have shared a folder via SMB. My script is otherwise working fine.
I use this syntax:

option exclude .proftpd.fifo

But the result is different from my expectation:

...
include         |.proftpd.fifo
Comparing...
Local '\\backup\backup3\Old' => Remote '/Old'
Synchronizing...
Local '\\backup\backup3' => Remote '/'
\...\.proftpd.fifo        |            0 B |    0,0 KB/s | binary |   0%
...

(and then my script fails because of this file).
I have tried to "quote" the file name in quotation marks, no help.
What can I do to exclude the file?
Torsten

Reply with quote

martin◆ Site Admin
Joined:: 2002-12-10
Posts:: 42,172
Location:: Prague, Czechia

Re: OPTION EXCLUDE with strange results for hidden UNIX files

2020-05-12

@Torsten: Please attach a full session log file showing the problem (using the latest version of WinSCP).

To generate the session log file, use /log=C:\path\to\winscp.log command-line argument. Submit the log with your post as an attachment. Note that passwords and passphrases not stored in the log. You may want to remove other data you consider sensitive though, such as host names, IP addresses, account names or file names (unless they are relevant to the problem). If you do not want to post the log publicly, you can mark the attachment as private.

Reply with quote

Torsten Donor
Joined:: 2020-05-11
Posts:: 9
Location:: Copenhagen

Re: OPTION EXCLUDE with strange results for hidden UNIX files

2020-05-14 00:29

Hej Martin
Here we go.
First, as it looked on the command prompt. Note that it does not exclude the file .protftpd.fifo, the rest is secondary. Note further that the source folder \\backup\backup3\ is on an FTP server as well, but since WinSCP cannot copy directly from one FTP server to another, I had to share the folder on the source FTP server as an SMB share.

D:\Klinikdokumenter\Klinik - EDB\Klinik Backup\NAS Synchronization>"C:\Users\Administrator\AppData\Local\Programs\WinSCP\WinSCP.com"   /loglevel=2  /loglevel=2 /log=logfi
le.log /xmllog=logfile.xml  /script=glostrup-test2.txt
batch           on
reconnecttime   60
include         |.proftpd.fifo
Connecting to fjernskrivebord.tg150.dk:8021 ...
Connected
Starting the session...
Session started.
Active session: [1] **********@fjernskrivebord.tg150.dk
Comparing...
Local '\\backup\backup3' => Remote '/Test'
Synchronizing...
Local '\\backup\backup3' => Remote '/Test'
\...\.proftpd.fifo        |            0 B |    0,0 KB/s | binary |   0%
Lost connection.
Timeout detected. (control connection)
Could not retrieve file information
Can't get attributes of file '/Test/.proftpd.fifo'.
(A)bort, (R)econnect (0 s): Reconnect
Connecting to fjernskrivebord.tg150.dk:8021 ...
Connected
Starting the session...
Session started.
Lost connection.
Timeout detected. (control connection)
Could not retrieve file information
Can't get attributes of file '/Test/.proftpd.fifo'.
(A)bort, (R)econnect (4 s): Abort
Lost connection.
Timeout detected. (control connection)
Could not retrieve file information
Can't get attributes of file '/Test/.proftpd.fifo'.
Copying files to remote side failed.
Session 'backupuser@fjernskrivebord.tg150.dk' closed.
No session.
Exit code: 1
Max roundtrip: 5569
D:\Klinikdokumenter\Klinik - EDB\Klinik Backup\NAS Synchronization>

Second, the content of the script file here:

option batch on
option reconnecttime 60
option exclude .proftpd.fifo
open -passive=on  ftp://**********:***************@fjernskrivebord.tg150.dk:8021 
synchronize -delete  -criteria=either  -transfer=binary  -resumesupport=on  remote  "\\backup\backup3\"   "/Test/"  
exit

Third, I attach the log file as requested. The interesting line is this one:

. 2020-05-14 01:08:29.219 Local file '\\backup\backup3\.proftpd.fifo' [2020-05-11T16:57:20.000Z] [0] included to synchronization

Fourth, I would like to mention that I found a workaround. As I noticed that the mysterious file is located in the FTP root folder, I simply moved my entire lot into a subfolder so that the hidden file is no longer in the way.

Good luck.
/Torsten

logfile (xml).txt (767 Bytes)

Description: XML log file

logfile.log (15.08 KB)

Description: Log file with log level 2

Reply with quote

martin◆ Site Admin

Re: OPTION EXCLUDE with strange results for hidden UNIX files

2020-05-14

Thanks for all the details. Isn't the .proftpd.fifo actually a folder, not a file?

Reply with quote

Torsten Donor

Re: OPTION EXCLUDE with strange results for hidden UNIX files

2020-05-14 06:56

You are right, it is a folder.
Do you mean to say I should use another exclude filter then? Which one?
/T

Reply with quote

martin◆ Site Admin
Joined:: 2002-12-10
Posts:: 42,172
Location:: Prague, Czechia

Re: OPTION EXCLUDE with strange results for hidden UNIX files

2020-05-15

It should be

option exclude .proftpd.fifo/

See https://winscp.net/eng/docs/file_mask#directory

Though note that option exclude is deprecated for years. You should use -filemask switch instead:

synchronize -filemask=|.proftpd.fifo/ ...

https://winscp.net/eng/docs/scriptcommand_synchronize#filemask

Reply with quote

Guest

Re: OPTION EXCLUDE with strange results for hidden UNIX files

2020-05-15 10:59

Hej Martin,

it works like a charm.
So, given the following folder structure:

 Directory of \\backup\backup3
11-05-2020  18:53    <DIR>          .
11-05-2020  12:13    <DIR>          ..
11-05-2020  18:57    <DIR>          .proftpd.fifo
14-05-2020  20:35    <DIR>          Daily Backups
11-05-2020  12:18    <DIR>          Old Backups
11-05-2020  12:37    <DIR>          Test

I have two possibilities now:

synchronize  -filemask=|.proftpd.fifo/;"Old Backups/";"Test/"  remote  "\\backup\backup3\"   "/Daily Backups/"

vs.

synchronize  remote   "\\backup\backup3\Daily Backups\"   "/Daily Backups/"

Where the former uses the file mask to exclude the unwanted ones, and the latter uses the source folder to only include the wanted.

Thank you!
/Torsten

Reply with quote