Forum » Support and Bug Reports »

Sync keeps transferring same files

Advertisement

donwiss
Joined:
Posts:
7
Location:
Brooklyn, NY

Sync keeps transferring same files

I'm moving my sites to DreamHost. My current sync program scrambles the permissions when uploading to DreamHost. Hence I am looking at the sync here.

These are files that changed, so the first time there were transferred was expected. And they were transferred. But a repeat of sync should find nothing.

WinSCP-compare-that-repeats.gif

Reply with quote

Advertisement

donwiss
Joined:
Posts:
7
Location:
Brooklyn, NY

I noticed that new files transferred and did not reappear. So I deleted the 194 files on the host. They transferred. But on subsequent syncs they reappear. This implies something is strange in the PC files.

For another website there are 8.9 MB of files that keep want to transfer repeatedly. Making sync unusable.

WinSCP-compare-that-repeats-2.gif

Reply with quote

donwiss
Joined:
Posts:
7
Location:
Brooklyn, NY

I tried a third domain. 48 files repeatedly transferred. I noticed that they were all files newer to being transferred to the host. So I deleted all files on the host and manually transferred them. Now every text file on the site is repeatedly transferred.

The sync is in the default auto. My manual transfers were auto, though I tried sending over the text files as text, and it made no difference. The site works fine.

WinSCP-compare-that-repeats-3.gif

Reply with quote

martin◆
Site Admin
martin avatar
Joined:
Posts:
41,040
Location:
Prague, Czechia

Re: Sync keeps transferring same files

Start here: Synchronization or keep remote directory up to date functions are not working. Why?

If it does not help, please post session log files from two successive synchronization runs. Such that the second run re-transfers a file already synchronized in the first run. Give us a name of the file. Ideally, do such synchronization that only synchronizes that one file, and not (too many) others.

Reply with quote

Advertisement

donwiss
Joined:
Posts:
7
Location:
Brooklyn, NY

Thanks. I was looking in Options/Preferences.
The preview shows the timestamps the same.
I found a folder with only one problematic file, and logged two runs. But I didn't pick a small folder. So I edited out the other files. I hope I didn't edit out too much. The log: 
. 2024-01-18 17:16:58.808 Collecting synchronization list for local directory 'C:\Internet\WEBPAGES\518first.com\manuals\house' and remote directory '/home/dh_kpgjxc/518first.com/manuals/house', mode = Remote, params = 0x443 (Delete, NoConfirmation, *PreviewChanges, BySize), file mask = ''
. 2024-01-18 17:16:58.830 Local file 'C:\Internet\WEBPAGES\518first.com\manuals\house\.' [2024-01-17T16:58:54.115Z] [0] excluded from synchronization
. 2024-01-18 17:16:58.830 Local file 'C:\Internet\WEBPAGES\518first.com\manuals\house\..' [2024-01-17T16:58:54.115Z] [0] excluded from synchronization
 
. 2024-01-18 17:16:58.835 Local file 'C:\Internet\WEBPAGES\518first.com\manuals\house\index.htm' [2024-01-17T17:01:59.679Z] [60620] included to synchronization
 
. 2024-01-18 17:16:58.840 Listing directory "/home/dh_kpgjxc/518first.com/manuals/house".
> 2024-01-18 17:16:58.840 Type: SSH_FXP_OPENDIR, Size: 51, Number: 291737867
< 2024-01-18 17:16:58.840 Type: SSH_FXP_STATUS, Size: 24, Number: 291737604
. 2024-01-18 17:16:58.840 Discarding reserved response
< 2024-01-18 17:16:58.916 Type: SSH_FXP_HANDLE, Size: 13, Number: 291737867
> 2024-01-18 17:16:58.916 Type: SSH_FXP_READDIR, Size: 13, Number: 291738124
< 2024-01-18 17:16:59.006 Type: SSH_FXP_NAME, Size: 14057, Number: 291738124
> 2024-01-18 17:16:59.006 Type: SSH_FXP_READDIR, Size: 13, Number: 291738380
< 2024-01-18 17:16:59.086 Type: SSH_FXP_NAME, Size: 12632, Number: 291738380
> 2024-01-18 17:16:59.086 Type: SSH_FXP_READDIR, Size: 13, Number: 291738636
< 2024-01-18 17:16:59.166 Type: SSH_FXP_STATUS, Size: 28, Number: 291738636
< 2024-01-18 17:16:59.171 Status code: 1
> 2024-01-18 17:16:59.171 Type: SSH_FXP_CLOSE, Size: 13, Number: 291738884
. 2024-01-18 17:16:59.171 .;d;0;2024-01-18T22:04:31.000Z;4;"dh_kpgjxc" [6447247];"pg11291404" [2284185];rwxr-xr-x;0
. 2024-01-18 17:16:59.171 ..;d;0;2024-01-18T22:04:30.000Z;4;"dh_kpgjxc" [6447247];"pg11291404" [2284185];rwxr-xr-x;0
 
. 2024-01-18 17:16:59.178 index.htm;-;59462;2024-01-17T17:01:59.000Z;4;"dh_kpgjxc" [6447247];"pg11291404" [2284185];rw-r--r--;0
 
. 2024-01-18 17:16:59.181 Local file 'C:\Internet\WEBPAGES\518first.com\manuals\house\index.htm' [2024-01-17T17:01:59.679Z] [60620] is modified comparing to remote file '/home/dh_kpgjxc/518first.com/manuals/house/index.htm' [2024-01-17T17:01:59.000Z] [59462]
. 2024-01-18 17:16:59.181 Remote file '/home/dh_kpgjxc/518first.com/manuals/house/index.htm' [2024-01-17T17:01:59.000Z] [59462] is modified comparing to local file 'C:\Internet\WEBPAGES\518first.com\manuals\house\index.htm' [2024-01-17T17:01:59.679Z] [60620]
 
 
. 2024-01-18 17:17:01.756 Synchronizing local directory 'C:\Internet\WEBPAGES\518first.com\manuals\house\' with remote directory '/home/dh_kpgjxc/518first.com/manuals/house/', params = 0x443 (Delete, NoConfirmation, *PreviewChanges, BySize)
. 2024-01-18 17:17:01.768 Copying 1 files/directories to remote directory "/home/dh_kpgjxc/518first.com/manuals/house/" - total size: 60,620
. 2024-01-18 17:17:01.768   PrTime: Yes; PrRO: No; Rght: rw-r--r--; PrR: No (No); FnCs: N; RIC: 0100; Resume: S (102400); CalcS: No; Mask: *.*
. 2024-01-18 17:17:01.768   TM: M; ClAr: No; RemEOF: No; RemBOM: No; CPS: 0; NewerOnly: No; EncryptNewFiles: No; ExcludeHiddenFiles: No; ExcludeEmptyDirectories: No; InclM: ; ResumeL: 0
. 2024-01-18 17:17:01.768   AscM: *.*html; *shtml; *.htm; *.txt; *.php; *.php3; *.cgi; *.c; *.cpp; *.h; *.pas; *.bas; *.tex; *.pl; *.js; .htaccess; *.xtml; *.css; *.cfg; *.ini; *.sh; *.xml; *.htaccess
. 2024-01-18 17:17:01.772 File: 'C:\Internet\WEBPAGES\518first.com\manuals\house\index.htm' [2024-01-17T17:01:59.679Z] [60620]
. 2024-01-18 17:17:01.772 Copying "C:\Internet\WEBPAGES\518first.com\manuals\house\index.htm" to remote directory started.
. 2024-01-18 17:17:01.772 Ascii transfer mode selected.
. 2024-01-18 17:17:01.773 Opening remote file.
> 2024-01-18 17:17:01.773 Type: SSH_FXP_OPEN, Size: 77, Number: 291740163
< 2024-01-18 17:17:01.773 Type: SSH_FXP_STATUS, Size: 24, Number: 291739908
. 2024-01-18 17:17:01.773 Discarding reserved response
< 2024-01-18 17:17:01.845 Type: SSH_FXP_HANDLE, Size: 13, Number: 291740163
> 2024-01-18 17:17:01.845 Type: SSH_FXP_WRITE, Size: 32150, Number: 291740678
. 2024-01-18 17:17:01.850 Skipped 1 SSH_FXP_WRITE packets
> 2024-01-18 17:17:01.850 Type: SSH_FXP_CLOSE, Size: 13, Number: 291741188
> 2024-01-18 17:17:01.850 Type: SSH_FXP_SETSTAT, Size: 73, Number: 291740425
< 2024-01-18 17:17:01.943 Type: SSH_FXP_STATUS, Size: 24, Number: 291740678
< 2024-01-18 17:17:01.943 Status code: 0
. 2024-01-18 17:17:01.994 Skipped 1 SSH_FXP_STATUS packets
< 2024-01-18 17:17:01.994 Type: SSH_FXP_STATUS, Size: 24, Number: 291741188
< 2024-01-18 17:17:01.999 Status code: 0
. 2024-01-18 17:17:01.999 Preserving timestamp [2024-01-17T17:01:59.000Z]
< 2024-01-18 17:17:01.999 Type: SSH_FXP_STATUS, Size: 24, Number: 291740425
< 2024-01-18 17:17:01.999 Status code: 0
. 2024-01-18 17:17:01.999 Transfer done: 'C:\Internet\WEBPAGES\518first.com\manuals\house\index.htm' => '/home/dh_kpgjxc/518first.com/manuals/house/index.htm' [59462]
. 2024-01-18 17:17:01.999 Copying finished: Transferred: 59,462, Elapsed: 0:00:00, CPS: 244,699/s
. 2024-01-18 17:17:02.003 Listing directory "/home/dh_kpgjxc/518first.com/manuals/house".
> 2024-01-18 17:17:02.004 Type: SSH_FXP_OPENDIR, Size: 51, Number: 291741451
< 2024-01-18 17:17:02.087 Type: SSH_FXP_HANDLE, Size: 13, Number: 291741451
> 2024-01-18 17:17:02.087 Type: SSH_FXP_READDIR, Size: 13, Number: 291741708
< 2024-01-18 17:17:02.166 Type: SSH_FXP_NAME, Size: 14057, Number: 291741708
> 2024-01-18 17:17:02.166 Type: SSH_FXP_READDIR, Size: 13, Number: 291741964
< 2024-01-18 17:17:02.243 Type: SSH_FXP_NAME, Size: 12632, Number: 291741964
> 2024-01-18 17:17:02.248 Type: SSH_FXP_READDIR, Size: 13, Number: 291742220
< 2024-01-18 17:17:02.323 Type: SSH_FXP_STATUS, Size: 28, Number: 291742220
< 2024-01-18 17:17:02.323 Status code: 1
> 2024-01-18 17:17:02.323 Type: SSH_FXP_CLOSE, Size: 13, Number: 291742468
. 2024-01-18 17:17:02.323 ..;d;0;2024-01-18T22:04:30.000Z;4;"dh_kpgjxc" [6447247];"pg11291404" [2284185];rwxr-xr-x;0
 
. 2024-01-18 17:17:02.335 index.htm;-;59462;2024-01-17T17:01:59.000Z;4;"dh_kpgjxc" [6447247];"pg11291404" [2284185];rw-r--r--;0
. 2024-01-18 17:17:02.335 33-00429EFS.pdf;-;622428;2023-09-15T23:03:12.000Z;4;"dh_kpgjxc" [6447247];"pg11291404" [2284185];rw-r--r--;0
 
 
. 2024-01-18 17:17:13.491 Collecting synchronization list for local directory 'C:\Internet\WEBPAGES\518first.com\manuals\house' and remote directory '/home/dh_kpgjxc/518first.com/manuals/house', mode = Remote, params = 0x443 (Delete, NoConfirmation, *PreviewChanges, BySize), file mask = ''
. 2024-01-18 17:17:13.513 Local file 'C:\Internet\WEBPAGES\518first.com\manuals\house\.' [2024-01-17T16:58:54.115Z] [0] excluded from synchronization
. 2024-01-18 17:17:13.513 Local file 'C:\Internet\WEBPAGES\518first.com\manuals\house\..' [2024-01-17T16:58:54.115Z] [0] excluded from synchronization
 
. 2024-01-18 17:17:13.518 Local file 'C:\Internet\WEBPAGES\518first.com\manuals\house\index.htm' [2024-01-17T17:01:59.679Z] [60620] included to synchronization
 
. 2024-01-18 17:17:13.523 Listing directory "/home/dh_kpgjxc/518first.com/manuals/house".
> 2024-01-18 17:17:13.524 Type: SSH_FXP_OPENDIR, Size: 51, Number: 291742731
< 2024-01-18 17:17:13.524 Type: SSH_FXP_STATUS, Size: 24, Number: 291742468
. 2024-01-18 17:17:13.524 Discarding reserved response
< 2024-01-18 17:17:13.602 Type: SSH_FXP_HANDLE, Size: 13, Number: 291742731
> 2024-01-18 17:17:13.602 Type: SSH_FXP_READDIR, Size: 13, Number: 291742988
< 2024-01-18 17:17:13.686 Type: SSH_FXP_NAME, Size: 14057, Number: 291742988
> 2024-01-18 17:17:13.686 Type: SSH_FXP_READDIR, Size: 13, Number: 291743244
< 2024-01-18 17:17:13.765 Type: SSH_FXP_NAME, Size: 12632, Number: 291743244
> 2024-01-18 17:17:13.765 Type: SSH_FXP_READDIR, Size: 13, Number: 291743500
< 2024-01-18 17:17:13.843 Type: SSH_FXP_STATUS, Size: 28, Number: 291743500
< 2024-01-18 17:17:13.843 Status code: 1
> 2024-01-18 17:17:13.843 Type: SSH_FXP_CLOSE, Size: 13, Number: 291743748
. 2024-01-18 17:17:13.843 .;d;0;2024-01-18T22:04:31.000Z;4;"dh_kpgjxc" [6447247];"pg11291404" [2284185];rwxr-xr-x;0
. 2024-01-18 17:17:13.843 ..;d;0;2024-01-18T22:04:30.000Z;4;"dh_kpgjxc" [6447247];"pg11291404" [2284185];rwxr-xr-x;0
 
. 2024-01-18 17:17:13.853 33-00428.pdf;-;2288673;2023-09-06T15:13:06.000Z;4;"dh_kpgjxc" [6447247];"pg11291404" [2284185];rw-r--r--;0
. 2024-01-18 17:17:13.853 index.htm;-;59462;2024-01-17T17:01:59.000Z;4;"dh_kpgjxc" [6447247];"pg11291404" [2284185];rw-r--r--;0
. 2024-01-18 17:17:13.853 33-00429EFS.pdf;-;622428;2023-09-15T23:03:12.000Z;4;"dh_kpgjxc" [6447247];"pg11291404" [2284185];rw-r--r--;0
 
. 2024-01-18 17:17:13.861 Local file 'C:\Internet\WEBPAGES\518first.com\manuals\house\index.htm' [2024-01-17T17:01:59.679Z] [60620] is modified comparing to remote file '/home/dh_kpgjxc/518first.com/manuals/house/index.htm' [2024-01-17T17:01:59.000Z] [59462]
. 2024-01-18 17:17:13.861 Remote file '/home/dh_kpgjxc/518first.com/manuals/house/index.htm' [2024-01-17T17:01:59.000Z] [59462] is modified comparing to local file 'C:\Internet\WEBPAGES\518first.com\manuals\house\index.htm' [2024-01-17T17:01:59.679Z] [60620]
 
. 2024-01-18 17:17:16.216 Synchronizing local directory 'C:\Internet\WEBPAGES\518first.com\manuals\house\' with remote directory '/home/dh_kpgjxc/518first.com/manuals/house/', params = 0x443 (Delete, NoConfirmation, *PreviewChanges, BySize)
. 2024-01-18 17:17:16.225 Copying 1 files/directories to remote directory "/home/dh_kpgjxc/518first.com/manuals/house/" - total size: 60,620
. 2024-01-18 17:17:16.225   PrTime: Yes; PrRO: No; Rght: rw-r--r--; PrR: No (No); FnCs: N; RIC: 0100; Resume: S (102400); CalcS: No; Mask: *.*
. 2024-01-18 17:17:16.225   TM: M; ClAr: No; RemEOF: No; RemBOM: No; CPS: 0; NewerOnly: No; EncryptNewFiles: No; ExcludeHiddenFiles: No; ExcludeEmptyDirectories: No; InclM: ; ResumeL: 0
. 2024-01-18 17:17:16.225   AscM: *.*html; *shtml; *.htm; *.txt; *.php; *.php3; *.cgi; *.c; *.cpp; *.h; *.pas; *.bas; *.tex; *.pl; *.js; .htaccess; *.xtml; *.css; *.cfg; *.ini; *.sh; *.xml; *.htaccess
. 2024-01-18 17:17:16.227 File: 'C:\Internet\WEBPAGES\518first.com\manuals\house\index.htm' [2024-01-17T17:01:59.679Z] [60620]
. 2024-01-18 17:17:16.227 Copying "C:\Internet\WEBPAGES\518first.com\manuals\house\index.htm" to remote directory started.
. 2024-01-18 17:17:16.227 Ascii transfer mode selected.
. 2024-01-18 17:17:16.229 Opening remote file.
> 2024-01-18 17:17:16.229 Type: SSH_FXP_OPEN, Size: 77, Number: 291745027
< 2024-01-18 17:17:16.229 Type: SSH_FXP_STATUS, Size: 24, Number: 291744772
. 2024-01-18 17:17:16.229 Discarding reserved response
< 2024-01-18 17:17:16.304 Type: SSH_FXP_HANDLE, Size: 13, Number: 291745027
> 2024-01-18 17:17:16.304 Type: SSH_FXP_WRITE, Size: 32150, Number: 291745542
. 2024-01-18 17:17:16.309 Skipped 1 SSH_FXP_WRITE packets
> 2024-01-18 17:17:16.309 Type: SSH_FXP_CLOSE, Size: 13, Number: 291746052
> 2024-01-18 17:17:16.314 Type: SSH_FXP_SETSTAT, Size: 73, Number: 291745289
< 2024-01-18 17:17:16.421 Type: SSH_FXP_STATUS, Size: 24, Number: 291745542
< 2024-01-18 17:17:16.422 Status code: 0
. 2024-01-18 17:17:16.468 Skipped 1 SSH_FXP_STATUS packets
< 2024-01-18 17:17:16.468 Type: SSH_FXP_STATUS, Size: 24, Number: 291746052
< 2024-01-18 17:17:16.468 Status code: 0
. 2024-01-18 17:17:16.468 Preserving timestamp [2024-01-17T17:01:59.000Z]
< 2024-01-18 17:17:16.473 Type: SSH_FXP_STATUS, Size: 24, Number: 291745289
< 2024-01-18 17:17:16.473 Status code: 0
. 2024-01-18 17:17:16.473 Transfer done: 'C:\Internet\WEBPAGES\518first.com\manuals\house\index.htm' => '/home/dh_kpgjxc/518first.com/manuals/house/index.htm' [59462]
. 2024-01-18 17:17:16.473 Copying finished: Transferred: 59,462, Elapsed: 0:00:00, CPS: 231,369/s
. 2024-01-18 17:17:16.474 Listing directory "/home/dh_kpgjxc/518first.com/manuals/house".
> 2024-01-18 17:17:16.474 Type: SSH_FXP_OPENDIR, Size: 51, Number: 291746315
< 2024-01-18 17:17:16.562 Type: SSH_FXP_HANDLE, Size: 13, Number: 291746315
> 2024-01-18 17:17:16.563 Type: SSH_FXP_READDIR, Size: 13, Number: 291746572
< 2024-01-18 17:17:16.637 Type: SSH_FXP_NAME, Size: 14057, Number: 291746572
> 2024-01-18 17:17:16.641 Type: SSH_FXP_READDIR, Size: 13, Number: 291746828
< 2024-01-18 17:17:16.747 Type: SSH_FXP_NAME, Size: 12632, Number: 291746828
> 2024-01-18 17:17:16.747 Type: SSH_FXP_READDIR, Size: 13, Number: 291747084
< 2024-01-18 17:17:16.827 Type: SSH_FXP_STATUS, Size: 28, Number: 291747084
< 2024-01-18 17:17:16.827 Status code: 1
> 2024-01-18 17:17:16.827 Type: SSH_FXP_CLOSE, Size: 13, Number: 291747332
. 2024-01-18 17:17:16.827 ..;d;0;2024-01-18T22:04:30.000Z;4;"dh_kpgjxc" [6447247];"pg11291404" [2284185];rwxr-xr-x;0
 
. 2024-01-18 17:17:16.834 33-00428.pdf;-;2288673;2023-09-06T15:13:06.000Z;4;"dh_kpgjxc" [6447247];"pg11291404" [2284185];rw-r--r--;0
. 2024-01-18 17:17:16.839 index.htm;-;59462;2024-01-17T17:01:59.000Z;4;"dh_kpgjxc" [6447247];"pg11291404" [2284185];rw-r--r--;0
. 2024-01-18 17:17:16.839 33-00429EFS.pdf;-;622428;2023-09-15T23:03:12.000Z;4;"dh_kpgjxc" [6447247];"pg11291404" [2284185];rw-r--r--;0

Reply with quote

martin◆
Site Admin
martin avatar
Joined:
Posts:
41,040
Location:
Prague, Czechia

You have turned on Size synchronization criteria and also changed transfer mode to Automatic. That cannot work together. All your text files get transferred in Ascii/Text mode, what changes their size.
So either revert to Binary transfer mode or do not use Size synchronization criteria.
I have added this to the FAQ linked above.

Reply with quote

donwiss
Joined:
Posts:
7
Location:
Brooklyn, NY

Thanks, but "I" did not set to Automatic Mode. WinSCP defaults to Automatic, every time, even if "Use same options next time" is checked.
Size is important, as some lossless image cropping programs don't change the timestamp.
Changing to Binary works, but I have to change it every time.
SmartSync has been fixed. So I can return to using it for syncing. You can save profiles, which is convenient.

Reply with quote

Advertisement

donwiss

What I don't understand is with SmartSync I don't have to choose Binary, or Text, or Automatic, or whatever Default is. SmartSync just gets it right. WinSCP gets me in trouble when transferring .procmailrc files. Aren't all files starting with a period text?

Reply with quote

Advertisement

You can post new topics in this forum

Documentation

Support

Associations

Follow Us