Slow file transfer for many small files using FTP

Advertisement

tomb
Joined:
Posts:
19

Slow file transfer for many small files using FTP

WinSCP version 5.1.6

When transferring many small files the transfer speed is 4-5 files per second at most. Files size is about 250 bytes. When doing the same test with SFTP to the same host I get to 20-25 files /sec.

The SFTP speed is fine. Can the FTP transfer do it at the same speed?
Description: This is the output from the slow FTP session
Description: this is the FTP script that is used

Reply with quote

Advertisement

martin
Site Admin
martin avatar
Joined:
Posts:
27,226
Location:
Prague, Czechia

Re: Slow file transfer for many small files using FTP

I'd expect FTP to be slower as it has to open new TCP/IP connection for each file. Do you experience a better performance with other FTP clients than with WinSCP for small files?
_________________
Martin Prikryl

Reply with quote

tomb
Joined:
Posts:
19

OK, so I can understand why FTP is slower than SFTP.

I compared WinSCP with FileZilla using FTP with small files: Filezilla is about 2x faster than Winscp doing 8-9 files/sec.
Getting Winscp up to this speed would be nice, but the current speed is no show stopper :wink:

Reply with quote

martin
Site Admin
martin avatar
Joined:
Posts:
27,226
Location:
Prague, Czechia

Can you attach comparable logs both using WinSCP and FileZilla?

Reply with quote

tomb
Joined:
Posts:
19

I did the same load test with Filezilla instead of Winscp, tranferring 160 files of 276 bytes each. The speed is 17 sec for 160 files, about 9 files/sec. WinSCP did 4-5 files/sec.
I included the log file.
The WinSCP log file is in my post of 20 sep.

The Filezilla log file suggests that it is setting up two connections in parallel. Maybe that is a clue?

Reply with quote

martin
Site Admin
martin avatar
Joined:
Posts:
27,226
Location:
Prague, Czechia

tomb wrote:

Can I do that in scripts too? By using -rawsettings option?
No. But you can run multiple scripts in parallel.
_________________
Martin Prikryl

Reply with quote

Advertisement

You can post new topics in this forum