More than 10,000 files in folder

Advertisement

dlceder
Joined:
Posts:
3
Location:
California, USA

More than 10,000 files in folder

I have more than 10,000 files in a single remote folder.
WinSCP version 5.11.1 (Build 7725) will only show 9,998
files, so I have no access to a couple of hundred files.
This issue has been present in previous versions as well
and I was hoping it would have been fixed with this latest
release.

Reply with quote E-mail

Advertisement

martin
Site Admin
martin avatar
Joined:
Posts:
40,476
Location:
Prague, Czechia

Re: More than 10,000 files in folder

What protocol? Can you access the other files with any other client using the same protocol?

Reply with quote

dlceder
Joined:
Posts:
3
Location:
California, USA

Re: More than 10,000 files in folder

martin wrote:

What protocol? Can you access the other files with any other client using the same protocol?

Sorry. Protocol FTP. I downloaded Filezilla and tried using that. It also shows only 9,998 files and only 356 KB total, but when I log into my cPanel I see all files and it says the folder is a total of 544 KB.
  • filezilla.jpg (292.5 KB, Private file)

Reply with quote E-mail

martin
Site Admin
martin avatar

Re: More than 10,000 files in folder

So then you should contact your web hosting provider, as this looks like a server-side bug.
Unless those two missing files are hidden files (their name start with a dot).

Reply with quote

dlceder

Re: More than 10,000 files in folder

There's a lot more than two files missing, and they are not hidden files. My husband says maybe our server only delivers so many bytes per request, and we have to configure it differently to serve more. I will inquire and/or we might decide to figure out a better solution by breaking up the folder into many subfolders with a smaller number of files in it. Thank you so much for your help and for your wonderful program.

Reply with quote E-mail

Advertisement

Guest

That's not a bug, but intentional server configuration.

The server deliberately limits directory listings to 10000 objects. Since the special . and .. directories are sent, too, you are left with 9998 usable objects.
Either the admin is aware of it as planned limitation (to cut bandwidth), or the admin is lazy (the limit is set by default in some server software).

Contacting server support is the correct way.

Reply with quote

jnjvette
Guest

More than 10,000 files in folder

I too had this issue. And yes, I was limited to 1,998 files in a folder on WinSCP as well as FileZilla. After reading this article, I did a little test. Lets say my directory name was "100" that had more than 1,998 (by the way, I know I had approximately 3,000 files in that folder from cPanel).
I created another directory and named in "100a". This was convenient so as I loaded my web site, all I had to do was add an "a" to the path for the file name. I then moved 100 photos out of directory "100" to directory "100a" Immediately, directory 100 started showing files I could not see previously.
In short, if you have reached the magical "1,998" files in a directory, you must create a new directory.

Reply with quote

Advertisement

You can post new topics in this forum