Slowness while accessing Amazon S3

Rexson12 Guest

Slowness while accessing Amazon S3

2024-01-18 11:08

Hello,

We are connecting to Amazon S3 browser using Amazon S3 protocol with access key and secret access key. When we are trying to get list of files in directory it takes huge amount of time to load that directory. File count for that directory is 112975 files which is around 33.27 Gb of data.
It took around 5 – 6 minutes to load that directory.

Could you please help us resolving this slowness so we can load the directory much quicker than 5–6 mins.

Thank you,
Rexson.

Reply with quote

martin◆ Site Admin
Joined:: 2002-12-10
Posts:: 41,518
Location:: Prague, Czechia

Re: Slowness while accessing Amazon S3

2024-01-22

And do you have a reason to assume it could be faster? Can you load the directory faster using any other client?

Please attach a full session log file showing the problem (using the latest version of WinSCP).

To generate the session log file, enable logging, log in to your server and do the operation and only the operation that causes the error. Submit the log with your post as an attachment. Note that passwords and passphrases not stored in the log. You may want to remove other data you consider sensitive though, such as host names, IP addresses, account names or file names (unless they are relevant to the problem). If you do not want to post the log publicly, you can mark the attachment as private.

Reply with quote

You can post new topics in this forum

Slowness while accessing Amazon S3

Slowness while accessing Amazon S3

Re: Slowness while accessing Amazon S3

Documentation

Support

Associations

Follow Us