Error transferring file to S3
I'm transferring a large number of files to S3 using the WinSCP GUI. Now and then I get the error "Error transferring files to S3". I simply click "Retry" and it goes on. Would it be possible to have WinSCP retry automatically. I have the default endurance settings on.
The error:
The header of the log file:
I have the full log file, but it is 25MB zipped from session start to session crash.
The error:
. 2021-07-21 08:42:40.482 HTTP session to https://mybucket.s3.amazonaws.com:443 begins. . 2021-07-21 08:42:40.482 ssl: SNI enabled by default. . 2021-07-21 08:42:40.483 Sending request headers: . 2021-07-21 08:42:40.483 PUT /asde-x-phase-1/2019/slc/Weather/slc20191126.mat HTTP/1.1 . 2021-07-21 08:42:40.483 User-Agent: WinSCP/5.19.1 neon/0.31.2 . 2021-07-21 08:42:40.483 Keep-Alive: . 2021-07-21 08:42:40.483 Connection: TE, Keep-Alive . 2021-07-21 08:42:40.483 TE: trailers . 2021-07-21 08:42:40.483 Host: mybucket.s3.amazonaws.com . 2021-07-21 08:42:40.483 Content-Length: 76207 . 2021-07-21 08:42:40.483 Authorization: xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx . 2021-07-21 08:42:40.483 x-amz-date: 20210721T124240Z . 2021-07-21 08:42:40.483 x-amz-content-sha256: UNSIGNED-PAYLOAD . 2021-07-21 08:42:40.483 Sending request-line and headers: . 2021-07-21 08:42:40.483 Doing DNS lookup on atsl-backup.s3.amazonaws.com... . 2021-07-21 08:42:40.483 req: Connecting to 52.217.104.252:443 . 2021-07-21 08:42:40.490 Doing SSL negotiation. . 2021-07-21 08:42:40.551 Identity match for 's3.amazonaws.com': good . 2021-07-21 08:42:40.551 Verifying certificate for "Amazon.com, Inc., Seattle, Washington, US" with fingerprint 62:d4:86:f0:92:a6:1b:63:9d:70:d8:17:89:bb:cd:9e:5d:49:ca:65:9c:2f:a5:82:16:d9:06:d4:e4:cf:4f:d2 and 08 failures . 2021-07-21 08:42:40.568 Certificate verified against Windows certificate store . 2021-07-21 08:42:40.568 Using TLSv1.2, cipher TLSv1.2: ECDHE-RSA-AES128-GCM-SHA256, 2048 bit RSA . 2021-07-21 08:42:40.568 Sending request body: . 2021-07-21 08:42:40.572 Request sent; retry is 0. . 2021-07-21 08:42:42.218 [status-line] < HTTP/1.1 500 Internal Server Error . 2021-07-21 08:42:42.218 Header Name: [x-amz-request-id], Value: [3F7JZ9KPXDFAY6YR] . 2021-07-21 08:42:42.218 Header Name: [x-amz-id-2], Value: [1oqnYDi2hWAHShn73h0em5u1ivSVvPWDNlSNwmNuDcOc9wiox8WTce8ha2VHfopOIcmMgK3tD7I=] . 2021-07-21 08:42:42.218 Header Name: [content-type], Value: [application/xml] . 2021-07-21 08:42:42.218 Header Name: [transfer-encoding], Value: [chunked] . 2021-07-21 08:42:42.218 Header Name: [date], Value: [Wed, 21 Jul 2021 12:42:42 GMT] . 2021-07-21 08:42:42.218 Header Name: [server], Value: [AmazonS3] . 2021-07-21 08:42:42.218 Header Name: [connection], Value: [close] . 2021-07-21 08:42:42.218 End of headers. . 2021-07-21 08:42:42.219 End of headers. . 2021-07-21 08:42:42.219 sess: Closing connection. . 2021-07-21 08:42:42.219 sess: Connection closed. . 2021-07-21 08:42:42.219 Request ends, status 500 class 5xx, error line: . 2021-07-21 08:42:42.219 500 Internal Server Error . 2021-07-21 08:42:42.219 We encountered an internal error. Please try again. . 2021-07-21 08:42:42.219 Extra Details: RequestId: 3F7JZ9KPXDFAY6YR, HostId: 1oqnYDi2hWAHShn73h0em5u1ivSVvPWDNlSNwmNuDcOc9wiox8WTce8ha2VHfopOIcmMgK3tD7I= < 2021-07-21 08:42:42.219 <?xml version="1.0" encoding="UTF-8"?> < 2021-07-21 08:42:42.219 <Error><Code>InternalError</Code><Message>We encountered an internal error. Please try again.</Message><RequestId>3F7JZ9KPXDFAY6YR</RequestId><HostId>1oqnYDi2hWAHShn73h0em5u1ivSVvPWDNlSNwmNuDcOc9wiox8WTce8ha2VHfopOIcmMgK3tD7I=</HostId></Error> . 2021-07-21 08:42:42.219 Request ends. . 2021-07-21 08:42:42.219 sess: Destroying session. * 2021-07-21 08:42:42.219 (ExtException) **We encountered an internal error. Please try again.** * 2021-07-21 08:42:42.219 Extra Details: RequestId: 3F7JZ9KPXDFAY6YR, HostId: 1oqnYDi2hWAHShn73h0em5u1ivSVvPWDNlSNwmNuDcOc9wiox8WTce8ha2VHfopOIcmMgK3tD7I= . 2021-07-21 08:42:42.222 Asking user: . 2021-07-21 08:42:42.222 Error transferring file 'E:\2019\slc\Weather\slc20191126.mat'. ("We encountered an internal error. Please try again.","Extra Details: RequestId: 3F7JZ9KPXDFAY6YR, HostId: 1oqnYDi2hWAHShn73h0em5u1ivSVvPWDNlSNwmNuDcOc9wiox8WTce8ha2VHfopOIcmMgK3tD7I=")
The header of the log file:
. 2021-07-21 05:43:19.530 -------------------------------------------------------------------------- . 2021-07-21 05:43:19.530 WinSCP Version 5.19.1 (Build 11552) (OS 10.0.14393 - Windows Server 2016 Standard) . 2021-07-21 05:43:19.530 Configuration: HKCU\Software\Martin Prikryl\WinSCP 2\ . 2021-07-21 05:43:19.531 Log level: Normal . 2021-07-21 05:43:19.531 Local account: HOSTID\username . 2021-07-21 05:43:19.531 Working directory: C:\Program Files (x86)\WinSCP . 2021-07-21 05:43:19.531 Process ID: 8824 . 2021-07-21 05:43:19.536 Ancestor processes: explorer, userinit . 2021-07-21 05:43:19.536 Command-line: "C:\Program Files (x86)\WinSCP\WinSCP.exe" . 2021-07-21 05:43:19.536 Time zone: Current: GMT-4, Standard: GMT-5 (Eastern Standard Time), DST: GMT-4 (Eastern Daylight Time), DST Start: 3/14/2021, DST End: 11/7/2021 . 2021-07-21 05:43:19.536 Login time: Wednesday, July 21, 2021 5:43:19 AM . 2021-07-21 05:43:19.536 -------------------------------------------------------------------------- . 2021-07-21 05:43:19.536 Session name: ATSL AWS S3 (Site) . 2021-07-21 05:43:19.536 Host name: s3.amazonaws.com (Port: 443) . 2021-07-21 05:43:19.536 User name: MYAWSID (Password: Yes, Key file: No, Passphrase: No) . 2021-07-21 05:43:19.536 Transfer Protocol: S3 . 2021-07-21 05:43:19.536 Proxy: None . 2021-07-21 05:43:19.536 HTTPS: Yes . 2021-07-21 05:43:19.536 S3: URL Style: Virtual Host . 2021-07-21 05:43:19.536 TLS/SSL versions: TLSv1.0-TLSv1.3 . 2021-07-21 05:43:19.536 Local directory: E:\, Remote directory: /mybucket/asde-x-phase-1, Update: Yes, Cache: Yes . 2021-07-21 05:43:19.536 Cache directory changes: Yes, Permanent: Yes . 2021-07-21 05:43:19.536 Recycle bin: Delete to: No, Overwritten to: No, Bin path: . 2021-07-21 05:43:19.536 --------------------------------------------------------------------------