Post a reply

Options
Add an Attachment

If you do not want to add an Attachment to your Post, please leave the Fields blank.

(maximum 10 MB; please compress large files; only common media, archive, text and programming file formats are allowed)

Options

Topic review

martin

Re: Script SCP to copy files from ESX 2.5 >4GB

ylafrance wrote:

but I'm able to copy files bigger than 35GB (vmdk files) in the GUI.

I think it is hardly possible. Can you post a SCP log file showing that (from GUI)?
ylafrance

Script SCP to copy files from ESX 2.5 >4GB

Hello, I would like some clarification. I've red about the SCP 4GB limitation but I'm able to copy files bigger than 35GB (vmdk files) in the GUI. When I script it only some of the files are copied??? It seems it's prompting me but I don't know for what. Some guidance would be appreciated. Thanks

scheduled command
C:\PROGRA~1\WinSCP\WinSCP.exe /console /script=WinSCP_Script_esx2.txt /log=c:\progra~1\WinSCP\esx2.log

Log
. 2009-07-27 01:30:00.527 ---------------------------------------------------------------. 2009-07-27 01:30:00.527 WinSCP Version 4.1.9 (Build 416) (OS 5.1.2600 Service Pack 2)
. 2009-07-27 01:30:00.527 Login time: July 27, 2009 1:30:00 AM
. 2009-07-27 01:30:00.527 ---------------------------------------------------------------
. 2009-07-27 01:30:00.527 Session name: root@192.x.x.x
. 2009-07-27 01:30:00.527 Host name: 192.x.x.x (Port: 22)
. 2009-07-27 01:30:00.527 User name: root (Password: Yes, Key file: No)
. 2009-07-27 01:30:00.527 Tunnel: No
. 2009-07-27 01:30:00.527 Transfer Protocol: SCP
. 2009-07-27 01:30:00.527 Ping type: -, Ping interval: 30 sec; Timeout: 15 sec
. 2009-07-27 01:30:00.527 Proxy: none
. 2009-07-27 01:30:00.527 SSH protocol version: 2; Compression: No
. 2009-07-27 01:30:00.527 Bypass authentication: No
. 2009-07-27 01:30:00.527 Try agent: Yes; Agent forwarding: No; TIS/CryptoCard: No; KI: Yes; GSSAPI: No
. 2009-07-27 01:30:00.527 Ciphers: aes,blowfish,3des,WARN,arcfour,des; Ssh2DES: No
. 2009-07-27 01:30:00.527 SSH Bugs: -,-,-,-,-,-,-,-
. 2009-07-27 01:30:00.527 SFTP Bugs: -,-
. 2009-07-27 01:30:00.527 Return code variable: Autodetect; Lookup user groups: Yes
. 2009-07-27 01:30:00.527 Shell: default, EOL: 0
. 2009-07-27 01:30:00.527 Clear aliases: Yes, Unset nat.vars: Yes, Resolve symlinks: Yes
. 2009-07-27 01:30:00.527 LS: ls -la, Ign LS warn: Yes, Scp1 Comp: No
. 2009-07-27 01:30:00.527 Local directory: default, Remote directory: home, Update: No, Cache: Yes
. 2009-07-27 01:30:00.527 Cache directory changes: Yes, Permanent: Yes
. 2009-07-27 01:30:00.527 DST mode: 1
. 2009-07-27 01:30:00.527
. 2009-07-27 01:30:00.527 Looking up host "192.x.x.x"
. 2009-07-27 01:30:00.527 Connecting to 192.x.x.x port 22
. 2009-07-27 01:30:00.527 Server version: SSH-2.0-OpenSSH_3.6.1p2
. 2009-07-27 01:30:00.527 We claim version: SSH-2.0-WinSCP_release_4.1.9
. 2009-07-27 01:30:00.527 SSPI: acquired credentials for: ylafrance@CIRB-CCRI.GC.CA
. 2009-07-27 01:30:00.527 Cannot convert IP address to SPN: DNS is not trusted
. 2009-07-27 01:30:00.527 GSSKEX disabled: The operation completed successfully.

. 2009-07-27 01:30:00.527 Using SSH protocol version 2
. 2009-07-27 01:30:00.527 Doing Diffie-Hellman group exchange
. 2009-07-27 01:30:00.574 Doing Diffie-Hellman key exchange with hash SHA-1
. 2009-07-27 01:30:00.934 Host key fingerprint is:
. 2009-07-27 01:30:00.934 ssh-rsa 1024 b5:9b:a5:27:47:8c:22:a3:75:f5:75:53:1d:67:35:50
. 2009-07-27 01:30:00.934 Initialised AES-256 CBC client->server encryption
. 2009-07-27 01:30:00.934 Initialised HMAC-SHA1 client->server MAC algorithm
. 2009-07-27 01:30:00.934 Initialised AES-256 CBC server->client encryption
. 2009-07-27 01:30:00.934 Initialised HMAC-SHA1 server->client MAC algorithm
! 2009-07-27 01:30:00.934 Using username "root".
. 2009-07-27 01:30:00.934 Keyboard-interactive authentication refused
. 2009-07-27 01:30:00.934 Prompt (6, SSH password, , &Password: )
. 2009-07-27 01:30:00.934 Using stored password.
. 2009-07-27 01:30:00.934 Sent password
. 2009-07-27 01:30:00.934 Access granted
. 2009-07-27 01:30:00.934 Opened channel for session
. 2009-07-27 01:30:00.934 Started a shell/command
. 2009-07-27 01:30:00.934 ---------------------------------------------------------------
. 2009-07-27 01:30:00.934 Using SCP protocol.
. 2009-07-27 01:30:00.934 Doing startup conversation with host.
. 2009-07-27 01:30:00.934 Skipping host startup message (if any).
> 2009-07-27 01:30:00.934 echo "WinSCP: this is end-of-file:0"
< 2009-07-27 01:30:00.965 WinSCP: this is end-of-file:0
. 2009-07-27 01:30:00.965 Detecting variable containing return code of last command.
. 2009-07-27 01:30:00.965 Trying "$status".
> 2009-07-27 01:30:00.965 echo "$status" ; echo "WinSCP: this is end-of-file:0"
< 2009-07-27 01:30:01.012 WinSCP: this is end-of-file:0
. 2009-07-27 01:30:01.012 Trying "$?".
> 2009-07-27 01:30:01.012 echo "$?" ; echo "WinSCP: this is end-of-file:0"
< 2009-07-27 01:30:01.059 0
< 2009-07-27 01:30:01.059 WinSCP: this is end-of-file:0
. 2009-07-27 01:30:01.059 Return code variable "$?" selected.
. 2009-07-27 01:30:01.059 Clearing all aliases.
> 2009-07-27 01:30:01.059 unalias "ls" ; echo "WinSCP: this is end-of-file:$?"
< 2009-07-27 01:30:01.090 WinSCP: this is end-of-file:0
> 2009-07-27 01:30:01.090 unalias "echo" ; echo "WinSCP: this is end-of-file:$?"
! 2009-07-27 01:30:01.137 -bash: unalias: `echo': not an alias
< 2009-07-27 01:30:01.137 WinSCP: this is end-of-file:1
> 2009-07-27 01:30:01.137 unalias "pwd" ; echo "WinSCP: this is end-of-file:$?"
! 2009-07-27 01:30:01.168 -bash: unalias: `pwd': not an alias
< 2009-07-27 01:30:01.168 WinSCP: this is end-of-file:1
> 2009-07-27 01:30:01.168 unalias "cd" ; echo "WinSCP: this is end-of-file:$?"
! 2009-07-27 01:30:01.215 -bash: unalias: `cd': not an alias
< 2009-07-27 01:30:01.215 WinSCP: this is end-of-file:1
> 2009-07-27 01:30:01.215 unalias "groups" ; echo "WinSCP: this is end-of-file:$?"
! 2009-07-27 01:30:01.246 -bash: unalias: `groups': not an alias
< 2009-07-27 01:30:01.246 WinSCP: this is end-of-file:1
> 2009-07-27 01:30:01.246 unalias "scp" ; echo "WinSCP: this is end-of-file:$?"
! 2009-07-27 01:30:01.293 -bash: unalias: `scp': not an alias
< 2009-07-27 01:30:01.293 WinSCP: this is end-of-file:1
> 2009-07-27 01:30:01.293 unalias "rm" ; echo "WinSCP: this is end-of-file:$?"
< 2009-07-27 01:30:01.324 WinSCP: this is end-of-file:0
> 2009-07-27 01:30:01.324 unalias "mv" ; echo "WinSCP: this is end-of-file:$?"
< 2009-07-27 01:30:01.371 WinSCP: this is end-of-file:0
> 2009-07-27 01:30:01.371 unalias "mkdir" ; echo "WinSCP: this is end-of-file:$?"
! 2009-07-27 01:30:01.418 -bash: unalias: `mkdir': not an alias
< 2009-07-27 01:30:01.418 WinSCP: this is end-of-file:1
> 2009-07-27 01:30:01.418 unalias "chmod" ; echo "WinSCP: this is end-of-file:$?"
! 2009-07-27 01:30:01.449 -bash: unalias: `chmod': not an alias
< 2009-07-27 01:30:01.449 WinSCP: this is end-of-file:1
> 2009-07-27 01:30:01.449 unalias "chgrp" ; echo "WinSCP: this is end-of-file:$?"
! 2009-07-27 01:30:01.496 -bash: unalias: `chgrp': not an alias
< 2009-07-27 01:30:01.496 WinSCP: this is end-of-file:1
> 2009-07-27 01:30:01.496 unalias "chown" ; echo "WinSCP: this is end-of-file:$?"
! 2009-07-27 01:30:01.527 -bash: unalias: `chown': not an alias
< 2009-07-27 01:30:01.527 WinSCP: this is end-of-file:1
> 2009-07-27 01:30:01.527 unalias "unset" ; echo "WinSCP: this is end-of-file:$?"
! 2009-07-27 01:30:01.574 -bash: unalias: `unset': not an alias
< 2009-07-27 01:30:01.574 WinSCP: this is end-of-file:1
> 2009-07-27 01:30:01.574 unalias "unalias" ; echo "WinSCP: this is end-of-file:$?"
! 2009-07-27 01:30:01.605 -bash: unalias: `unalias': not an alias
< 2009-07-27 01:30:01.605 WinSCP: this is end-of-file:1
> 2009-07-27 01:30:01.605 unalias "ln" ; echo "WinSCP: this is end-of-file:$?"
! 2009-07-27 01:30:01.652 -bash: unalias: `ln': not an alias
< 2009-07-27 01:30:01.652 WinSCP: this is end-of-file:1
> 2009-07-27 01:30:01.652 unalias "cp" ; echo "WinSCP: this is end-of-file:$?"
< 2009-07-27 01:30:01.699 WinSCP: this is end-of-file:0
. 2009-07-27 01:30:01.699 Clearing national user variables.
> 2009-07-27 01:30:01.699 unset "LANG" ; echo "WinSCP: this is end-of-file:$?"
< 2009-07-27 01:30:01.730 WinSCP: this is end-of-file:0
> 2009-07-27 01:30:01.730 unset "LANGUAGE" ; echo "WinSCP: this is end-of-file:$?"
< 2009-07-27 01:30:01.777 WinSCP: this is end-of-file:1
> 2009-07-27 01:30:01.777 unset "LC_CTYPE" ; echo "WinSCP: this is end-of-file:$?"
< 2009-07-27 01:30:01.809 WinSCP: this is end-of-file:1
> 2009-07-27 01:30:01.809 unset "LC_COLLATE" ; echo "WinSCP: this is end-of-file:$?"
< 2009-07-27 01:30:01.855 WinSCP: this is end-of-file:1
> 2009-07-27 01:30:01.855 unset "LC_MONETARY" ; echo "WinSCP: this is end-of-file:$?"
< 2009-07-27 01:30:01.887 WinSCP: this is end-of-file:1
> 2009-07-27 01:30:01.887 unset "LC_NUMERIC" ; echo "WinSCP: this is end-of-file:$?"
< 2009-07-27 01:30:01.934 WinSCP: this is end-of-file:1
> 2009-07-27 01:30:01.934 unset "LC_TIME" ; echo "WinSCP: this is end-of-file:$?"
< 2009-07-27 01:30:01.965 WinSCP: this is end-of-file:1
> 2009-07-27 01:30:01.965 unset "LC_MESSAGES" ; echo "WinSCP: this is end-of-file:$?"
< 2009-07-27 01:30:02.012 WinSCP: this is end-of-file:1
> 2009-07-27 01:30:02.012 unset "LC_ALL" ; echo "WinSCP: this is end-of-file:$?"
< 2009-07-27 01:30:02.059 WinSCP: this is end-of-file:1
> 2009-07-27 01:30:02.059 unset "HUMAN_BLOCKS" ; echo "WinSCP: this is end-of-file:$?"
< 2009-07-27 01:30:02.090 WinSCP: this is end-of-file:1
. 2009-07-27 01:30:02.090 Looking up groups and users.
> 2009-07-27 01:30:02.090 groups ; echo "WinSCP: this is end-of-file:$?"
< 2009-07-27 01:30:02.137 root bin daemon sys adm disk wheel
< 2009-07-27 01:30:02.277 WinSCP: this is end-of-file:0
. 2009-07-27 01:30:02.277 Following groups found:
. 2009-07-27 01:30:02.277 root
. 2009-07-27 01:30:02.277 bin
. 2009-07-27 01:30:02.277 daemon
. 2009-07-27 01:30:02.277 sys
. 2009-07-27 01:30:02.277 adm
. 2009-07-27 01:30:02.277 disk
. 2009-07-27 01:30:02.277 wheel
. 2009-07-27 01:30:02.277 No users found.
. 2009-07-27 01:30:02.277 Getting current directory name.
> 2009-07-27 01:30:02.277 pwd ; echo "WinSCP: this is end-of-file:$?"
< 2009-07-27 01:30:02.324 /root
< 2009-07-27 01:30:02.324 WinSCP: this is end-of-file:0
. 2009-07-27 01:30:02.324 Startup conversation with host finished.
. 2009-07-27 01:30:02.324 Cached directory change via "/vmfs/vmhba1:0:1:2" to "/vmfs/vmhba1:0:1:2".
. 2009-07-27 01:30:02.324 Getting current directory name.
. 2009-07-27 01:30:02.324 Listing file "cirb-intranet.vmdk".
. 2009-07-27 01:30:02.324 Locating to cached directory "/vmfs/vmhba1:0:1:2".
> 2009-07-27 01:30:02.324 cd "/vmfs/vmhba1:0:1:2" ; echo "WinSCP: this is end-of-file:$?"
< 2009-07-27 01:30:02.371 WinSCP: this is end-of-file:0
> 2009-07-27 01:30:02.371 ls -la -d "cirb-intranet.vmdk" ; echo "WinSCP: this is end-of-file:$?"
< 2009-07-27 01:30:02.402 -rw------- 1 root root 41943040512 Jul 27 01:11 cirb-intranet.vmdk
< 2009-07-27 01:30:02.590 WinSCP: this is end-of-file:0
. 2009-07-27 01:30:02.590 Listing file "cirb-rdcms-dev.vmdk".
> 2009-07-27 01:30:02.590 ls -la -d "cirb-rdcms-dev.vmdk" ; echo "WinSCP: this is end-of-file:$?"
< 2009-07-27 01:30:02.621 -rw------- 1 root root 73400320512 Jul 27 01:11 cirb-rdcms-dev.vmdk
< 2009-07-27 01:30:02.793 WinSCP: this is end-of-file:0
. 2009-07-27 01:30:02.809 Copying 2 files/directories to local directory "E:\VMDK\cirb-esx2\"
. 2009-07-27 01:30:02.809 PrTime: Yes; PrRO: No; Rght: rw-r--r--; PrR: No (No); FnCs: N; RIC: 01; Resume: S (102400); CalcS: No; Mask:
. 2009-07-27 01:30:02.809 TM: B; ClAr: No; CPS: 0; ExclM(No):
. 2009-07-27 01:30:02.809 AscM: *.*html; *.htm; *.txt; *.php; *.php3; *.cgi; *.c; *.cpp; *.h; *.pas; *.bas; *.tex; *.pl; .htaccess; *.xtml; *.css; *.cfg; *.ini; *.sh; *.xml
> 2009-07-27 01:30:02.809 echo "WinSCP: this is begin-of-file" ; scp -r -p -d -f "cirb-intranet.vmdk" ; echo "WinSCP: this is end-of-file:$?"
< 2009-07-27 01:30:02.840 WinSCP: this is begin-of-file
. 2009-07-27 01:30:02.840 Sending NULL.
. 2009-07-27 01:30:17.840 Waiting for data timed out, asking user what to do.
. 2009-07-27 01:30:17.840 Asking user:
. 2009-07-27 01:30:17.840 Host has not answered for 15 seconds.
. 2009-07-27 01:30:17.840
. 2009-07-27 01:30:17.840 Wait for another 15 seconds? ()
. 2009-07-27 01:30:17.840 Attempt to close connection due to fatal exception:
* 2009-07-27 01:30:17.840 Terminated by user.
. 2009-07-27 01:30:17.840 Closing connection.
. 2009-07-27 01:30:17.840 Sending special code: 12
. 2009-07-27 01:30:17.840 Sent EOF message


script
# Comment out the next two lines to test
option batch on
option confirm off

# Connect - format: user:password@host
# "password" is replaced by the actual password
open scp://root:"password"@192.x.x.x
# Change remote directory
cd /vmfs/vmhba1:0:1:2

# Force binary mode transfer
option transfer binary

# Download backup file to the local directory
get cirb-intranet.vmdk cirb-rdcms-dev.vmdk E:\VMDK\cirb-esx2\

# Disconnect
close

# Exit WinSCP
exit