It would be nice to see your solution, after you ask others und find it by yourself.
Sorry, but you keep repeating yourself. Did you try some of my suggestions? Particularly the
$session.GetFiles("$remotePath/*", "$localPath\", $True).Check()
Sorry for the delay in answering, I was able to modify my script to delete the empty directories (without using the $session.GetFiles command). Now that I have my script working and have the time, I will build a new one and use your recommendation.