kitty.exe -cmd "cd ""!/"""
It appears that when a path has these characters WinSCP wraps them in double quotes independently of the command which then breaks the command.
Using the command in this path:
Sigur Rós - Með suð í eyrum við spilum endalaust
If I change the command to this it appears to fix the issue:
-cmd "cd '!/'"