When trying to list the remote directory and files, getting following error

Could not retrieve directory listing
The network connection was aborted by the local system.

But when refreshing again and again, it works fine. Is it problem from my side ? or remote machine side ?