Yannis, Open a shell and ping the server. If you get package loss/high ping, then it is absolutely your Internet connection and not the server's fault.