The first thing that comes to my mind about timeouts is the possiblity of a firewall running on the server. Can you check if any firewall is running on the server? Also, from the perldoc, there appears to be a debug option that you can turn on, for e.g.

$Net::SSLeay::trace = 2;
[download]

This may give you more insight into the connection between your client and server.

Try the above possiblities and see if either helps solve your problem.