Well this does seem to work fine for me:

use LWP::Simple;
print get 'http://modperl.com:9000/';
[download]

So yes, this should work. Your problem must be of a different nature. Is there perhaps a firewall blocking access to nonstandard ports?