What is $server{'LocalAddr'}? There is no %server declared in your code; are you trying to access $server->{'LocalAddr'}, i.e. a hash key in the returned object? If so, I seriously doubt it's going to work. IO::Socket modules return blessed filehandles, not hashrefs; not to mention accessing it as a hashref is not documented, and so shouldn't be relied upon even if it does work.

Also, did you use strict? Accessing %server like you are should cause a fatal error, given there's no declaration for it.