I've used Net::Server very effectivly in the past. The documentation is a little difficult to comprehend straight up, (or at least was for me at the time) however with a little tenacity, i've got something that works really well.

This is only one half of you're requirement, i would think client communication could be handled quite effectively by IO::Socket