I would second the above comment. A single process, multiplexing server is going to be the quickest and simplest road to your solution. You can use Net::Server::Multiplex if you want to reuse someone else's solution to get up and running quickly.

However, if you want to learn how to do this yourself, you should get the Cookbook and read Chapter 17, and particularly recipe 17.13.