You might want to check out POE. This is the sort of task it is really great at.

Of course POE isn't usually the first thing one throws at a Perl newbie. But you seem to be handling threads OK...