I've never acctually written any code that uses POE, but it sounds to me like what you want to do is exactly what POE was designed for: have a single "multitasking and networking framework" that handles all of your Events.

The POE::Component::IRC and POE::Component::Server::HTTP Modules might be of particular intrest for you.

http://poe.perl.org/