I don't see why you can't create a queue for every thread. Something like

my %listerners;

sub create_new_listener {
   my ($param) = @_;

   my $queue  = Thread::Queue->new();
   my $thread = threads->new(\&listen, $param, $queue);

   $listeners{$param} = [ $thread, $queue ];
}
[download]

If you need to send something to a worker, lookup its queue.