If your code is written reasonably well (i.e. not reliance on globals being undef at loadtime, no unintentional closures etc),
converting to mod_perl or
fastcgi shouldn't take too long, and then you can load/compile all your code up-front, saving the load time for each request.