If you really can't use mod_perl, then you could try to defer the module loading. Normally this is done by removing the "use" statements and put "require" statements at the point where the functionality is needed. Of course this is error prone and you have to fully qualify function calls.
Maybe it's worth to take a look at the autouse module, which automates the deferred load of modules.