You should always load all of your handlers in httpd.conf or a startup.pl called from httpd.conf for memory reasons. It will save you a lot of memory through copy-on-write if you load them before the fork.