Apache maps requests to specific handlers based on what's in your httpd.conf file. Usually you can configure it to not send directory requests to mod_perl. You may find this thread helpful.