What do you mean by "cache"? Any code compiled by the perl interpreter will stay there until the process is shut down.

So, if your reason for only loading the particular module you intend to use was to save memory, it will probably not help much in mod_perl since all of the modules will eventually get loaded into every process.