Have you considered making one module that loads all the modules that you need and then have the plugins inherit from that primary module?

This will not improve performance but will improve code clarity and reduce the amount of duplicate work.