Short answer: No.
Long answer: Perl uses the modules, e.g. loading it into memory, parsing and compiling it, when you need them. So just by having them installed on your computer, which is basically nothing other than having it copied to a place where the perl interpreter will find it, you will not experience any problems with running your system or the perl progam.

Regards,
C-Keen