However, one of things I wanted to leave out were the Perl Core modules.
You shouldn't do that because core modules can be upgraded, and bugs are occasionally fixed in them.

On a side note, that utility has been written already, its scandeps

depend