jhs3,
If you want to know what modules are part of the core, then use Module::CoreList. In addition to those modules, certain distributions include additional modules such as ActiveState Perl on Win32.

With regards to installing modules, there are far too many links for me to write in this small margin. You may want to look into CPAN, CPANPLUS, apt-get, PPM, etc.