Have a look at your environment variables such as PERL5LIB. I got into a mess with modules using XS compiled with different versions of perl that were solved when I unset the library paths. It's still a little magical to me.

A decent solution is to try out perlbrew which let's you switch between versions of perl on the same box and sandboxes the installed modules.