The make install should install to the PREFIX you specified in your perl Makefile.PL.
I had the same
problem. Maybe you should just delete the stuff you "un-tarred"
and "un-tar" it again to make sure you are doing a clean perl Makefile.PL PREFIX=/whatever
What is the perl module?