What happens if you build perl according to the instructions in the INSTALL file? Specifically ...

  ./Configure [your options]
  make
  make test
  make install
[download]

instead of randomly copying files around, and if you also make the -Dprefix match what you actually appear to want, namely /home/perl/usr instead of /usr?

And finally - -Uusedl turns dynamic loading off, so XS won't work unless you rebuild perl. That's gonna break things for you in the future.