I was thinking of installing pure perl modules in a tree separate from the ones which need to be compiled.

You can instruct Perl's builder to add the lib directories of other Perl installations to the list from which @INC is initialised. Pure Perl modules will work fine, XS modules will give an error.