At work I use Solaris 10 (Sparc) and gcc to build perl for source. You've not told us how building your own perl fails. What happens if you try:

./Configure -des -Dprefix=$HOME/Your/target/path/here
make test
make install
[download]