I might be wrong on this, but doesn't

perl Makefile.PL LIB=/home/gabor/perl5lib
[download]

specify exactly this installation path? As far as I know, the module is then installed into this exact path, meaning Module Foo::Bar ends up installed as /home/gabor/perl5lib/Foo/Bar.pm.

Update: Possibly you will have to specify PREFIX=/home/gabor/perl5lib or other such parameters like INSTALLSCRIPT, INSTALLBIN, INSTALLMAN3DIR as well, depending where you want these files to end up in