You always need to build modules to match the particular build of perl you're interested in. This applies equally to endianness, word length, threading, etc. The standard way to build a module and have everything magically work is:

$ /path/to/perl Makefile.PL
$ make
$ make test
$ make install
[download]