I checked on my RHEL5 X86_64 box and the "standard" perl (/usr/bin/perl) is build with 64 bytes.
Nevertheless the compiler switch for gcc is -m32 to build the 32 bit version.
So this needs to be changed in the make file for the module.