The "incompatible lib..." text implies you built a 64-bit mod_perl on a system where IHS is 32-bit. Try export CC="gcc -m32"
(this can happen when the Apache build was created on a system where "gcc" is 32-bit and you build your mod wheree "gcc" defaults to 64-bit.