This appears to be similar to this bug.

According to the bug report someone had luck with installing Math::BigInt::GMP.

As a note: If you do run into these type of situations with modules, CPAN has somewhat recently added (or made more accessible) some excellent sections. I personally like to check Testing results on different Platforms and Bug Reports, if I run into a problem. Module Discussion Forums are also there but don't seem to be used.