Did you install gmplib as described in the Math::BigInt::GMP INSTALL file?

Update: Problems in Net::SSH Covers issues of compiling against a gmplib which has been built using a different compiler, the replies should be worth a read.