The string conversion sounds to binary sounds like the best bet. Math::BigInt has historically had a lot of holes and bugs, but the current maintainer has put a lot of work into it, and will respond very quickly to a bug report (hint hint).

Looks like the failure to take octal is still there in the current version, but do make sure you have an up-to-date Math::BigInt, to avoid already fixed bugs.