If you haven't already, upgrade to the newest Math::BigInt and Math::BigFloat from CPAN and confirm that it still happens.

BTW, I find it a lot easier to say:

$ perl -wle'print for atan2(1,0), atan2(0,1)'
[download]