Think of it another way.

my $value= get_numeric_value_from_somewhere();
eval { print 'Will never be printed' if ($value/0) }
# except for zero, you want?!
[download]

The result is true for .1/0, .0001/0, etc. etc. all the way down to the smallest values on either side of zero that any given machine can represent.

Why should it be different for zero itself?