Then it isn't a typeglob assignment, and no magic is lost. This is the same code as yours, using errno 111 instead of 1:

$ perl -e'$! = 111; print "$!\n"'
Connection refused
[download]

Either you were fooled by the "Operation not permitted" error (which is unlikely since it isn't a Perl error according to perldiag), or I still don't get your point.