I suggest that the docs for each may say just what you're asking.

If just iterating over the list of keys of the hash (e.g. foreach (keys %hash)) then of course no limitations exist -- the list of keys is generated once at the start of the iteration, so deletion does nothing.