Wouldn't this also fail if $chompstr contained \E ?

No. That confused me when I first heard of \Q..\E too.

• \Q..\E doesn't prevent interpolation.
• \E isn't special in interpolated strings. It matches the two characters. "\" and "E"
• $ don't trigger interpolation in interpolated strings. It matches end of lines.