Yes, that's how I understand the term "bounce". But I've seen some mail programs (the Mac mail app perhaps) that distinguishes between "bounce" (meaning bounce the mail back to sender as undeliverable) and "redirect" (meaning redirect the mail to another user, but make it look like it came from the original sender).

I think that both of these features would be useful.