Just a matter of perspective: the left part which is kept unchanged is the one ignored from substitution, because the right part is kept in '$&'.

So both parts are kept, just in different aspects.

Almost as confusing as using single line and multi line modifiers at the same time...