In perlreref in the discussion of Escape Sequences it says:

\b An assertion, not backspace, except in a character class

so there is no expectation that \b (an assertion) should have consistent behavior with \u (an escape sequence character).