A few possibilities.

• vim treats the file as being encoded using a different encoding then the one that was really used, so it doesn't see char U+FEFF.
• vim doesn't understand the \x{} notation.

What does this have to do with Perl?