I somehow remember having the same discussion about problematic highlighting and the Perl debugger, and it was also the Term::ReadLine backend to be blamed.

Unfortunately I can't find it again, so I replied to you to make it searchable for others having the same problem, but with the debugger. :)