If you want to kick the habit, give cperl-mode a try instead of perl-mode; it doesn't seem to colour &foo;, and it does colour some other useful things, like regex metachars.