Sounds like you want to quote metacharacters in your regular expression, so that they're not treated as meta:

    @found = grep { /^\Q$handle\E/ } @notes;
[download]

The \Q and \E should do it for you. More in perlre.