Does this work because ! has a different opperator precedence?

Yes,

grep not /$bad/, @list;
[download]

is parsed as

grep not(/$bad/, @list);
[download]

since not has lower precedence than ,