perldoc perlrecharclass says you don't need to escape [ within a (non-Posix) character class, and for ] there is a similiar rule as for the hyphen, so

<token: punctuation>  ( [][.,?!"';:&()-]+ )
[download]

should be valid without any backslash.
Update: corrected position of hyphen, had it outside of the regex :-/