Your problem is the greedyness of punct. If it's ok that !@#$ will be parsed as four tokens, you should be able to get away with:

    punct: /[^\w\s]/ {print "<punct: $item[1]>" }
[download]

although I have not tested it.

Otherwise, you may want to try something like (also untested):

    punct: /(?:[^\w\s[]+|\[[^\w\s[]*|\[\[(?!.+?]]))+/ 
           {print "<punct: $item[1]>"}
[download]

Note that your link rule consumes "[[]]]" completely, as a leading [[, a ] as the content, and a trailing ]]. Similary, "[[]] foo [[]]" is consumed by the link rule completely, with "]] foo [[" as the part inside the 'link'.

Abigail