What about filtering the files with grep?

unlink grep ! /\.zip$/, glob 'a/b/*';
[download]

(Untested.)