I'd probably go for the regex just because it's the first thing I thought of and I didn't consider your problem for too long (hey, at least I'm honest :). But this should do:

my @tokens = $string =~ /([^ ]+".*?"|[^ ]+)/g;
[download]

Update: Forgot you could have something before the first quote.