Yes, indeed. :) I think both bart and Corion suggested I use Parse::YAPP, so you're in good company. The tokenizer was my project for last week and I've got another project for the next fortnight, but I will definitely give it a burl when I get the chance. After all, it works (and we can leave it running overnight). ;)

I'm not really from the yacc/bison/(f)lex crowd, but I am familiar with Benchmark, so maybe I'll take a hint and grant your wish.