in reply to Arbitrary Analysis?

...load all the data into a SQL DB and then run SQL queries at it...

Using what table schema? What will your queries look like?

Never underestimate the speed and power of simple perl scripts using regexps to filter and parse raw log files.