in reply to Speeding up large file processing

If you're devoted to the idea of buying hardware to solve the problem, I'd first look at adding enough RAM to put everything on a RAMdisk. That would speed the I/O up dramatically, though I/O may not be your problem.

Consider profiling to see what the slow parts of your program are; that should help you figure out whether speeding up I/O will help very much.