in reply to perl ST sort performance issue for large file?

split(/,,/);
I don't see any ",," in the sample data you gave.

Do realize, 3Gb is a huge amount of data. It's going to take a long time, no matter what. Some things you may want to try out:

Oh, and in your map, you're splitting twice. Instead of writing map {[$_, (split)[0], (split)[2]]}, why not map {[$_, (split)[0,2]]}? But compared to the sort, this will only have a minor effect.

Replies are listed 'Best First'.
Re^2: perl ST sort performance issue for large file?
by AnomalousMonk (Archbishop) on Mar 30, 2012 at 11:46 UTC