In a similar situation, I piped out to GNU sort. If for some reason you don't want to do this, perhaps the source would be a good guide in implementing it in Perl (Inline::C perhaps?), of course there are GPL issues.

I don't know if having more threads is going to speed things up. I would think that you're mainly IO bound.

-Lee

"To be civilized is to deny one's nature."