in reply to Speed up file write taking weeks

If we assume that writing 1.7 trillion records takes two weeks, then that's 1.4 million records per second, which is a reasonable number, assuming that the fields are of a decent size. So while you might be able to speed up things a bit, I'd be surprised if you could reduce it from weeks to days. You'd have to paraellelise it, with multiple disks and CPUs

Dave.