$ time ./llil4vec long* long* long* | cksum llil4vec start use OpenMP ( old ) (mem-fix) ( new ) memory consumption 89.6 GB 62.4 GB 33.0 GB use boost sort get properties 48.133s 32.659s 12.993s sort properties 39.684s 39.399s 33.421s vector reduce 87.982s 75.644s 35.568s vector stable sort 25.990s 31.133s 21.987s write stdout 3.707s 3.206s 3.693s total time 205.498s 182.042s 107.664s count lines 970195200 count unique 295755152 29612263 5038456270 real time 3m57.228s 3m38.118s 1m50.092s user 73m27.931s 70m13.776s 45m32.094s sys 2m42.941s 2m29.584s 2m20.917s