The sorted array is produced by a combination of several external applications and is the ultimate result of an initial data set of several hundred megs - a few weeks of work. The sorting of the smaller set is something I need to do quite often, there is just no way to repeat this process every time (nor any need).