in reply to Re: Possible faster way to do this?
in thread Possible faster way to do this?

Maybe two days isn't all that bad.
When it's for just one column of a total of 95, my guess would be that this is pretty bad :P. But rather than the 5TB file, it's sorting and searching for unique values in 50GB (~5TB/95) that I'd be the most worried about personally.