Actually this was a free dictionary file from http://www.orchy.com/dictionary/. (with all the first part cropped out, though). So it is space separated data and not line-fed.

I'm not so sure about the end of the file though I doubt that's the problem because it's only testing the first 5-10 of this 150k word file. It never gets close to the end of the dictionary.

Thank you.