in reply to Checking LInes in Text File

You can also do this on the commandline:
sort -u infile > outfile # or (you might many some of uniq's extra options): sort infile | uniq > outfile