sort -u < inputfile > outputfile