or without the pipe, there's (normally) a command line switch for unique sorting ... sort -u flat-file.txt > uniqued.txt

-- Hofmator