Here is another variation:

    perl -i.bak -ne 'print unless $h{$_}++' file
[download]

However, since these solutions store unique lines in memory they are potentially slow for very large files.

--
John.