If this is a one time fix, you can use the unix commands 'sort' and 'uniq', like so:

sort db.txt | uniq > newfile.db
[download]

'sort' sorts the entries in db.txt, uniq then cuts out duplicates and the the '>' redirects the output to a new file name instead of the screen (STDOUT).

tstock