in reply to Delete duplicate data in file
perl -pi -e'$_ = "" if $seen{ $_ }++' temp/* [download]
Makeshifts last the longest.