in reply to Sorting/Cleansing a Duplicate File

.. a word document ..
I suggest you chomp the input. Also consider removing any leading/trailing whitespace and skipping over blank lines.
poj

Replies are listed 'Best First'.
Re^2: Sorting/Cleansing a Duplicate File
by perlron (Pilgrim) on Oct 25, 2014 at 16:17 UTC
    and the word document introduced some unicode/ut8 characters which somehow appeared wierd on the html page. its that perl utf8 thingy i keep readig about i think.
    Do not wait to strike when the iron is hot! Make it hot by striking - WB Yeats
[reply]
Re^2: Sorting/Cleansing a Duplicate File
by perlron (Pilgrim) on Oct 25, 2014 at 15:00 UTC
    thanks i did chomp it. but i need a new line anyway in the file..so i let it be.
    Do not wait to strike when the iron is hot! Make it hot by striking - WB Yeats
[reply]
      yes, but the last line may not have a new line and then you could get a duplicate.
      poj
[reply]

In Section Seekers of Perl Wisdom