in reply to Re^2: How to eliminate redundancy in huge dataset (1,000 - 10,000)
in thread How to eliminate redundancy in huge dataset (1,000 - 10,000)

See how to use the variable $/ in perlvar to change Perl understanding of what a line is. For your particular case just use...
$/ = "\n\n";
before the loop.

Replies are listed 'Best First'.
Re^4: How to eliminate redundancy in huge dataset (1,000 - 10,000)
by johngg (Canon) on May 07, 2008 at 22:18 UTC
    ... or paragraph mode.

    $/ = q{};

    Probably safest to localise it's scope to avoid unwanted side effects.

    ... { local $/ = q{}; while ( <> ) { ... } } ...

    Cheers,

    JohnGG