in reply to Re: How to eliminate redundancy in huge dataset (1,000 - 10,000)
in thread How to eliminate redundancy in huge dataset (1,000 - 10,000)

This node falls below the community's minimum standard of quality and will not be displayed.

Replies are listed 'Best First'.
Re^3: How to eliminate redundancy in huge dataset (1,000 - 10,000)
by salva (Canon) on May 07, 2008 at 20:13 UTC
    See how to use the variable $/ in perlvar to change Perl understanding of what a line is. For your particular case just use...
    $/ = "\n\n";
    before the loop.
      ... or paragraph mode.

      $/ = q{};

      Probably safest to localise it's scope to avoid unwanted side effects.

      ... { local $/ = q{}; while ( <> ) { ... } } ...

      Cheers,

      JohnGG