in reply to Re^2: out of memory problem
in thread out of memory problem
I don't have time to look at it personally, at least not now, but the following will help you greatly. Change
open ($testdataset, "datasetnew.txt") or die "Cannot open file"; @testdataset = <$testdataset>; close ($testdataset); @testdataset = grep { $_ ne '' } @testdataset; @testdataset = grep /\S/, @testdataset; foreach $dataline (@testdataset) {
to
open (my $testdataset, '<', "datasetnew.txt") or die "Cannot open input file: $!\n"; while (my $dataline = <$testdataset>) { next if $dataline =~ /^\s*$/;
You'll have (2 or 3) fewer copies of your file in memory.
|
|---|