Hi Perl Gurus,

Iam quiet new to Perl and iam running into an issue which is beyond my reach now. I have a perl script which is causing segmentation fault (core) in AIX. The perl version is 32 bit and when i try to load a huge file of size 37 Mb in a hash, i get core dump. The line is 

@{ $self->{lines}} = split('~', $line);

[download]

The $line has a huge single line data. I tried "tie" with DB_BTREE, DB_HASH, but nothing worked.

The code snippet is 

sub new
{
    my $class   = shift();
    my $self        = {};
    $self->{fname}  = shift() or $self->{fname} = "STDIN";
  
    # Open File Handle
    if ($self->{fname} ne "STDIN")
    {
        # Check For Empty File
        if (not -s $self->{fname})
        {
            #die "Empty or non-existent input file.\n";
            return 0;
        }
        local *IN;
        print "Before File Open\n";
        open(IN, "< $self->{fname}") or return 0;   
        #die "Can't open $self->{fname} for input: $!\n";
        print "After File Open\n";
        $self->{file} = *IN;
        $self->{fopen} = 1;
    }
    else
    {
        $self->{file} = *STDIN;
    }

    my $line = "";
    while (not length($line))
    {
        print "inside while loop in X12.pm\n";
        $line = readline($self->{file});
        return 0 if (not defined($line));
        $line =~ s/^\s+//;  # Strip leading whitespace
        print "line read from the file in X12.pm\n";
    }

    # Get Header Information and Initalize File Read Buffer
    if ($line !~ /^ISA/)
    {
        $self->{fieldOut}   = "*";
        $self->{segOut}     = "\n";
        $self->{compSep}        = "<";
        $self->{fieldSep}   = "\\*";
        $self->{segSep}     = "\\\n";
        print "self in if cond in X12.pm\n";
    }
    elsif (length($line) < 106)
    {
        return 0;
        #die "ISA segment invalid, aborting.\n";
    }
    else
    {
        $self->{fieldOut}   = substr($line, 3, 1);
        $self->{segOut}     = substr($line, 105, 1);
        $self->{compSep}    = substr($line, 104, 1);
        $self->{fieldSep}   = "\\$self->{fieldOut}";
        $self->{segSep}     = "\\$self->{segOut}";
        print "self in else cond in X12.pm\n";
    }

    print "self->{segSep} is $self->{segSep}\n";

    @{ $self->{lines}} = split(/$self->{segSep}/, $line);

    bless($self, $class);
    return $self;
}

[download]

Please help me resolve this issue. I would like to have the return variable from split in a hash (@{ $self->{lines}} ), since this is being used by some more functions as input. Please help. One more thing i would like to add, moving to 64 bit perl is a final option which we are not looking into now.

Thanks, peacelover1976

In reply to 32 Bit Perl causing segmentation fault if data is big by peacelover1976

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.