in reply to Re: How to manage a big file
in thread How to manage a pattern matching & counting with big data file

Now each line is a potential pattern & we need to make four more pattern by adding next two & previous two lines, for example :-

Pattern (1):- I_SDRAM_TOP/I_SDRAM_IF/sdram_clk_G1B1I16 ( COnsider this as a seed pattern)

Pattern (2):- I_SDRAM_TOP/I_SDRAM_IF/sdram_clk I_SDRAM_TOP/I_SDRAM_IF/bufbdf_G1B1I16 I_SDRAM_TOP/I_SDRAM_IF/sdram_clk_G1B1I16 ( Seed +2)

Pattern (3):- I_SDRAM_TOP/I_SDRAM_IF/bufbdf_G1B1I16 I_SDRAM_TOP/I_SDRAM_IF/sdram_clk_G1B1I16 (seed +1)

Pattern (4):- I_SDRAM_TOP/I_SDRAM_IF/sdram_clk_G1B1I16 I_SDRAM_TOP/I_SDRAM_IF/sd_mux_dq_out_6 (seed -1)

Pattern (5):- I_SDRAM_TOP/I_SDRAM_IF/sdram_clk_G1B1I16 I_SDRAM_TOP/I_SDRAM_IF/sd_mux_dq_out_6 I_SDRAM_TOP/I_SDRAM_IF/sd_DQ_out6 (seed -2)

Now these five patterns needs to scan in the master file & print each pattern wise occurrence count.

Replies are listed 'Best First'.
Re^3: How to manage a big file
by Lennotoecom (Pilgrim) on Apr 23, 2014 at 09:51 UTC
    while thinking about your last addition,
    consider this 
    open IN,'<1';
while (<IN>) {
        $a = 1 if /Endpoint/;
        $b = 1 if /-/ and $a;
        if($a and $b){
                if(/^\s+(.+)\s\(/){
                        $h{$1}{'x'} = ++$x if ! exists $h{$1};
                        $r .= $h{$1}{'x'}.".";
                }
        }
        $a = 0, $b = 0, ++$r{$r}, $r = '' if /data arrival time/ and $
+b;
}

close IN;

foreach (sort keys %r) {
        print "$_: $r{$_}\n";
}

    [download]
    algorithm:
    find /Endpoint/
    find /-/
    assign every line pattern a unique code from 1 towards infinity
    form the unique string number, count it as one occurence
    find /data arrival time/
    which will result in something like this: 
    1.2.2.3.3.4.4.5.6.7.8.9.10.10.11.11.12.12.: 8

    [download]
    which means I copied your example file eight times in my '1' file
    update
    regarding your patterns:
    they are quite confusing
    why did you pick up the middle line to form your pattern?
    Please consider this snippet above, maybe it will suit your needs as well?
    update 2
    have you tried this soultion? has it worked? please tell.
[reply]
[d/l]
[select]
      FWIW, $a and $b are special, its better to use meaningful variable names not already reserved
[reply]

In Section Seekers of Perl Wisdom