Hello All, Here is the problem, I want to open a big giant file, and read all lines that have the text fwa into an array, then take that array and find out how many duplicates are in it, listing the duplicates and their count. Pretty simple, but then again... 
#!/usr/bin/perl

system("clear");
open(FILE,"/var/log/everything");
my $i=0;
while($input=<FILE>){
     if($input=~/fwa/i){
     $i++; @parsed[$i]=$input;
     }
}
print "\n $i  entities";

foreach my $test (@parsed){
        my $data="";
        my $x="";
        my $t="";
                foreach my $final (@parsed){
                     if($final eq $test){
                     $x++;
                     my $data='valid_time';
                     }
                $t++;
                }
        if($data eq "valid_time"){
        print "$x $test";
        }
}

[download]
So you can see, I load the file, and then go through 2 foreach loops, the first gets the line, the 2nd compares the line to each of the other lines, and then returns true if it is found again, and outputs the count. This does not work at all, and the ram usage is 23MB, not good. Anyone think of a better way? Is there a simple array function to do this? Can I sort the array somehow first? Thanks in advance.

In reply to File Search And Compare by PyroX

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.