in reply to Re^9: find common data in multiple files
in thread find common data in multiple files

Hi BR

I am sorry for all misunderstanding. I try to put it in a simple way. I have 25 different txt files. Each of 25 files has only two columns. One column is id (ID21) and second column is name (ABC12). Each files has different number of rows. Each row has data like (ID21 ABC12). i made it sure that one id and name (say ID21 ABC12) appears only once in one file. That means one file doesn't have any replicate values of "ID" and "name". Also there is fixed "ID" for particular "name". So I want if ID21 ABC12 is present in all 25 txt files it should be printed in output.

I am thankful for all who have provided me solutions. But i guess problem is ID21 ABC12 is not appearing in all 25 files. So, all codes provided are not working for me. And also i dont know in which of the files ID21 ABC12 is appearing. So, my last posted code was to generate output like this:

First column: print all common IDs (even if they are present in 2 files), then second column: has file 1 with name which match their id. Nothing prints if it doesn't match ID (so appear blank). Third column: is file 2 which prints name matching its id and so on.

So what I want my output to be is match all keys first then join the second column of each 25 files labelling file name (that is file1, file2 etc). I want output to be like this: 

ID    file1 file2 file3 file4 file5 file6......file25
ID21  ABC12 ABC12             ABC12            ABC12
ID22        XYZ11       XYZ11

[download]

this output shows ID21 and ABC12 is present in more than 2 files. And ID21 and ABC12 is present in file1, file2, file5 and file25 and absent in other files. next row has ID22 and matching name is found in file2 and file4. The following code for getting above mentioned output 

#!/usr/bin/env perl
use strict;
use warnings;
my %data;

while (<>) {
    my ( $key, $value ) = split;
    push( @{ $data{$key} }, $value );
}

foreach my $key ( sort keys %data ) {
    if ( @{ $data{$key} } >= @ARGV ) {
        print join( "\t", $key, @{ $data{$key} } ), "\n";
    }
}

[download]

Please let me know if this was answer for what you asked me:) Regards mao9856

Replies are listed 'Best First'.
Re^11: find common data in multiple files
by poj (Abbot) on Jan 09, 2018 at 07:39 UTC

    Using @push does not maintain the correct column alignment. You need to assign values to the element associated with that file number.

    #!/usr/bin/env perl
use strict;
use warnings;
my %data = ();

#@ARGV = map { "File$_" }(1..4);
my $num = @ARGV;

# input
for my $i (0..$num-1){
  open my $fh,'<',$ARGV[$i] or die "$!";
  while (<$fh>) {
    my ( $key, $value ) = split;
    $data{$key}[$i] = $value;
  }
  close $fh;
}

# output
print join ("\t", 'ID', @ARGV),"\n";
foreach my $key ( sort keys %data ) {
    my @line = map { $_ || '-' } @{ $data{$key} }[0..$num-1];
    if (grep $_ eq '-',@line){
      print join ("\t", $key, @line),"\n";
    }
}

    [download]
    poj
[reply]
[d/l]
[select]

      Thank you so much poj:) This code got me desired output. Thanks a million :)

[reply]

In Section Seekers of Perl Wisdom