Ok. I changed my code to do a Mysql query. I have 2 files DB and a MySQL Table. The mysql table is constructed with 3 column: chrom, start, end. DB has 7 columns. For each line in DB, I want to count the number of times that col2 matches chrom and start is BETWEEN col3 and col4. Then I want to print that value in DB col8. Here is the code I have:

#!/usr/bin/perl

# PERL MODULE
use DBI;

my $DB_NAME = "H3K36me3";
my $DB_USER = "root";
my $DB_PASS = "password";

my $dbh = DBI->connect("DBI:mysql:$DB_NAME","$DB_USER","$DB_PASS");

open (FILE,"@ARGV[0]")||die "usage: perl MySQL.query.pl <DB> ";
@array=<FILE>;
close(FILE);

foreach $line (@array){
    my ($Gene,$chr_id,$left,$right,$Strand,$ExonCount,$SizeKB)=split(/
+\t/,$line);
    $sql = "select count(*) from H3K36me3 where chrom =\"$chr_id\" AND
+ start between $left AND $right";
    $sth= $dbh->prepare($sql);
    @Count=$sth->execute()||die "problem Here!\n";
    @Count=$sth->fetchrow();
    while (@Count = $sth->fetchrow()) {    
        print "@Count[0]\n";
    }
}

[download]

The problem is that I can print it to the screen and it will slowly work (the MySQL table is 20 million rows), but when I go to print to file with ' perl MySQL.query.pl DB > Out.txt' it stops around ~6000 rows. It actually stops in a wierd way, like if the actual count is 30, it will only print 3. How do I deal with this?

In reply to Re^2: Searching and Coutning using 2 files with multiple columns by shart3
in thread Searching and Coutning using 2 files with multiple columns by shart3

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.