I think moritz is correct about getting the mailserver to do this throttling for you. But I do have limited experience with problems much smaller than yours. I send out mails to users whose mailboxes are full. I use two strategies to prevent overloading my already overloaded mailserver.

First, it refuses connections and new RCPTs when it's already sweating. Second, I try not to get it to that point. (This send_mail function is from my own Net::SMTP::OneLiner.) 

# This part is a no brainer and your mail software
#   likely already supports something like it:

eval { send_mail('postmaster@mei.net', "$dir_entry\@mei.net", 
    "Usage Notice (full mailbox)", $msg) };
if( $@ ) { 
        warn "sleeping for 2 seconds then retrying due to send_mail() 
+WARNING: $@";
        sleep 2;
        redo RETRY;
    }
}

[download]

The second thing is to simply wait until the load average is low enough: 

sub sleep_until_low_load {
    my $limit = shift;

    REDO:
    open PROC, "/proc/loadavg" or die $!;
    my $line = <PROC>;
    my $load = $1 if $line =~ m/^\s*([\d\.]+)\s+/;
    close PROC;

    if( $load > $limit ) {
        print "\tsleeping for 5 seconds since $load > $limit\n";
        sleep 5;
        goto REDO;
    }
}

[download]

-Paul

In reply to Re: Applying the brakes by jettero
in thread Applying the brakes by Ryszard

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.