Re^2: Email Thresholding

The OP doesn't make clear, but I could imagine something where most of the time you get no events, but if you get one you want the email sent right away (hence the check every few minutes) but sometimes things go really haywire and it turns itself into a spammer when the first event would have been sufficient to get the on-call person to fix things (which presumably takes less than an hour in most cases...). If you're the person on the receiving end of the emails, then it probably becomes important to learn enough Perl to fix the spam problem. Pure speculation, however.

Comment on Re^2: Email Thresholding

Replies are listed 'Best First'.
Re^3: Email Thresholding by bfdi533 (Friar) on Apr 02, 2015 at 15:31 UTC
That is exactly right. There are times when there are no emails and the first event of the hour is the only email needed. But the times when it gets very noisy, the email "spam" is a problem. Last night as an example we received 23000+ emails, hence the need for thresholding.	[reply]
Re^4: Email Thresholding by bitingduck (Deacon) on Apr 02, 2015 at 15:36 UTC
For something like that I might even add a feature where the on-call person who does the fix runs a little script that sets a flag to indicate the last time a human responded with a fix, and if a new event comes in after that time, but in less than an hour, it sends the email because either the fix didn't fix it or a new event has showed up to set things off and you want someone to respond right away.	[reply]
Re^5: Email Thresholding by mr_mischief (Monsignor) on Apr 02, 2015 at 16:37 UTC
That's a good technical solution but probably a poor choice for the psychology of the situation. You want your hungover, just awakened sysadmin to spend what focus she has available on fixing the actual problem that triggered the alert.	[reply]
Re^4: Email Thresholding by Lotus1 (Vicar) on Apr 03, 2015 at 23:51 UTC
If the process runs every couple of minutes how can you receive over 23000 emails in a single night? It must be sending one email per event. If you sum up all the events each time the script runs and send one email every couple of minutes the most emails you'll get overnight is `15 hours/night * 30 emails/hour = 450 emails/night`.	[reply] [d/l]
Re^5: Email Thresholding by bfdi533 (Friar) on Apr 09, 2015 at 16:46 UTC
Yes, currently the script is sending one email per event. Thus, this thread to get some ideas on thresholding.	[reply]
Re^6: Email Thresholding by Lotus1 (Vicar) on Apr 10, 2015 at 01:43 UTC