I'd look at Algorithm::TokenBucket for the fancy variant of rate limiting. Alternatively, if it's just simple lines, maybe you can set up syslogd to send you an email/SMS for a certain category? I think syslogd has its own limiting, at least for quickly repeating messages.