Instead of re-inventing the wheel, I can highly recommend using Nagios instead.

I don't love it when it wakes me up at 1am, 3am and then 445am as it did today, but it's one less thing that I had to develop from the ground up.