Mail::Audit is the way to go... For your mailing-list stuff, I'd check out Mail::ListDetector and Mail::Audit::List. These three modules are rumored to work very well together.

Actually the first thing you should do is read Simon Cozens' article Mail Filtering with Mail::Audit. It is a rather thorough introduction, and will help you set things up quickly and correctly.

-Blake