in reply to WWW::mechanize not obeying rules
jeffa has written WWW::Mechanize::Polite, which uses WWW::RobotRules to add Robots.txt-compliant behaviour to WWW::Mechanize.