Heck, why not just penalize people that don't give votes averaging out, in the end, to zero or better? If somebody has a bad day and decides to take it out on PM, PM fights back.