It's not strenuous enough, what's the fun in a game without a decent risk? How about an automatic serial down-voter detection that removes 20% of your XP without warning each time you click to down-vote the same user above a certain number of times in a row?