Voting ++ or -- on an anonymous post isn't merely throwing away your vote. It does affect the value of $NORM, which is used to calculate the probability of gaining/losing XP per vote, as described in the Voting/Experience System.