I think consuming an extra vote alone won't do it - especially on higher levels you have enough daily votes that it won't make a difference. It is a very rare day that I manage to spend all my 40 votes, and even with 30 at level 8 I often had a few left over at the end of the voting day.

I was going to propose it should cost an XP, but both penalties at once would be even better. If it is at all implemented (and I don't think I like the idea), then it should really hurt to take the offer. The message should clearly be "pay attention next time, and don't get used to this feature".

Makeshifts last the longest.