I have a similar situation. I was a Pontiff under the old system, and since I didn't log in this weekend, I had 35 votes left. I don't know for sure, but I assume that the Vote Fairy only gives you votes if you are below your allotted number, and doesn't remove them if you are above. That's my guess, one of the pmdevs will have to verify that.