This is a known problem with Perl Monks as far as I know, sometimes referred to as the "Vote Fairy".

It basically seems to be a race condition in the database: when you download a page, your records gets updated. If at the same time the cron job runs which hands out the votes, your page loading may well interfere with that.

I tend to avoid PerlMonks around that time.. ;-)

Liz