Unfortunately, I believe that people may abuse it. Here's a scenario:
"Foo the initiate" set's up an alter ego in PerlMonks to help upvote himself. This may be a painfully slow way to get XP, but in theory it could be done. Now, let's let "Foo the initiate" set up an alter ego that will send him 2 or 3 XP to himself. If this is possible, then, "Foo the initiate" could set up a quick script to give himself free XP every day. Combined with a script that automatically logs "Foo the initiate" in daily (an easy 182 XP), "Foo the initiate" gains 912 to 1277 XP for writing a couple of scripts and contributing nothing to the site. Add a robot for the voting, and you could literally become a Saint without even trying (after some quick Excel analysis, following the averages and voting a maximum of 20 times a day, you would end up with 2945XP).