This topic comes up from time to time. There are at least two camps: those who think that downvotes should be accompanied by some sort of explanation, and those who think that that would encourage retaliatory downvoting.

Some recent, related threads:
Possible changes to Voting/XP
Voting etiquette
Why down vote is soo easy?
/msg me the reason of --