Recent history shows that although the voting system encourages participation and increases the signal to noise ratio, it can lead to some unfortunate situations. There are at least three ways the voting system can be abused:

I think there are some relatively simple tweaks to the XP system that could alievate these problems.

I believe that these three modifications could help avoid the situations highlighted in the past few weeks. The null vote would reduce the show-me-your-rep voting, and the other two suggestions would remove the incentives for personality voting votebots.

We've already lost several high-level monks over this, and their contributions will be missed. I'd like to try to avoid this in the future if possible.

-Blake

Replies are listed 'Best First'.
Re: Downvoting Dilemma
by stefan k (Curate) on Aug 08, 2001 at 15:01 UTC
    Hm,
    curious enough you just care about downvotes. I don't feel that the use of downvote power should be in any way restricted. And it should not be made public as well.
    What is so bad about people downvoting nodes? Even if the node would not have deserved it. If there is someone who just downvotes because of likability he probably won't be a very high-level monk so he won't have much votes to spent.

    I'd just leave it to overall statistics to get the "real" value of a node. If there are enough people in this place it will all come out well.

    On the other hand: I see that voting bots could be a problem and the "show-me-your-rep" vote is something I have to admit I used sometimes (though I usually ++ that node then). Thus I encourage the null-vote button. For the problem with bots I can't offer any solution besides some weird and not thoroughly thought through thoughts (I think I need to be punisished for that english, er what? *grin*) like measuring time between loading the node and hitting the vote-button or check for "randomness" or something. As I said, just a faint glimpse of an idea...

    Let people downvote as much as they like to without punishing them in any way, it's just another side of this fabulous community.

    Update: fixed a few typos

    Regards... Stefan

(ichimunki) Re: Downvoting Dilemma
by ichimunki (Priest) on Aug 08, 2001 at 17:53 UTC
    There is no downvoting problem-- newbies who ask good questions badly and certain personalities are the only people I've ever seen complain about downvotes. In the former case, newbies need some feedback that they should put a little more effort into their part of the "learning to fish" exercise-- and a downvote won't kill them. Why when I first got to the Monastery I posted a snide answer that I hoped would help a Seeker understand the problem they were having writing a hand-rolled CGI form parser. Not only did I get downvotes, but Merlyn was rather unkind about it in the Catbox. I'm still here, having learned my lesson about providing in assistance in joining the Cargo Cult. As for personalities who can't stand to have people take swipes at them in public-- well, they could stop being public figures. It's part of the price you pay for being well-known. I mean, compare a downvote to having a picture of yourself in the Enquirer. It's laughably unimportant. Consequently, nothing should be done to discourage downvotes in the least bit, especially since they are a necessary part of the auto-reap consideration process.

    As zdog noted in the recent thread discussing showing a ++/-- vote totals (seemingly a popular notion given that my root node in that thread is my highest rep node right now), the direction of votes is not recorded in the version of the Everything Engine that PM uses. So any suggestions to show that information require vroom to make some choices about how to display history and to import code to do that at all.

    Finally, I do like the idea of being able to cast a Null vote. Maybe it should cost two or five votes though. I don't know what good it does you or the node to know what its rep is, but I can see where it might be interesting/amusing... especially if it's one of those nodes that doesn't appear in Best Nodes or Worst Nodes. The only time I really want to know what a node's rep is is before I vote on it, so that I don't push some perfectly decent link to a stonehenge.com article or a link to the FAQ into the top ten nodes of all time list. Those are excellent, informative nodes, but when you compare XP benefit to the poster with the effort expended by the poster, they often don't compare favorably. They are usually the first response-- and because I think most people browse "newest first" they tend to get more votes simply based on when they were posted, not the overall quality of the node. So yes, null votes would be a nice feature, but I'm not sure I get what benefit it would provide.
Re: Downvoting Dilemma
by chipmunk (Parson) on Aug 08, 2001 at 19:00 UTC
    Regarding your second suggestion, "Potential loss of XP on downvotes"... I am opposed to any voting system which affects the voter differently based on the reputation of the node being voted on. Any such system will unfairly penalize either people who vote earlier, or people who vote later.

    In the case of your suggestion, where monks lose XP for down-voting a node with a high reputation, monks are penalized for voting later. Why should a monk who down-votes a node soon after it is posted not be affected in the same way as a monk who casts a down-vote several days later? This would be an artificial and unfair system.

    I lean towards allowing monks to use their votes as they see fit, and avoiding any complicated solutions which would end up creating new problems.

(tye)Re: Downvoting Dilemma
by tye (Sage) on Aug 08, 2001 at 20:27 UTC

    Well, for a change, these proposed fixes for the "downvoting problems" seem rather reserved. I certainly support the first one and don't have a real problem with the last one.

    My first impression of your second item was that I'd implement it backward to what you propose. I see a problem with new users getting too many downvotes and I downvote nodes that have high reps but that are incorrect. But thinking further, I guess you are thinking that systematically downvoting a monk means downvoting even their high-rep nodes and that should cost you XP.

    So I'd just modify your second item to "no XP gain for casting downvotes". Normally I'd be against such a change but I see that we have some immature individuals that have taken to downvoting amazingly stupidly and are continuing to do so. (If jcwren fixes the stats page, then this might be easier to notice.) I'm (somewhat) happy that the victims of this have not flooded us with complaints about the problem, but that may mean that many aren't aware of the extent of this childish behavior. I'm aware of two specific cases that are rather alarming, appearing to involve the concerted effort of at least 10 "users" (perhaps all run by the same person) systematically targetting the same person over the course of weeks, downvoting all nodes by that person. I've ask vroom to look into this again (last time he looked he wasn't able to find any smoking guns).

    Another minor change I've been getting to like would be "no loss of XP if you have no XP", specifically to address the well-meaning newbie whose first node shows their newbieness and attracts a bunch of downvotes.

            - tye (but my friends call me "Tye")
Re: (elbie) Downvoting Dilemma
by elbie (Curate) on Aug 08, 2001 at 17:32 UTC
    With your proposed solution for the downvote problem, I am concerned that this would discourage people who want to downvote a node for legitimate reasons. Even with the showing of up/down percentages. Does a 86% up vote mean that it has a rep of 4 (5++ and 1--) or 80 (100++ and 20--)?

    As for the zero vote, if you're just voting to see someone's rep, should they still get experience? With the case of the zero vote, I will grudingly say yes. Even though the whole purpose of asking users to moderate their peers is being misused (and thus those votes are not deserving of granting experience) not granting experience for zero votes would only lead to monks to continue to vote ++ (or --) to see the rep of a given node.

    If someone feels like writing a more complex solution into the everything engine, people who consistently downvote specific monks or who cast a large number of votes in a small timeframe (such a threshhold would need to be determined) could be discouraged. Granted, smarter votebots who just vote at random intervals through the day wouldn't be caught, and it does lead to a huge increase in the amount of information that needs to be tracked.

    elbieelbieelbie

Re: Downvoting Dilemma
by footpad (Abbot) on Aug 08, 2001 at 20:28 UTC

    While you have some interesting ideas that might be effective in certain ways, I believe there would be unfortunate side-effects. Several risks have already been expressed and I think there are others.

    I do believe there is a votebot problem. After all, a certain monk routinely receives a extreme number of downvotes per day, enough to adversely affect his XP if he choses to take a day off. Others get downvoted randomly.

    Personally, I'm pulled in multiple directions on the entire issue. After all, no matter the automated controls we implement, it's likely someone will find a way to work around them and continue to abuse the system. Furthermore, the time invested in actually implementing those controls would take away from other, better pursuits.

Another idea...
by mugwumpjism (Hermit) on Aug 08, 2001 at 18:27 UTC

    The whole idea of karma is that the yin balances the yang. So, why not have people give others their karma through the voting system rather than merely "using up their votes for the day"?

    The question of where karma comes from would need to be answered; I can think of all sorts of different ways that this could be achieved. People should get a certain amount of karma just from reading posts, and posting too. The amount you get should be based on how much you already have... so people who have reached higher karma levels have more to give away. ie, create karma when the site is getting more good content added to it.

    Just my 2¢

      That is a quite interesting idea; it could possible solve all these problems with up and down voting which worry so much to so many people. Let's elaborate the idea.

      • If someone vote for a node, some karma is given from his or her pool, while it is positive. Therefore, if someone votes, he or she is positively saying that is interested on the node contents.
      • The amount of karma received depends on the karma of the giver. Thus, people with highest karma levels would give the higher amount of karma, and viceversa. But this should be done without penalizing to higher karma owners.
      • Downvotes could be completely removed from the system. No downvotes, no personality downvoting.
      • As giving a vote implies losing own karma, no reason to create and/or use a votebot ever exists.
      • Some way to create karma is needed. I can think of a some of them:
        • just making a new node, even if only a small quantity of karma
        • getting a vote in an own node
        • login into perlmonks (as it happens right now)

      The result of all these points would be that karma would naturally accumulate in people with the best nodes. At the same time, personality voting and votebots would become unnecesary.

      On the other way, a malicious person could abuse the system anyway; apart of creating fake personalities, someone could decide never to vote, thus keeping all his or her karma. A way to avoid this is to "degrade" karma with time, so that karma is lost if not given to others.

        Downvotes could be completely removed from the system. No downvotes, no personality downvoting.

        Yes. But if we are to model things on a pain/reward system, then there needs to be an element of pain. But I think the scope of this could be reduced to editorial decisions.

        A way to avoid this is to "degrade" karma with time, so that karma is lost if not given to others.

        Brilliant. Perhaps it could grow the more hands it passes through? Perhaps the difference in levels between the recipient and the sender could come into play to determine this growth.

Re: Downvoting Dilemma
by Moonie (Friar) on Aug 09, 2001 at 04:09 UTC
    I really like the option for the Null Vote. It'll hopefully solve the problem with voting just for curiousity sake. The other two options don't seem ideal. I can see your point about discourging downvotes, but at times downvoting is a necessity (to delete a node) or used if a node is incorrect or if a user does not agree with the author (it is their right I think to voice their feedback). Another monk mentioned that losing XP on voting on a node that has a high reputation is punishing the monk who votes later... I don't believe that's fair. Regardless of the repuation for the node, I don't think the monk voting should lose any XP, but possibly just not gain any XP. Hence, you won't gain anything from downvoting, other than voicing your feedback to the author. Also, I disagree about posting a user's percentages. I'm not completely againist it, I just don't see the point. Are you going to try to use embarrassment to force people not to downvote? I don't think that's very reasonable. Granted, I'm all for trying to minimize the effects of downvoting based on who you are, as well as votebots. I just don't agree with that particular tatic. - Moon
Re: Downvoting Dilemma
by blakem (Monsignor) on Aug 09, 2001 at 10:12 UTC
    Whewww, that certainly got a lot of discussion. Rather than address each post individually, I'll attempt to summarize all my thoughts here on one node.

    Null vote option -- Not much opposition to this one, most people seem to like it (or at least not dislike it.) It's an implementation issue more than anything.

    Public upvote/downvote percentage -- I thought there would be more concern about this one, since it violates one of the core issues of voting, namely that it is private and confidential. I'm a bit squemish on this one, but I didn't here too many complaints, probably due to its aggregate nature.

    Possible loss of XP for downvotes -- This seemed to be much more controversial than the other two. Unfortunately, I think it might also be the most effective at curtailing the personality votebots that seem to be the most troublesome.

    Put yourself in the position of a votebot writer. As the system stands now abusing the system is trivial. Grab the links off of someones home node, then downvote any of them that you haven't already voted on. As an added bonus, you get XP for doing it, which means that tomorrow (or next week) you'll be able to cast more downvotes. The problem gets worse as time goes on.

    Now consider a system, where on average even a smart votebot would lose XP. Over time, it will start to lose votes (if you just look a the votebot part of the persona) and the problem begins to correct itself.

    The trick is to design such a system. (yes this does smack of an arms race, but vroom gets to set the rules, so it should be possible to win this one) Assuming that the voting system is mostly functional (which I think we can all agree to) a nodes rep has some correlation to its overall relevance to this site. Therefore, a downvote on a highly ranked node is likely to be a downvote on a highly relavent node.

    I would even argue that time plays a factor as well. Over a span of time a nodes rep gains a higher and higher correspondence with its relavence. Therefore, downvoting older nodes (say like 1 week ago) also seems suspect.

    The possiblity of losing XP would be:
    1.) Proportional to the current nodes rep
    2.) Proportional to the current nodes age (in days, not minutes)
    3.) Inversely proportional to the voters upvote/downvote percentage

    If these rules were in place, gaining XP with a downvoting votebot would be very difficult. You'd have to grab recent posts that weren't highly ranked, and have to keep your upvote percentage above some threshold. This severely limits the possibilities of abuse. It would also allow targets to take a day off without getting attacked, because there wouldn't be any "safe" nodes to downvote.

    -Blake

Re: Downvoting Dilemma
by adamsj (Hermit) on Aug 08, 2001 at 21:13 UTC
    I'm not very concerned with changes 1 or 3, but I think 2 is overcomplicated. I'd rather see a straight "one downvote equals one XP lost by the caster". A downvote is different from an upvote in obvious ways--in particular, unlike an upvote, a downvote can be cast maliciously. So my feeling is that if someone feels strongly enough about a node to downvote it, then let them put their money...er, their XP...where their mouth is.

    Update: In response to Masem's comment below, let me note that using votebots to upvote a central account is improper but not malicious. There's a limit to what can be done, and I'm in favor of doing what can be done to restrict malicious behavior directed at individuals without unreasonably restricting what the general population can do. I'm also inclined to think that discouraging quick reaping of nodes is a Good Thing.

    I do agree that downvotes aren't inherently malicious.

    I also think it's odd that we tell people to just shrug it off when they're hit with massive XP loss through snipering but balk at a single XP-- for voluntary action--even if it's in the public good, sometimes you have to pay for it.

    adamsj

    They laughed at Joan of Arc, but she went right ahead and built it. --Gracie Allen

      But you can also use upvotes maliciously too; if one had several low-level accounts that upvoted anything on a main account, it's just as bad as votebots downvoting someone else.

      In addition, there's times where a downvote is not being used maliciously; one example is to help prevent flames and derogatory posts from the site. In this case, the voter that helps to downvote and invoke nodereaper is doing the site a favor, and should not be punished for it.

      I don't think that beyond trying to find votebots and remove them, there's much that can be done to improve the downvoting problem. At least, through modification of the moderation system without hurting other parts of it that already work well.

      -----------------------------------------------------
      Dr. Michael K. Neylon - mneylon-pm@masemware.com || "You've left the lens cap of your mind on again, Pinky" - The Brain

Re: Downvoting Dilemma
by petral (Curate) on Aug 09, 2001 at 04:38 UTC
    One thing that always stops me when I'm trying to devise schemes to discourage (down)vote-bots is that it just leads into an arms race. The idea of posting percents is horrible anyway, but it also would just result in slightly more complicated bots.

      p