Beefy Boxes and Bandwidth Generously Provided by pair Networks
We don't bite newbies here... much
 
PerlMonks  

Re: Perl Developer Survey 2017 results are available (doctored) (updated)

by LanX (Saint)
on Apr 27, 2017 at 17:07 UTC ( [id://1189071]=note: print w/replies, xml ) Need Help??


in reply to Perl Developer Survey 2017 results are available

I'm afraid, it looks like the results were doctored.

If you look at the total respondents for Q15 (the editor) question it must be 1102 not 849, the percentages in the chart make sense then. (ie 519/1102 = 0,47 for VIM and so on)

BUT the other questions before seem to have accurate totals around ~840.

Sorry, this isn't very likely, if you ever conducted a poll yourself you'd know that people tend to get tired quickly, a question in the middle wouldn't suddenly attract 30% more respondents.

Probably an over motivated user added 253 responses here, (most likely for the evil editor. ;-)

edit

Already the third phrase of this blog entry says: We have received 849 responses from developers from all over the world.

update

also Q23 (produced apps) and Q17 (web frameworks) have anomalies

update

this makes sense, if Q17 was manipulated consequently Q23 must be also.

Looks like a fanboy for web-apps and editors was active here.

Cheers Rolf
(addicted to the Perl Programming Language and ☆☆☆☆ :)
Je suis Charlie!

PS: see also Re^4: Perl Developer Survey 2017 results are available (wrong math)

  • Comment on Re: Perl Developer Survey 2017 results are available (doctored) (updated)

Replies are listed 'Best First'.
Re^2: Perl Developer Survey 2017 results are available (emacs less popular)
by tye (Sage) on Apr 28, 2017 at 14:12 UTC

    Come on, the math is not hard here. The question allowed multiple responses and in one case the division was done using the number of responders instead of using the number of responses.

    And you got your conspiracy exactly backward. The result was to artificially inflate the percentage reported for emacs.

    $ say '85+65+78+519+355' 1102 $ say '85/11.02,65/11.02,78/11.02,519/11.02,355/11.02' 7.71324863883848 5.8983666061706 7.07803992740472 47.0961887477314 32.2141560798548 $ say 138/11.02 12.5226860254083

    So just drop emacs' popularity from the reported 16.25% to the correct 12.5%.

    All that is left is to figure out if the mistake was motivated by the preparer being an emacs fan or because they felt sorry for emacs fans and whether it was intentional or accidental. q-:

    Update: Oh, and the percentages reported for Notepad++, Eclipse, and VisualStudio might well also be inflated by x1.3 (hard to say for sure since the counts were not reported for them).

    Update: Though, I kind of find the 30% higher percentages more accurate. The problem was probably that they put the counts into the graph software and it is what provided the percentages. Makes me wish for a "Venn diagram" chart where the area of each shape is proportional to the number of people who chose that option and the areas of the overlaps between shapes is also proportional (to the number of people who chose all of the corresponding options).

    - tye        

      Hi Tye

      welcome back to the monastery! :)

      I figured that out already, and I'm not such a fanboy that I care about the results of a bad survey.

      But I care about bad math and fake news. Nowadays more than ever.

      My theory is that the questions were single choice, but the other option allowed free text were multiple editors were inserted.

      Anyway a decent survey would at least

      • avoid opinionated choices
      • publish the original data
      • keep a snap shot of the original survey online
      Otherwise we'll never know, that's why I give up.

      Regarding venn diagram, this wouldn't be possible in many cases.

      Imho the best representation is a hasse diagram.

      Cheers Rolf
      (addicted to the Perl Programming Language and ☆☆☆☆ :)
      Je suis Charlie!

        "I'm not such a fanboy that I care about the results of a bad survey."

        Yet here you are ... dong that very thing as that very role.

      Additionally I also identified the web framework question as contradictory.

      I don't know how good this survey site can defy bots only responding for 3 questions.

      Cheers Rolf
      (addicted to the Perl Programming Language and ☆☆☆☆ :)
      Je suis Charlie!

        Keep scratching that itch until it becomes reality ...
Re^2: Perl Developer Survey 2017 results are available (doctored) (updated)
by ikegami (Patriarch) on Apr 27, 2017 at 19:45 UTC

    Or maybe that question allowed respondants to provide multiple responses.

      If that is the case, the results are presented in a very bad way.

      Several numbers are contradicting and percentages are taken from different totals.

      And the gap - the supposed multiple votes - at all 3 questions is always about 30%.

      I might have a theory what happened but I'm tired now.

      Let's hope the next survey is better prepared.

      Cheers Rolf
      (addicted to the Perl Programming Language and ☆☆☆☆ :)
      Je suis Charlie!

Re^2: Perl Developer Survey 2017 results are available (doctored) (updated)
by Your Mother (Archbishop) on Apr 27, 2017 at 19:22 UTC

    You act like numbers mean something or are absolute values. They are just an invention of Western society to hold down the… blah, blah, blah… Bonk! Bonk! On the head!

    It’s long established that vi vi vi is the editor of The Beast. :P

      It is not what things are objectively and in themselves, but what they are for us, in our way of looking at them, that makes us happy or the reverse. As Epictetus says, Men are not influenced by things, but by their thoughts about things.
      -- Arthur Schopenhauer (1788 - 1860): The Wisdom of Life
      I think that is visible especially in nowaday's politics…

        Schopenhauer. :P Now there is a buzzkill. That desire for things to mean what one wants instead of what they mean in reality is exactly the attitude I was ridiculing. And I like my Star Trek references.

      > vi vi vi is the editor of The Beast.

      Bless St IGNUcius, holy holy holy! =)

      On a more serious note: I don't care about the real percentages of editors or web-frameworks.

      I care about manipulated truth!

      30% of all responses covered only 3 out of 31 questions without being noted?

      Seriously?

      Cheers Rolf
      (addicted to the Perl Programming Language and ☆☆☆☆ :)
      Je suis Charlie!

Re^2: Perl Developer Survey 2017 results are available
by Anonymous Monk on Apr 27, 2017 at 19:17 UTC

    Joking aside now: this must have been a multiple-choice question. All we know is that some people use more than one IDE, while 596+ respondents only use one.

        Surely you jest, brother LanX? That was almost 2 months ago. I can barely remember what I had for lunch yesterday.

        There were certainly some questions where multiple answers were available, eg. "Q5 What other languages do you use?" but I don't immediately recall if the IDE question was one of them as I would not have entered multiple answers there anyway.

        The survey is useful in a qualitative fashion but I agree that the results could have been better presented. It's unclear whether that's the fault of BiP or of surveyplanet.com (or both).

        I don’t recall that it was but my memory is not reliable at this point in time. I filled in ☑ Other: Emacs. I have been forced to develop in Notepad from time to time and I like Atom and TextMate.

Re^2: Perl Developer Survey 2017 results are available (doctored)
by Anonymous Monk on Apr 27, 2017 at 17:16 UTC
    "I'm afraid, it looks like the results were doctored."

    I'm afraid you have no qualifications and as such, have no legs to stand on. You simply don't LIKE the results.

Re^2: Perl Developer Survey 2017 results are available (obvious) (obvious)
by Anonymous Monk on Apr 27, 2017 at 18:49 UTC

    All it takes for evil to Trump is for good men to do nothing. -- Abraham Lincoln

    :wq

      I'm intimidated by the fear of being average. –Adolf Hitler

      Rumor has it he was also terrified of misattributing historical quotes.

        oh noes! Godwin's Law such soon?

        perl -le'print map{pack c,($-++?1:13)+ord}split//,ESEL'

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://1189071]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others studying the Monastery: (5)
As of 2024-04-24 23:20 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found