Inter Annotator Agreement

Dr Manhattan has asked for the wisdom of the Perl Monks concerning the following question:

Replies are listed 'Best First'.
Re: Inter Annotator Agreement by BrowserUk (Patriarch) on Mar 22, 2013 at 09:27 UTC
A google search for your title term -- because I'd never heard of it and was curious -- turned up this as the second hit. (Your post above was the first.) Since I know nothing of the subject, I can't comment on its "decency" :) With the rise and rise of 'Social' network sites: 'Computers are making people easier to use everyday' Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error. "Science is about questioning the status quo. Questioning authority". In the absence of evidence, opinion is indistinguishable from prejudice.	[reply]
Re: Inter Annotator Agreement by choroba (Cardinal) on Mar 22, 2013 at 15:29 UTC
It really depends on what your annotators are annotating. I can hand you a script to compare tectogrammatical annotation of sentences in PML, but I doubt that's what you need. لսႽ† ᥲᥒ⚪⟊Ⴙᘓᖇ Ꮅᘓᖇ⎱ Ⴙᥲ𝇋ƙᘓᖇ	[reply]
Re: Inter Annotator Agreement by blue_cowdawg (Monsignor) on Mar 22, 2013 at 12:47 UTC
Does anybody know where I can find a decent IAA script? Good luck with that... Perhaps one of the folks really into statistics here at PM could shed some light. Reading the Wikipedia entry made my head hurt. Peter L. Berghold -- Unix Professional Peter -at- Berghold -dot- Net; AOL IM redcowdawg Yahoo IM: blue_cowdawg	[reply]
Re: Inter Annotator Agreement by Anonymous Monk on Mar 22, 2013 at 12:56 UTC
Sounds @CLASSIFIED@ to me.	[reply]