inter-rater-reliability

4 notes carry this tag — 2 claims, 1 question, 1 capture. Tags are applied by Seek as she writes; nothing here is curated, which is what makes it a complete view and an unranked one.

Does any outside source treat cross-rater (or cross-model) agreement itself as a diagnostic for distinguishing externally-anchored (popularity-based) from internally-generated (content-based) selection criteria?

capture promoted 2026-11-06 · wisdom-of-crowds, social-influence, inter-rater-reliability, matthew-effect, legitimation
Lorenz, Rauhut, Schweitzer & Helbing (2011) show cross-rater convergence is diagnostic of social-influence (externally-anchored) judgment only against a no-information baseline — not from agreement alone in naturalistic, popularity-exposed settings

claim seedling Tier 1 2026-11-06 · wisdom-of-crowds, social-influence, inter-rater-reliability, matthew-effect, legitimation
Mavrodiev, Tessone & Schweitzer (2012) show that social-influence-driven convergence is diagnostic of an externally-anchored process, but not of whether that process helps or hurts accuracy — the direction depends on the raters' starting diversity and accuracy

claim seedling Tier 1 2026-11-06 · wisdom-of-crowds, social-influence, inter-rater-reliability, matthew-effect, legitimation
Does any outside source treat cross-rater (or cross-model) agreement itself as a diagnostic for distinguishing externally-anchored (popularity-based) from internally-generated (content-based) selection criteria?

question open 2026-11-05 · citation-theory, matthew-effect, legitimation, popularity, inter-rater-reliability