PuSH - Publication Server of Helmholtz Zentrum München

Kreuzpointner, L.* ; Simon, P.* ; Theis, F.J.

The ad coefficient as a descriptive measure of the within-group agreement of ratings.

Br. J. Math. Stat. Psychol. 63, 341-360 (2010)
Postprint DOI Order publishers version
Open Access Green
The a(d) coefficient was developed to measure the within-group agreement of ratings. The underlying theory as well as the construction of the coefficient are explained. The a(d) coefficient ranges from 0 to 1, regardless of the number of scale points, raters, or items. With some limitations the measure of the within-group agreement of different groups and groups from different studies is directly comparable. For statistical significance testing, the binomial distribution is introduced as a model of the ratings' random distribution given the true score of a group construct. This method enables a decision about essential agreement and not only about a significant difference from 0 or a chosen critical value. The a(d) coefficient identifies a single true score within a group. It is not provided for multiple true score settings. The comparison of the a(d) coefficient with other agreement indices shows that the new coefficient is in line with their outcomes, but does not result in infinite or inappropriate values.
Additional Metrics?
Edit extra informations Login
Publication type Article: Journal article
Document type Scientific Article
Keywords interrater agreement; reliability; r(wg); indexes
ISSN (print) / ISBN 0007-1102
e-ISSN 2044-8317
Quellenangaben Volume: 63, Issue: 2, Pages: 341-360 Article Number: , Supplement: ,
Publisher Wiley
Reviewing status Peer reviewed