KNAW

Publication

Measuring Agreement in Ordered Rating Scales (2001)

Pagina-navigatie:
Title Measuring Agreement in Ordered Rating Scales
Published in Quality and Quantity, Vol. 35, p.325-341. ISSN 0033-5177.
Author Eijk, van der Cees
Date 2001
Type article
Publisher Kluwer Academic
Abstract Ordered rating scales are one of the most frequently used question formats in large-scale surveys. Analysts of the responses to such questions often find themselves in need of describing the degree of agreement (concentration, consensus) of the answers to such questions. For that purpose they commonly use standard deviations of the response distributions, or measures based on these (such as the coefficient of consensus defined by Granberg and Holmberg, 1988), or the coefficient of variability, etc. This paper demonstrates that such measures are inappropriate for this purpose because they misrepresent what they are supposed to measure: the `peakedness' of a distribution. As an alternative a measure of agreement A is proposed. This measure is a weighted average of the degree of agreement that exists in the simple component parts – layers – into which any frequency distribution can be disaggregated, and for which agreement can be expressed in a straightforward and unequivocal way.
Publication http://purl.utwente.nl/publications/61236
OpenURL Search this publication in (your) library
Persistent Identifier URN:NBN:NL:UI:28-61236
Metadata XML
Repository University of Twente
University of Twente

Go to page top
Go back to contents
Go back to site navigation