TY - JOUR
T1 - A measure of reliability using qualitative data
AU - Koslowsky, Meni
AU - Bailit, Howard
N1 - Funding Information:
1 This work was supported, in part, by Contract NIH-72-4207 from the Division of Dental Health, National Institutes of Health, Public Health Service. The authors would like to thank Paula Valluzzo and Paula Atwood for their help in collecting the data.
PY - 1975/12
Y1 - 1975/12
N2 - In many research activities, the data is unordered or qualitative. In such circumstances, inter-rater reliability is usually measured by calculating a percentage of agreement score between judges. The present paper expands on an equation first introduced by Goodman and Kruskal for obtaining a reliability measure of one item. This formula determines inter-rater reliability for a series of items across many subjects. The statistic that results is easily interpreted and in many ways is analogous to the conventional reliability for quantitative data.
AB - In many research activities, the data is unordered or qualitative. In such circumstances, inter-rater reliability is usually measured by calculating a percentage of agreement score between judges. The present paper expands on an equation first introduced by Goodman and Kruskal for obtaining a reliability measure of one item. This formula determines inter-rater reliability for a series of items across many subjects. The statistic that results is easily interpreted and in many ways is analogous to the conventional reliability for quantitative data.
UR - http://www.scopus.com/inward/record.url?scp=84965905608&partnerID=8YFLogxK
U2 - 10.1177/001316447503500411
DO - 10.1177/001316447503500411
M3 - ???researchoutput.researchoutputtypes.contributiontojournal.article???
AN - SCOPUS:84965905608
SN - 0013-1644
VL - 35
SP - 843
EP - 846
JO - Educational and Psychological Measurement
JF - Educational and Psychological Measurement
IS - 4
ER -