Quantifying marker agreement: terminology, statistics and issues
Published version
Peer-reviewed
Repository URI
Repository DOI
Type
Article
Change log
Authors
Bramley, Tom
Abstract
One challenge facing assessment agencies is in choosing the appropriate statistical indicators of marker agreement for communicating to different audiences. This task is not made easier by the wide variety of terminology in use, and differences in how the same terms are sometimes used. The purpose of this article is to provide a brief overview of: i) the different terminology used to describe indicators of marker agreement; ii) some of the different statistics which are used and; iii) the issues involved in choosing an appropriate indicator and its associated statistic. It is hoped that this will clarify some ambiguities which are often encountered, and contribute to a more consistent approach in reporting research in this area.
Description
Keywords
Marking, Examination statistics
Journal Title
Research Matters
Conference Name
Journal ISSN
Volume Title
Publisher
Research Division, Cambridge University Press & Assessment