Repository logo
 

Quantifying marker agreement: terminology, statistics and issues

Published version
Peer-reviewed

Change log

Authors

Bramley, Tom 

Abstract

One challenge facing assessment agencies is in choosing the appropriate statistical indicators of marker agreement for communicating to different audiences. This task is not made easier by the wide variety of terminology in use, and differences in how the same terms are sometimes used. The purpose of this article is to provide a brief overview of: i) the different terminology used to describe indicators of marker agreement; ii) some of the different statistics which are used and; iii) the issues involved in choosing an appropriate indicator and its associated statistic. It is hoped that this will clarify some ambiguities which are often encountered, and contribute to a more consistent approach in reporting research in this area.

Description

Keywords

Marking, Examination statistics

Journal Title

Research Matters

Conference Name

Journal ISSN

Volume Title

Publisher

Research Division, Cambridge University Press & Assessment

Publisher DOI

Publisher URL

Relationships