Show simple item record

dc.contributor.authorChambers, Lucy
dc.contributor.authorCunningham, Euan
dc.date.accessioned2022-05-11T17:00:06Z
dc.date.available2022-05-11T17:00:06Z
dc.date.issued2022-04-27
dc.date.submitted2021-10-26
dc.identifier.issn2504-284X
dc.identifier.urihttps://www.repository.cam.ac.uk/handle/1810/337037
dc.description.abstract<jats:p>When completing a comparative judgment (CJ) exercise, judges are asked to make holistic decisions about the quality of the work they are comparing. A key consideration is the validity of expert judgements. This article details a study where an aspect of validity, whether or not judges are attending to construct-irrelevant features, was investigated. There are a number of potentially construct-irrelevant features indicated in the assessment literature, and we focused on four features: appearance; handwriting; spelling, punctuation, and grammar (SPaG); and missing response vs. incorrect answer. This study explored this through an empirical experiment supplemented by judge observation and survey. The study was conducted within an awarding organisation. The particular context was within a programme of work trialling, a new method of maintaining examination standards involving the comparative judgement of candidates’ examination responses from the same subject from two different years. Judgements in this context are cognitively demanding, and there is a possibility that judges may attend to superficial features of the responses they are comparing. It is, therefore, important to understand how CJ decisions are made and what they are or are not based on so that we can have confidence in judgements and know that any use of them is valid.</jats:p>
dc.languageen
dc.publisherFrontiers Media SA
dc.subjectEducation
dc.subjectcomparative judgment
dc.subjectstandard maintaining
dc.subjectconstruct-irrelevance
dc.subjectvalidity
dc.subjectassessment
dc.titleExploring the Validity of Comparative Judgement: Do Judges Attend to Construct-Irrelevant Features?
dc.typeArticle
dc.date.updated2022-05-11T17:00:05Z
prism.publicationNameFrontiers in Education
prism.volume7
dc.identifier.doi10.17863/CAM.84459
dcterms.dateAccepted2022-03-14
rioxxterms.versionofrecord10.3389/feduc.2022.802392
rioxxterms.versionVoR
rioxxterms.licenseref.urihttp://creativecommons.org/licenses/by/4.0/
dc.identifier.eissn2504-284X
cam.issuedOnline2022-04-27


Files in this item

Thumbnail
Thumbnail
Thumbnail

This item appears in the following Collection(s)

Show simple item record