A New Remote Guided Method for Supervised Web-Based Cognitive Testing to Ensure High Quality Data
dc.contributor.author | Leong, Victoria | |
dc.contributor.author | Raheel, Kausar | |
dc.contributor.author | Sim, Jia Yi | |
dc.contributor.author | Kacker, Kriti | |
dc.contributor.author | Karlaftis, Vasileios | |
dc.contributor.author | Vassiliu, Chrysoula | |
dc.contributor.author | Chen, SH Annabel | |
dc.contributor.author | Robbins, Trevor | |
dc.contributor.author | Sahakian, Barbara | |
dc.contributor.author | Kourtzi, Zoe | |
dc.date.accessioned | 2021-12-21T00:31:28Z | |
dc.date.available | 2021-12-21T00:31:28Z | |
dc.date.issued | 2022-01-06 | |
dc.identifier.issn | 1438-8871 | |
dc.identifier.uri | https://www.repository.cam.ac.uk/handle/1810/331640 | |
dc.description.abstract | Background. The global COVID-19 pandemic has triggered a fundamental reexamination of how human psychological research can be conducted both safely and robustly in a new era of digital working and physical distancing. Online web-based testing has risen to the fore as a promising solution for rapid mass collection of cognitive data without requiring human contact. However, a long-standing debate exists over the data quality and validity of web-based studies. Here, we examine the opportunities and challenges afforded by the societal shift toward web-based testing, highlight an urgent need to establish a standard data quality assurance framework for online studies, and develop and validate a new supervised online testing methodology, remote guided testing (RGT). Methods. A total of 85 healthy young adults were tested on 10 cognitive tasks assessing executive functioning (flexibility, memory and inhibition) and learning. Tasks were administered either face-to-face in the laboratory (N=41) or online using remote guided testing (N=44), delivered using identical web-based platforms (CANTAB, Inquisit and i-ABC). Data quality was assessed using detailed trial-level measures (missed trials, outlying and excluded responses, response times), as well as overall task performance measures. Results. The results indicated that, across all measures of data quality and performance, RGT data was statistically-equivalent to data collected in person in the lab. Moreover, RGT participants out-performed the lab group on measured verbal intelligence, which could reflect test environment differences, including possible effects of mask-wearing on communication. Conclusions. These data suggest that the RGT methodology could help to ameliorate concerns regarding online data quality and - particularly for studies involving high-risk or rare cohorts - offer an alternative for collecting high-quality human cognitive data without requiring in-person physical attendance. | |
dc.description.sponsorship | Biotechnology and Biological Sciences Research Council (H012508 and BB/P021255/1). Wellcome Trust (205067/Z/16/Z). | |
dc.publisher | JMIR Publications Inc. | |
dc.rights | Attribution 4.0 International | |
dc.rights.uri | https://creativecommons.org/licenses/by/4.0/ | |
dc.title | A New Remote Guided Method for Supervised Web-Based Cognitive Testing to Ensure High Quality Data | |
dc.type | Article | |
dc.publisher.department | Department of Psychology | |
dc.date.updated | 2021-12-18T07:07:11Z | |
prism.publicationDate | 2021 | |
prism.publicationName | Journal of Medical Internet Research | |
dc.identifier.doi | 10.17863/CAM.79071 | |
dcterms.dateAccepted | 2021-07-27 | |
rioxxterms.versionofrecord | 10.2196/28368 | |
rioxxterms.version | VoR | |
dc.contributor.orcid | Karlaftis, Vasileios [0000-0003-1285-1593] | |
dc.contributor.orcid | Robbins, Trevor [0000-0003-0642-5977] | |
dc.contributor.orcid | Sahakian, Barbara [0000-0001-7352-1745] | |
dc.contributor.orcid | Kourtzi, Zoe [0000-0001-9441-7832] | |
dc.identifier.eissn | 1438-8871 | |
rioxxterms.type | Journal Article/Review | |
pubs.funder-project-id | European Commission (290011) | |
pubs.funder-project-id | Wellcome Trust (205067/Z/16/Z) | |
pubs.funder-project-id | National Research Foundation Singapore (via Cambridge Centre for Advanced Research and Education in Singapore (CARES)) (NRF-CLIC) | |
pubs.funder-project-id | Biotechnology and Biological Sciences Research Council (BB/P021255/1) | |
pubs.funder-project-id | European Commission Horizon 2020 (H2020) Marie Sk?odowska-Curie actions (765121) | |
pubs.funder-project-id | European Commission Horizon 2020 (H2020) Marie Sk?odowska-Curie actions (840271) | |
cam.issuedOnline | 2022-01-06 | |
cam.orpheus.success | 2021-12-20 - Embargo set during processing via Fast-track | |
cam.depositDate | 2021-12-18 | |
pubs.licence-identifier | apollo-deposit-licence-2-1 | |
pubs.licence-display-name | Apollo Repository Deposit Licence Agreement | |
rioxxterms.freetoread.startdate | 2100-01-01 |
Files in this item
This item appears in the following Collection(s)
-
Cambridge University Research Outputs
Research outputs of the University of Cambridge