Repository logo
 

Disentangling Item and Testing Effects in Inoculation Research on Online Misinformation: Solomon Revisited.

Published version
Peer-reviewed

Type

Article

Change log

Authors

Maertens, Rakoen 
McClanahan, William 
van der Linden, Sander 

Abstract

Online misinformation is a pervasive global problem. In response, psychologists have recently explored the theory of psychological inoculation: If people are preemptively exposed to a weakened version of a misinformation technique, they can build up cognitive resistance. This study addresses two unanswered methodological questions about a widely adopted online "fake news" inoculation game, Bad News. First, research in this area has often looked at pre- and post-intervention difference scores for the same items, which may imply that any observed effects are specific to the survey items themselves (item effects). Second, it is possible that using a pretest influences the outcome variable of interest, or that the pretest may interact with the intervention (testing effects). We investigate both item and testing effects in two online studies (total N = 2,159) using the Bad News game. For the item effect, we examine if inoculation effects are still observed when different items are used in the pre- and posttest. To examine the testing effect, we use a Solomon's Three Group Design. We find that inoculation interventions are somewhat influenced by item effects, and not by testing effects. We show that inoculation interventions are effective at improving people's ability to spot misinformation techniques and that the Bad News game does not make people more skeptical of real news. We discuss the larger relevance of these findings for evaluating real-world psychological interventions.

Description

Keywords

Bad News, Solomon’s Three Group Design, fake news, inoculation theory, misinformation

Journal Title

Educ Psychol Meas

Conference Name

Journal ISSN

0013-1644
1552-3888

Volume Title

81

Publisher

SAGE Publications
Sponsorship
ESRC (ES/V011960/1)
Economic and Social Research Council (2268886)