Repository logo
 

Replications, Comparisons, Sampling and the Problem of Representativeness in Animal Cognition Research.

Published version
Peer-reviewed

Type

Article

Change log

Authors

Farrar, Benjamin G 
Voudouris, Konstantinos 
Clayton, Nicola S 

Abstract

Animal cognition research often involves small and idiosyncratic samples. This can constrain the generalizability and replicability of a study's results and prevent meaningful comparisons between samples. However, there is little consensus about what makes a strong replication or comparison in animal research. We apply a resampling definition of replication to answer these questions in Part 1 of this article, and, in Part 2, we focus on the problem of representativeness in animal research. Through a case study and a simulation study, we highlight how and when representativeness may be an issue in animal behavior and cognition research and show how the representativeness problems can be viewed through the lenses of, i) replicability, ii) generalizability and external validity, iii) pseudoreplication and, iv) theory testing. Next, we discuss when and how researchers can improve their ability to learn from small sample research through, i) increasing heterogeneity in experimental design, ii) increasing homogeneity in experimental design, and, iii) statistically modeling variation. Finally, we describe how the strongest solutions will vary depending on the goals and resources of individual research programs and discuss some barriers towards implementing them.

Description

Keywords

Animal cognition, Comparison, Experimental design, Generalizability, Replication, Representativeness, Sampling

Journal Title

Anim Behav Cogn

Conference Name

Journal ISSN

2372-5052
2372-4323

Volume Title

8

Publisher

Animal Behavior and Cognition
Sponsorship
BBSRC (1943419)
Biotechnology and Biological Sciences Research Council (BB/M011194/1)
BGF was supported by the University of Cambridge BBSRC Doctoral Training Programme (BB/M011194/1).