Replications, Comparisons, Sampling and the Problem of Representativeness in Animal Cognition Research.
Published version
Peer-reviewed
Repository URI
Repository DOI
Change log
Authors
Abstract
Animal cognition research often involves small and idiosyncratic samples. This can constrain the generalizability and replicability of a study's results and prevent meaningful comparisons between samples. However, there is little consensus about what makes a strong replication or comparison in animal research. We apply a resampling definition of replication to answer these questions in Part 1 of this article, and, in Part 2, we focus on the problem of representativeness in animal research. Through a case study and a simulation study, we highlight how and when representativeness may be an issue in animal behavior and cognition research and show how the representativeness problems can be viewed through the lenses of, i) replicability, ii) generalizability and external validity, iii) pseudoreplication and, iv) theory testing. Next, we discuss when and how researchers can improve their ability to learn from small sample research through, i) increasing heterogeneity in experimental design, ii) increasing homogeneity in experimental design, and, iii) statistically modeling variation. Finally, we describe how the strongest solutions will vary depending on the goals and resources of individual research programs and discuss some barriers towards implementing them.
Description
Keywords
Journal Title
Conference Name
Journal ISSN
2372-4323
Volume Title
Publisher
Publisher DOI
Sponsorship
Biotechnology and Biological Sciences Research Council (BB/M011194/1)