Show simple item record

dc.contributor.authorChristie, Alecen
dc.contributor.authorAmano, Tatsuyaen
dc.contributor.authorMartin, Philipen
dc.contributor.authorShackelford, Gormen
dc.contributor.authorSimmons, Bennoen
dc.contributor.authorSutherland, Williamen
dc.date.accessioned2019-09-04T23:30:55Z
dc.date.available2019-09-04T23:30:55Z
dc.date.issued2019-12-01en
dc.identifier.issn0021-8901
dc.identifier.urihttps://www.repository.cam.ac.uk/handle/1810/296425
dc.description.abstractMonitoring the impacts of anthropogenic threats and interventions to mitigate these threats is key to understanding how to best conserve biodiversity. Ecologists use many different study designs to monitor such impacts. Simpler designs lacking controls (e.g. Before-After (BA) and After) or pre-impact data (e.g. Control-Impact (CI)) are considered to be less robust than more complex designs (e.g. Before-After Control-Impact (BACI) or Randomised Controlled Trials (RCTs)). However, we lack quantitative estimates of how much less accurate simpler study designs are in ecology. Understanding this could help prioritise research and weight studies by their design’s accuracy in meta-analysis and evidence assessment. 2. We compared how accurately five study designs estimated the true effect of a simulated environmental impact that caused a step-change response in a population’s density. We derived empirical estimates of several simulation parameters from 47 ecological datasets to ensure our simulations were realistic. We measured design performance by determining the percentage of simulations where: (i) the true effect fell within the 95% Confidence Intervals of effect size estimates, and (ii) each design correctly estimated the true effect’s direction and magnitude. We also considered how sample size affected their performance. 3. We demonstrated that BACI designs performed: 1.3-1.8 times better than RCTs; 2.9-4.2 times vs BA; 3.2-4.6 times vs CI; and 7.1-10.1 times vs After designs (depending on sample size), when correctly estimating true effect’s direction and magnitude to within ±30%. Although BACI designs suffered from low power at small sample sizes, they outperformed other designs for almost all performance measures. Increasing sample size improved BACI design accuracy but only increased the precision of simpler designs around biased estimates. 4. Synthesis and applications. We suggest that more investment in more robust designs is needed in ecology since inferences from simpler designs, even with large sample sizes may be misleading. Facilitating this requires longer-term funding and stronger research-practice partnerships. We also propose ‘accuracy weights’ and demonstrate how they can weight studies in three recent meta-analyses by accounting for study design and sample size. We hope these help decision-makers and meta-analysts better account for study design when assessing evidence.
dc.publisherWiley
dc.rightsAll rights reserved
dc.rights.uri
dc.titleSimple study designs in ecology produce inaccurate estimates of biodiversity responsesen
dc.typeArticle
prism.endingPage2754
prism.issueIdentifier12en
prism.publicationDate2019en
prism.publicationNameJournal of Applied Ecologyen
prism.startingPage2742
prism.volume56en
dc.identifier.doi10.17863/CAM.43475
dcterms.dateAccepted2019-08-12en
rioxxterms.versionofrecord10.1111/1365-2664.13499en
rioxxterms.versionAM
rioxxterms.licenseref.urihttp://www.rioxx.net/licenses/all-rights-reserveden
rioxxterms.licenseref.startdate2019-12-01en
dc.contributor.orcidChristie, Alec [0000-0002-8465-8410]
dc.contributor.orcidAmano, Tatsuya [0000-0001-6576-3410]
dc.contributor.orcidMartin, Philip [0000-0002-6804-2720]
dc.contributor.orcidShackelford, Gorm [0000-0003-0949-0934]
dc.contributor.orcidSimmons, Benno [0000-0002-2751-9430]
dc.contributor.orcidSutherland, William [0000-0002-6498-0437]
dc.identifier.eissn1365-2664
rioxxterms.typeJournal Article/Reviewen
pubs.funder-project-idMAVA Fondation pour la Nature (14077)
pubs.funder-project-idNERC (NE/L002507/1)
rioxxterms.freetoread.startdate2020-08-31


Files in this item

Thumbnail

This item appears in the following Collection(s)

Show simple item record