Repository logo
 

The harvest plot: a method for synthesising evidence about the differential effects of interventions.


Change log

Authors

Fayter, Debra 
Petticrew, Mark 
Sowden, Amanda 
Thomas, Sian 

Abstract

BACKGROUND: One attraction of meta-analysis is the forest plot, a compact overview of the essential data included in a systematic review and the overall 'result'. However, meta-analysis is not always suitable for synthesising evidence about the effects of interventions which may influence the wider determinants of health. As part of a systematic review of the effects of population-level tobacco control interventions on social inequalities in smoking, we designed a novel approach to synthesis intended to bring aspects of the graphical directness of a forest plot to bear on the problem of synthesising evidence from a complex and diverse group of studies. METHODS: We coded the included studies (n = 85) on two methodological dimensions (suitability of study design and quality of execution) and extracted data on effects stratified by up to six different dimensions of inequality (income, occupation, education, gender, race or ethnicity, and age), distinguishing between 'hard' (behavioural) and 'intermediate' (process or attitudinal) outcomes. Adopting a hypothesis-testing approach, we then assessed which of three competing hypotheses (positive social gradient, negative social gradient, or no gradient) was best supported by each study for each dimension of inequality. RESULTS: We plotted the results on a matrix ('harvest plot') for each category of intervention, weighting studies by the methodological criteria and distributing them between the competing hypotheses. These matrices formed part of the analytical process and helped to encapsulate the output, for example by drawing attention to the finding that increasing the price of tobacco products may be more effective in discouraging smoking among people with lower incomes and in lower occupational groups. CONCLUSION: The harvest plot is a novel and useful method for synthesising evidence about the differential effects of population-level interventions. It contributes to the challenge of making best use of all available evidence by incorporating all relevant data. The visual display assists both the process of synthesis and the assimilation of the findings. The method is suitable for adaptation to a variety of questions in evidence synthesis and may be particularly useful for systematic reviews addressing the broader type of research question which may be most relevant to policymakers.

Description

Keywords

Data Interpretation, Statistical, Health Promotion, Humans, Meta-Analysis as Topic, Outcome Assessment, Health Care, Preventive Health Services, Smoking Cessation, Smoking Prevention, Socioeconomic Factors, Statistical Distributions

Journal Title

BMC Med Res Methodol

Conference Name

Journal ISSN

1471-2288
1471-2288

Volume Title

Publisher

Springer Science and Business Media LLC
Sponsorship
Medical Research Council (G106/1203)
Medical Research Council (MC_UU_12015/4)
Medical Research Council (MC_U106179474)