Repository logo
 

Software tools to support title and abstract screening for systematic reviews in healthcare: an evaluation.

Accepted version
Peer-reviewed

Change log

Authors

Griffin, Simon J 
Kuhn, Isla 
Usher-Smith, Juliet A 

Abstract

BACKGROUND: Systematic reviews are vital to the pursuit of evidence-based medicine within healthcare. Screening titles and abstracts (T&Ab) for inclusion in a systematic review is an intensive, and often collaborative, step. The use of appropriate tools is therefore important. In this study, we identified and evaluated the usability of software tools that support T&Ab screening for systematic reviews within healthcare research. METHODS: We identified software tools using three search methods: a web-based search; a search of the online "systematic review toolbox"; and screening of references in existing literature. We included tools that were accessible and available for testing at the time of the study (December 2018), do not require specific computing infrastructure and provide basic screening functionality for systematic reviews. Key properties of each software tool were identified using a feature analysis adapted for this purpose. This analysis included a weighting developed by a group of medical researchers, therefore prioritising the most relevant features. The highest scoring tools from the feature analysis were then included in a user survey, in which we further investigated the suitability of the tools for supporting T&Ab screening amongst systematic reviewers working in medical research. RESULTS: Fifteen tools met our inclusion criteria. They vary significantly in relation to cost, scope and intended user community. Six of the identified tools (Abstrackr, Colandr, Covidence, DRAGON, EPPI-Reviewer and Rayyan) scored higher than 75% in the feature analysis and were included in the user survey. Of these, Covidence and Rayyan were the most popular with the survey respondents. Their usability scored highly across a range of metrics, with all surveyed researchers (n = 6) stating that they would be likely (or very likely) to use these tools in the future. CONCLUSIONS: Based on this study, we would recommend Covidence and Rayyan to systematic reviewers looking for suitable and easy to use tools to support T&Ab screening within healthcare research. These two tools consistently demonstrated good alignment with user requirements. We acknowledge, however, the role of some of the other tools we considered in providing more specialist features that may be of great importance to many researchers.

Description

Keywords

Feature analysis, Screening, Software tools, Systematic reviews, Title and abstract, Abstracting and Indexing, Biomedical Research, Delivery of Health Care, Evidence-Based Medicine, Humans, Software, Surveys and Questionnaires, Systematic Reviews as Topic

Journal Title

BMC Med Res Methodol

Conference Name

Journal ISSN

1471-2288
1471-2288

Volume Title

20

Publisher

Springer Science and Business Media LLC

Rights

All rights reserved
Sponsorship
Medical Research Council (MC_UU_12015/4)
Cancer Research UK (21464)
Department of Health (via National Institute for Health Research (NIHR)) (RM-SR-2017-09-009)
HH is funded by a National Institute for Health Research NIHR Systematic Review Fellowship, RM-SR-2017-09-009. JUS is funded by a Cancer Research UK Prevention Fellowship (C55650/A21464). The University of Cambridge has received salary support in respect of SJG from the NHS in the East of England through the Clinical Academic Reserve.