Systematic reviews are a key tool in the practice of evidence based medicine. Their findings and conclusions aim to support decision-making in health care practice and policy, but are also a valuable basis for future research. Systematic reviews synthesise and critically appraise all relevant evidence available regarding a specific research question using systematic methods (hence the name).
But how to make the methods systematic?
The answer is simple: By prospectively specifying them. Not only does this provide a roadmap for the review team, it also reduces the risk that the methods are being modified during the systematic review process depending on the results, thus introducing bias. For example, if I decided to report only certain outcomes and analyses because they have significant results, I would bias my systematic review’s results and conclusions.
Two transparent ways of prospectively specifying one’s methods are to publish a systematic review protocol as a peer-reviewed article and/or to register the systematic review in PROSPERO, the international prospective register of systematic reviews (1).
Publishing a systematic review protocol as a peer-reviewed article has the advantage that independent reviewers will critically appraise the proposed methods. While publishing protocols has long been the standard for Cochrane reviews, protocols for most other systematic reviews have only regularly been published from 2012 onwards. Nowadays several systematic review protocols are published each day, e.g. in the journals Systematic Reviews or BMJ Open.
PROSPERO records have the advantage that they can be updated throughout the review process to report important changes and to reflect the current status of the review (ongoing, completed, published or discontinued). Prospective registration of systematic reviews is possible since February 2011, when PROSPERO was launched. Since then, over 50,000 reviews have been registered (as of July 1, 2019)*.
These numbers demonstrate the success of past efforts, which also include the publication of a reporting guideline for systematic review protocols, the PRISMA-P checklist (2). Nevertheless, there are still various issues surrounding systematic review protocols and registration, some of which I have investigated in my research:
Therefore, I believe that we need further innovation in the field of systematic review protocols and registration. We should discuss alternative models of peer review for systematic review protocols, agree on guidance on the reporting of discrepancies between review and protocol, and find new ways to keep PROSPERO up-to-date. I am looking forward to discussing my ideas with you at EBMLive 2019!
Tanja Rombey is a 2019 Doug Altman Scholarship recipient and a doctoral student (Theoretical Medicine) at Witten/Herdecke University, Germany. She has a Master’s degree in Public Health from the University of Sheffield and a Bachelor’s degree in Health Economics from the University of Cologne. Tanja has a keen interest in systematic reviews and their methods as a part of evidence based medicine. She currently works on a systematic review and non-linear dose-response meta-analysis. Tanja has no conflicts of interest to declare.