Users rely on The Cochrane Database of Systematic Reviews (CDSR) and the Campbell Collaboration Library of Systematic Reviews for the best available evidence in making health and social care decisions. However, some evidence suggests that “empty reviews” in these databases provide limited implications for practice or make recommendations without consideration of the bias that may be caused by excluding studies.
Objectives
To report our findings on the reporting of empty reviews, to seek input for the development of recommended guidelines for reporting empty reviews to the Cochrane and Campbell Methods Groups, and to invite participation in the guideline development process.
Methods
Following the suggestions of Moher et al. for the development of reporting guidelines, this project has identified the need for reporting guidelines for reviews without included studies by reviewing the literature, identifying all empty reviews within the CDSR, describing these reviews, examining how these reviews report implications for practice and consulting with other systematic review groups to find existing guidelines for reporting empty reviews. This information is presented for discussion in this forum to further prepare for focus groups with Cochrane/Campbell users and a formal guideline consensus meeting with invited Cochrane/Campbell contributors.
Results
At present the reporting of empty reviews in the CDSR is inconsistent and the Cochrane Handbook for Systematic Reviews of Interventions does not provide reporting guidelines. Through Issue 3, 2010, there are 374 empty reviews reported in the CDSR, representing 9% of total published reviews and 0% to 40% of reviews by the Cochrane Review Group. The publication of empty reviews appears to be increasing rather than decreasing over time.
Conclusions
Guidelines for the reporting of empty reviews are needed. We invite the open discussion of Cochrane and Campbell contributors regarding recommendations towards the development of guidelines. We hope to encourage participation by interested colleagues in a future, more formal consensus meeting.