Abstract: How Empty Are Empty Reviews: Writing Guidelines to Make Systematic Reviews More Useful (Society for Social Work and Research 15th Annual Conference: Emerging Horizons for Social Work Research)

15016 How Empty Are Empty Reviews: Writing Guidelines to Make Systematic Reviews More Useful

Schedule:
Sunday, January 16, 2011: 12:15 PM
Grand Salon H (Tampa Marriott Waterside Hotel & Marina)
* noted as presenting author
Joanne Yaffe, PhD, Associate Professor, University of Utah, Salt Lake City, UT
Background

Users rely on The Cochrane Database of Systematic Reviews (CDSR) and the Campbell Collaboration Library of Systematic Reviews for the best available evidence in making health and social care decisions. However, some evidence suggests that “empty reviews” in these databases provide limited implications for practice or make recommendations without consideration of the bias that may be caused by excluding studies.

Objectives

To report our findings on the reporting of empty reviews, to seek input for the development of recommended guidelines for reporting empty reviews to the Cochrane and Campbell Methods Groups, and to invite participation in the guideline development process.

Methods

Following the suggestions of Moher et al. for the development of reporting guidelines, this project has identified the need for reporting guidelines for reviews without included studies by reviewing the literature, identifying all empty reviews within the CDSR, describing these reviews, examining how these reviews report implications for practice and consulting with other systematic review groups to find existing guidelines for reporting empty reviews. This information is presented for discussion in this forum to further prepare for focus groups with Cochrane/Campbell users and a formal guideline consensus meeting with invited Cochrane/Campbell contributors.

Results

At present the reporting of empty reviews in the CDSR is inconsistent and the Cochrane Handbook for Systematic Reviews of Interventions does not provide reporting guidelines. Through Issue 3, 2010, there are 374 empty reviews reported in the CDSR, representing 9% of total published reviews and 0% to 40% of reviews by the Cochrane Review Group. The publication of empty reviews appears to be increasing rather than decreasing over time.

Conclusions

Guidelines for the reporting of empty reviews are needed. We invite the open discussion of Cochrane and Campbell contributors regarding recommendations towards the development of guidelines. We hope to encourage participation by interested colleagues in a future, more formal consensus meeting.