skip navigation


Register for Latest Research

Stay Informed
Register with NCJRS to receive NCJRS's biweekly e-newsletter JUSTINFO and additional periodic emails from NCJRS and the NCJRS federal sponsors that highlight the latest research published or sponsored by the Office of Justice Programs.

NCJRS Abstract

The document referenced below is part of the NCJRS Virtual Library collection. To conduct further searches of the collection, visit the Virtual Library. See the Obtain Documents page for direction on how to access resources online, via mail, through interlibrary loans, or in a local library.


NCJ Number: 228993 Find in a Library
Title: Missing a Critical Piece of the Pie: Simple Document Search Strategies Inadequate for Systematic Reviews
Journal: Journal of Experimental Criminology  Volume:5  Issue:4  Dated:December 2009  Pages:429-440
Author(s): David B. Wilson
Date Published: December 2009
Page Count: 12
Type: Report (Study/Research)
Format: Article
Language: English
Country: United States of America
Annotation: This article explores issues that underpin the importance of a quality systematic review of research literature to minimize bias.
Abstract: A social scientist reviewing the research literature on a topic often obsesses over potential biases in the individual studies being examined. However, this bias in primary studies may also exist at the level of a review; and a biased collection of studies will lead to a biased review. Systematic reviews strive to minimize bias in a review of conclusions drawn across studies. The purpose of this paper is to demonstrate the importance of engaging in a systematic and thorough search process by highlighting the following issues: 1) review evidence on the existence of publication issues bias; 2) show through an examination of the references in completed Campbell Collaboration reviews that the main bibliographic databases relevant to criminal justice are inadequate as a single source for identifying studies; and 3) address the myth that relying solely on peer-reviewed journal studies are included in a review. Recommendations to the field are offered for the development of a study registry or registries to facilitate the process of identifying an unbiased sample of studies. Tables and references
Main Term(s): Criminal justice research
Index Term(s): Literature; Literature reviews; Research methods
To cite this abstract, use the following link:

*A link to the full-text document is provided whenever possible. For documents not available online, a link to the publisher's website is provided. Tell us how you use the NCJRS Library and Abstracts Database - send us your feedback.