U.S. flag

An official website of the United States government, Department of Justice.

NCJRS Virtual Library

The Virtual Library houses over 235,000 criminal justice resources, including all known OJP works.
Click here to search the NCJRS Virtual Library

No Effects in Independent Prevention Trials: Can We Reject the Cynical View?

NCJ Number
227270
Journal
Journal of Experimental Criminology Volume: 5 Issue: 2 Dated: June 2009 Pages: 163-183
Author(s)
Manuel Eisner
Date Published
June 2009
Length
21 pages
Annotation
This paper attempts to advance the debate that some experimental and quasi-experimental criminological studies might be biased by suggesting ways to examine empirically the extent of bias that arises from conflict of interest.
Abstract
Recent studies suggest that the reported effect sizes of prevention and intervention trials in criminology are considerably larger when program developers are involved in a study than when trials are conducted by independent researchers. This paper argues that the possibility of these differences may be due to systematic bias related to conflict of interest. If this is true, the results could be (1) the inability to estimate the true effect of interventions unless the approximate effect size of bias is known, (2) public trust in the research program of evidence-based prevention would be undermined, (3) systematic bias directs research resources into areas that may have less promise than others where bias is less common, and (4) an incentive for new researchers to adopt the same problematic practices that exist in the field is created. A review of the evidence shows that the possibility of a substantial problem cannot be currently rejected. In recognition of these dangers, significant efforts have been made over the past decade to improve standards for conducting and publishing experimental and quasi-experimental studies in many domains of research on evidence-based prevention and intervention. Figure, tables, and references