U.S. flag

An official website of the United States government, Department of Justice.

NCJRS Virtual Library

The Virtual Library houses over 235,000 criminal justice resources, including all known OJP works.
Click here to search the NCJRS Virtual Library

ISSUES OF DESIGN AND ANALYSIS IN EVALUATION RESEARCH (FROM VALIDITY ISSUES IN EVALUATIVE RESEARCH, 1976), BY I N BERNSTEIN - SEE NCJ-38442)

NCJ Number
38443
Author(s)
D F ALWIN; M J SULLIVAN
Date Published
1976
Length
24 pages
Annotation
THIS PAPER ADDRESSES THE QUESTION OF INTERNAL VALIDITY IN QUASI-EXPERIMENTAL AND NONEXPERIMENTAL SOCIAL POLICY RESEARCH.
Abstract
IT FOCUSES ON PROBLEMS OF SELECTION IN RESEARCH DESIGNS WHERE ASSIGNMENT TO EXPERIMENTAL CONDITIONS OCCURS ON A NONRANDOM BASIS. FIVE DIFFERENT SOLUTIONS TO THE PROBLEMS OF SELECTION ARE DISCUSSED - RANDOMIZATION, CONVARIANCE ADJUSTMENT, GAIN SCORES, MATCHING, AND EXPLICIT SELECTION - AND THE CONDITIONS UNDER WHICH THESE SOLUTIONS ARE USEFUL ARE EXAMINED. IT IS CONCLUDED THAT WHEREVER POSSIBLE, RESEARCHERS SHOULD EMPLOY RANDOMIZATION. WHEN THIS APPROACH IS UNAVAILABLE, AND THE RESEARCHER HAS CONTROL OVER THE ALLOCATION OF OBSERVATIONS TO EXPERIMENTAL CONDITIONS, THE ASSIGNMENT OF OBSERVATIONS TO TREATMENT AND CONTROL CONDITIONS AS AN EXACT FUNCTION OF THEIR OBSERVED SCORES ON A SELECTION VARIABLE IS SUGGESTED. WHEN THE ALLOCATION OF OBSERVATIONS TO EXPERIMENTAL CONDITIONS IS NOT UNDER THE CONTROL OF THE RESEARCHER, AND WHERE THE ASSUMPTION OF LINEARITY IS APPROPRIATE, LINEAR STATISTICAL ADJUSTMENT IS JUDGED THE BEST ANALYTIC APPROACH. REFERENCES ARE INCLUDED. (AUTHOR ABSTRACT MODIFIED)