U.S. flag

An official website of the United States government, Department of Justice.

NCJRS Virtual Library

The Virtual Library houses over 235,000 criminal justice resources, including all known OJP works.
Click here to search the NCJRS Virtual Library

EVALUATING PROGRAM OUTCOMES (FROM EVALUATION OF HUMAN SERVICE PROGRAMS, 1978, BY C CLIFFORD ATTKISSON ET AL SEE NCJ-51554)

NCJ Number
51565
Author(s)
W A HARGREAVES; C C ATTKISSON
Date Published
1978
Length
37 pages
Annotation
APPLICATIONS OF OUTCOME EVALUATION IN MONITORING PROGRAM QUALITY, DEMONSTRATING PROGRAM EFFECTIVENESS, AND AIDING ADMINISTRATIVE DECISIONMAKING ARE REVIEWED, AND 10 FACTORS IN PLANNIG OUTCOME STUDIES ARE DISCUSSED.
Abstract
TO BE RELEVANT, OUTCOME MEASUREMENT MUST ADDRESS THREE ASPECTS OF PROGRAM MANAGEMENT: CONTINUOUS MONITORING OF PROGRAM QUALITY; DEMONSTRATION OF PROGRAM EFFECTIVENESS; AND DECISIONS ABOUT PROGRAM MODIFICATIONS AIMED AT IMPROVING EFFECTIVENESS. MONITORING IS USED TO DETECT SPECIFIC STRENGTHS AND WEAKNESSES IN A PROGRAM. INEXPENSIVE OUTCOME INDICATORS, SUCH AS RATINGS OF CLIENT STATUS BEFORE AND AFTER SERVICE AND MEASURES OF CLIENT SATISFACTION, ARE PRACTICAL FOR THE QUANTITATIVE ASPECTS OF MONITORING AND MAY BE SUPPLEMENTED BY QUALITATIVE FOLLOWUP CONTACTS WITH SELECTED CLIENTS. DEMONSTRATING OVERALL PROGRAM EFFECTIVENESS IS MORE DIFFICULT. ESTIMATES OF EFFECTIVENESS REQUIRE NORMATIVE STUDIES AMONG GROUPS OF SIMILAR PROGRAMS. HOWEVER, THE DEVELOPMENT OF OUTCOME NORMS IS IN ITS INFANCY. OUTCOME EVALUATIONS CONCERNED WITH AIDING ADMINISTRATIVE DECISIONMAKING GENERALLY ARE TIME-LIMITED EFFORTS RATHER THAN ONGOING MONITORING SYSTEMS. COMPARATIVE OUTCOME STUDIES SUPPORT TWO TYPES OF PROGRAM DECISIONS: THE ADMINISTRATIVE POLICY DECISION TO OFFER A NEW OR SUBSTITUTE SERVICE AND THE CLINICAL DECISION PROCESS OF ASSIGNING CLIENTS TO SERVICES. TEN ISSUES MUST BE RESOLVED IN PLANNING AN OUTCOME STUDY: SELECTION OF SERVICES TO BE COMPARED; ASSIGNMENT OF SUBJECTS TO SERVICES; SELECTION OF SUBJECTS; OBTAINING INFORMED CONSENT FROM SUBJECTS; DESCRIPTION OF THE SAMPLE; DESCRIPTION OF SERVICES PROVIDED; SELECTION OF PREDICTOR VARIABLES; SELECTION OF OUTCOME MEASURES; ANALYSIS OF DATA; AND FEEDBACK OF RESULTS INTO THE DECISION PROCESS. GUIDELINES FOR RESOLVING EACH ISSUE ARE OFFERED (INCLUDING EXPLANATIONS OF FOUR TYPES OF SUBJECT ASSIGNMENT DESIGN). A SAMPLE GLOBAL ASSESSMENT SCALE (A METHOD FOR ASSESSING CLIENT STATUS) AND A SAMPLE CLIENT SATISFACTION QUESTIONNAIRE ARE PROVIDED. TOGETHER WITH A LIST OF REFERENCES. (AUTHOR ABSTRACT MODIFIED--LKM)