skip navigation

PUBLICATIONS

Register for Latest Research

Stay Informed
Register with NCJRS to receive NCJRS's biweekly e-newsletter JUSTINFO and additional periodic emails from NCJRS and the NCJRS federal sponsors that highlight the latest research published or sponsored by the Office of Justice Programs.

NCJRS Abstract

The document referenced below is part of the NCJRS Virtual Library collection. To conduct further searches of the collection, visit the Virtual Library. See the Obtain Documents page for direction on how to access resources online, via mail, through interlibrary loans, or in a local library.

 

NCJ Number: 67442 Find in a Library
Title: POST-EVALUATION DETERMINATION OF A PROGRAM'S GENERALIZABILITY
Journal: EVALUATION AND PROGRAM PLANNING  Volume:2  Issue:4  Dated:(1979)  Pages:297-302
Author(s): N L SMITH; D N CAULEY
Corporate Author: Pergamon Press, Inc
United States of America
Date Published: 1979
Page Count: 6
Sponsoring Agency: Pergamon Press, Inc
Elmsford, NY 10523
Type: Program/Project Evaluation
Format: Article
Language: English
Country: United States of America
Annotation: THIS PAPER SUGGESTS SECONDARY ANALYSIS PROCEDURES WHICH CAN BE EMPLOYED USING EXISTING EVALUATION DATA TO ESTIMATE A PROGRAM'S GENERALIZABILITY WHEN FOLLOWUP FIELD STUDIES ARE NOT FEASIBLE.
Abstract: POSTEVALUATION DETERMINATIONS OF A PROGRAM'S GENERALIZABILITY ARE POSSIBLE, WHETHER THE EVALUATION WAS PREPLANNED OR POSTPLANNED. REGARDLESS OF THE ADEQUACY OF THE EVALUATION PLANNING AND DESIGN, UNEXPECTED QUESTIONS OF PROGRAM GENERALIZATION OFTEN ARISE DUE TO FACTORS SUCH AS THE CHANGES IN THE NATURE OF THE PROGRAM ACTIVITIES FROM PLANNING TO COMPLETION, POLITICAL PRESSURE TO EXPAND A SUCCESSFUL PROGRAM, UNANTICIPATED EFFECTS MAKING THE PROGRAM BENEFICIAL TO NEW CLIENT GROUPS, REDEFINITION PROGRAM THRUST, AND THE AVAILABILITY OF ADDITIONAL FUNDS FOR PROGRAM EXPANSION INTO NEW AREAS. EXTERNAL VALIDITY MUST BE TESTED. EXTERNAL VALIDITY CAN BE CLASSIFIED ACCORDING TO GENERAL TYPES--POPULATION VALIDITY WHICH REFERS TO GENERALIZATIONS ACROSS GROUPS OF PEOPLE AND ECOLOGICAL INITIAL EVALUATION DESIGNS, THEREBY MAKING POST HOC ANALYSES EASIER AND MORE USEFUL. A SAMPLING PLAN USED IN THE EVALUATION STUDY CAN DETERMINE THE SCOPE OF PERMISSIBLE GENERALIZATION. THE MOST IMPORTANT POPULATION VARIABLES MUST BE IDENTIFIED IN DOING A POST HOC CONSIDERATION A PROGRAM GENERALIZABILITY. ONE'S ABILITY TO MAKE A GENERALIZATION IS THUS DEPENDENT ON THE CONTEXT (AS DEFINED BY THE SIGNIFICANT POPULATION AND ECOLOGICAL VARIABLES) IN WHICH IT IS TO BE APPLIED. FOR QUESTIONS OF ECOLOGICAL VALIDITY, IT IS INCREASINGLY RECOGNIZED THAT SUCCESSFUL INNOVATIONS ARE CHARACTERIZED BY LOCAL ADAPTATION OF THE INNOVATIVE PROGRAM. EACH PROGRAM IS CUSTOMIZED TO MEET DIFFERENT NEEDS AND SETTINGS. POSTEVALUATION PROCEDURES PROVIDE POTENTIALLY USEFUL TECHNIQUES FOR EVALUATORS TRYING TO RESPOND TO LAST MINUTE QUESTIONS OF PROGRAM GENERALIZABILITY. REFERENCES ARE CITED. (MJW)
Index Term(s): Evaluation; Evaluation of evaluation; Evaluation techniques; Evaluative research; Feedback; Program evaluation
To cite this abstract, use the following link:
http://www.ncjrs.gov/App/publications/abstract.aspx?ID=67442

*A link to the full-text document is provided whenever possible. For documents not available online, a link to the publisher's website is provided. Tell us how you use the NCJRS Library and Abstracts Database - send us your feedback.