skip navigation

PUBLICATIONS

Register for Latest Research

Stay Informed
Register with NCJRS to receive NCJRS's biweekly e-newsletter JUSTINFO and additional periodic emails from NCJRS and the NCJRS federal sponsors that highlight the latest research published or sponsored by the Office of Justice Programs.

NCJRS Abstract

The document referenced below is part of the NCJRS Virtual Library collection. To conduct further searches of the collection, visit the Virtual Library. See the Obtain Documents page for direction on how to access resources online, via mail, through interlibrary loans, or in a local library.

 

NCJ Number: 50181 Add to Shopping cart Find in a Library
Title: CORRECTING COVARIATES FOR UNRELIABILITY - DOES IT LEAD TO DIFFERENCES IN EVALUATOR'S CONCLUSIONS?
Journal: EVALUATION QUARTERLY  Volume:2  Issue:3  Dated:(AUGUST 1978)  Pages:401-420
Author(s): R G ST PIERRE
Corporate Author: Abt Associates, Inc
United States of America

Sage Publications, Inc
United States of America
Date Published: 1978
Page Count: 20
Sponsoring Agency: Abt Associates, Inc
Cambridge, MA 02138
Sage Publications, Inc
Thousand Oaks, CA 91320
US Office of Education
Washington, DC 20202
Contract Number: 300-75-0134
Type: Program/Project Evaluation
Format: Article
Language: English
Country: United States of America
Annotation: THE EFFECTS OF DIFFERENT ASSUMPTIONS ABOUT TEST RELIABILITY ON THE FINDINGS AND CONCLUSIONS OF PROGRAM EVALUATIONS ARE EXPLORED IN AN ANALYSIS OF DATA FROM AN EXPERIMENTAL EDUCATIONAL PROGRAM.
Abstract: EVALUATIONS OF EDUCATIONAL PROGRAMS TYPICALLY ARE QUASI-EXPERIMENTAL. USUALLY SOME FORM OF ANALYSIS OF CONVARIANCE IS EMPLOYED TO EQUATE TREATMENT AND COMPARISON GROUPS ON PRETREATMENT CONDITIONS. THE APPLICATION OF ANALYSIS OF COVARIANCE TO QUASI-EXPERIMENTAL DATA HAS BEEN CRITICIZED ON THE GROUNDS THAT THE PROCEDURE LEADS TO BIAS IN THE ADJUSTMENT OF OUTCOME SCORES. VARIOUS PROCEDURES, MOST DEALING WITH THE CORRECTION OF COVARIATES FOR UNRELIABILITY, HAVE BEEN DESIGNED TO YIELD UNBIASED ADJUSTMENTS. ONE SUCH PROCEDURE WAS APPLIED TO DATA COLLECTED IN THE NATIONAL EVALUATION OF PROJECT FOLLOW THROUGH, A LARGE-SCALE QUASI-EXPERIMENTAL EDUCATIONAL PROGRAM FOR DISADVANTAGED CHILDREN. PROJECT EVALUATORS SOUGHT TO DETERMINE WHETHER THE APPLICATION OF RELIABILITY CORRECTIONS ALTERS RESULTS OBTAINED WITH UNCORRECTED COVARIATES SO AS TO CHANGE APPRECIABLY THE CONCLUSIONS DRAWN FROM THE RESULTS. THE RELIABILITY CORRECTIONS LED TO SOME CHANGES IN CONCLUSIONS ABOUT THE PERFORMANCE OF VARIOUS EDUCATIONAL MODELS FUNDED UNDER PROJECT FOLLOW THROUGH. THE RESULTS OF BOTH ANALYSES WERE PRESENTED IN THE EVALUATORS' REPORT, BUT CONCLUSIONS WERE BASED ON THE ANALYSIS EMPLOYING THE UNCORRECTED DATA DUE TO CONTROVERSY SURROUNDING METHODS OF CORRECTING FOR UNRELIABILITY IN COVARIATES. DETAILS OF THE ANALYSIS, SUPPORTING DATA, AND A LIST OF REFERENCES ARE INCLUDED. (AUTHOR ABSTRACT MODIFIED--LKM)
Index Term(s): Data analysis; Evaluation; Program evaluation; Statistical analysis
To cite this abstract, use the following link:
http://www.ncjrs.gov/App/publications/abstract.aspx?ID=50181

*A link to the full-text document is provided whenever possible. For documents not available online, a link to the publisher's website is provided. Tell us how you use the NCJRS Library and Abstracts Database - send us your feedback.