Bias and Mean Square Errors of Estimators as Criteria for Evaluating Competing Analysis Strategies in Quasi-Experiments

Stephen F. Olejnik and Andrew C. Porter

Journal of Educational and Behavioral Statistics, 1981, vol. 6, issue 1, 33-53

Abstract: The evaluation of competing analysis strategies based on estimator bias and the mean square errors of estimators is demonstrated using gains in standard scores and analysis of covariance adjusted for errors of measurement procedures for quasi-experiments conforming to the fan spread hypothesis. Some confusion in the appropriateness of these analysis procedures is resolved by considering the fan spread model defined in latent and manifest variables, large and small sample properties of the estimators, and explicitly stating the nature of individual academic growth patterns. For a linear model of individual academic growth both procedures provide an unbiased estimator with equal mean square errors when the samples are large. With small samples, analysis of covariance adjusted for errors of measurement provides an unbiased estimator, while the gain in standard scores estimator is biased and has a spuriously low mean square error. Under a nonlinear model and large samples only gains in standard scores provide an unbiased estimator. Neither procedure is appropriate for a nonlinear model with small samples. A data example is provided to demonstrate the study's findings. It is recommended that both criteria of bias and mean square errors of estimators be considered when evaluating recently developed analytic strategies for quasi-experiments.

Keywords: Quasi-experiments; Biased estimators; Mean square & errors of estimates; Standardized gains scores; Analysis of covariance (search for similar items in EconPapers)
Date: 1981
References: Add references at CitEc
Citations:

Downloads: (external link)
https://journals.sagepub.com/doi/10.3102/10769986006001033 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:sae:jedbes:v:6:y:1981:i:1:p:33-53

DOI: 10.3102/10769986006001033

Access Statistics for this article

More articles in Journal of Educational and Behavioral Statistics
Bibliographic data for series maintained by SAGE Publications ().