Admissions Bias: A New Approach to Validity Estimation in Selected Samples

Jesse Rothstein

University of California at Berkeley, Center for Studies in Higher Education from Center for Studies in Higher Education, UC Berkeley

Abstract: Validity researchers typically work with nonrandom samples, membership in which depends in part on the exam score being investigated. In a study of the SAT's validity for freshman GPA at a particular college, for example, FGPA is not observed for the entire pool of potential applicants, but only for those who are admitted and enroll. This sample selection biases validity estimates. Corrections for restriction of range remedy the problem only when the exam score is the sole determinant of selection, and even then do not permit consistent estimation of the exam's incremental validity. Regression omitted variables results motivate a proposed validity estimator that is consistent whenever the determinants of selection are observed. An algorithm is suggested for calculation of these "robust" validity coefficients, and used to estimate the SAT's validity at the University of California. The usual validity estimates are shown to be substantially biased, in the hypothesized directions, by admissions-induced sample selection.

Keywords: Higher Education; SAT; Tests; Exams; Admissions; Validity; Incremental Validity; Selection Bias; University of California (search for similar items in EconPapers)
Date: 2002-05-01
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.escholarship.org/uc/item/66n4x6g4.pdf;origin=repeccitec (application/pdf)

Related works:
Working Paper: Admissions Bias: A New Approach to Validity Estimation in Selected Samples (2002)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:cdl:cshedu:qt66n4x6g4

Access Statistics for this paper

More papers in University of California at Berkeley, Center for Studies in Higher Education from Center for Studies in Higher Education, UC Berkeley
Bibliographic data for series maintained by Lisa Schiff ().