 Admissions Bias: A New Approach to Validity Estimation in Selected SamplesDepartment of Economics, Working Paper Series from Department of Economics, Institute for Business and Economic Research, UC Berkeley Abstract: Validity researchers typically work with nonrandom samples, membership in which depends in part on the exam score being investigated. In a study of the SAT's validity for freshman GPA at a particular college, for example, FGPA is not observed for the entire pool of potential applicants, but only for those who are admitted and enroll. This sample selection biases validity estimates. Corrections for restriction of range remedy the problem only when the exam score is the sole determinant of selection, and even then do not permit consistent estimation of the exam's incremental validity. Regression omitted variables results motivate a proposed validity estimator that is consistent whenever the determinants of selection are observed. An algorithm is suggested for calculation of these "robust" validity coefficients, and used to estimate the SAT's validity at the University of California. The usual validity estimates are shown to be substantially biased, in the hypothesized directions, by admissions-induced sample selection. Keywords: Higher Education; SAT; Tests; Exams; Admissions; Validity; Incremental Validity; Selection Bias; University of California (search for similar items in EconPapers) Downloads: (external link) Related works: Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text Persistent link: https://EconPapers.repec.org/RePEc:cdl:econwp:qt66n4x6g4 Access Statistics for this paper More papers in Department of Economics, Working Paper Series from Department of Economics, Institute for Business and Economic Research, UC Berkeley Contact information at EDIRC. |
Is your work missing from RePEc? Here is how to contribute.
Questions or problems? Check the EconPapers FAQ or send mail to .
EconPapers is hosted by the
School of Business at Örebro University.