Assessing Model Sensitivity of the Imputation Methods Used in the National Assessment of Educational Progress

Neal Thomas

Journal of Educational and Behavioral Statistics, 2000, vol. 25, issue 4, 351-371

Abstract: The National Assessment of Educational Progress (NAEP) uses latent trait item response models to summarize performance of students on assessments of educational proficiency in different subject areas such as mathematics and reading. Because of limited examination time and concerns about student motivation. NAEP employs sparse matrix sampling designs that assign a small number of examination items to each sampled student to measure broad curriculums. As a consequence, each sampled student’s latent trait is not accurately measured, and NAEP uses multiple imputation missing data statistical methods to account for the uncertainty about the latent traits. The sensitivity of these model-based estimation and reporting procedures to statistical and psychometric assumptions is assessed. Estimation of the mean of the latent trait train different subpopulations was very robust to the modeling assumptions. Many of the other currently reported summaries, however; may depend on the modeling assumptions underlying the estimation procedures; these assumptions, motivated primarily by analytic tractability, are unlikely to attain, raising concerns about current reporting practices. The results indicate that more conservative criteria should be considered when forming intervals about estimates, and when assessing significance. A possible expansion of the imputation model is suggested that may improve its performance.

Keywords: Item Response Theory (IRT); NAEP; plausible values; multiple imputation; model sensitivity (search for similar items in EconPapers)
Date: 2000
References: Add references at CitEc
Citations:

Downloads: (external link)
https://journals.sagepub.com/doi/10.3102/10769986025004351 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:sae:jedbes:v:25:y:2000:i:4:p:351-371

DOI: 10.3102/10769986025004351

Access Statistics for this article

More articles in Journal of Educational and Behavioral Statistics
Bibliographic data for series maintained by SAGE Publications ().