Invalid Methods and False Answers: Physics Education Research and the Use of GREs

Michael B. Weissman

Econ Journal Watch, 2022, vol. 19, issue 1, 4–29

Abstract: Finding good educational policies requires sound estimates of their potential effects. Methods for making such estimates, i.e., finding causal estimands, have made great progress in the last few decades. Nevertheless, serious errors in causal reasoning have been found previously in papers in a leading physics education journal, Physical Review Physics Education Research. Here I examine three papers from that journal that present explicit methods of causal inference. The methods offered involve major errors, including errors in identifying causal mediation, choosing variables to control for, and imputing missing data. The erroneous methods lead to major underestimation of the predictive power of Graduate Record Exams.

Keywords: Causal inference; GRE; physics education research; education; statistics (search for similar items in EconPapers)
JEL-codes: A2 B4 C1 I2 (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://econjwatch.org/File+download/1226/WeissmanMar2022.pdf?mimetype=pdf (application/pdf)
https://econjwatch.org/1267 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ejw:journl:v:19:y:2022:i:1:p:4-29

Access Statistics for this article

Econ Journal Watch is currently edited by Daniel Klein

More articles in Econ Journal Watch from Econ Journal Watch Contact information at EDIRC.
Bibliographic data for series maintained by Jason Briggeman ().