Analytical errors in NCSES' testing of SOGI measures for national workforce surveys

Jonathan B. Freeman

No fdy7b, OSF Preprints from Center for Open Science

Abstract: The National Center for Science and Engineering Statistics (NCSES) administers annual and biennial surveys of the US college- and PhD-educated populations, tracking who is in STEM fields and what disparities exist based on sex, race, disability, first-generation status, and income background. NCSES recently conducted two pilot studies – a field test (n = 5,000) and a non-probability study (n = 2,800) – testing how respondents react to voluntary sexual orientation and gender identity (SOGI) questions. The agency concluded that while the gender identity question was acceptable, the sexual orientation question raised data-quality concerns. However, closer inspection reveals several analytical flaws and discrepancies that show that NCSES’ conclusion was unwarranted. Using standard quality metrics for federal population surveys and standard analytical approaches of NCSES’ peer statistical agencies, both gender identity and sexual orientation questions appear to have performed excellently in the pilot tests.

Date: 2024-04-01
References: Add references at CitEc
Citations:

Downloads: (external link)
https://osf.io/download/660b67fae65c600d9e7d9b7e/

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:osf:osfxxx:fdy7b

DOI: 10.31219/osf.io/fdy7b

Access Statistics for this paper

More papers in OSF Preprints from Center for Open Science
Bibliographic data for series maintained by OSF ().