Identifying academic success and underperformance: The discriminative power of very short answer questions and multiple-choice questions

Elise V van Wijk, Floris M van Blankenstein, Bastian N Ruijter, Jos H T Rohling, Jolein van der Kraan, Friedo W Dekker and Alexandra M J Langers

PLOS ONE, 2026, vol. 21, issue 7, 1-11

Abstract: Background: Multiple-choice questions (MCQs) are widely used in medical education, but are criticized for cueing and guessing. Very short answer questions (VSAQs), which require students to generate responses independently, may better assess knowledge. While VSAQs demonstrate higher item discrimination within individual exams, their effectiveness in distinguishing academic performance across multiple assessments remains unclear – representing a key gap in the validation of VSAQs under Messick’s framework, specifically the category of “relations to other variables”. This study examines whether VSAQs or MCQs more effectively distinguish students of varying performance levels across multiple summative examinations. Methods: We analyzed retrospective data from six mixed-format examinations with VSAQs and MCQs of three cohorts of first- and second-year medical students. Academic performance was measured using grade point average (GPA) across assessments. Linear regression assessed the relationship of each question format with GPA, while ROC curves and C-statistics evaluated their ability to identify poor and excellent performing students (lowest and highest quintile of GPA). Results: VSAQs showed higher item discrimination (Rir-values) than MCQs in all exams. VSAQs also had a stronger positive association with GPA compared to MCQs, and higher C-statistics, indicating superior discriminative ability. Conclusion: VSAQs outperform MCQs in distinguishing academic performance levels across multiple assessments. Their integration into examinations enhances discriminative ability and may facilitate earlier identification of poor and excellent performing students, enabling targeted interventions and support of students.

Date: 2026
References: Add references at CitEc
Citations:

Downloads: (external link)
https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0349318 (text/html)
https://journals.plos.org/plosone/article/file?id= ... 49318&type=printable (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:plo:pone00:0349318

DOI: 10.1371/journal.pone.0349318

Access Statistics for this article

More articles in PLOS ONE from Public Library of Science
Bibliographic data for series maintained by plosone ().