Cutoff Point in Multiple Choice Examinations using Negative Marking or Number of Correct Scoring - An Analysis of Statistical Power

Niklas Karlsson () and Anders Lunander ()
Additional contact information
Niklas Karlsson: Örebro University School of Business, Postal: Örebro University, School of Business, SE - 701 82 ÖREBRO, Sweden, https://www.oru.se/english/employee/niklas_karlsson
Anders Lunander: Örebro University School of Business, Postal: Örebro University, School of Business, SE - 701 82 ÖREBRO, Sweden, https://www.oru.se/english/employee/anders_lunander

No 2025:9, Working Papers from Örebro University, School of Business

Abstract: Given the presence of a cutoff score in a multiple-choice questions test, a challenge for the test maker is to choose a scoring method maximizing the probability of a passing score for those with adequate knowledge given a prescribed risk of passing those with insufficient understanding. Within the environment of a true-false choice test, we analyze the statistical power of the standard method - one point if the correct answer is marked and zero otherwise – with that of the negative marking method - no answer results in zero points, a correct answer generates one point, and an incorrect answer is penalized by one point. Our comparison of power between the two methods indicates that the power is about equal when test taker exhibits a small variance in terms of her degree of confidence across the questions. For larger variance, the negative marking method is superior to the standard method. However, the more the test taker fails to capture her level of confidence, i.e., mis-calibration of knowledge, the lower statistical power of the negative marking. Which method has the highest power depends on the magnitude of mis-calibration. Underrating does not affect the power of NM as much as overrating

Keywords: multiple-choice questions; negative marking; test of statistical power (search for similar items in EconPapers)
JEL-codes: A22 C12 (search for similar items in EconPapers)
Pages: 22 pages
Date: 2025-08-28
New Economics Papers: this item is included in nep-dcm and nep-inv
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.oru.se/globalassets/oru-sv/institution ... rs2025/wp-9-2025.pdf Full text (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:hhs:oruesi:2025_009

Access Statistics for this paper

More papers in Working Papers from Örebro University, School of Business Örebro University School of Business, SE - 701 82 ÖREBRO, Sweden. Contact information at EDIRC.
Bibliographic data for series maintained by ().