A Continuous Scoring Function for Confidence-Based Marking using Multiple Choice Questions

Niklas Karlsson () and Anders Lunander ()
Additional contact information
Niklas Karlsson: Insper - Instituto de Ensino e Pesquisa, Postal: Örebro University, School of Business, SE - 701 82 ÖREBRO, Sweden, https://www.oru.se/english/employee/niklas_karlsson
Anders Lunander: Örebro University School of Business, Postal: Örebro University, School of Business, SE - 701 82 ÖREBRO, Sweden, https://www.oru.se/english/employee/anders_lunander

No 2025:11, Working Papers from Örebro University, School of Business

Abstract: In most multiple-choice tests using confidence based marking (CBM), a discrete certainty scale is applied, often with three or four probability intervals of equal length. In this paper we derive a continuous certainty scale for CBM which we think circumvents the alleged complexity that would be inherent in a continuous scale. In our approach, the examinee, given a correct answer, is awarded the same number of points as her reported degree of confidence that her chosen alternative is the correct answer, i.e., the examinee’s uncertainty is directly reflected in terms of the number of points achieved if the answer is correct. We test our continuous scoring scheme in an examination in basic statistics at our university. The results indicate that most students are quite good at assessing their confidence levels, but students tend on average to overrate their confidence for high levels of stated confidence and underrate their confidence for low levels of stated confidence.

Keywords: Multiple choice questions; confidence-based marking; scoring function (search for similar items in EconPapers)
JEL-codes: A22 C12 (search for similar items in EconPapers)
Pages: 25 pages
Date: 2025-10-01
References: Add references at CitEc
Citations:

Downloads: (external link)
https://www.oru.se/globalassets/oru-sv/institution ... s2025/wp-11-2025.pdf Full text (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:hhs:oruesi:2025_011

Access Statistics for this paper

More papers in Working Papers from Örebro University, School of Business Örebro University School of Business, SE - 701 82 ÖREBRO, Sweden. Contact information at EDIRC.
Bibliographic data for series maintained by ().