Concept and Implementation of a Two-Stage Coding Scheme for the Development of Computer-Based Testing (CBT)-Items in Traditional Test Software

Thilo J. Ketschau and Janne Kleinhans
Additional contact information
Thilo J. Ketschau: Department of Educational Philosophy and Vocational Education, TU Dortmund University, 44227 Dortmund, Germany
Janne Kleinhans: TOPSIM GmbH, 72070 Tübingen, Germany

J, 2019, vol. 2, issue 1, 1-9

Abstract: Computer-based testing (CBT) is gaining importance for studies addressing the diagnosis of competencies, because it is possible to simulate authentic action situations and may reduce the effort of analyzing the data. This benefit is most important for the phase of item design. In this phase of assessment construction, the pattern of answers of a sample is used to draw conclusions on the functionality of the items. Currently, there are no standards for the encodement of items which consider the specifications of CBT-instruments. These specifications are, for example, the a posteriori non-variability of the coding, a lack of information when using conventional test scores and the need of standardization of different formats of items. Taking these specifications into consideration, this paper proposes and discusses a two-stage coding systematization for CBT-items. For this, a distinction between item-coding and answer-coding was done. The coding is discussed for single-section and multi-section formats as well as dichotomous and polytomous answer modes. Therefore, this paper is for users of CBT-instruments who want to achieve the optimal information value of their test results with efficient coding.

Keywords: computer-based testing; test construction; item development; encoding; dichotomous/polytomous items (search for similar items in EconPapers)
JEL-codes: I1 I10 I12 I13 I14 I18 I19 (search for similar items in EconPapers)
Date: 2019
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2571-8800/2/1/4/pdf (application/pdf)
https://www.mdpi.com/2571-8800/2/1/4/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jjopen:v:2:y:2019:i:1:p:4-49:d:198984

Access Statistics for this article

J is currently edited by Ms. Angelia Su

More articles in J from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().