IRT for voting advice applications: a multi-dimensional test that is adaptive and interpretable

Karl Sigfrid ()
Additional contact information
Karl Sigfrid: Stockholm University

Quality & Quantity: International Journal of Methodology, 2024, vol. 58, issue 5, No 6, 4137-4156

Abstract: Abstract Voting advice applications rely on user input to match user preferences to political parties or candidates. Providing the input can be time-consuming, which may have a negative effect on participation. For individuals who are under time constraints or who are affected by survey fatigue, the participation threshold may be lowered if there is an option to conclude the test without answering all question items. The test result should ideally be close to the result that the participant would have gotten after answering the full battery of questions. We propose a method that allows respondents to conclude a VAA early and still get results with sufficient accuracy.The method proposed here extends the Graded Response Model and the Maximum Information Criterion, used in Item Response Theory. The aim of the method is to allow the user to control the length of the test. Furthermore, we want a simpler interpretation of multidimensional parameter estimates than we get from traditional MIRT. To achieve this, we propose an algorithm for adaptive IRT capable of selecting from a pool of items that belong to separate unidimensional scales. Using both simulated data and response data from a voting advice application project, we evaluate the accuracy of shorter tests implemented with our adaptive method. When only a few test items are answered, our proposed method outperforms a static-order IRT test of equal length in identifying the best match. We expect that implementation of the method can increase participation and engagement in voting advice applications.

Keywords: Item response theory; Computerized adaptive tests; Content-based recommender system; Voting advice application (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s11135-024-01845-6 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:qualqt:v:58:y:2024:i:5:d:10.1007_s11135-024-01845-6

Ordering information: This journal article can be ordered from
http://www.springer.com/economics/journal/11135

DOI: 10.1007/s11135-024-01845-6

Access Statistics for this article

Quality & Quantity: International Journal of Methodology is currently edited by Vittorio Capecchi

More articles in Quality & Quantity: International Journal of Methodology from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().