How to reduce the number of rating scale items without predictability loss?

W. W. Koczkodaj (), T. Kakiashvili, A. Szymańska, J. Montero-Marin (), R. Araya, J. Garcia-Campayo, K. Rutkowski and D. Strzałka ()
Additional contact information
W. W. Koczkodaj: Laurentian University
T. Kakiashvili: Sudbury Therapy
A. Szymańska: UKSW University
J. Montero-Marin: University of Zaragoza
R. Araya: London School of Hygiene and Tropical Medicine
J. Garcia-Campayo: University of Zaragoza
K. Rutkowski: Jagiellonian University
D. Strzałka: Rzeszów University of Technology

Scientometrics, 2017, vol. 111, issue 2, No 2, 593 pages

Abstract: Abstract Rating scales are used to elicit data about qualitative entities (e.g., research collaboration). This study presents an innovative method for reducing the number of rating scale items without the predictability loss. The “area under the receiver operator curve method” (AUC ROC) is used. The presented method has reduced the number of rating scale items (variables) to 28.57% (from 21 to 6) making over 70% of collected data unnecessary. Results have been verified by two methods of analysis: Graded Response Model (GRM) and Confirmatory Factor Analysis (CFA). GRM revealed that the new method differentiates observations of high and middle scores. CFA proved that the reliability of the rating scale has not deteriorated by the scale item reduction. Both statistical analysis evidenced usefulness of the AUC ROC reduction method.

Keywords: Rating scale; Prediction; Receiver operator characteristic; Reduction; 94A50; 62C25; 62C99; 62P10 (search for similar items in EconPapers)
Date: 2017
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://link.springer.com/10.1007/s11192-017-2283-4 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:scient:v:111:y:2017:i:2:d:10.1007_s11192-017-2283-4

Ordering information: This journal article can be ordered from
http://www.springer.com/economics/journal/11192

DOI: 10.1007/s11192-017-2283-4

Access Statistics for this article

Scientometrics is currently edited by Wolfgang Glänzel

More articles in Scientometrics from Springer, Akadémiai Kiadó
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().