Methodological issues on statistical rigor of agreement analysis

Ming Li (), Qian Gao () and Tianfei Yu ()
Additional contact information
Ming Li: Qiqihar University
Qian Gao: Qiqihar University
Tianfei Yu: Qiqihar University

Scientometrics, 2023, vol. 128, issue 3, No 27, 2025-2027

Abstract: Abstract With the intention to evaluate a current h(fa)-index which considered the relative contribution of each author, Sebo P and colleagues selected senior hospital physicians from six college hospitals in Switzerland between 1 and 14 March 2020. Using Web of Science, the authors assessed the h(fa)-index of all physicians with acquired non-zero h-index. They applied Cohen’s kappa statistic to calculate the inter-rater agreement between the h-index and the h(fa)-index. We argue that the agreement between the results of the two metrics is disputed by Cohen’s kappa statistic. Therefore, we recommend that an additional appropriate statistical approach, the weighted Cohen’s kappa statistic, should be used in this study.

Keywords: Academic research; H-index; H(fa)-index; Agreement; Cohen’s kappa; Weighted kappa (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s11192-022-04591-4 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:scient:v:128:y:2023:i:3:d:10.1007_s11192-022-04591-4

Ordering information: This journal article can be ordered from
http://www.springer.com/economics/journal/11192

DOI: 10.1007/s11192-022-04591-4

Access Statistics for this article

Scientometrics is currently edited by Wolfgang Glänzel

More articles in Scientometrics from Springer, Akadémiai Kiadó
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().