Comparison of citation impact between pre-and post-publication peer-selected best papers: the case of Best Paper Awards recipients at computer science conferences

Yongzhen Wang ()
Additional contact information
Yongzhen Wang: Dalian University of Technology

Scientometrics, 2024, vol. 129, issue 1, No 23, 662 pages

Abstract: Abstract This paper presents a preliminary comparison of citation impact between two types of Best Paper Awards recipients: pre-and post-publication peer-selected best papers. Two hundred and ninety-nine pairs of pre-and post-publication peer-selected best papers from 15 highly prestigious computer science conferences spanning more than two decades were gathered for empirical analysis. Each pair was published in the same proceedings, and their citation information was collected within a 10-year period after their formal publication. A series of pairwise comparisons were performed in order to unbiasedly uncover their differences in citation counts (i.e., a good proxy for citation impact), as well as in citation speed, citation diversity, and citation location distributions (i.e., three characteristic properties of citation impact). The empirical results demonstrate that in computer science, the post-publication peer-selected best papers receive significantly more citations than their pre-publication counterparts, with an estimated probability of up to 0.79 (95% CI: 0.74 ~ 0.83). Meanwhile, they tend to accumulate their citations more quickly in the later (versus earlier) stages—they can scarcely be fast-aging papers, and their accumulated citations tend to cover a broader scope of academic disciplines. Overall, however, the pre-and post-publication peer-selected best papers have very similar citation location distributions. Both of them are most frequently cited in the Background sections, followed by the Methods sections, and finally the Results sections. In addition, the citation impact superiority of the post-publication peer-selected best papers remains consistent across different fields of research and over a long period of time, from 1997 to 2022.

Keywords: Citation impact; Best paper; Peer evaluation; Academic honor; Computer science (search for similar items in EconPapers)
Date: 2024
References: Add references at CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s11192-023-04881-5 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:scient:v:129:y:2024:i:1:d:10.1007_s11192-023-04881-5

Ordering information: This journal article can be ordered from
http://www.springer.com/economics/journal/11192

DOI: 10.1007/s11192-023-04881-5

Access Statistics for this article

Scientometrics is currently edited by Wolfgang Glänzel

More articles in Scientometrics from Springer, Akadémiai Kiadó
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().