How accurate are news mentions of scholarly output? A content analysis

Houqiang Yu (), Xinyun Yu and Xueting Cao
Additional contact information
Houqiang Yu: Sun Yat-Sen University
Xinyun Yu: Nanjing University of Science and Technology
Xueting Cao: Jiangsu Broadcasting Corporation

Scientometrics, 2022, vol. 127, issue 7, No 17, 4075-4096

Abstract: Abstract News mentions are considered as useful source for measuring the societal impact of scholarly output, meanwhile data quality plays a fundamental role in its research and application. This study is aimed to measure the accuracy of news mentions data in the altmetrics database, in order to inform the reliability and limitation of relevant news altmetrics studies. In total, 5.83 million news mentions records that involve 1.03 million scholarly outputs were extracted from the whole dataset up to December 2019 provided by the Altmetric database. 3000 records were sampled for content analysis using stratified sampling strategy. Results show that: (1) 6 major types and 14 specific error types are identified. (2) Error occurs in 42.5% of the sample records, 27.1% could be attributable to the news platform and 15.4% could be attributable to the Altmetric database. (3) Inaccessibility to the source news article (25.9%), incorrect news link provided by the Altmetric database (6.9%) and inaccurate news mention (7.9%) are found to be the three most common error types. (4) 8.5% of the sample records have errors that would cause miscalculation and undermine the validity of studies based on the data, while 33.8% of the sample records have errors that would influence the reliability and reproductivity. (5) Underlying reasons for the errors are summarized and possible measures to improve the data quality are discussed in an in-depth and systematic way. These results suggest that although the Altmetric database has made great achievements in collecting news altmetrics data, the data collection can be further improved.

Keywords: Altmetrics; Data quality; News data; News altmetrics data; News mention (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s11192-022-04382-x Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:scient:v:127:y:2022:i:7:d:10.1007_s11192-022-04382-x

Ordering information: This journal article can be ordered from
http://www.springer.com/economics/journal/11192

DOI: 10.1007/s11192-022-04382-x

Access Statistics for this article

Scientometrics is currently edited by Wolfgang Glänzel

More articles in Scientometrics from Springer, Akadémiai Kiadó
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().