Exploring the scientific impact of negative results

Dan Tian, Xiao Hu, Yuchen Qian and Jiang Li

Journal of Informetrics, 2024, vol. 18, issue 1

Abstract: Negative results are a routine part of the scientific research journey, yet they often receive insufficient attention in scientific publications. In this study, we investigate the scientific impact of negative results by comparing the citations and citation context between negative and positive results. Specifically, we compared 159 negative result papers from three journals: Journal of Negative Results in BioMedicine, PLoS One, and BMC Research Notes, with 1,058 matched positive result papers authored by the same first and corresponding authors. The citation context was categorized according to three dimensions: citation aspect, citation purpose, and citation polarity. The first two were automatically provided by Citation Opinion Retrieval and Analysis (CORA), while citation polarity was manually annotated. Our analysis revealed several key findings. Firstly, negative results received 38.6 % fewer citations than positive results, even after controlling for bibliographic factors. Secondly, negative results were associated with a significantly higher proportion of negative citations when compared to positive results. Lastly, a higher proportion of negative results were negatively cited in the methods section.

Keywords: Negative results; Scientific impact; Citations; Citation context (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S1751157723001062
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:infome:v:18:y:2024:i:1:s1751157723001062

DOI: 10.1016/j.joi.2023.101481

Access Statistics for this article

Journal of Informetrics is currently edited by Leo Egghe

More articles in Journal of Informetrics from Elsevier
Bibliographic data for series maintained by Catherine Liu ().