Exploring the bibliometric and semantic nature of negative results

Christian Gumpenberger (), Juan Gorraiz (), Martin Wieland (), Ivana Roche (), Edgar Schiebel (), Dominique Besagni () and Claire François ()
Additional contact information
Christian Gumpenberger: University of Vienna
Juan Gorraiz: University of Vienna
Martin Wieland: University of Vienna
Ivana Roche: INIST–CNRS Institut de l’Information Scientifique et Technique
Edgar Schiebel: AIT Austrian Institute of Technology GmbH, Tech Gate Vienna
Dominique Besagni: INIST–CNRS Institut de l’Information Scientifique et Technique
Claire François: INIST–CNRS Institut de l’Information Scientifique et Technique

Scientometrics, 2013, vol. 95, issue 1, No 19, 277-297

Abstract: Abstract Negative results are not popular to disseminate. However, their publication would help to save resources and foster scientific communication. This study analysed the bibliometric and semantic nature of negative results publications. The Journal of Negative Results in Biomedicine (JNRBM) was used as a role model. Its complete articles from 2002–2009 were extracted from SCOPUS and supplemented by related records. Complementary negative results records were retrieved from Web of Science in “Biochemistry” and “Telecommunications”. Applied bibliometrics comprised of co-author and co-affiliation analysis and a citation impact profile. Bibliometrics showed that authorship is widely spread. A specific community for the publication of negative results in devoted literature is non-existent. Neither co-author nor co-affiliation analysis indicated strong interconnectivities. JNRBM articles are cited by a broad spectrum of journals rather than by specific titles. Devoted negative results journals like JNRBM have a rather low impact measured by the number of received citations. On the other hand, only one-third of the publications remain uncited, corroborating their importance for the scientific community. The semantic analysis relies on negative expressions manually identified in JNRBM article titles and abstracts and extracted to syntactic patterns. By using a Natural Language Processing tool these patterns are then employed to detect their occurrences in the multidisciplinary bibliographical database PASCAL. The translation of manually identified negation patterns to syntactic patterns and their application to multidisciplinary bibliographic databases (PASCAL, Web of Science) proved to be a successful method to retrieve even hidden negative results. There is proof that negative results are not only restricted to the biomedical domain. Interestingly a high percentage of the so far identified negative results papers were funded and therefore needed to be published. Thus policies that explicitly encourage or even mandate the publication of negative results could probably bring about a shift in the current scientific communication behaviour.

Keywords: Bibliometrics; Scientometrics; Negative result publication; S&T information; Semantic analysis; Publication bias (search for similar items in EconPapers)
Date: 2013
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (2)

Downloads: (external link)
http://link.springer.com/10.1007/s11192-012-0829-z Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:scient:v:95:y:2013:i:1:d:10.1007_s11192-012-0829-z

Ordering information: This journal article can be ordered from
http://www.springer.com/economics/journal/11192

DOI: 10.1007/s11192-012-0829-z

Access Statistics for this article

Scientometrics is currently edited by Wolfgang Glänzel

More articles in Scientometrics from Springer, Akadémiai Kiadó
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().