Research fund evaluation based on academic publication output analysis: the case of Chinese research fund evaluation

Ji-ping Gao (), Cheng Su, Hai-yan Wang, Li-hua Zhai and Yun-tao Pan
Additional contact information
Ji-ping Gao: Institute of Scientific and Technical Information of China (ISTIC)
Cheng Su: Institute of Scientific and Technical Information of China (ISTIC)
Hai-yan Wang: Institute of Scientific and Technical Information of China (ISTIC)
Li-hua Zhai: Institute of Scientific and Technical Information of China (ISTIC)
Yun-tao Pan: Institute of Scientific and Technical Information of China (ISTIC)

Scientometrics, 2019, vol. 119, issue 2, No 20, 959-972

Abstract: Abstract Government funding is a key scientific research resource, and it has made a concrete contribution to the world’s science and technology development. But these funds come from common taxpayers, so we need to evaluate the effectiveness of these funds. Generally speaking, policymakers adopt the method of peer review to make assessments. Compared to kinds of shortcomings of peer review, the paper here proposed the benchmarking evaluation method based on the academic publication outputs of supporting funds, mainly guiding indicators from scientometrics. At first, with the academic publication output extracted from the concluding report project manager submitted to the government after the fund finished, we designed the analysis framework to search and define the research field the fund belonged to. And then from the following three perspectives, including quantity, quality and relative influence, we compared the research fund output to the field output. Later, we took one fund program from national program on key basic research project of China (973 Program) in the field of quantum physics as an example to make an empirical analysis to demonstrate its effectiveness. At last, we found that the funded program performance was superior to the field, and even about 11.65% of the research achievement reaches the top 1/1000 of the world, but the research was lacking in remarkable papers, so it needs further improvement.

Keywords: Research fund evaluation; Academic publication output analysis; Benchmarking bibliometrics; Research achievement; Scientometrics (search for similar items in EconPapers)
Date: 2019
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (9)

Downloads: (external link)
http://link.springer.com/10.1007/s11192-019-03073-4 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:scient:v:119:y:2019:i:2:d:10.1007_s11192-019-03073-4

Ordering information: This journal article can be ordered from
http://www.springer.com/economics/journal/11192

DOI: 10.1007/s11192-019-03073-4

Access Statistics for this article

Scientometrics is currently edited by Wolfgang Glänzel

More articles in Scientometrics from Springer, Akadémiai Kiadó
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().