Impacts towards a comprehensive assessment of the book impact by integrating multiple evaluation sources

Qingqing Zhou and Chengzhi Zhang

Journal of Informetrics, 2021, vol. 15, issue 3

Abstract: The surge in the number of books published makes the manual evaluation methods (e.g. peer review) difficult to efficiently evaluate books. The use of books’ citations and alternative evaluation metrics (e.g. library holdings, social media mentions, book reviews) can assist manual evaluation and reduce the cost of evaluation. However, most existing evaluation research was based on a single evaluation source with coarse-grained analysis, which may obtain incomprehensive or one-sided evaluation results of book impact. Meanwhile, relying on a single resource for book assessment may lead to the risk that the evaluation results cannot be obtained due to the lack of the evaluation data, especially for newly published books. Hence, this paper measured book impact based on an evaluation system constructed by integrating multiple evaluation sources. Specifically, we conducted finer-grained mining on the multiple evaluation sources, including books’ internal evaluation resources (e.g. books’ contents) and external evaluation resources (e.g. books’ reviews, books’ citations and books’ usages). Various technologies (e.g. topic extraction, sentiment analysis, text classification) were used to extract corresponding evaluation metrics from the internal and external evaluation resources. Then, Expert evaluation combined with analytic hierarchy process was used to integrate the evaluation metrics and construct a book impact evaluation system. Finally, the reliability of the evaluation system was verified by comparing with the results of expert evaluation, detailed and diversified evaluation results were then obtained. The experimental results reveal that differential evaluation resources can measure the books’ impacts from different dimensions, and the integration of multiple evaluation data can assess books more comprehensively. Meanwhile, the book impact evaluation system can provide personalized evaluation results according to the users’ evaluation purposes. In addition, the disciplinary differences should be considered for assessing books’ impacts.

Keywords: Book impact assessment; Multiple evaluation sources, Review mining; Citation context analysis; Depth and breadth analysis (search for similar items in EconPapers)
Date: 2021
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (2)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S1751157721000663
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:infome:v:15:y:2021:i:3:s1751157721000663

DOI: 10.1016/j.joi.2021.101195

Access Statistics for this article

Journal of Informetrics is currently edited by Leo Egghe

More articles in Journal of Informetrics from Elsevier
Bibliographic data for series maintained by Catherine Liu ().