Metrics as Proxies: A Theoretical and Empirical Study of Reasonings Based on Bibliometric Indicators

Łukasz Remisiewicz
Additional contact information
Łukasz Remisiewicz: University of Gdańsk

No 4ywhz_v1, SocArXiv from Center for Open Science

Abstract: The role of bibliometric indicators in research assessment has been widely debated. This article explores how citation-based metrics are interpreted and applied in negative habilitation reviews, combining theoretical insights on citation practices with empirical analysis of review discourse. The theoretical section examines different conceptual frameworks for understanding bibliometric indicators, including essentialist, constructivist, and normative perspectives on citations. It highlights how citation metrics are often assumed to reflect recognition, influence, or research quality, despite growing evidence of their contextual limitations. The empirical section analyzes 174 negative habilitation reviews from four disciplines, identifying distinct patterns in how reviewers incorporate bibliometric data into their assessments. While some reviewers treat citation counts and journal rankings as direct indicators of scholarly impact, others regard them as secondary or complementary tools that require careful contextualization. The findings reveal a lack of standardized bibliometric reasoning, leading to inconsistencies in how candidates’ research contributions are evaluated. The study underscores the need for greater transparency and theoretical awareness in the use of citation-based metrics in peer review, contributing to broader discussions on the reliability and standardization of research evaluation practices.

Date: 2025-02-12
References: Add references at CitEc
Citations:

Downloads: (external link)
https://osf.io/download/67abb1066262da316b4864af/

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:osf:socarx:4ywhz_v1

DOI: 10.31219/osf.io/4ywhz_v1

Access Statistics for this paper

More papers in SocArXiv from Center for Open Science
Bibliographic data for series maintained by OSF ().