Multi-actor policy dynamics in research evaluation: Experts, databases, and academics

Eleonora Dagiene, Ludo Waltman and Guus Dix
Additional contact information
Eleonora Dagiene: Mykolas Romeris University

No pqusk, OSF Preprints from Center for Open Science

Abstract: This mixed-methods study examines the complex interplay of actors and factors shaping research assessment policies in Lithuania in the period 1996–2008, a period of transition towards Western practices. Analysing policy documents, bibliometric data, interviews, and grey literature, we focus on the interactions between policymakers, international experts, providers of publication data, and researchers. Our findings reveal the significant influence of international networks on Lithuanian policymakers, leading to the adoption of quantitative assessment and reliance on Web of Science data. However, this narrow focus, coupled with existing power dynamics and top-down decision-making, led to unintended consequences and conflicts among disciplines, culminating in a Constitutional Court challenge. This research also highlights the substantial role of journal publishers and data providers in influencing policy shifts. We underscore the need for international organizations to adopt open data sources that encompass a wider array of scholarly outputs. Additionally, national policymakers must consider disciplinary differences and research capacity when designing assessment policies. The Lithuanian experience serves as a cautionary tale, emphasizing the importance of context-specific, inclusive, and flexible research assessment systems, particularly relevant for ongoing reforms such as the Coalition for Advancing Research Assessment (CoARA).

Date: 2024-07-28
New Economics Papers: this item is included in nep-sog and nep-tra
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://osf.io/download/66a4c52186d1179507c9a8d5/

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:osf:osfxxx:pqusk

DOI: 10.31219/osf.io/pqusk

Access Statistics for this paper

More papers in OSF Preprints from Center for Open Science
Bibliographic data for series maintained by OSF ().