Research Evaluation

1991 - 2025

Current editor(s): Julia Melkers, Emanuela Reale and Thed van Leeuwen

From Oxford University Press
Bibliographic data for series maintained by Oxford University Press ().

Access Statistics for this journal.
Is something missing from the series or not right? See the RePEc data check for the archive and series.

2022, volume 31, articles 4

Devices of evaluation: Institutionalization and impact—Introduction to the special issue pp. 423-428

Julian Hamann, Frerk Blome and Anna Kosmützky

Competitive exposure and existential recognition: Visibility and legitimacy on academic social networking sites pp. 429-437

Helena Francke and Björn Hammarfelt

Biographical representation, from narrative to list: The evolution of curricula vitae in the humanities, 1950 to 2010 pp. 438-451

Julian Hamann and Wolfgang Kaltenbrunner

Devices of future excellence: Detaching excellence recognition from ‘eminent men’ pp. 452-462

Roland Bloch and Alexander Mitterle

Spreading the gospel: Legitimating university rankings as boundary work pp. 463-474

Jelena Brankovic, Leopold Ringel and Tobias Werron

‘I want to be able to do what I know the tools will allow us to do’: Practicing evaluative bibliometrics through digital infrastructure pp. 475-485

Anne K Krüger and Sabrina Petersohn

Making the cut: How panel reviewers use evaluation devices to select applications at the European Research Council pp. 486-497

Lucas Brunet and Ruth Müller

Affective auditing: The emotional weight of the research excellence framework pp. 498-506

Richard Watermeyer, Gemma Elizabeth Derrick and Mar Borras Batalla

2022, volume 31, articles 3

Research calls, competition for funding and inefficiency pp. 289-296

António Osório and Lutz Bornmann

The funding and research trends in library and information science of NSSFC: Comparison of awards and papers pp. 297-310

Jianqin Xiang and Haiyan Wang

Enriching research quality: A proposition for stakeholder heterogeneity pp. 311-320

Thomas Franssen

Automated citation recommendation tools encourage questionable citations pp. 321-325

Serge P J M Horbach, Freek J W Oude Maatman, Willem Halffman and Wytske M Hepkema

Pathways for assessing interdisciplinarity: A systematic review pp. 326-343

Bethany K Laursen, Nicole Motzer and Kelly J Anderson

Interdisciplinary research and policy impacts: Assessing the significance of knowledge coproduction pp. 344-354

Luisa Veras de Sandes-Guimarães, Raquel Velho and Guilherme Ary Plonski

Valorization of transdisciplinary research: An evaluation approach and empirical illustration pp. 355-371

Stefania Munaretto, Caro E Mooren and Laurens K Hessels

University policy engagement bodies in the UK and the variable meanings of and approaches to impact pp. 372-384

Hannah Durrant and Eleanor MacKillop

Under pressure: The extent and distribution of perceived pressure among scientists in Germany, Austria, and Switzerland pp. 385-409

David Johann, Isabel J Raabe and Heiko Rauhut

Creating evaluative homogeneity: Experience of constructing a national journal ranking pp. 410-422

Jakub Krzeski, Krystian Szadkowski and Emanuel Kulczycki

2022, volume 31, articles 2

Assessing research excellence: Evaluating the Research Excellence Framework pp. 173-187

Mehmet Pinar and Timothy J Horne

Key factors affecting the promotion of researchers of the Argentine Scientific and Technical Research Council (CONICET) pp. 188-201

María Guillermina D'Onofrio and Juan D Rogers

Societal targeting in researcher funding: An exploratory approach pp. 202-213

Irene Ramos-Vielba, Duncan A Thomas and Kaare Aagaard

The epistemic, production, and accountability prospects of social impact: An analysis of strategic research proposals pp. 214-225

Juha-Pekka Lauronen

Does R&D tax credit impact firm behaviour? Micro evidence for Portugal pp. 226-235

Alexandre Paredes, Joana Mendonça, Fernando Bação and Bruno Damásio

Does monitoring performance act as an incentive for improving research performance? National and organizational level analysis of Finnish universities pp. 236-248

Laura Himanen and Hanna-Mari Puuska

Evaluating the Revised National Institutes of Health clinical trial definition impact on recruitment progress pp. 249-256

Eugene I KaneIII, Gail L Daumit, Kevin M Fain, Roberta W Scherer and Emma Elizabeth McGinty

Predicting funded research project performance based on machine learning pp. 257-270

Hoon Jang

A participatory approach to tracking system transformation in clusters and innovation ecosystems—Evolving practice in Sweden’s Vinnväxt programme pp. 271-287

Emily Wise, Moa Eklund, Madeline Smith and James Wilson

2022, volume 31, articles 1

Self-made university rankings: Categorization tactics and communication activism in Italian universities pp. 1-14

Andrea Bonaccorsi, Paola Belingheri, Brigida Blasi and Sandra Romagnosi

Fraud, specialization, and efficiency in peer review pp. 15-23

J A Garcia, Rosa Rodriguez-Sanchez and J Fdez-Valdivia

A Research Pathway Model for evaluating the implementation of practice-based research: The case of self-management health innovations pp. 24-48

Wilke van Beest, Wouter P C Boon, Daan Andriessen, Harald Pol, Gerrita van der Veen and Ellen H M Moors

Evaluation of rice research: An alternate method to capture outcomes pp. 49-60

Parshuram Samal, Biswajit Mondal, Nitiprasad N Jambhulkar, Onkar N Singh, Ramlakhan Verma, Sushant K Dash, Anup K Das and Himanshu Pathak

Using the catastrophe theory to discover transformative research topics pp. 61-79

Haiyun Xu, Jos Winnink, Huawei Wu, Hongshen Pang and Chao Wang

Research evaluations for an energy transition? Insights from a review of Swedish research evaluation reports pp. 80-92

Sofie Sandin and Mats Benner

The Corona-Eye: Exploring the risks of COVID-19 on fair assessments of impact for REF2021 pp. 93-103

Gemma E Derrick and Julie Bayley

Do peers share the same criteria for assessing grant applications? pp. 104-117

Sven E Hug and Michael Ochsner

Measuring societal impact of research—Developing and validating an impact instrument for occupational health and safety pp. 118-131

Ole Henning Sørensen, Jakob Bjørner, Andreas Holtermann, Johnny Dyreborg, Jorid Birkelund Sørli, Jesper Kristiansen and Steffen Bohni Nielsen

Beyond bean counting: Is the policy effective for the innovation efficiency of wind power industry in China? pp. 132-144

Zihao Jiang, Jiarong Shi, Zhiying Liu and Lei Gong

Capabilities for transdisciplinary research pp. 145-158

Cian O’Donovan, Aleksandra (Ola) Michalec and Joshua R Moon

Documenting development of interdisciplinary collaboration among researchers by visualizing connections pp. 159-172

Linden E Higgins and Julia M Smith

2021, volume 30, articles 4

Researcher experiences in practice-based interdisciplinary research (Imagining Autism: Feasibility and Impact of a Drama-Based Intervention on the Social Communicative and Imaginative Behaviour of Children with Autism) pp. 421-430

Jennifer Leigh and Nicole Brown

A formative approach to the evaluation of Transformative Innovation Policies (The Need for Reflexive Evaluation Approaches in Development Cooperation) pp. 431-442

Jordi Molas-Gallart, Alejandra Boni, Sandro Giachi and Johan Schot

Exploring research impact models: A systematic scoping review (AsseCssment of the Impact of a Clinical and Health Services Research Call in Catalonia) pp. 443-457

Maryam Razmgir, Sirous Panahi, Leila Ghalichi, Seyed Ali Javad Mousavi and Shahram Sedghi

Looking for evidence of research impact and use: A qualitative study of an Australian research-policy system (Public Social Policy Development and Implementation: A Case Study of the Ghana National Health Insurance Scheme) pp. 458-469

Robyn S. Newson, Lucie Rychetnik, Lesley King, Andrew J. Milat and Adrian E. Bauman

Profile of authors publishing in ‘predatory’ journals and causal factors behind their decision: A systematic review (Understanding of Medical Students about Predatory Journals: A Comparative Study from KSA and New Zealand) pp. 470-483

Sefika Mertkan, Gulen Onurkan Aliusta and Nilgun Suphi

Systematizing societal effects of transdisciplinary research (‚Wirkungen in Der Partizipativen Gesundheitsforschung: Eine Einordnung in Die Diskurse Zum Forschungsimpact) pp. 484-499

Martina Schäfer, Matthias Bergmann and Lena Theiler

Self-evaluating participatory research projects: A content validation of the InSPIRES online impact evaluation tool (Content Validity and Reliability of Single Items or Questionnaires) pp. 500-513

Florence Gignac, Anne-Sophie Gresle, Valeria Santoro Lamelas, Montserrat Yepes-Baldó, Leonardo de la Torre, Maria-Jesus Pinazo and the InSPIRES Consortium

The different responses of universities to introduction of performance-based research funding (How Incentives Trickle down: Local Use of a National Bibliometric Indicator System) pp. 514-528

Giovanni Abramo and Ciriaco Andrea D’Angelo

It takes two to tango: Examining productive interactions in urban research collaboration (Generating Research Questions through Problematization) pp. 529-539

Helka Kalliomäki, Sampo Ruoppila and Jenni Airaksinen

Teachers conceptualizing and developing assessment for skill development: Trialing a maker assessment framework (A Brief History of Inquiry: From Dewey to Standards) pp. 540-551

Jennifer Lock, Sandra Becker and Petrea Redmond

Being a female academic under neoliberal evaluation: A systematic review (I Want to Be Both but Is That Possible?”: Communicating Mother-Scholar Uncertainty during Doctoral Candidacy) pp. 552-562

Javier Mula-Flacón, Cristina Cruz-González, Jesús Domingo Segovia and Carmen Lucena Rodríguez

Evidence of research mastery: How applicants argue the feasibility of their research projects (Concepts of originality in the natural science, medical, and engineering disciplines: An analysis of research proposals, Science, Technology) pp. 563-571

Eva Barlösius and Kristina Blem

2021, volume 30, articles 3

No time for that now! Qualitative changes in manuscript peer review during the Covid-19 pandemic (COVID-19 Medical Papers Have Fewer Women First Authors than Expected) pp. 231-239

Serge P J M Horbach

Does government support of a few leading universities have a broader impact on the higher education system? Evaluation of the Russian University Excellence Initiative (The Costs and Benefits of World-Class Universities) pp. 240-255

Andrey Lovakov, Anna Panova, Ivan Sterligov and Maria Yudkevich

On the relationship between interdisciplinarity and impact: Distinct effects on academic and broader impact (A Comparison of Two Approaches for Measuring Interdisciplinary Research Output: The Disciplinary Diversity of Authors vs the Disciplinary Diversity of the Reference List) pp. 256-268

Lin Zhang, Beibei Sun, Lidan Jiang and Ying Huang

SSH researchers make an impact differently. Looking at public research from the perspective of users (ISRIA Statement. Ten Point Guidelines for an Effective Process of Research Impact Assessment) pp. 269-289

Andrea Bonaccorsi, Filippo Chiarello and Gualtiero Fantoni

Estimating the effects of public subsidies on the performance of supported enterprises across firm sizes (Implementing Matching Estimators for Average Treatment Effects in Stata) pp. 290-313

Ondřej Dvouletý, Ivana Blažková and Oto Potluka

An exploration of referees’ comments published in open peer review journals: The characteristics of review language and the association between review scrutiny and citations (Peer Review for Journals: Evidence on Quality Control, Fairness, and Innovation) pp. 314-322

Dietmar Wolfram, Peiling Wang and Fuad Abuzahra

The production of scientific and societal value in research evaluation: a review of societal impact assessment methods (Systems Thinking, Knowledge and Action: Towards Better Models and Methods) pp. 323-335

Jorrit P Smit and Laurens K Hessels

The systemic approach as an instrument to evaluate higher education systems: Opportunities and challenges (Benchmarking Universities’ Efficiency Indicators in the Presence of Internal Heterogeneity) pp. 336-348

Juan Aparicio, Dorys Yaneth Rodríguez and Jon Mikel Zabala-Iturriagagoitia

Does reviewing experience reduce disagreement in proposals evaluation? Insights from Marie Skłodowska-Curie and COST Actions (Peer Review of Grant Applications: Criteria Used and Qualitative Study of Reviewer Practices) pp. 349-360

Marco Seeber, Jef Vlegels, Elwin Reimink, Ana Marušić and David G Pina

How far does an emphasis on stakeholder engagement and co-production in research present a threat to academic identity and autonomy? A prospective study across five European countries (Systems Thinking, Knowledge and Action: Towards Better Models and Methods) pp. 361-369

Annette Boaz, Robert Borst, Maarten Kok and Alison O’Shea

‘Scaling’ the academia: Perspectives of academics on the impact of their practices (Comparing University Rankings’) pp. 370-381

Yasar Kondakci, Merve Zayim-Kurtay, Sevgi Kaya-Kasikci, Hanife Hilal Senay and Busra Kulakoglu

Say my name, say my name: Academic authorship conventions between editorial policies and disciplinary practices (Rethinking Authorship in the Era of Collaborative Research) pp. 382-392

Felicitas Hesselmann, Cornelia Schendzielorz and Nikita Sorgatz

Research and the real world: Analyzing the short- and long-term impact of knowledge transfer (ISRIA Statement: Ten-Point Guidelines for an Effective Process of Research Impact Assessment) pp. 393-404

Katherine Caves and Sarah Lueling

Journal citation reports and the definition of a predatory journal: The case of the Multidisciplinary Digital Publishing Institute (MDPI) (Plagiarism and Predatory Journals: A Threat to Scientific Integrity) pp. 405-419

M Ángeles Oviedo-García

Expression of concern: Journal citation reports and the definition of a predatory journal: The case of the Multidisciplinary Digital Publishing Institute (MDPI) pp. 420-420

M Ángeles Oviedo-García

2021, volume 30, articles 2

The use of an impact framework to evaluate the impact of research on policy and practice: Screening questionnaires for intellectual disability pp. 141-153

Karen McKenzie, Aja Murray, George Murray and Rachel Martin

Understanding and evaluating the impact of integrated problem-oriented research programmes: Concepts and considerations pp. 154-168

Brian M Belcher and Karl Hughes

Gathering evidence of impact from research support services: Examining impact in the context of the Centre for Environmental Data Analysis pp. 169-178

Poppy Townsend and Clare Wilkinson

Understanding collaborative interactions in relation to research impact in social sciences and humanities: A meta-ethnography pp. 179-190

Alexis Dewaele, Kristof Vandael, Stefan Meysman and Ann Buysse

Transformative academic institutions: An experimental framework for understanding regional impacts of research pp. 191-200

María José Aranguren, Patricia Canto-Farachala and James Wilson

The program and policy change framework: A new tool to measure research use in low- and middle-income countries pp. 201-214

Karen Fowle, Brent Wells, Melissa Day, Anjali Kumar, Cameron Bess, Brian Bingham and Annica Wayman

Proposed methodology for measuring the effectiveness of policies designed to further research pp. 215-229

Núria Bautista-Puig, Luis Moreno Lorente and Elías Sanz-Casado

2021, volume 30, articles 1

What are the social and scientific benefits of participating at academic conferences? Insights from a survey among doctoral students and postdocs in Germany (Postdoctoral Researchers: Roles, Functions and Career Prospects) pp. 1-12

Kalle Hauss

The effect of facilitating interdisciplinary cooperation on the research productivity of university research teams: The moderating role of government assistance (Defining Interdisciplinary Research: Conclusions from a Critical Review of the Literature) pp. 13-25

Aihua Chen and Xiaoting Wang

Evaluating socially engaged climate research: Scientists’ visions of a climate resilient U.S. Southwest (A How-to Guide for Coproduction of Actionable Science) pp. 26-38

Gigi Owen

Transdisciplinary research outcomes based on the Transdisciplinary Research on Energetics and Cancer II initiative experience (Addressing Social Determinants of Health and Health Inequalities) pp. 39-50

Sarah D Hohl, Sarah Knerr, Sarah Gehlert, Marian L Neuhouser, Shirley A A Beresford, Joseph M Unger, Paul A Fishman and Beti Thompson

Quantifying the contributions technicians make to research (How Can We Ensure Visibility and Diversity in Research Contributions? How the Contributor Role Taxonomy (CRediT) is Helping the Shift From Authorship to Contributorship) pp. 51-56

Clare McLaren and Alan Dent

Mirror, mirror on the wall: is economics the fairest of them all? An investigation into the social sciences and humanities in Vietnam (Cash Bonuses for Peer-Reviewed Papers Go Global) pp. 57-72

Quan-Hoang Vuong, Anh-Tuan Bui, Viet-Phuong La, Minh-Hoang Nguyen, Hung-Hiep Pham, Thanh-Hang Pham, Thi-Hanh Vu, Thu-Trang Vuong and Manh-Toan Ho

Transforming science and society? Methodological lessons from and for transformation research (Shifting Power Relations in Sustainability Transitions: A Multi-Actor Perspective) pp. 73-89

Katharina Hölscher, Julia M Wittmayer, Martin Hirschnitz-Garbers, Alfred Olfert, Jörg Walther, Georg Schiller and Benjamin Brunnow

Lessons from mixed-method evaluations—An example from labor market research (Instrumental Variables and the Search for Identification: From Supply and Demand to Natural Experiments) pp. 90-101

Christopher Osiander

Science rules! A qualitative study of scientists’ approaches to grant lottery (The Secret to Germany’s Scientific Excellence) pp. 102-111

Axel Philipps

The role of metrics in peer assessments (How Incentives Trickle down: Local Use of a National Bibliometric Indicator System) pp. 112-126

Liv Langfeldt, Ingvild Reymert and Dag W Aksnes

Interdisciplinary knowledge combinations and emerging technological topics: Implications for reducing uncertainties in research evaluation (Blade Runner Economics: Will Innovation Lead the Economic Recovery?) pp. 127-140

Seokbeom Kwon, Jan Youtie and Alan L Porter