Economics at your fingertips  

Research Evaluation

1991 - 2023

Current editor(s): Julia Melkers, Emanuela Reale and Thed van Leeuwen

From Oxford University Press
Bibliographic data for series maintained by Oxford University Press ().

Access Statistics for this journal.
Track citations for all items by RSS feed
Is something missing from the series or not right? See the RePEc data check for the archive and series.

Volume 32, issue 1, 2023

Voices from the field pp. 1-1 Downloads
Julia Melkers, Emanuela Reale and Thed van Leeuwen
Tilting at twin windmills: On article quotas and journal impact factors pp. 2-3 Downloads
Joseph E Serafy
When publication metrics become the fetish: The research evaluation systems’ relationship with academic work engagement and burnout pp. 4-18 Downloads
Konrad Kulikowski, Sylwia Przytuła and Łukasz Sułkowski
Evaluation of the arts in performance-based research funding systems: An international perspective pp. 19-31 Downloads
Kamila Lewandowska, Emanuel Kulczycki and Michael Ochsner
The footprint of a metrics-based research evaluation system on Spain’s philosophical scholarship: An analysis of researchers’ perceptions pp. 32-46 Downloads
Ramón A Feenstra and Emilio Delgado López-Cózar
The impact of Italian performance-based research funding systems on the intensity of international research collaboration pp. 47-57 Downloads
Giovanni Abramo and Ciriaco Andrea D’Angelo
S&T resource allocation considering both performance and potential: The case of Chinese research institutes pp. 58-69 Downloads
Teng-Yu Zhao|, Ruimin Pei and Guo-Liang Yang
Quis judicabit ipsos judices? A case study on the dynamics of competitive funding panel evaluations pp. 70-85 Downloads
João M Santos
Peer review in funding-by-lottery: A systematic overview and expansion pp. 86-100 Downloads
Jamie Shaw
What makes databases tick: Logics that underpin national databases for research output in Europe pp. 101-115 Downloads
Linda Sīle and Sarah de Rijcke
Research governance and the dynamics of science: A framework for the study of governance effects on research fields pp. 116-127 Downloads
Maria Nedeva, Mayra M Tirado and Duncan A Thomas
Toward a modular evaluation approach of real-world laboratories: Findings from a literature review pp. 128-143 Downloads
Teresa Kampfmann, Philip Bernert and Daniel J Lang
Explaining employment sector choices of doctoral graduates in Germany pp. 144-156 Downloads
Lea Goldan, Steffen Jaksztat and Christiane Gross
Globalization of scientific communication: Evidence from authors in academic journals by country of origin pp. 157-169 Downloads
Vít Macháček

Volume 31, issue 3, 2022

Research calls, competition for funding and inefficiency pp. 289-296 Downloads
António Osório and Lutz Bornmann
The funding and research trends in library and information science of NSSFC: Comparison of awards and papers pp. 297-310 Downloads
Jianqin Xiang and Haiyan Wang
Enriching research quality: A proposition for stakeholder heterogeneity pp. 311-320 Downloads
Thomas Franssen
Automated citation recommendation tools encourage questionable citations pp. 321-325 Downloads
Serge P J M Horbach, Freek J W Oude Maatman, Willem Halffman and Wytske M Hepkema
Pathways for assessing interdisciplinarity: A systematic review pp. 326-343 Downloads
Bethany K Laursen, Nicole Motzer and Kelly J Anderson
Interdisciplinary research and policy impacts: Assessing the significance of knowledge coproduction pp. 344-354 Downloads
Luisa Veras de Sandes-Guimarães, Raquel Velho and Guilherme Ary Plonski
Valorization of transdisciplinary research: An evaluation approach and empirical illustration pp. 355-371 Downloads
Stefania Munaretto, Caro E Mooren and Laurens K Hessels
University policy engagement bodies in the UK and the variable meanings of and approaches to impact pp. 372-384 Downloads
Hannah Durrant and Eleanor MacKillop
Under pressure: The extent and distribution of perceived pressure among scientists in Germany, Austria, and Switzerland pp. 385-409 Downloads
David Johann, Isabel J Raabe and Heiko Rauhut
Creating evaluative homogeneity: Experience of constructing a national journal ranking pp. 410-422 Downloads
Jakub Krzeski, Krystian Szadkowski and Emanuel Kulczycki

Volume 31, issue 2, 2022

Assessing research excellence: Evaluating the Research Excellence Framework pp. 173-187 Downloads
Mehmet Pinar and Timothy J Horne
Key factors affecting the promotion of researchers of the Argentine Scientific and Technical Research Council (CONICET) pp. 188-201 Downloads
María Guillermina D'Onofrio and Juan D Rogers
Societal targeting in researcher funding: An exploratory approach pp. 202-213 Downloads
Irene Ramos-Vielba, Duncan A Thomas and Kaare Aagaard
The epistemic, production, and accountability prospects of social impact: An analysis of strategic research proposals pp. 214-225 Downloads
Juha-Pekka Lauronen
Does R&D tax credit impact firm behaviour? Micro evidence for Portugal pp. 226-235 Downloads
Alexandre Paredes, Joana Mendonça, Fernando Bação and Bruno Damásio
Does monitoring performance act as an incentive for improving research performance? National and organizational level analysis of Finnish universities pp. 236-248 Downloads
Laura Himanen and Hanna-Mari Puuska
Evaluating the Revised National Institutes of Health clinical trial definition impact on recruitment progress pp. 249-256 Downloads
Eugene I KaneIII, Gail L Daumit, Kevin M Fain, Roberta W Scherer and Emma Elizabeth McGinty
Predicting funded research project performance based on machine learning pp. 257-270 Downloads
Hoon Jang
A participatory approach to tracking system transformation in clusters and innovation ecosystems—Evolving practice in Sweden’s Vinnväxt programme pp. 271-287 Downloads
Emily Wise, Moa Eklund, Madeline Smith and James Wilson

Volume 31, issue 1, 2022

Self-made university rankings: Categorization tactics and communication activism in Italian universities (Factors Contributing to University Image. The Postgraduate Students’ Point of View) pp. 1-14 Downloads
Andrea Bonaccorsi, Paola Belingheri, Brigida Blasi and Sandra Romagnosi
Fraud, specialization, and efficiency in peer review (A Theory of Fraud and Overtreatment in Experts Markets) pp. 15-23 Downloads
J A Garcia, Rosa Rodriguez-Sanchez and J Fdez-Valdivia
A Research Pathway Model for evaluating the implementation of practice-based research: The case of self-management health innovations (Self-Management Approaches for People with Chronic Conditions: A Review) pp. 24-48 Downloads
Wilke van Beest, Wouter P C Boon, Daan Andriessen, Harald Pol, Gerrita van der Veen and Ellen H M Moors
Evaluation of rice research: An alternate method to capture outcomes (Rainfed Rice Production Systems in Eastern India: An on-Farm Diagnosis and Policy Alternatives’ – A) pp. 49-60 Downloads
Parshuram Samal, Biswajit Mondal, Nitiprasad N Jambhulkar, Onkar N Singh, Ramlakhan Verma, Sushant K Dash, Anup K Das and Himanshu Pathak
Using the catastrophe theory to discover transformative research topics (Nonlinear Analysis: Catastrophe Theory Modeling and Cobb’s Cusp Surface Analysis Program) pp. 61-79 Downloads
Haiyun Xu, Jos Winnink, Huawei Wu, Hongshen Pang and Chao Wang
Research evaluations for an energy transition? Insights from a review of Swedish research evaluation reports (Defining and Assessing Research Quality in a Transdisciplinary Context) pp. 80-92 Downloads
Sofie Sandin and Mats Benner
The Corona-Eye: Exploring the risks of COVID-19 on fair assessments of impact for REF2021 (ISRIA Statement: Ten-Point Guidelines for an Effective Process of Research Impact Assessment) pp. 93-103 Downloads
Gemma E Derrick and Julie Bayley
Do peers share the same criteria for assessing grant applications? (Estimating the Association between Latent Class Membership and External Variables Using Bias-Adjusted Three-Step Approaches) pp. 104-117 Downloads
Sven E Hug and Michael Ochsner
Measuring societal impact of research—Developing and validating an impact instrument for occupational health and safety (Can Beliefs about Musculoskeletal Pain and Work Be Changed at the National Level? Prospective Evaluation of the Danish National Job & Body Campaign) pp. 118-131 Downloads
Ole Henning Sørensen, Jakob Bjørner, Andreas Holtermann, Johnny Dyreborg, Jorid Birkelund Sørli, Jesper Kristiansen and Steffen Bohni Nielsen
Beyond bean counting: Is the policy effective for the innovation efficiency of wind power industry in China? (Do Financial Constraints Moderate the Relationship between Innovation Subsidies and Firms’ R&D Investment) pp. 132-144 Downloads
Zihao Jiang, Jiarong Shi, Zhiying Liu and Lei Gong
Capabilities for transdisciplinary research (Why the Capability Approach?) pp. 145-158 Downloads
Cian O’Donovan, Aleksandra (Ola) Michalec and Joshua R Moon
Documenting development of interdisciplinary collaboration among researchers by visualizing connections (Academic-Practitioner Collaboration in Management Research: A Case of Cross-Profession Collaboration) pp. 159-172 Downloads
Linden E Higgins and Julia M Smith

Volume 30, issue 4, 2021

Researcher experiences in practice-based interdisciplinary research (Imagining Autism: Feasibility and Impact of a Drama-Based Intervention on the Social Communicative and Imaginative Behaviour of Children with Autism) pp. 421-430 Downloads
Jennifer Leigh and Nicole Brown
A formative approach to the evaluation of Transformative Innovation Policies (The Need for Reflexive Evaluation Approaches in Development Cooperation) pp. 431-442 Downloads
Jordi Molas-Gallart, Alejandra Boni, Sandro Giachi and Johan Schot
Exploring research impact models: A systematic scoping review (AsseCssment of the Impact of a Clinical and Health Services Research Call in Catalonia) pp. 443-457 Downloads
Maryam Razmgir, Sirous Panahi, Leila Ghalichi, Seyed Ali Javad Mousavi and Shahram Sedghi
Looking for evidence of research impact and use: A qualitative study of an Australian research-policy system (Public Social Policy Development and Implementation: A Case Study of the Ghana National Health Insurance Scheme) pp. 458-469 Downloads
Robyn S. Newson, Lucie Rychetnik, Lesley King, Andrew J. Milat and Adrian E. Bauman
Profile of authors publishing in ‘predatory’ journals and causal factors behind their decision: A systematic review (Understanding of Medical Students about Predatory Journals: A Comparative Study from KSA and New Zealand) pp. 470-483 Downloads
Sefika Mertkan, Gulen Onurkan Aliusta and Nilgun Suphi
Systematizing societal effects of transdisciplinary research (‚Wirkungen in Der Partizipativen Gesundheitsforschung: Eine Einordnung in Die Diskurse Zum Forschungsimpact) pp. 484-499 Downloads
Martina Schäfer, Matthias Bergmann and Lena Theiler
Self-evaluating participatory research projects: A content validation of the InSPIRES online impact evaluation tool (Content Validity and Reliability of Single Items or Questionnaires) pp. 500-513 Downloads
Florence Gignac, Anne-Sophie Gresle, Valeria Santoro Lamelas, Montserrat Yepes-Baldó, Leonardo de la Torre, Maria-Jesus Pinazo and the InSPIRES Consortium
The different responses of universities to introduction of performance-based research funding (How Incentives Trickle down: Local Use of a National Bibliometric Indicator System) pp. 514-528 Downloads
Giovanni Abramo and Ciriaco Andrea D’Angelo
It takes two to tango: Examining productive interactions in urban research collaboration (Generating Research Questions through Problematization) pp. 529-539 Downloads
Helka Kalliomäki, Sampo Ruoppila and Jenni Airaksinen
Teachers conceptualizing and developing assessment for skill development: Trialing a maker assessment framework (A Brief History of Inquiry: From Dewey to Standards) pp. 540-551 Downloads
Jennifer Lock, Sandra Becker and Petrea Redmond
Being a female academic under neoliberal evaluation: A systematic review (I Want to Be Both but Is That Possible?”: Communicating Mother-Scholar Uncertainty during Doctoral Candidacy) pp. 552-562 Downloads
Javier Mula-Flacón, Cristina Cruz-González, Jesús Domingo Segovia and Carmen Lucena Rodríguez
Evidence of research mastery: How applicants argue the feasibility of their research projects (Concepts of originality in the natural science, medical, and engineering disciplines: An analysis of research proposals, Science, Technology) pp. 563-571 Downloads
Eva Barlösius and Kristina Blem

Volume 30, issue 3, 2021

No time for that now! Qualitative changes in manuscript peer review during the Covid-19 pandemic (COVID-19 Medical Papers Have Fewer Women First Authors than Expected) pp. 231-239 Downloads
Serge P J M Horbach
Does government support of a few leading universities have a broader impact on the higher education system? Evaluation of the Russian University Excellence Initiative (The Costs and Benefits of World-Class Universities) pp. 240-255 Downloads
Andrey Lovakov, Anna Panova, Ivan Sterligov and Maria Yudkevich
On the relationship between interdisciplinarity and impact: Distinct effects on academic and broader impact (A Comparison of Two Approaches for Measuring Interdisciplinary Research Output: The Disciplinary Diversity of Authors vs the Disciplinary Diversity of the Reference List) pp. 256-268 Downloads
Lin Zhang, Beibei Sun, Lidan Jiang and Ying Huang
SSH researchers make an impact differently. Looking at public research from the perspective of users (ISRIA Statement. Ten Point Guidelines for an Effective Process of Research Impact Assessment) pp. 269-289 Downloads
Andrea Bonaccorsi, Filippo Chiarello and Gualtiero Fantoni
Estimating the effects of public subsidies on the performance of supported enterprises across firm sizes (Implementing Matching Estimators for Average Treatment Effects in Stata) pp. 290-313 Downloads
Ondřej Dvouletý, Ivana Blažková and Oto Potluka
An exploration of referees’ comments published in open peer review journals: The characteristics of review language and the association between review scrutiny and citations (Peer Review for Journals: Evidence on Quality Control, Fairness, and Innovation) pp. 314-322 Downloads
Dietmar Wolfram, Peiling Wang and Fuad Abuzahra
The production of scientific and societal value in research evaluation: a review of societal impact assessment methods (Systems Thinking, Knowledge and Action: Towards Better Models and Methods) pp. 323-335 Downloads
Jorrit P Smit and Laurens K Hessels
The systemic approach as an instrument to evaluate higher education systems: Opportunities and challenges (Benchmarking Universities’ Efficiency Indicators in the Presence of Internal Heterogeneity) pp. 336-348 Downloads
Juan Aparicio, Dorys Yaneth Rodríguez and Jon Mikel Zabala-Iturriagagoitia
Does reviewing experience reduce disagreement in proposals evaluation? Insights from Marie Skłodowska-Curie and COST Actions (Peer Review of Grant Applications: Criteria Used and Qualitative Study of Reviewer Practices) pp. 349-360 Downloads
Marco Seeber, Jef Vlegels, Elwin Reimink, Ana Marušić and David G Pina
How far does an emphasis on stakeholder engagement and co-production in research present a threat to academic identity and autonomy? A prospective study across five European countries (Systems Thinking, Knowledge and Action: Towards Better Models and Methods) pp. 361-369 Downloads
Annette Boaz, Robert Borst, Maarten Kok and Alison O’Shea
‘Scaling’ the academia: Perspectives of academics on the impact of their practices (Comparing University Rankings’) pp. 370-381 Downloads
Yasar Kondakci, Merve Zayim-Kurtay, Sevgi Kaya-Kasikci, Hanife Hilal Senay and Busra Kulakoglu
Say my name, say my name: Academic authorship conventions between editorial policies and disciplinary practices (Rethinking Authorship in the Era of Collaborative Research) pp. 382-392 Downloads
Felicitas Hesselmann, Cornelia Schendzielorz and Nikita Sorgatz
Research and the real world: Analyzing the short- and long-term impact of knowledge transfer (ISRIA Statement: Ten-Point Guidelines for an Effective Process of Research Impact Assessment) pp. 393-404 Downloads
Katherine Caves and Sarah Lueling
Journal citation reports and the definition of a predatory journal: The case of the Multidisciplinary Digital Publishing Institute (MDPI) (Plagiarism and Predatory Journals: A Threat to Scientific Integrity) pp. 405-419 Downloads
M Ángeles Oviedo-García
Expression of concern: Journal citation reports and the definition of a predatory journal: The case of the Multidisciplinary Digital Publishing Institute (MDPI) pp. 420-420 Downloads
M Ángeles Oviedo-García

Volume 30, issue 2, 2021

The use of an impact framework to evaluate the impact of research on policy and practice: Screening questionnaires for intellectual disability pp. 141-153 Downloads
Karen McKenzie, Aja Murray, George Murray and Rachel Martin
Understanding and evaluating the impact of integrated problem-oriented research programmes: Concepts and considerations pp. 154-168 Downloads
Brian M Belcher and Karl Hughes
Gathering evidence of impact from research support services: Examining impact in the context of the Centre for Environmental Data Analysis pp. 169-178 Downloads
Poppy Townsend and Clare Wilkinson
Understanding collaborative interactions in relation to research impact in social sciences and humanities: A meta-ethnography pp. 179-190 Downloads
Alexis Dewaele, Kristof Vandael, Stefan Meysman and Ann Buysse
Transformative academic institutions: An experimental framework for understanding regional impacts of research pp. 191-200 Downloads
María José Aranguren, Patricia Canto-Farachala and James Wilson
The program and policy change framework: A new tool to measure research use in low- and middle-income countries pp. 201-214 Downloads
Karen Fowle, Brent Wells, Melissa Day, Anjali Kumar, Cameron Bess, Brian Bingham and Annica Wayman
Proposed methodology for measuring the effectiveness of policies designed to further research pp. 215-229 Downloads
Núria Bautista-Puig, Luis Moreno Lorente and Elías Sanz-Casado

Volume 30, issue 1, 2021

What are the social and scientific benefits of participating at academic conferences? Insights from a survey among doctoral students and postdocs in Germany (Postdoctoral Researchers: Roles, Functions and Career Prospects) pp. 1-12 Downloads
Kalle Hauss
The effect of facilitating interdisciplinary cooperation on the research productivity of university research teams: The moderating role of government assistance (Defining Interdisciplinary Research: Conclusions from a Critical Review of the Literature) pp. 13-25 Downloads
Aihua Chen and Xiaoting Wang
Evaluating socially engaged climate research: Scientists’ visions of a climate resilient U.S. Southwest (A How-to Guide for Coproduction of Actionable Science) pp. 26-38 Downloads
Gigi Owen
Transdisciplinary research outcomes based on the Transdisciplinary Research on Energetics and Cancer II initiative experience (Addressing Social Determinants of Health and Health Inequalities) pp. 39-50 Downloads
Sarah D Hohl, Sarah Knerr, Sarah Gehlert, Marian L Neuhouser, Shirley A A Beresford, Joseph M Unger, Paul A Fishman and Beti Thompson
Quantifying the contributions technicians make to research (How Can We Ensure Visibility and Diversity in Research Contributions? How the Contributor Role Taxonomy (CRediT) is Helping the Shift From Authorship to Contributorship) pp. 51-56 Downloads
Clare McLaren and Alan Dent
Mirror, mirror on the wall: is economics the fairest of them all? An investigation into the social sciences and humanities in Vietnam (Cash Bonuses for Peer-Reviewed Papers Go Global) pp. 57-72 Downloads
Quan-Hoang Vuong, Anh-Tuan Bui, Viet-Phuong La, Minh-Hoang Nguyen, Hung-Hiep Pham, Thanh-Hang Pham, Thi-Hanh Vu, Thu-Trang Vuong and Manh-Toan Ho
Transforming science and society? Methodological lessons from and for transformation research (Shifting Power Relations in Sustainability Transitions: A Multi-Actor Perspective) pp. 73-89 Downloads
Katharina Hölscher, Julia M Wittmayer, Martin Hirschnitz-Garbers, Alfred Olfert, Jörg Walther, Georg Schiller and Benjamin Brunnow
Lessons from mixed-method evaluations—An example from labor market research (Instrumental Variables and the Search for Identification: From Supply and Demand to Natural Experiments) pp. 90-101 Downloads
Christopher Osiander
Science rules! A qualitative study of scientists’ approaches to grant lottery (The Secret to Germany’s Scientific Excellence) pp. 102-111 Downloads
Axel Philipps
The role of metrics in peer assessments (How Incentives Trickle down: Local Use of a National Bibliometric Indicator System) pp. 112-126 Downloads
Liv Langfeldt, Ingvild Reymert and Dag W Aksnes
Interdisciplinary knowledge combinations and emerging technological topics: Implications for reducing uncertainties in research evaluation (Blade Runner Economics: Will Innovation Lead the Economic Recovery?) pp. 127-140 Downloads
Seokbeom Kwon, Jan Youtie and Alan L Porter
Page updated 2024-02-23