EconPapers    
Economics at your fingertips  
 

Rising Stars

Erich Battistin () and Marco Ovidi ()
Additional contact information
Erich Battistin: Queen Mary, University of London
Marco Ovidi: Queen Mary, University of London

No 11198, IZA Discussion Papers from Institute for the Study of Labor (IZA)

Abstract: We use the UK's 2014 Research Excellence Framework (REF) to study which attributes characterize a top-scoring (four-star) publication in Economics and Econometrics. We frame the analysis as a classification problem and, using information in official documents, derive conditions to infer the unobservable score that panellists awarded to each publication. Juxtaposing institutions' submissions with REF outcomes provides information on the latent pass-marks used for assigning quality levels, which respond to journal prestige measured by the Thomson Reuters Article Influence Score. We explore this statistical feature in the econometric analysis, which reveals the limited contribution to awarded quality made by other publication attributes, possibly unobservable to us, conditional on the Article Influence Score. We conclude that, in large-scale and costly evaluations such as the REF, the time-consuming task of peer reviews should be devoted to publications not in academic outlets with unambiguously top-scoring bibliometric indicators of journal impact. Our model also predicts a ranking of academic journals consistent with the classification of REF panellists.

Keywords: education policy; higher education; journal ranking; research funding (search for similar items in EconPapers)
JEL-codes: H52 H52 H83 H83 I23 I23 I28 (search for similar items in EconPapers)
New Economics Papers: this item is included in nep-sog
Date: 2017-12
References: View references in EconPapers View complete reference list from CitEc
Citations Track citations by RSS feed

Downloads: (external link)
http://ftp.iza.org/dp11198.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:iza:izadps:dp11198

Ordering information: This working paper can be ordered from
IZA, Margard Ody, P.O. Box 7240, D-53072 Bonn, Germany

Access Statistics for this paper

More papers in IZA Discussion Papers from Institute for the Study of Labor (IZA) IZA, P.O. Box 7240, D-53072 Bonn, Germany. Contact information at EDIRC.
Bibliographic data for series maintained by Mark Fallak ().

 
Page updated 2018-03-28
Handle: RePEc:iza:izadps:dp11198