Citations as a Measure of the Research Outputs of New Zealand's Economics Departments: The Problem of 'Long and Variable Lags'

John Tressler () and David Anderson

Agenda - A Journal of Policy Analysis and Reform, 2012, vol. 19, issue 1, 17-40

Abstract: The paper explores the merits of utilising citation counts to measure research output in economics in the context of a nationwide research evaluation scheme: the New Zealand Performance-Based Research Fund (PBRF). Citations were collected for all refereed papers produced by New Zealand's academic economists over the period 2000 to 2008, and used to estimate the time-lags in between publication and the flow of citations; to demonstrate the impact of alternative definitions of 'economics-relevant' journals on citation counts; and to assess the impact of citation measures on departmental and individual performance. We conclude that under certain scenarios around 60 per cent of papers received no citations over the period. Our findings suggest that the time-lags between publication and citation make it difficult to rely on citation counts to produce a meaningful measure of output in a PBRF-like research-evaluation framework, especially one based on the assessment of individual academics.

Date: 2012
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (9)

Downloads: (external link)
http://press-files.anu.edu.au/downloads/press/p192951/pdf/citations02.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:acb:agenda:v:19:y:2012:i:1:p:17-40

Access Statistics for this article

More articles in Agenda - A Journal of Policy Analysis and Reform from Australian National University, College of Business and Economics, School of Economics Contact information at EDIRC.
Bibliographic data for series maintained by ().