Efficiency vs Effectiveness: Alternative Metrics for Research Performance

Anatoliy Goncharuk

Journal of Applied Management and Investments, 2018, vol. 7, issue 1, 24-37

Abstract: This paper raised the problem of adequacy of the current performance metrics for a research. The author has looked at this problem from the publisher perspective, and tried answer the question how effective the publications are and how to adequately evaluate their performance. He reviewed the advantages and disadvantages of the existing metrics and concluded that the evaluation of research performance is a complex task which cannot adequately be expressed by a single index. The author developed the metrics applying a non-parametric technique DEA that calculates the relative efficiency on a relatively small number of publicly available data. The bidimensional tool for research (publication) performance analysis – "Efficiency-Effectiveness" matrix is suggested. The practicality of suggested metrics is demonstrated on a case of the Journal of Applied Management and Investments (JAMI). It helped to find the root causes of the low efficiency and low effectiveness of most of the articles of JAMI. Among them: a language variety, restricted access for readers to some volumes (issues), non-indexation in the leading international scientific databases, and practical orientation of many publications that usually are not high-cited. The identified problems should be the reasons for revising the editorial policy aimed at increasing the efficiency and effectiveness of the journal's publications. The author concluded that suggested metrics can’t find all problems of the publisher (journal), but they can allocate a group of problematic publications that burden it. The results of this study should be useful for publisher and chief editors of the research journals that want to improve the editorial policy and to increase the efficiency and quality of the publications (issues).

Keywords: research journal; publications; performance; efficiency; effectiveness (search for similar items in EconPapers)
JEL-codes: C14 L82 O32 (search for similar items in EconPapers)
Date: 2018
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://www.jami.org.ua/Papers/JAMI_7_1_2018_24-37.pdf (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ods:journl:v:7:y:2018:i:1:p:24-37

Access Statistics for this article

Journal of Applied Management and Investments is currently edited by Anatoliy G. Goncharuk

More articles in Journal of Applied Management and Investments from Department of Business Administration and Corporate Security, International Humanitarian University Contact information at EDIRC.
Bibliographic data for series maintained by Anatoliy G. Goncharuk ().