From black box to white box at open access journals: predictive validity of manuscript reviewing and editorial decisions at Atmospheric Chemistry and Physics
Lutz Bornmann (),
Werner Marx,
Hermann Schier,
Andreas Thor and
Hans-Dieter Daniel
Research Evaluation, 2010, vol. 19, issue 2, 105-118
Abstract:
More than 4,500 open access (OA) journals have now become established in science. But doubts exist about the quality of the manuscript selection process for publication in these journals. In this study we investigate the quality of the selection process of an OA journal, taking as an example the journal Atmospheric Chemistry and Physics (ACP). ACP is working with a new system of public peer review. We examine the predictive validity of the ACP peer review system, namely, whether the process selects the best of the manuscripts submitted. We have data for 1,111 manuscripts that went through the complete ACP selection process in the years 2001 to 2006. The predictive validity was investigated on the basis of citation counts for the later published manuscripts. The results of the citation analysis confirm the predictive validity of the reviewers' ratings and the editorial decisions at ACP: Both covary with citation counts for the published manuscripts. Copyright , Beech Tree Publishing.
Date: 2010
References: Add references at CitEc
Citations: View citations in EconPapers (4)
Downloads: (external link)
http://hdl.handle.net/10.3152/095820210X510089 (application/pdf)
Access to full text is restricted to subscribers.
Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
HTML/Text
Persistent link: https://EconPapers.repec.org/RePEc:oup:rseval:v:19:y:2010:i:2:p:105-118
Access Statistics for this article
Research Evaluation is currently edited by Julia Melkers, Emanuela Reale and Thed van Leeuwen
More articles in Research Evaluation from Oxford University Press
Bibliographic data for series maintained by Oxford University Press ().