The effect of manuscript characteristics on quality assessment of scientific manuscripts in psychology

Hilde EM Augusteijn, Jelte M Wicherts, Klaas Sijtsma and Marcel ALM van Assen

PLOS ONE, 2026, vol. 21, issue 9, 1-23

Abstract: We report a vignette study and a survey to investigate which study characteristics influence quality ratings psychology academics give of articles submitted for publication, and psychology academics and students to theses written by psychology students. In the vignette study, 800 respondents evaluated the quality of an abstract (7-point scale) of studies with small (N = 54) or large sample sizes (N = 540), showing statistically significant or non-significant results, and containing statistical reporting errors or no errors. In the subsequent survey, the same participants rated the importance of 29 manuscript characteristics related to a study’s theory, design, conduct, data analyses, and presentation for assessing either the quality of a manuscript or its publishability (article) or grade (thesis). Results showed that quality ratings were affected by sample sizes but not by statistical significance or the presence of statistical reporting errors in the rated research vignette. Furthermore, in the survey academics and students provided highly similar ratings of the importance of different aspects relevant to quality assessment of articles and theses. These results suggest that quality criteria for scientific manuscripts are already adopted by students and are similar for submitted manuscripts and theses. Further research is needed to examine which study characteristics researchers consider most important when assessing a manuscript’s quality in peer review.

Date: 2026
References: Add references at CitEc
Citations:

Downloads: (external link)
https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0355938 (text/html)
https://journals.plos.org/plosone/article/file?id= ... 55938&type=printable (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:plo:pone00:0355938

DOI: 10.1371/journal.pone.0355938

Access Statistics for this article

More articles in PLOS ONE from Public Library of Science
Bibliographic data for series maintained by plosone ().