Publication Bias in Empirical Sociological Research

Alan S. Gerber and Neil Malhotra
Additional contact information
Alan S. Gerber: Yale University, New Haven, Connecticut
Neil Malhotra: Stanford University, Stanford, California, neilm@stanford.edu

Sociological Methods & Research, 2008, vol. 37, issue 1, 3-30

Abstract: Despite great attention to the quality of research methods in individual studies, if publication decisions of journals are a function of the statistical significance of research findings, the published literature as a whole may not produce accurate measures of true effects. This article examines the two most prominent sociology journals (the American Sociological Review and the American Journal of Sociology ) and another important though less influential journal ( The Sociological Quarterly ) for evidence of publication bias. The effect of the .05 significance level on the pattern of published findings is examined using a ``caliper'' test, and the hypothesis of no publication bias can be rejected at approximately the 1 in 10 million level. Findings suggest that some of the results reported in leading sociology journals may be misleading and inaccurate due to publication bias. Some reasons for publication bias and proposed reforms to reduce its impact on research are also discussed.

Keywords: publication bias; caliper test; meta-analysis; hypothesis testing (search for similar items in EconPapers)
Date: 2008
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (3)

Downloads: (external link)
https://journals.sagepub.com/doi/10.1177/0049124108318973 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:sae:somere:v:37:y:2008:i:1:p:3-30

DOI: 10.1177/0049124108318973

Access Statistics for this article

More articles in Sociological Methods & Research
Bibliographic data for series maintained by SAGE Publications ().