Meta-Analysis and Publication Bias: How Well Does the FAT-PET-PEESE Procedure Work?

Nazila Alinaghi () and W. Reed ()

Working Papers in Economics from University of Canterbury, Department of Economics and Finance

Abstract: This paper studies the performance of the FAT-PET-PEESE (FPP) procedure, a commonly employed approach for addressing publication bias in the economics and business meta-analysis literature. The FPP procedure is generally used for three purposes: (i) to test whether a sample of estimates suffers from publication bias, (ii) to test whether the estimates indicate that the effect of interest is statistically different from zero, and (iii) to obtain an estimate of the mean true effect. Our findings indicate that the FPP procedure performs well in the basic but unrealistic environment of “fixed effects,” where all estimates are assumed to derive from a single population value and sampling error is the only reason for why studies produce different estimates. However, when we study its performance in more realistic data environments, where there is heterogeneity in the population effects across and within studies, the FPP procedure becomes unreliable for the first two purposes, and is less efficient than other estimators when estimating overall mean effect. Further, hypothesis tests about the mean true effect are frequently unreliable. We corroborate our findings by recreating the simulation framework of Stanley and Doucouliagos (2017) and repeat our tests using their framework.

Keywords: Meta-analysis; publication bias; funnel asymmetry test (FAT); Precision Effect Estimate with Standard Error (PEESE); Monte Carlo; Simulations (search for similar items in EconPapers)
JEL-codes: B41 C15 C18 (search for similar items in EconPapers)
Pages: 72 pages
Date: 2017-07-18
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
https://repec.canterbury.ac.nz/cbt/econwp/1704.pdf (application/pdf)

Related works:
Working Paper: Meta-Analysis and Publication Bias: How Well Does the Fat-Pet-Peese Procedure Work? (2017)
Working Paper: Meta-Analysis and Publication Bias: How Well Does the FAT-PET-PEESE Procedure Work? (2016)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:cbt:econwp:17/04

Access Statistics for this paper

More papers in Working Papers in Economics from University of Canterbury, Department of Economics and Finance Private Bag 4800, Christchurch, New Zealand. Contact information at EDIRC.
Bibliographic data for series maintained by Albert Yee ().