MHTOPT: Stata module for Optimal Multiple Hypothesis Testing

Davide Viviano (), Kaspar Wuthrich, Paul Niehaus and Erick Rosas Lopez ()
Additional contact information
Davide Viviano: Harvard University
Kaspar Wuthrich: Department of Economics, University of Michigan
Erick Rosas Lopez: UC San Diego

Statistical Software Components from Boston College Department of Economics

Abstract: mhtopt implements the optimal multiple-hypothesis-testing (MHT) correction of Viviano, Wuthrich and Niehaus (2026), which derives the per-test significance level alpha* from the economic incentives of research production rather than treating MHT adjustment as ad hoc. Given a cost function for adding hypotheses and observations to a study, the package returns the alpha* that maximizes the welfare of an evidence-driven decision maker. Two cost models are supported: a linear/FDA calibration (default, using fixed-cost share parameters from Sertkaya et al. 2016) and a Cobb-Douglas calibration (J-PAL parameters from Appendix A of the paper). The package provides five commands: mht_critical computes alpha* for given J and n; mht_test applies the correction to a vector of p-values and compares against Bonferroni, Holm, Benjamini-Hochberg, and unadjusted decisions; mht_est is a postestimation wrapper that reads e(b) and e(V) from any Stata regression; mht_cost_estimate recovers cost parameters from project-level data; mht_table reproduces Table 1 of the paper. Reference: arXiv:2104.13367.

Language: Stata
Requires: Stata version 15
Keywords: hypothesis testing; multiple hypotheses (search for similar items in EconPapers)
Date: 2026-06-19
Note: This module should be installed from within Stata by typing "ssc install mhtopt". The module is made available under terms of the MIT license (https://opensource.org/licenses/MIT).
References: Add references at CitEc
Citations:

Downloads: (external link)
http://fmwww.bc.edu/repec/bocode/m/mht_cost_estimate.ado
http://fmwww.bc.edu/repec/bocode/m/mht_critical.ado
http://fmwww.bc.edu/repec/bocode/m/mht_est.ado
http://fmwww.bc.edu/repec/bocode/m/mht_table.ado
http://fmwww.bc.edu/repec/bocode/m/mht_test.ado
http://fmwww.bc.edu/repec/bocode/m/mht_cost_estimate.sthlp
http://fmwww.bc.edu/repec/bocode/m/mht_critical.sthlp
http://fmwww.bc.edu/repec/bocode/m/mht_est.sthlp
http://fmwww.bc.edu/repec/bocode/m/mht_table.sthlp
http://fmwww.bc.edu/repec/bocode/m/mht_test.sthlp
http://fmwww.bc.edu/repec/bocode/m/mht_example.do

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:boc:bocode:s459757

Ordering information: This software item can be ordered from
http://repec.org/docs/ssc.php

Access Statistics for this software item

More software in Statistical Software Components from Boston College Department of Economics Boston College, 140 Commonwealth Avenue, Chestnut Hill MA 02467 USA. Contact information at EDIRC.
Bibliographic data for series maintained by Christopher F Baum ().