Inflation of Familywise Error Rate in Treatment Efficacy Testing Due to the Reallocation of Significance Levels Based on Safety Data

Akifumi Notsu () and Keita Mori
Additional contact information
Akifumi Notsu: Clinical Research Center, Shizuoka Cancer Center, 1007 Shimonagakubo, Sunto-Nagaizumi, Shizuoka 411-8777, Japan
Keita Mori: Clinical Research Center, Shizuoka Cancer Center, 1007 Shimonagakubo, Sunto-Nagaizumi, Shizuoka 411-8777, Japan

Mathematics, 2025, vol. 13, issue 16, 1-10

Abstract: In randomized clinical trials comparing two standard treatments, a two-sided test for efficacy at a significance level α is typically used when neither treatment is expected to be superior at the design stage. This two-sided test comprises two one-sided tests, each conducted at a significance level of α / 2 . If safety data later suggest that one treatment is not clinically acceptable due to a higher rate of adverse events, investigators may reallocate the α / 2 significance level originally assigned to the one-sided efficacy test for that treatment to the other one-sided test. This results in a two-stage procedure. We examine the impact of such reallocation on the familywise error rate (FWER). Using theoretical derivations and simulation studies, we show that FWER can exceed the nominal level α when the treatment with fewer adverse events tends to show greater efficacy. Therefore, the two-stage procedure should be avoided when strict control of FWER is a priority. These findings emphasize the need for caution when reallocating significance levels based on auxiliary information and have implications beyond clinical trials, particularly in adaptive statistical methodologies.

Keywords: clinical trial; adaptive clinical trial; familywise error rate; reallocation (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2227-7390/13/16/2547/pdf (application/pdf)
https://www.mdpi.com/2227-7390/13/16/2547/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:13:y:2025:i:16:p:2547-:d:1720794

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().