ECLIPSE v2.0: A Systematic Falsification Framework with Quantitative Integrity Metrics

Sjöberg Tala, Camilo Alejandro (M.D.)

No z3fke_v1, MetaArXiv from Center for Open Science

Abstract: The replication crisis reveals pervasive methodological weaknesses, with replication failure rates exceeding 60% in psychology and preclinical biology. While preregistration improves transparency, it lacks technical enforcement and quantitative assessment of rigor. ECLIPSE v2.0 introduces a computational framework that enforces falsification integrity through cryptographic data splitting, single-shot validation, and automated auditing. The framework integrates five sequential stages: (1) irreversible data partitioning with SHA-256 verification; (2) binding preregistration of falsification criteria; (3) cross-validated model development; (4) single-shot holdout testing; and (5) automatic integrity assessment. Three quantitative tools were developed: the Eclipse Integrity Score (EIS) measuring methodological rigor; the Statistical Test for Data Snooping (STDS) detecting performance inflation; and an Automated Code Auditor using multi-level static analysis to identify protocol violations. Across four validation studies, ECLIPSE achieved: (1) strong discrimination between honest and p-hacked studies (Cohen’s d = 3.54, AUC = 0.991); (2) 89% sensitivity for detecting 15% performance inflation; (3) auditor accuracy F1 = 0.908; and (4) prediction of replication success in 73 published studies (ρ = 0.68), outperforming impact factor and sample size. ECLIPSE provides the first quantitative, enforceable, and scalable methodology for ensuring research integrity through prevention, detection, and assessment. Open-source implementation is available at https://github.com/camilosjobergtala/AFH-MODEL .

Date: 2025-10-29
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://osf.io/download/68f8f6c1ee7b2356d6c3fef4/

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:osf:metaar:z3fke_v1

DOI: 10.31219/osf.io/z3fke_v1

Access Statistics for this paper

More papers in MetaArXiv from Center for Open Science
Bibliographic data for series maintained by OSF ().