Reverse Fragility in Cochrane Meta-Analyses with P Values 0.05 to 0.20 Requires a Robustness Dimension

Authors

  • Thomas F Heston Department of Family Medicine, University of Washington, Seattle, USA; Department of Medical Education and Clinical Sciences, Elson S. Floyd College of Medicine, Washington State University, Spokane, USA https://orcid.org/0000-0002-5655-2512

DOI:

https://doi.org/10.5281/zenodo.19741629

Keywords:

fragility index, reverse fragility, neutrality boundary, robustness, meta-analysis, Cochrane, p-fr-nb framework, evidence synthesis

Abstract

A meta-epidemiological analysis of 280 Cochrane meta-analyses with P-values between 0.05 and 0.20 reports high reverse fragility and interprets these findings as potentially indicating clinical relevance. That interpretation exceeds what the reverse fragility index can measure. Reverse fragility quantifies classification stability; it does not quantify distance from therapeutic neutrality. The two dimensions are orthogonal, so fragile near-null meta-analyses and underpowered detections of real effects can yield identical reverse fragility values. Completing the analysis with the neutrality boundary framework at the meta-analytic level discriminates between these cases and specifies which nonsignificant Cochrane results warrant a clinical relevance claim.

References

1. Sharifan A, Harrod C, Dobrescu A, Gartlehner G. Reverse fragility index shows high fragility in Cochrane meta-analyses with P values between 0.05 and 0.20: A meta-epidemiological study. J Clin Epidemiol. 2026 Apr 21;0(0). doi:10.1016/j.jclinepi.2026.112285 PubMed PMID: 42025973.

2. Heston TF. Significance, Fragility, and Robustness in Clinical Trials: Stratifying Statistical Evidence. Cureus. 2025 Dec 31;17(12). doi:10.7759/cureus.100494

3. Heston TF. Bidirectional fragility is a step forward but not far enough: the case for a global fragility index. Internet Med J. 2026 Apr 8;1(1):e19464166–e19464166. doi:10.5281/zenodo.19464166

4. Heston TF. The Neutrality Boundary Framework: Quantifying Statistical Robustness Geometrically. arXiv. 2025 Nov 2;2511.00982. doi:10.48550/arXiv.2511.00982

5. Heston TF. The Modified-Arm Fragility Quotient: An Improved Metric for Assessing Robustness in Clinical Trials. Zenodo. 2025 Aug 31. doi:10.5281/zenodo.17014261

6. Walsh M, Srinathan SK, McAuley DF, Mrkobrada M, Levine O, Ribic C, et al. The statistical significance of randomized controlled trial results is frequently fragile: a case for a Fragility Index. J Clin Epidemiol. 2014 Jun;67(6):622–8. doi:10.1016/j.jclinepi.2013.10.019

7. Khan MS, Fonarow GC, Friede T, Lateef N, Khan SU, Anker SD, et al. Application of the reverse fragility index to statistically nonsignificant randomized clinical trial results. JAMA Netw Open. 2020 Aug 3;3(8):e2012469. doi:10.1001/jamanetworkopen.2020.12469

Downloads

Published

2026-04-24

How to Cite

Heston, T. F. (2026). Reverse Fragility in Cochrane Meta-Analyses with P Values 0.05 to 0.20 Requires a Robustness Dimension. Internet Medical Journal, 1(1), e19741629. https://doi.org/10.5281/zenodo.19741629

Issue

Section

Articles