No adjustments are needed for multiple comparisons
- PMID: 2081237
No adjustments are needed for multiple comparisons
Abstract
Adjustments for making multiple comparisons in large bodies of data are recommended to avoid rejecting the null hypothesis too readily. Unfortunately, reducing the type I error for null associations increases the type II error for those associations that are not null. The theoretical basis for advocating a routine adjustment for multiple comparisons is the "universal null hypothesis" that "chance" serves as the first-order explanation for observed phenomena. This hypothesis undermines the basic premises of empirical research, which holds that nature follows regular laws that may be studied through observations. A policy of not making adjustments for multiple comparisons is preferable because it will lead to fewer errors of interpretation when the data under evaluation are not random numbers but actual observations on nature. Furthermore, scientists should not be so reluctant to explore leads that may turn out to be wrong that they penalize themselves by missing possibly important findings.
Similar articles
-
[Not significant--what now?].Zentralbl Gynakol. 2006 Dec;128(6):307-10. doi: 10.1055/s-2006-942088. Zentralbl Gynakol. 2006. PMID: 17213967 German.
-
Power and sample size when multiple endpoints are considered.Pharm Stat. 2007 Jul-Sep;6(3):161-70. doi: 10.1002/pst.301. Pharm Stat. 2007. PMID: 17674404
-
Interpretation of research data: hypothesis testing.Am J Hosp Pharm. 1980 Nov;37(11):1539-45. Am J Hosp Pharm. 1980. PMID: 7211860
-
[How to assess the size of a clinical trial?].Rev Mal Respir. 1994;11(6):547-57. Rev Mal Respir. 1994. PMID: 7831504 Review. French.
-
Redressing the power and effect of significance. A new approach to an old problem: teaching statistics to nursing students.Nurse Educ Today. 2000 Jul;20(5):358-64. doi: 10.1054/nedt.2000.0429. Nurse Educ Today. 2000. PMID: 10895117 Review.
Cited by
-
A Unique Gut Microbiome-Physical Function Axis Exists in Older People with HIV: An Exploratory Study.AIDS Res Hum Retroviruses. 2021 Jul;37(7):542-550. doi: 10.1089/AID.2020.0283. Epub 2021 Apr 30. AIDS Res Hum Retroviruses. 2021. PMID: 33787299 Free PMC article.
-
Pupillary fluctuation amplitude preceding target presentation is linked to the variable foreperiod effect on reaction time in Psychomotor Vigilance Tasks.PLoS One. 2022 Oct 20;17(10):e0276205. doi: 10.1371/journal.pone.0276205. eCollection 2022. PLoS One. 2022. PMID: 36264952 Free PMC article.
-
Prevalence of Chemotherapy-Induced Peripheral Neuropathy in Multiple Myeloma Patients and its Impact on Quality of Life: A Single Center Cross-Sectional Study.Front Pharmacol. 2021 Apr 22;12:637593. doi: 10.3389/fphar.2021.637593. eCollection 2021. Front Pharmacol. 2021. PMID: 33967771 Free PMC article.
-
Individual-level factors associated with COVID-19 vaccine acceptance among U.S. patients with cancer.Vaccine. 2022 Nov 2;40(46):6649-6657. doi: 10.1016/j.vaccine.2022.09.063. Epub 2022 Sep 28. Vaccine. 2022. PMID: 36210253 Free PMC article.
-
Focal atrophy on MRI and neuropathologic classification of dementia with Lewy bodies.Neurology. 2012 Aug 7;79(6):553-60. doi: 10.1212/WNL.0b013e31826357a5. Epub 2012 Jul 25. Neurology. 2012. PMID: 22843258 Free PMC article.
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources