November 27, 2023

One-Third of Normal Patients Misclassified by Typical Statistically Significant Cutoffs

 A study in a nuclear medicine journal investigated how often a statistically significant cutoff between normal and abnormal values would misclassify healthy patients. Analyzing 32 test results, the typical cutoff fell just 0.66 SDs from the mean. At that point, one SD encompasses 34% of normally distributed data on both sides of the mean. Consequently, 34% of healthy patients fall beyond 0.66 SDs and would be erroneously deemed abnormal. The authors conclude statistical significance frequently fails to ensure clinical usefulness on an individual level.

Citation: Heston TF, Wahl RL. How often are statistically significant results clinically relevant? Not often. J Nucl Med. 2009;50(Suppl 2):1370. DOI: 10.5281/zenodo.10198933

https://faculty.washington.edu/theston/repository/