Skip to main content
  • Oral presentation
  • Open access
  • Published:

Determining clinical significance independently from statistical significance? Implications for practice

Objective

To present two proposed methods for determining clinically significant effects and describe each by using the same example from the scoliosis literature where statistical significance was not obtained.

Background

In science, statistics are universally used for making an inference about a population from sample data. The purpose of statistical inference is to determine if a proposed null hypothesis can be rejected, by comparing the probability of an observation to occur under the null hypothesis (p-value) to a chosen alpha level of confidence. The null hypothesis is rejected if the p-value is smaller than alpha. The current focus on null hypothesis statistical significance testing in published work perpetuates confusion between statistical significance and clinical importance. Clinically, there are shortfalls to relying only on statistical inference.

Materials and methods

A review of the Pubmed literature revealed several methods for assessing the significance of a clinical effect [1][2]. Two methods will be presented because they are easy to calculate and all variables needed for calculation were available from the scoliosis literature: Half standard deviation rule of thumb and a method combining cut-off points and reliable change index (RCI). Both methods are presented using an example from the scoliosis literature on the effect of exercises where statistical significance was not obtained.

Results

The proposed methods, although mathematically different, are more similar than different in terms of the conclusions they produce.

Conclusions

A combination of statistical and clinical significance determination methods to drawn statistically and clinically relevant inferences should be used when reporting clinical study results.

References

  1. Wise EA: Statistical significance testing and clinical effectiveness studies. Psychotherapy (chic). 2011, 48 (3): 225-8.

    Article  Google Scholar 

  2. Chapman JR, Norvell DC, Hermsmeyer JT, Bransford RJ, Devine J, McGirt MJ, Lee MJ: Evaluating common outcomes for measuring treatment succes for chronic low back pain. Spine. 2011, 36 (21): S54-68.

    Article  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Schreiber, S., Parent, E. & Hedden, D. Determining clinical significance independently from statistical significance? Implications for practice. Scoliosis 7 (Suppl 1), O34 (2012). https://doi.org/10.1186/1748-7161-7-S1-O34

Download citation

  • Published:

  • DOI: https://doi.org/10.1186/1748-7161-7-S1-O34

Keywords