Sample size: the minimum number of observations needed to observe an effect of a certain size with a given power level.Statistical power: the likelihood that a test will detect an effect of a certain size if there is one, usually set at 80% or higher.If you know or have estimates for any three of these, you can calculate the fourth component. What is a power analysis?Ī power analysis is a calculation that helps you determine a minimum sample size for your study.Ī power analysis is made up of four main components. To balance these pros and cons of low versus high statistical power, you should use a power analysis to set an appropriate level. This may lead to finding statistically significant results with very little usefulness in the real world. On the flip side, too much power means your tests are highly sensitive to true effects, including very small ones. This means that resources like time and money are wasted, and it may even be unethical to collect data from participants (especially in clinical trials). If you don’t ensure sufficient power, your study may not be able to detect a true effect at all. This means that if there are true effects to be found in 100 different studies with 80% power, only 80 out of 100 statistical tests will actually detect them. The higher the statistical power of a test, the lower the risk of making a Type II error.
Power is the probability of avoiding a Type II error. Type II error : you conclude that spending 10 minutes in nature daily doesn’t affect stress when it actually does.Type I error: you conclude that spending 10 minutes in nature daily reduces stress when it actually doesn’t.Type II error: not rejecting the null hypothesis of no effect when it is actually false.Type I error: rejecting the null hypothesis of no effect when it is actually true.There’s always a risk of making one of two decision errors when interpreting study results: Alternative hypothesis: Spending 10 minutes daily outdoors in a natural environment will reduce symptoms of stress in recent college graduates.Null hypothesis: Spending 10 minutes daily outdoors in a natural environment has no effect on stress in recent college graduates.You rephrase this into a null and alternative hypothesis. Example: Null and alternative hypothesesYour research question concerns whether spending time outside in nature can curb stress in college graduates. The goal is to collect enough data from a sample to statistically test whether you can reasonably reject the null hypothesis in favor of the alternative hypothesis. In hypothesis testing, you start with a null hypothesis of no effect and an alternative hypothesis of a true effect (your actual research prediction). Having enough statistical power is necessary to draw accurate conclusions about a population using sample data. Frequently asked questions about statistical power.