A power fallacy

Eric-Jan Wagenmakers, Josine Verhagen, Alexander Ly, M. Bakker, Michael D Lee, Dora Matzke, Jeffrey N Rouder, Richard D Morey

Research output: Contribution to journalArticleScientificpeer-review

37 Citations (Scopus)

Abstract

The power fallacy refers to the misconception that what holds on average -across an ensemble of hypothetical experiments- also holds for each case individually. According to the fallacy, high-power experiments always yield more informative data than do low-power experiments. Here we expose the fallacy with concrete examples, demonstrating that a particular outcome from a high-power experiment can be completely uninformative, whereas a particular outcome from a low-power experiment can be highly informative. Although power is useful in planning an experiment, it is less useful-and sometimes even misleading-for making inferences from observed data. To make inferences from data, we recommend the use of likelihood ratios or Bayes factors, which are the extension of likelihood ratios beyond point hypotheses. These methods of inference do not average over hypothetical replications of an experiment, but instead condition on the data that have actually been observed. In this way, likelihood ratios and Bayes factors rationally quantify the evidence that a particular data set provides for or against the null or any other hypothesis.

Original languageEnglish
Pages (from-to)913-917
Number of pages5
JournalBehavior Research Methods
Volume47
Issue number4
DOIs
Publication statusPublished - Dec 2015

Fingerprint Dive into the research topics of 'A power fallacy'. Together they form a unique fingerprint.

  • Cite this

    Wagenmakers, E-J., Verhagen, J., Ly, A., Bakker, M., Lee, M. D., Matzke, D., Rouder, J. N., & Morey, R. D. (2015). A power fallacy. Behavior Research Methods, 47(4), 913-917. https://doi.org/10.3758/s13428-014-0517-4