Reproducibility of individual effect sizes in meta-analyses in psychology

Research output: Contribution to journalArticleScientificpeer-review

4 Citations (Scopus)

Abstract

To determine the reproducibility of psychological meta-analyses, we investigated whether we could reproduce 500 primary study effect sizes drawn from 33 published meta-analyses based on the information given in the meta-analyses, and whether recomputations of primary study effect sizes altered the overall results of the meta-analysis. Results showed that almost half (k = 224) of all sampled primary effect sizes could not be reproduced based on the reported information in the meta-analysis, mostly because of incomplete or missing information on how effect sizes from primary studies were selected and computed. Overall, this led to small discrepancies in the computation of mean effect sizes, confidence intervals and heterogeneity estimates in 13 out of 33 meta-analyses. We provide recommendations to improve transparancy in the reporting of the entire meta-analytic process, including the use of preregistration, data and workflow sharing, and explicit coding practices.
Original languageEnglish
Article numbere0233107
Number of pages18
JournalPLoS ONE
Volume15
Issue number5
DOIs
Publication statusPublished - 2020

Keywords

  • meta-analysis
  • reproducibility
  • reporting errors
  • effect sizes

Fingerprint Dive into the research topics of 'Reproducibility of individual effect sizes in meta-analyses in psychology'. Together they form a unique fingerprint.

Cite this