The Meta-Plot: A graphical tool for interpreting the results of a meta-analysis

Marcel A.L.M. Van Assen; Olmo R. Van Den Akker; Hilde E.M. Augusteijn; Marjan Bakker; Michèle B. Nuijten; Anton Olsson-Collentine; Andrea H. Stoevenbelt; Jelte M. Wicherts; Robbie C.M. Van Aert

doi:10.1027/2151-2604/a000513

The Meta-Plot: A graphical tool for interpreting the results of a meta-analysis

Marcel A.L.M. Van Assen, Olmo R. Van Den Akker, Hilde E.M. Augusteijn, Marjan Bakker, Michèle B. Nuijten, Anton Olsson-Collentine, Andrea H. Stoevenbelt, Jelte M. Wicherts, Robbie C.M. Van Aert^*

^*Corresponding author for this work

Methodology and Statistics

Research output: Contribution to journal › Article › Scientific › peer-review

1 Citation (Scopus)

108 Downloads (Pure)

Abstract

The meta-plot is a descriptive visual tool for meta-analysis that provides information on the primary studies in the meta-analysis and the results of the meta-analysis. More precisely, the meta-plot portrays (1) the precision and statistical power of the primary studies in themetaanalysis, (2) the estimate and confidence interval of a random-effects meta-analysis, (3) the results of a cumulative random-effects metaanalysis yielding a robustness check of the meta-analytic effect size with respect to primary studies' precision, and (4) evidence of publication bias. After explaining the underlying logic and theory, the meta-plot is applied to two cherry-picked meta-analyses that appear to be biased and to 10 randomly selected meta-analyses from the psychological literature. We recommend accompanying any meta-analysis of common effect size measures with the meta-plot.

Original language	English
Pages (from-to)	65-78
Journal	Zeitschrift fur Psychologie / Journal of Psychology
Volume	231
Issue number	1
DOIs	https://doi.org/10.1027/2151-2604/a000513
Publication status	Published - 2023

Keywords

cumulative meta-analysis
funnel plot
meta-analysis
publication bias
statistical power

Access to Document

10.1027/2151-2604/a000513Licence: CC BY

MTO v Assen the Meta-Plot ZfP JoP 2023Final published version, 738 KBLicence: CC BY

Cite this

Van Assen, M. A. L. M., Van Den Akker, O. R., Augusteijn, H. E. M., Bakker, M., Nuijten, M. B., Olsson-Collentine, A., Stoevenbelt, A. H., Wicherts, J. M., & Van Aert, R. C. M. (2023). The Meta-Plot: A graphical tool for interpreting the results of a meta-analysis. Zeitschrift fur Psychologie / Journal of Psychology, 231(1), 65-78. https://doi.org/10.1027/2151-2604/a000513

@article{2e108b342fa746d0954e2b58034b98a0,

title = "The Meta-Plot: A graphical tool for interpreting the results of a meta-analysis",

abstract = "The meta-plot is a descriptive visual tool for meta-analysis that provides information on the primary studies in the meta-analysis and the results of the meta-analysis. More precisely, the meta-plot portrays (1) the precision and statistical power of the primary studies in themetaanalysis, (2) the estimate and confidence interval of a random-effects meta-analysis, (3) the results of a cumulative random-effects metaanalysis yielding a robustness check of the meta-analytic effect size with respect to primary studies' precision, and (4) evidence of publication bias. After explaining the underlying logic and theory, the meta-plot is applied to two cherry-picked meta-analyses that appear to be biased and to 10 randomly selected meta-analyses from the psychological literature. We recommend accompanying any meta-analysis of common effect size measures with the meta-plot.",

keywords = "cumulative meta-analysis, funnel plot, meta-analysis, publication bias, statistical power",

author = "{Van Assen}, {Marcel A.L.M.} and {Van Den Akker}, {Olmo R.} and Augusteijn, {Hilde E.M.} and Marjan Bakker and Nuijten, {Mich{\`e}le B.} and Anton Olsson-Collentine and Stoevenbelt, {Andrea H.} and Wicherts, {Jelte M.} and {Van Aert}, {Robbie C.M.}",

note = "Funding Information: This research was supported by the European Research Council, Grant Number: 726361 (IMPROVE). ",

year = "2023",

doi = "10.1027/2151-2604/a000513",

language = "English",

volume = "231",

pages = "65--78",

journal = "Zeitschrift fur Psychologie / Journal of Psychology",

issn = "2190-8370",

publisher = "HOGREFE PUBLISHING CORP",

number = "1",

}

TY - JOUR

T1 - The Meta-Plot

T2 - A graphical tool for interpreting the results of a meta-analysis

AU - Van Assen, Marcel A.L.M.

AU - Van Den Akker, Olmo R.

AU - Augusteijn, Hilde E.M.

AU - Bakker, Marjan

AU - Nuijten, Michèle B.

AU - Olsson-Collentine, Anton

AU - Stoevenbelt, Andrea H.

AU - Wicherts, Jelte M.

AU - Van Aert, Robbie C.M.

N1 - Funding Information: This research was supported by the European Research Council, Grant Number: 726361 (IMPROVE).

PY - 2023

Y1 - 2023

N2 - The meta-plot is a descriptive visual tool for meta-analysis that provides information on the primary studies in the meta-analysis and the results of the meta-analysis. More precisely, the meta-plot portrays (1) the precision and statistical power of the primary studies in themetaanalysis, (2) the estimate and confidence interval of a random-effects meta-analysis, (3) the results of a cumulative random-effects metaanalysis yielding a robustness check of the meta-analytic effect size with respect to primary studies' precision, and (4) evidence of publication bias. After explaining the underlying logic and theory, the meta-plot is applied to two cherry-picked meta-analyses that appear to be biased and to 10 randomly selected meta-analyses from the psychological literature. We recommend accompanying any meta-analysis of common effect size measures with the meta-plot.

AB - The meta-plot is a descriptive visual tool for meta-analysis that provides information on the primary studies in the meta-analysis and the results of the meta-analysis. More precisely, the meta-plot portrays (1) the precision and statistical power of the primary studies in themetaanalysis, (2) the estimate and confidence interval of a random-effects meta-analysis, (3) the results of a cumulative random-effects metaanalysis yielding a robustness check of the meta-analytic effect size with respect to primary studies' precision, and (4) evidence of publication bias. After explaining the underlying logic and theory, the meta-plot is applied to two cherry-picked meta-analyses that appear to be biased and to 10 randomly selected meta-analyses from the psychological literature. We recommend accompanying any meta-analysis of common effect size measures with the meta-plot.

KW - cumulative meta-analysis

KW - funnel plot

KW - meta-analysis

KW - publication bias

KW - statistical power

UR - https://osf.io/eayfr/

UR - http://www.scopus.com/inward/record.url?scp=85149143103&partnerID=8YFLogxK

U2 - 10.1027/2151-2604/a000513

DO - 10.1027/2151-2604/a000513

M3 - Article

AN - SCOPUS:85149143103

SN - 2190-8370

VL - 231

SP - 65

EP - 78

JO - Zeitschrift fur Psychologie / Journal of Psychology

JF - Zeitschrift fur Psychologie / Journal of Psychology

IS - 1

ER -

The Meta-Plot: A graphical tool for interpreting the results of a meta-analysis

Abstract

Keywords

Access to Document

Other files and links

Fingerprint

Web application meta-plot

The meta-plot: A graphical tool for interpreting the results of a meta-analysis

Cite this