A new justification of the Hartung‐Knapp method for random‐effects meta‐analysis based on weighted least squares regression

Robbie van Aert*, Dan Jackson

*Corresponding author for this work

Research output: Contribution to journalArticleScientificpeer-review

Abstract

The Hartung-Knapp method for random-effects meta-analysis, that was also independently proposed by Sidik and Jonkman, is becoming advocated for general use. This method has previously been justified by taking all estimated variances as known and using a different pivotal quantity to the more conventional one when making inferences about the average effect. We provide a new conceptual framework for, and justification of, the Hartung-Knapp method. Specifically, we show that inferences from fitted random-effects models, using both the conventional and the Hartung-Knapp method, are equivalent to those from closely related intercept only weighted least squares regression models. This observation provides a new link between Hartung and Knapp's methodology for meta-analysis and standard linear models, where it can be seen that the Hartung-Knapp method can be justified by a linear model that makes a slightly weaker assumption than taking all variances as known. This provides intuition for why the Hartung-Knapp method has been found to perform better than the conventional one in simulation studies. Furthermore, our new findings give more credence to ad hoc adjustments of confidence intervals from the Hartung-Knapp method that ensure these are at least as wide as more conventional confidence intervals. The conceptual basis for the Hartung-Knapp method that we present here should replace the established one because it more clearly illustrates the potential benefit of using it.
Original languageEnglish
Number of pages13
JournalResearch Synthesis Methods
DOIs
Publication statusE-pub ahead of print - 2019

Fingerprint

meta-analysis
confidence interval
method
conceptual framework
methodology
simulation
effect

Keywords

  • BETWEEN-STUDY VARIANCE
  • CLINICAL-TRIALS
  • CONFIDENCE-INTERVALS
  • EFFECTS META-REGRESSION
  • HETEROGENEITY VARIANCE ESTIMATORS
  • Hartung-Knapp modification
  • MODELS
  • REFINED METHOD
  • TESTS
  • meta-analysis
  • meta-regression
  • random-effects weighted least squares regression

Cite this

@article{f4d9814127834f9a89218bbf4d2d010a,
title = "A new justification of the Hartung‐Knapp method for random‐effects meta‐analysis based on weighted least squares regression",
abstract = "The Hartung-Knapp method for random-effects meta-analysis, that was also independently proposed by Sidik and Jonkman, is becoming advocated for general use. This method has previously been justified by taking all estimated variances as known and using a different pivotal quantity to the more conventional one when making inferences about the average effect. We provide a new conceptual framework for, and justification of, the Hartung-Knapp method. Specifically, we show that inferences from fitted random-effects models, using both the conventional and the Hartung-Knapp method, are equivalent to those from closely related intercept only weighted least squares regression models. This observation provides a new link between Hartung and Knapp's methodology for meta-analysis and standard linear models, where it can be seen that the Hartung-Knapp method can be justified by a linear model that makes a slightly weaker assumption than taking all variances as known. This provides intuition for why the Hartung-Knapp method has been found to perform better than the conventional one in simulation studies. Furthermore, our new findings give more credence to ad hoc adjustments of confidence intervals from the Hartung-Knapp method that ensure these are at least as wide as more conventional confidence intervals. The conceptual basis for the Hartung-Knapp method that we present here should replace the established one because it more clearly illustrates the potential benefit of using it.",
keywords = "BETWEEN-STUDY VARIANCE, CLINICAL-TRIALS, CONFIDENCE-INTERVALS, EFFECTS META-REGRESSION, HETEROGENEITY VARIANCE ESTIMATORS, Hartung-Knapp modification, MODELS, REFINED METHOD, TESTS, meta-analysis, meta-regression, random-effects weighted least squares regression",
author = "{van Aert}, Robbie and Dan Jackson",
year = "2019",
doi = "10.1002/jrsm.1356",
language = "English",
journal = "Research Synthesis Methods",
issn = "1759-2879",

}

TY - JOUR

T1 - A new justification of the Hartung‐Knapp method for random‐effects meta‐analysis based on weighted least squares regression

AU - van Aert, Robbie

AU - Jackson, Dan

PY - 2019

Y1 - 2019

N2 - The Hartung-Knapp method for random-effects meta-analysis, that was also independently proposed by Sidik and Jonkman, is becoming advocated for general use. This method has previously been justified by taking all estimated variances as known and using a different pivotal quantity to the more conventional one when making inferences about the average effect. We provide a new conceptual framework for, and justification of, the Hartung-Knapp method. Specifically, we show that inferences from fitted random-effects models, using both the conventional and the Hartung-Knapp method, are equivalent to those from closely related intercept only weighted least squares regression models. This observation provides a new link between Hartung and Knapp's methodology for meta-analysis and standard linear models, where it can be seen that the Hartung-Knapp method can be justified by a linear model that makes a slightly weaker assumption than taking all variances as known. This provides intuition for why the Hartung-Knapp method has been found to perform better than the conventional one in simulation studies. Furthermore, our new findings give more credence to ad hoc adjustments of confidence intervals from the Hartung-Knapp method that ensure these are at least as wide as more conventional confidence intervals. The conceptual basis for the Hartung-Knapp method that we present here should replace the established one because it more clearly illustrates the potential benefit of using it.

AB - The Hartung-Knapp method for random-effects meta-analysis, that was also independently proposed by Sidik and Jonkman, is becoming advocated for general use. This method has previously been justified by taking all estimated variances as known and using a different pivotal quantity to the more conventional one when making inferences about the average effect. We provide a new conceptual framework for, and justification of, the Hartung-Knapp method. Specifically, we show that inferences from fitted random-effects models, using both the conventional and the Hartung-Knapp method, are equivalent to those from closely related intercept only weighted least squares regression models. This observation provides a new link between Hartung and Knapp's methodology for meta-analysis and standard linear models, where it can be seen that the Hartung-Knapp method can be justified by a linear model that makes a slightly weaker assumption than taking all variances as known. This provides intuition for why the Hartung-Knapp method has been found to perform better than the conventional one in simulation studies. Furthermore, our new findings give more credence to ad hoc adjustments of confidence intervals from the Hartung-Knapp method that ensure these are at least as wide as more conventional confidence intervals. The conceptual basis for the Hartung-Knapp method that we present here should replace the established one because it more clearly illustrates the potential benefit of using it.

KW - BETWEEN-STUDY VARIANCE

KW - CLINICAL-TRIALS

KW - CONFIDENCE-INTERVALS

KW - EFFECTS META-REGRESSION

KW - HETEROGENEITY VARIANCE ESTIMATORS

KW - Hartung-Knapp modification

KW - MODELS

KW - REFINED METHOD

KW - TESTS

KW - meta-analysis

KW - meta-regression

KW - random-effects weighted least squares regression

U2 - 10.1002/jrsm.1356

DO - 10.1002/jrsm.1356

M3 - Article

JO - Research Synthesis Methods

JF - Research Synthesis Methods

SN - 1759-2879

ER -