Statistical power of likelihood ratio and Wald tests in latent class models with covariates

D.W. Gudicha, V.D. Schmittmann, J.K. Vermunt

Research output: Contribution to journalArticleScientificpeer-review

26 Downloads (Pure)

Abstract

This paper discusses power and sample-size computation for likelihood ratio and Wald testing of the significance of covariate effects in latent class models. For both tests, asymptotic distributions can be used; that is, the test statistic can be assumed to follow a central Chi-square under the null hypothesis and a non-central Chi-square under the alternative hypothesis. Power or sample-size computation using these asymptotic distributions requires specification of the non-centrality parameter, which in practice is rarely known. We show how to calculate this non-centrality parameter using a large simulated data set from the model under the alternative hypothesis. A simulation study is conducted evaluating the adequacy of the proposed power analysis methods, determining the key study design factor affecting the power level, and comparing the performance of the likelihood ratio and Wald test. The proposed power analysis methods turn out to perform very well for a broad range of conditions. Moreover, apart from effect size and sample size, an important factor affecting the power is the class separation, implying that when class separation is low, rather large sample sizes are needed to achieve a reasonable power level.

Original languageEnglish
Pages (from-to)1824-1837
JournalBehavior Research Methods
Volume49
Issue number5
DOIs
Publication statusPublished - Oct 2017

Keywords

  • Latent class
  • Power analysis
  • Likelihood ratio
  • Wald test
  • Asymptotic distributions
  • Non-centrality parameter
  • Large simulated data set
  • SAMPLE-SIZE
  • LOGISTIC-REGRESSION
  • NUMBER

Cite this

@article{3783a5502cba4e63b2858d0de80e2d66,
title = "Statistical power of likelihood ratio and Wald tests in latent class models with covariates",
abstract = "This paper discusses power and sample-size computation for likelihood ratio and Wald testing of the significance of covariate effects in latent class models. For both tests, asymptotic distributions can be used; that is, the test statistic can be assumed to follow a central Chi-square under the null hypothesis and a non-central Chi-square under the alternative hypothesis. Power or sample-size computation using these asymptotic distributions requires specification of the non-centrality parameter, which in practice is rarely known. We show how to calculate this non-centrality parameter using a large simulated data set from the model under the alternative hypothesis. A simulation study is conducted evaluating the adequacy of the proposed power analysis methods, determining the key study design factor affecting the power level, and comparing the performance of the likelihood ratio and Wald test. The proposed power analysis methods turn out to perform very well for a broad range of conditions. Moreover, apart from effect size and sample size, an important factor affecting the power is the class separation, implying that when class separation is low, rather large sample sizes are needed to achieve a reasonable power level.",
keywords = "Latent class, Power analysis, Likelihood ratio, Wald test, Asymptotic distributions, Non-centrality parameter, Large simulated data set, SAMPLE-SIZE, LOGISTIC-REGRESSION, NUMBER",
author = "D.W. Gudicha and V.D. Schmittmann and J.K. Vermunt",
year = "2017",
month = "10",
doi = "10.3758/s13428-016-0825-y",
language = "English",
volume = "49",
pages = "1824--1837",
journal = "Behavior Research Methods",
issn = "1554-351X",
publisher = "Springer",
number = "5",

}

Statistical power of likelihood ratio and Wald tests in latent class models with covariates. / Gudicha, D.W.; Schmittmann, V.D.; Vermunt, J.K.

In: Behavior Research Methods, Vol. 49, No. 5, 10.2017, p. 1824-1837.

Research output: Contribution to journalArticleScientificpeer-review

TY - JOUR

T1 - Statistical power of likelihood ratio and Wald tests in latent class models with covariates

AU - Gudicha, D.W.

AU - Schmittmann, V.D.

AU - Vermunt, J.K.

PY - 2017/10

Y1 - 2017/10

N2 - This paper discusses power and sample-size computation for likelihood ratio and Wald testing of the significance of covariate effects in latent class models. For both tests, asymptotic distributions can be used; that is, the test statistic can be assumed to follow a central Chi-square under the null hypothesis and a non-central Chi-square under the alternative hypothesis. Power or sample-size computation using these asymptotic distributions requires specification of the non-centrality parameter, which in practice is rarely known. We show how to calculate this non-centrality parameter using a large simulated data set from the model under the alternative hypothesis. A simulation study is conducted evaluating the adequacy of the proposed power analysis methods, determining the key study design factor affecting the power level, and comparing the performance of the likelihood ratio and Wald test. The proposed power analysis methods turn out to perform very well for a broad range of conditions. Moreover, apart from effect size and sample size, an important factor affecting the power is the class separation, implying that when class separation is low, rather large sample sizes are needed to achieve a reasonable power level.

AB - This paper discusses power and sample-size computation for likelihood ratio and Wald testing of the significance of covariate effects in latent class models. For both tests, asymptotic distributions can be used; that is, the test statistic can be assumed to follow a central Chi-square under the null hypothesis and a non-central Chi-square under the alternative hypothesis. Power or sample-size computation using these asymptotic distributions requires specification of the non-centrality parameter, which in practice is rarely known. We show how to calculate this non-centrality parameter using a large simulated data set from the model under the alternative hypothesis. A simulation study is conducted evaluating the adequacy of the proposed power analysis methods, determining the key study design factor affecting the power level, and comparing the performance of the likelihood ratio and Wald test. The proposed power analysis methods turn out to perform very well for a broad range of conditions. Moreover, apart from effect size and sample size, an important factor affecting the power is the class separation, implying that when class separation is low, rather large sample sizes are needed to achieve a reasonable power level.

KW - Latent class

KW - Power analysis

KW - Likelihood ratio

KW - Wald test

KW - Asymptotic distributions

KW - Non-centrality parameter

KW - Large simulated data set

KW - SAMPLE-SIZE

KW - LOGISTIC-REGRESSION

KW - NUMBER

U2 - 10.3758/s13428-016-0825-y

DO - 10.3758/s13428-016-0825-y

M3 - Article

VL - 49

SP - 1824

EP - 1837

JO - Behavior Research Methods

JF - Behavior Research Methods

SN - 1554-351X

IS - 5

ER -