Goodness-of-fit of multilevel latent class models for categorical data

Research output: Contribution to journalArticleScientificpeer-review

Abstract

In the context of multilevel latent class models, the goodness-of-fit depends on multiple aspects, among which are two local independence assumptions. However, because of the lack of local fit statistics, the model and any issues relating to model fit can only be inspected jointly through global fit statistics. This hinders the search for model improvements, as it cannot be determined where misfit originates and which of the many model adjustments may improve its fit. Also, when relying solely on global fit statistics, assumption violations may become obscured, leading to wrong substantive results. In this paper, two local fit statistics are proposed to improve the understanding of the model, allow individual testing of the local independence assumptions, and inspect the fit of the higher level of the model. Through an application in which the local fit statistics group-variable residual and paired-case residual are used as guidance, it is shown that they pinpoint misfit, enhance the search for model improvements, provide substantive insight, and lead to a model with different substantive conclusions, which would likely not have been found when relying on global information criteria. Both residuals can be obtained in the user-friendly Latent GOLD 5.0 software package.
Original languageEnglish
Pages (from-to)252-282
JournalSociological Methodology
Volume46
Issue number1
DOIs
Publication statusPublished - 2016

Fingerprint

statistics
lack
Group

Cite this

@article{984f48abecb5470791061ab26a3267bc,
title = "Goodness-of-fit of multilevel latent class models for categorical data",
abstract = "In the context of multilevel latent class models, the goodness-of-fit depends on multiple aspects, among which are two local independence assumptions. However, because of the lack of local fit statistics, the model and any issues relating to model fit can only be inspected jointly through global fit statistics. This hinders the search for model improvements, as it cannot be determined where misfit originates and which of the many model adjustments may improve its fit. Also, when relying solely on global fit statistics, assumption violations may become obscured, leading to wrong substantive results. In this paper, two local fit statistics are proposed to improve the understanding of the model, allow individual testing of the local independence assumptions, and inspect the fit of the higher level of the model. Through an application in which the local fit statistics group-variable residual and paired-case residual are used as guidance, it is shown that they pinpoint misfit, enhance the search for model improvements, provide substantive insight, and lead to a model with different substantive conclusions, which would likely not have been found when relying on global information criteria. Both residuals can be obtained in the user-friendly Latent GOLD 5.0 software package.",
author = "E. Nagelkerke and D.L. Oberski and J.K. Vermunt",
year = "2016",
doi = "10.1177/0081175015581379",
language = "English",
volume = "46",
pages = "252--282",
journal = "Sociological Methodology",
issn = "0081-1750",
publisher = "Wiley-Blackwell",
number = "1",

}

Goodness-of-fit of multilevel latent class models for categorical data. / Nagelkerke, E.; Oberski, D.L.; Vermunt, J.K.

In: Sociological Methodology, Vol. 46, No. 1, 2016, p. 252-282.

Research output: Contribution to journalArticleScientificpeer-review

TY - JOUR

T1 - Goodness-of-fit of multilevel latent class models for categorical data

AU - Nagelkerke, E.

AU - Oberski, D.L.

AU - Vermunt, J.K.

PY - 2016

Y1 - 2016

N2 - In the context of multilevel latent class models, the goodness-of-fit depends on multiple aspects, among which are two local independence assumptions. However, because of the lack of local fit statistics, the model and any issues relating to model fit can only be inspected jointly through global fit statistics. This hinders the search for model improvements, as it cannot be determined where misfit originates and which of the many model adjustments may improve its fit. Also, when relying solely on global fit statistics, assumption violations may become obscured, leading to wrong substantive results. In this paper, two local fit statistics are proposed to improve the understanding of the model, allow individual testing of the local independence assumptions, and inspect the fit of the higher level of the model. Through an application in which the local fit statistics group-variable residual and paired-case residual are used as guidance, it is shown that they pinpoint misfit, enhance the search for model improvements, provide substantive insight, and lead to a model with different substantive conclusions, which would likely not have been found when relying on global information criteria. Both residuals can be obtained in the user-friendly Latent GOLD 5.0 software package.

AB - In the context of multilevel latent class models, the goodness-of-fit depends on multiple aspects, among which are two local independence assumptions. However, because of the lack of local fit statistics, the model and any issues relating to model fit can only be inspected jointly through global fit statistics. This hinders the search for model improvements, as it cannot be determined where misfit originates and which of the many model adjustments may improve its fit. Also, when relying solely on global fit statistics, assumption violations may become obscured, leading to wrong substantive results. In this paper, two local fit statistics are proposed to improve the understanding of the model, allow individual testing of the local independence assumptions, and inspect the fit of the higher level of the model. Through an application in which the local fit statistics group-variable residual and paired-case residual are used as guidance, it is shown that they pinpoint misfit, enhance the search for model improvements, provide substantive insight, and lead to a model with different substantive conclusions, which would likely not have been found when relying on global information criteria. Both residuals can be obtained in the user-friendly Latent GOLD 5.0 software package.

U2 - 10.1177/0081175015581379

DO - 10.1177/0081175015581379

M3 - Article

VL - 46

SP - 252

EP - 282

JO - Sociological Methodology

JF - Sociological Methodology

SN - 0081-1750

IS - 1

ER -