A Statistical Power Comparison from Multivariate and Univariate Latent Growth Models with Incomplete Data

Abstract

Latent growth modeling (LGM) is widely used to examine group differences in developmental trajectories in educational research. With multiple outcomes of interest, a multiple-domain latent growth model (MDLGM) can be applied to account for associations among growth trajectories from the outcomes. While the MDLGM is conceived as a more powerful multivariate analysis technique when compared with univariate LGM, the examination of its methodological performance is very limited. Henceforth, this study compared the statistical power of the MDLGM and separate univariate LGMs via a simulation study with a two-group, two-domain design. Results indicated that the MDLGM and the set of LGMs showed largely comparable power, with a small advantage for the MDLGM under conditions of weak inter-domain correlation and small group differences and showed reduced power as missingness increased. These findings provide educational researchers with a guideline for model selection in longitudinal studies with multiple outcomes.

1. Introduction

In longitudinal data analysis, missing data (e.g., attrition) are commonly encountered in educational and psychological settings, and many studies have discussed the treatment and mechanisms of missing data in longitudinal research [1,2]. In longitudinal research, the latent growth model (LGM) [3] within the structural equation modeling (SEM) framework is widely used and can be extended to incorporate multiple growth trajectories simultaneously. The resulting model is referred to as a multiple-domain latent growth model (MDLGM) or a cross-domain analysis of change model [4]. The MDLGM allows researchers to examine individual differences in developmental change both within individual domains and across multiple domains over time. By jointly modeling correlated growth processes, the MDLGM provides a flexible analytic approach for addressing diverse research questions in correlational longitudinal and developmental research.

Although the MDLGM has been applied in educational and psychological research [5,6], the literature indicates that methodological knowledge regarding its performance in terms of statistical power remains limited. Some studies have examined the statistical power of the MDLGM [7,8] and investigated the use of MDLGM for mediation and causal inference in longitudinal analyses [9,10]. Also, recent simulation studies extended MDLGMs to accommodate non-normal outcome distributions, such as count or ordinal data, via the Bayesian estimation [11]. However, empirical evaluations of their comparative statistical performance under controlled simulation conditions remain limited. The present study provides a structured assessment of the relative statistical power and Type I error rates of these existing models across varying design parameters, including missingness in outcome, as MDLGM’s statistical power for examining group differences in several growth trajectories in the presence of missing data has yet to be investigated. Further, it is well established that conducting multivariate analyses, rather than multiple univariate analyses, can reduce inflation of Type I error rates and improve statistical power when examining multiple correlated outcome variables simultaneously [12,13]. Accordingly, the MDLGM may yield greater power than separate univariate LGMs because it incorporates additional information through correlations among latent growth factors across domains. Therefore, the purpose of this study was to compare the statistical power of the MDLGM with that of a set of univariate LGMs for detecting group differences in longitudinal data with missingness.

1.1. Univariate Latent Growth Modeling

The LGM is a restricted confirmatory factor analysis (CFA) [14] model with a mean structure. The LGM detects both intra-individual differences and inter-individual differences across time using the intercept and slope factors (latent variables). In this framework, individual change over time is assumed to follow a constant rate of increase or decrease, represented by a straight line across measurement occasions. As seen in Figure 1, for instance, the two latent variables (i.e., the intercept and slope factors) are indicated by three repeated outcome measures, ${\mathrm{Y}}_{it}$ for the ith individual at time point t. The intercept factor describes the level in the outcome measures at a reference time point (e.g., the first measurement occasion), whereas the slope factor indicates the rate of change in the outcome measure over time [15,16]. The linear LGM in Figure 1 can be expressed as follows:

$${\mathbf{y}}_i={\mathit{\tau }}_{y_i}+{\mathsf{\Lambda }}_y{\mathit{\eta }}_i+{\mathit{\epsilon }}_i,$$

(1)

where ${\mathbf{y}}_i$ is a 3 × 1 vector of the three observed outcome measures for the ith individual, ${\mathit{\tau }}_{y_i}$ is a 3 × 1 vector of the intercepts of the three observed measures, ${\mathsf{\Lambda }}_y$ is a 3 × 2 matrix of factor loadings for the intercept and slope factors, ${\mathit{\eta }}_i$ is a 2 × 1 vector of the intercept and slope factor scores for the ith individual, and ${\mathit{\epsilon }}_i$ a 3 × 1 vector that refers to the residuals in the observed outcome measures that are not explained by the latent growth model for the ith individual that assumed to follow a multivariate normal distribution with a mean vector of zeros and a variance/covariance matrix of ${\mathsf{\Theta }}_{\epsilon }$. The intercepts of the observed measures (${\mathit{\tau }}_{y_i}$) are typically constrained to zero in the LGM specification due to a model identification issue. Specifically, the components of ${\mathsf{\Lambda }}_y$ are fixed to known constants in which the first column presents ones, and the second column captures (${\mathsf{\lambda }}_{ t}$ = t − 1) at each time point, t.

Further, the intercept and slope factor vector (${\mathit{\eta }}_i$) for the ith individual can be decomposed into fixed and random effects as follows:

$${\mathit{\eta }}_i={\mathit{\mu }}_{{\eta }_i}+{\mathit{\zeta }}_{\mathit{i}},$$

(2)

where ${\mathit{\mu }}_{{\eta }_i}$ is a 2 × 1 vector of means of the intercept and slope factors, and ${\mathit{\zeta }}_{\mathit{i}}$ is a 2 × 1 vector of the intercept and slope factors’ disturbances for the ith individual that follows a multivariate normal distribution with a mean of zeros and variance/covariance matrix of Ψ.

1.2. Multiple-Domain Latent Growth Model

Numerous studies have investigated individual differences in developmental trajectories across multiple outcomes or domains [6,17,18]. The latent growth model (LGM) described in Equations (1) and (2) can be readily extended to assess associations among growth factors across domains, thereby allowing the estimation of intercorrelations among latent growth parameters across multiple-domains [4,19]. The resulting model is referred to as a multiple-domain latent growth model (MDLGM) [8,20,21]. This model has also been described as an associative latent growth model [19], a parallel process model [22,23,24], a cross-domain latent growth model [4], and a bivariate latent growth model [15]. For the purposes of this study, the model will henceforth be referred to as the multiple-domain latent growth model (MDLGM).

The MDLGM allows researchers to simultaneously examine the relationships among multiple growth trajectories. For example, researchers may seek to assess how individuals’ academic achievement evolves concurrently across domains such as reading and mathematics and to determine whether growth processes in these domains are interrelated [4]. In contrast, analyzing multiple outcomes using a series of separate univariate LGMs does not capture interrelations across domains regarding growth factors (e.g., intercept and slope factors), which can be directly estimated using the MDLGM.

Let $y_{it\left(A\right)}$ denote the observed outcome measure in domain A for the ith individual at time point t and $y_{it\left(B\right)}$ represent the observed measure in domain B for the ith individual at time point t as seen in Figure 2. Given that the functional forms of the growth trajectories in both domain A and B are linear in Figure 2, the MDLGM can be expressed as follows:

$${\mathbf{y}}_{ij}={\mathit{\tau }}_{ij}+{\mathsf{\Lambda }}_y{\mathit{\eta }}_{ij}+{\mathsf{\epsilon }}_{ij},$$

(3)

where ${\mathbf{y}}_{ij}$ is a 6 × 1 vector of the observed outcome measures for the ith individual in the jth domain, ${\mathit{\tau }}_{ij}$ is a 6 × 1 vector of the intercepts of outcome measures for the ith individual in the jth domain that are constrained to zeros, ${\mathsf{\Lambda }}_y$ is a 6 × 4 matrix of the growth factors’ factor loading matrix loadings load on observed outcome measures, ${\mathit{\eta }}_{ij}$ is a 4 × 1 vector of the growth factors, and ${\mathsf{\epsilon }}_{ij}$ is a 6 × 1 vector of the residuals in the observed outcome measures that are not explained by the latent growth model that assumed to follow the multivariate normal distribution with a mean vector of zeros and a variance/covariance matrix of ${\mathsf{\Theta }}_{\epsilon }$.

Again, the intercept and slope factor vector (${\mathit{\eta }}_i$) in Equation (3) for the ith individual can be decomposed into fixed and random effects as follows:

$${\mathit{\eta }}_i={\mathit{\mu }}_{{\eta }_i}+{\mathit{\zeta }}_{\mathit{i}}$$

(4)

where ${\mathit{\mu }}_{{\eta }_i}$ is a 4 × 1 vector of means of the intercept and slope factors in domain A and domain B, and ${\mathit{\zeta }}_{\mathit{i}}$ is a 2 × 1 vector of the intercept and slope factors’ disturbances for the ith individual in domain A and domain B that follows a multivariate normal distribution with a mean of zeros and variance/covariance matrix of Ψ.

In addition, the association between the two outcome measures is represented by the covariance structure among the latent intercept and slope factors [15]. The covariance structure of the latent growth factors is captured by the elements of the $\mathsf{\Psi }$ matrix, which is the covariance structure of latent residuals (${\mathit{\zeta }}_i$) in Equation (4) as follows:

$$\mathsf{\Psi }=\left[\begin{array}{c}\begin{array}{c}{\sigma }_{{\alpha }_{\left(A\right)}}^2\\ {\sigma }_{{\beta }_{\left(A\right)}{\alpha }_{\left(A\right)}}\\ {\sigma }_{{\alpha }_{\left(B\right)}{\alpha }_{\left(A\right)}}\end{array}\\ {\sigma }_{{\beta }_{\left(B\right)}{\alpha }_{\left(A\right)}}\end{array} \begin{array}{c}\begin{array}{c}{\sigma }_{{\alpha }_{\left(A\right)}{\beta }_{\left(A\right)}}\\ {\sigma }_{{\beta }_{\left(A\right)}}^2\\ {\sigma }_{{\alpha }_{\left(B\right)}{\beta }_{\left(A\right)}}\end{array}\\ {\sigma }_{{\beta }_{\left(B\right)}{\beta }_{\left(A\right)}}\end{array} \begin{array}{c}\begin{array}{c}{\sigma }_{{\alpha }_{\left(A\right)}{\alpha }_{\left(B\right)}}\\ {\sigma }_{{\beta }_{\left(A\right)}{\alpha }_{\left(B\right)}}\\ {\sigma }_{{\alpha }_{\left(B\right)}}^2\end{array}\\ {\sigma }_{{\beta }_{\left(B\right)}{\alpha }_{\left(B\right)}}\end{array} \begin{array}{c}\begin{array}{c}{\sigma }_{{\alpha }_{\left(A\right)}{\beta }_{\left(B\right)}}\\ {\sigma }_{{\beta }_{\left(A\right)}{\beta }_{\left(B\right)}}\\ {\sigma }_{{\alpha }_{\left(B\right)}{\beta }_{\left(B\right)}}\end{array}\\ {\sigma }_{{\beta }_{\left(B\right)}}^2\end{array}\right].$$

(5)

The $\mathsf{\Psi }$ matrix includes the domain-specific variances and the covariances between domains. The diagonal entries correspond to the variances of the latent growth factors within each domain, while the off-diagonal entries represent the covariances among growth factors both within and across domains.

It is important to first evaluate the growth pattern within each domain to determine the appropriate functional form for the domain-specific univariate latent growth model [4,25]. For example, this preliminary assessment may involve visual inspection of observed scores across measurement occasions. Accordingly, separate univariate LGMs should be fitted for each domain prior to estimating the multiple-domain latent growth model (MDLGM) [4,26].

1.3. Conditional MDLGM

In the presence of heterogeneity in the intercept and slope factors, it is possible to examine whether variability in growth processes across domains is explained by time-invariant predictors such as group membership (e.g., gender) [4]. Inclusion of a binary time-invariant predictor enables the estimation of group-based differences in latent growth parameters within the MDLGM framework through dummy-coded variable specification.

Let $x_i$ denote a binary predictor indicating a group membership for the ith individual (as shown in Figure 3) and let ${\gamma }_{{\alpha }_{\left(A\right)}}$, ${\gamma }_{{\beta }_{\left(A\right)}}$, ${\gamma }_{{\alpha }_{\left(B\right)}}$, and ${\gamma }_{{\beta }_{\left(B\right)}}$ represent the path coefficients regressed on the intercept and slope factors in domains A and B; that is, the path coefficients represent the group differences in initial status and growth rate in the outcome measure in domains A and B. It is known that the inclusion of a time-invariant predictor affects the structural component of the MDLGM so that the growth factors (${\mathit{\eta }}_i$) for the ith individual in the conditional MDLGM can be expressed as follows:

$${\mathit{\eta }}_i= {\mathit{\mu }}_{{\eta }_i}+\mathsf{\Gamma }{x}_i+{\mathit{\zeta }}_i,$$

(6)

where ${\mathit{\eta }}_i$ is a 4 × 1 vector for the ith individual containing the intercept and slope factors for domains A and B; ${\mathit{\mu }}_{{\eta }_i}$ is a 4 × 1 vector of the means of the intercept and slope factors in domains A and B; $\mathsf{\Gamma }$ is a 4 × 1 vector including the regression coefficients’ weights that quantifies linear associations between the predictor and the growth factors in domains A and B; and ${\mathit{\zeta }}_i$ is a 4 × 1 vector representing the latent disturbances for the ith individual. The latent disturbances in the conditional MDLGM can be interpreted as the variability that remains in the growth factors (i.e., intercept and slope factors) after taking into account the impact of the predictor [27].

1.4. Missing Data Mechanism and Maximum Likelihood Method

Missing data are commonly encountered in educational and psychological research, particularly in longitudinal studies [2]. Rubin [28] defined three missing data mechanisms, including missing completely at random (MCAR), missing at random (MAR), and missing not at random (MNAR). Longitudinal missing data are generally considered to be either MAR or MNAR [29]. Although various methods are available for handling parameter estimation with missing data, maximum likelihood (ML), also known as full information maximum likelihood (FIML), is a model-based estimation method that is widely used when data are MAR [2]. Under ML estimation, observations with a larger number of observed data points are weighted more heavily than those with fewer observed data points when estimating latent growth models [30]. In other words, ML estimation is advantageous because it makes inferences based on the likelihood function derived from the observed data and provides model fit indices [1].

An alternative approach for handling missing data under the MAR assumption is a multiple imputation method. In this approach, missing data points are imputed multiple times (e.g., typically five to ten imputations) using information from the observed data. The latent growth model is then fitted separately to each imputed dataset, and the results are subsequently pooled across analyses [30].

Enders [1] noted that the assumptions required for models designed to handle MNAR data (e.g., selection models and pattern-mixture models) are difficult to satisfy in practice. Furthermore, because the present study represents an initial examination of the performance of the MDLGM with incomplete data, the missing data mechanism was assumed to be MAR.

1.5. Purpose of the Present Study

Despite the substantial use of LGMs, relatively few studies have examined their statistical power [7,31,32,33,34,35,36]. Fan [32] investigated the statistical power of linear LGMs for detecting group differences in latent growth parameters by regressing intercept and slope factors on a dummy-coded predictor while varying study conditions such as group difference effect sizes and sample size. The results indicated that Type I error rates remained acceptable (i.e., approximately 0.05) across a wide range of sample sizes when no group differences in intercept and/or slope factors were present. Moreover, statistical power to detect group differences in intercept and slope factors was acceptable (e.g., 0.80) when group differences were large (d = 0.80), even with relatively small sample sizes (e.g., N = 100). In contrast, when group differences were small (d = 0.20), much larger sample sizes (e.g., N ≥ 800) were required to achieve sufficient statistical power (i.e., 0.80 or higher).

Prior methodological work has argued that multivariate latent growth modeling may yield benefits compared to estimating separate univariate growth models [21]. In a related study, Lee and Whittaker [8] found that the use of a multiple-domain latent growth model (MDLGM) to detect group differences in slope factors generally yielded power comparable to that obtained using two separate univariate LGMs. However, they also reported that under certain conditions, when relatively strong inter-domain correlations were combined with relatively small group differences in both domains, the MDLGM provided a slight power advantage over the set of univariate LGMs (e.g., a group difference of 0.0 in Domain A and 0.2 in Domain B with an inter-domain correlation of 0.50). This advantage was attributed to the additional variance components captured by random effects in the conditional MDLGM, which contributed to smaller standard errors for slope coefficients regressed on the exogenous grouping variable [8]. These findings suggest that the MDLGM may be more advantageous than a set of univariate LGMs for detecting group differences, particularly when certain degrees of missingness are present in observed outcome measures.

To our knowledge, prior research has not directly investigated the statistical power of the MDLGM for identifying group differences under conditions of incomplete data. The present study, therefore, aimed to evaluate the power of the MDLGM to identify differences in slope factors and to compare its performance with that of a set of univariate LGMs in the presence of missing data. A Monte Carlo simulation design was implemented to determine whether the MDLGM provides greater statistical power than separate univariate LGMs when testing for group differences. Five design factors were manipulated: (a) sample size, (b) group difference effect sizes, (c) the magnitude of intercorrelations among latent growth factors across domains, (d) the degree of missingness in the observed data, and (e) the number of measurement occasions, resulting in a total of 576 simulation conditions.

2. Materials and Methods

2.1. Simulation Study Conditions

In this simulation study, there was a total of 576 simulation conditions, including a combination of three sample sizes (i.e., N = 200, 400, and 800), two number of measurement occasions (i.e., three/four measurement occasions), four intercorrelations among latent factors between two domains (i.e., ρ = 0.0, 0.1, 0.3, and 0.5), four group difference effect sizes (i.e., d = 0.0, d = 0.2, d = 0.5, d = 0.8), and three different degrees of missingness (i.e., no missingness, moderate missingness, and large missingness).

2.1.1. Sample Size

It is known that a minimum sample size for employing SEM is N = 200 [37]. Also, some researchers have found that the most commonly seen sample sizes in applied studies in SEM were 200, 500, 1000, and 2000 [38]. Thus, three different sample sizes were used in this simulation study (N = 200, 400, and 800) to represent small, moderate, and large sample sizes, respectively.

2.1.2. Group Difference Effect Size

It is well established that the statistical power of a model to detect group differences depends on the magnitude of the group difference effect size [39]. The group difference effect size differed by the Cohen’s effect size measure criteria [40]. There were four group difference effect sizes, indicating null effect (d = 0.0), small group difference (d = 0.2), moderate group difference (d = 0.5), and large group difference (d = 0.8).

2.1.3. Intercorrelation Between Domains

Frane [41] demonstrated that the influence of effect sizes on the power to detect group differences is contingent upon the degree of correlation among response variables. In line with this finding, the intercorrelations among latent growth factors were varied to be zero (0.0), small (0.1), moderate (0.3), and large (0.5) correlations [40].

2.1.4. The Degree of Missingness

Assuming the degree of missingness in the observed measures increased across time, the first measurement occasion data were missing completely at random (MCAR), and the observed outcome measures at the rest of the measurement occasions were missing at random (MAR) [42]. Accordingly, data were generated with no missing (0%), moderate missingness (30% missing data at the last time point), and large missingness (50% missing data at the last time point).

2.1.5. The Number of Measurement Occasions

It is known that a minimum of three repeated measurement occasions is required to estimate a latent growth model (LGM). Additionally, Muthén and Curran [31] found that there were substantial differences in statistical power for detecting group differences when comparing models with three versus four measurement occasions. Accordingly, we consider the scenarios under three- and four-wave designs.

2.2. Data Generation

Data were generated using the conditional MDLGM with a binary predictor (dummy coded) representing group membership (Figure 3) via the Monte Carlo feature in Mplus (version 7.4) [43]. Data were generated to follow a multivariate normal distribution. Additionally, the group assignment in the present study was assumed to be random and balanced so that the variance of the binary grouping variable (G) was set to 0.25. Based on the previous literature, the intercept and slope factors’ mean values were set to zero and 0.1, respectively [22,44], and the two growth factors’ variance values were set to 1, representing a standardized group difference effect size (i.e., Cohen’s d). By doing so, the regression coefficients, ${\gamma }_{{\alpha }_{\left(A\right)}}$, ${\gamma }_{{\beta }_{\left(A\right)}}$, ${\gamma }_{{\alpha }_{\left(B\right)}}$, and ${\gamma }_{{\beta }_{\left(B\right)}}$, can be interpreted as Cohen’s d effect size. Further, data were generated via the effect size, indicating group difference on the two domains’ intercept factors were fixed to zero. This represents that the individuals’ initial statuses on the two domains are the same across individuals. Once the data were generated, the generated parameter estimates were checked by descriptive statistics (e.g., mean, median, standard deviation) to ensure the data generation process.

Specifically, the correlations between the intercept and slope factors within each domain were fixed at 0.20, and the correlations among growth factors across domains were also set to 0.20, consistent with values commonly reported in educational research [45]. The residual variances of the outcome variables (${\sigma }_{{\epsilon }_i}^2$) in each domain were all set to 0.50, and these residual variances are not correlated with each other across measurement occasions and with the growth factors [42].

2.3. Model Estimation

A total of 1000 randomly generated datasets were analyzed using Mplus 7.4 [43] with the maximum likelihood (ML) estimation method. For each of the 576 simulation conditions, the data were fitted to four models: the full MDLGM, restricted MDLGM, a set of full univariate LGMs, and a set of restricted univariate LGMs. With the full MDLGM, the direct effects of the grouping variable on the two domains’ slope factors were estimated simultaneously. With the set of full univariate LGMs, the direct effect of the grouping variable on each of the two domains’ slope factors was estimated separately. Subsequently, a restricted MDLGM was estimated in which the regression coefficients from the grouping variable to the slope factors in both domains [${\gamma }_{{\beta }_{\left(A\right)}}$ and ${\gamma }_{{\beta }_{\left(B\right)}}$] were constrained to zero. Similarly, restricted univariate LGMs were estimated for each domain by fixing the corresponding regression coefficient to zero. Throughout this study, the MDLGMs/LGMs in which the coefficients of ${\gamma }_{{\beta }_{\left(A\right)}}$ and ${\gamma }_{{\beta }_{\left(B\right)}}$ were freely estimated were referred to as full models, whereas the MDLGMs/LGMs with constraints of ${\gamma }_{{\beta }_{\left(A\right)}}$ and ${\gamma }_{{\beta }_{\left(B\right)}}$ equal to zero were referred to as restricted models.

2.4. Data Analysis

Upon completion of data generation, the 1000 generated datasets were fitted to four models (i.e., the full MDLGM/set of LGMs and the restricted MDLGM/set of LGMs). Thereafter, null hypotheses were examined by both MDLGMs and the set of LGMs using R 3.4.0 (R Core Team, 2017) [46].

The overall multivariate null hypothesis tested by the MDLGMs is:

$$H_0: {\gamma }_{{\beta }_{\left(A\right)}}={\gamma }_{{\beta }_{\left(B\right)}}=0,$$

(7)

where ${\gamma }_{{\beta }_{\left(A\right)}}$ and ${\gamma }_{{\beta }_{\left(B\right)}}$ represent the regression coefficients of the domain A and domain B’s slope factors on the grouping variable, respectively. The overall multivariate null hypothesis was utilized as a likelihood ratio test with 2 degrees of freedom (df) difference. Specifically, the likelihood ratio test was conducted by comparing the model ${\chi }^2$ test statistic associated with the full MDLGM to that of the restricted MDLGM. The likelihood ratio test’s null hypothesis was rejected with an occasion of statistically significant Δ${\chi }^2$ between the full model and the restricted model at an α-level of 0.05.

Likewise, the overall multivariate null hypothesis tested by a set of LGMs is as follows:

$$H_0: {\gamma }_{{\beta }_{\left(A\right)}}=0 \mathrm{a}\mathrm{n}\mathrm{d}{ H}_0:{\gamma }_{{\beta }_{\left(B\right)}}=0.$$

(8)

The overall multivariate test for the set of univariate LGMs also utilized a set of likelihood ratio tests. The likelihood ratio tests were conducted by comparing the ${\chi }^2$ test statistics associated with the full LGM to those of the restricted LGM. The null hypothesis of the likelihood ratio tests was rejected when at least one of the two Δ${\chi }^2$ tests between the full LGM and the restricted LGM was statistically significant at a Bonferroni-adjusted α-level of 0.025 (0.05/2 = 0.025).

Empirical statistical power was evaluated under conditions in which the regression effect of the grouping variable on the slope factor was nonzero. Power was defined as the proportion of the 1000 replications in which the overall multivariate null hypothesis for the MDLGM or the set of LGMs was rejected when a true group difference in the slope parameter was present. Consistent with Cohen’s recommendation [40], power values of 0.80 or greater were regarded as adequate. In conditions where the regression effect from the grouping variable to the slope factor was fixed at zero, empirical Type I error rates were computed as the proportion of replications in which the overall multivariate null hypothesis was incorrectly rejected. Type I error rates were evaluated by Bradley’s cutoff criterion [47] of robustness (α ± α/2). Accordingly, with a nominal significance level of α = 0.05, acceptable Type I error rates ranged from 0.025 to 0.075.

3. Results

A total of 1000 successful replications were obtained in each of the simulation conditions. When non-convergent cases occurred, those replications were automatically rerun and replaced with converged solutions to ensure a total of 1000 valid replications.

Table 1. Type 1 error rates for the overall multivariate test across three repeated measures.

		High Missingness				Moderate Missingness				No Missingness
		Intercorrelation				Intercorrelation				Intercorrelation
Model	N	0.0	0.1	0.3	0.5	0.0	0.1	0.3	0.5	0.0	0.1	0.3	0.5
MD LGM	200	0.034	0.051	0.043	0.051	0.052	0.047	0.047	0.047	0.048	0.054	0.066	0.047
	400	0.056	0.051	0.055	0.045	0.048	0.054	0.066	0.045	0.049	0.048	0.049	0.058
	800	0.056	0.056	0.064	0.056	0.055	0.049	0.045	0.043	0.045	0.046	0.053	0.053
LGMs	200	0.035	0.058	0.033	0.046	0.054	0.055	0.045	0.041	0.05	0.053	0.065	0.043
	400	0.051	0.053	0.061	0.043	0.052	0.055	0.059	0.044	0.048	0.046	0.047	0.049
	800	0.053	0.048	0.062	0.048	0.054	0.047	0.051	0.041	0.045	0.043	0.044	0.041

Note. Intercorrelation = intercorrelation between domains, MDLGM = multiple-domain latent growth model; LGMs = univariate latent growth models, N = sample size.

represents the Type I error rates for both the MDLGM and the set of LGMs with three repeated measures as a function of group difference effect size, the degree of missingness in the outcome measures, and intercorrelation between domains.

The empirical Type I error rates for the MDLGM and the set of LGMs ranged between 0.034 and 0.064 and between 0.033 and 0.062, respectively, indicating that the two approaches showed acceptable Type I error rates based on Bradley’s criteria [47]. Similarly, the empirical Type I error rates for the two approaches with four measurement occasions ranged from 0.043 to 0.063 and from 0.039 to 0.066, respectively, as shown in

Table 2. Type 1 error rates for the overall multivariate test across four repeated measures.

		High Missingness				Moderate Missingness				No Missingness
		Intercorrelation				Intercorrelation				Intercorrelation
Model	N	0.0	0.1	0.3	0.5	0.0	0.1	0.3	0.5	0.0	0.1	0.3	0.5
MD LGM	200	0.063	0.05	0.068	0.052	0.043	0.052	0.059	0.048	0.058	0.045	0.053	0.058
	400	0.045	0.054	0.043	0.046	0.046	0.046	0.046	0.055	0.043	0.053	0.055	0.056
	800	0.046	0.05	0.038	0.05	0.059	0.052	0.06	0.048	0.043	0.061	0.052	0.056
LGMs	200	0.058	0.049	0.054	0.049	0.048	0.058	0.054	0.039	0.057	0.042	0.051	0.05
	400	0.044	0.055	0.045	0.041	0.041	0.046	0.043	0.052	0.048	0.05	0.055	0.055
	800	0.048	0.051	0.049	0.052	0.066	0.054	0.062	0.042	0.05	0.056	0.051	0.049

Note. Intercorrelation = intercorrelation between domains, MDLGM = multiple-domain latent growth model; LGMs = univariate latent growth models; N = sample size.

.

As seen in

Table 3. Power rates of MDLGM for the overall multivariate test across three repeated measures.

			High Missingness				Moderate Missingness				No Missingness
			Intercorrelation				Intercorrelation				Intercorrelation
Model	d	N	0.0	0.1	0.3	0.5	0.0	0.1	0.3	0.5	0.0	0.1	0.3	0.5
MD LGM	0.2	200	0.315	0.272	0.269	0.226	0.331	0.288	0.252	0.237	0.377	0.317	0.274	0.244
		400	0.559	0.544	0.474	0.434	0.573	0.512	0.469	0.455	0.640	0.574	0.537	0.487
		800	0.865	0.805	0.774	0.737	0.87	0.85	0.792	0.752	0.906	0.87	0.809	0.785
	0.5	200	0.965	0.957	0.949	0.911	0.971	0.956	0.943	0.91	0.99	0.968	0.95	0.939
		400	1	1	1	0.993	0.999	0.999	0.999	1	1	1	1	0.997
		800	1	1	1	1	1	1	1	1	1	1	1	1
	0.8	200	1	1	1	0.998	1	1	1	1	1	1	1	0.999
		400	1	1	1	1	1	1	1	1	1	1	1	1
		800	1	1	1	1	1	1	1	1	1	1	1	1
LGMs	0.2	200	0.286	0.26	0.272	0.245	0.3	0.274	0.249	0.255	0.339	0.291	0.289	0.263
		400	0.497	0.512	0.47	0.443	0.502	0.465	0.461	0.467	0.576	0.532	0.528	0.5
		800	0.792	0.748	0.747	0.739	0.794	0.797	0.763	0.766	0.848	0.819	0.791	0.79
	0.5	200	0.934	0.931	0.925	0.917	0.95	0.937	0.93	0.908	0.973	0.951	0.943	0.936
		400	0.999	0.999	1	0.993	0.999	0.999	0.998	1	1	1	1	0.997
		800	1	1	1	1	1	1	1	1	1	1	1	1
	0.8	200	1	1	1	0.998	1	1	1	1	1	1	1	0.999
		400	1	1	1	1	1	1	1	1	1	1	1	1
		800	1	1	1	1	1	1	1	1	1	1	1	1

Note. d = group difference effect size; Intercorrelation = intercorrelation between domains; MDLGM = multiple-domain latent growth model; LGMs = univariate latent growth models; N = sample size.

, the MDLGM and the set of LGMs demonstrated comparable power rates across many of the simulation conditions. However, a relatively small power advantage of the MDLGM emerged when the intercorrelation between domains was relatively low (i.e., ρ = 0.0, 0.1) and relatively low group difference effect sizes (d = 0.2). When there was a relatively large group difference effect size (d = 0.5) with a relatively high degree of intercorrelation between domains (ρ = 0.3, 0.5), the power rates from the set of LGMs tend to be similar to the power rates of the MDLGM. In the present study, power rates were considered “similar” when the absolute difference between the two models did not exceed 0.01. As expected, both modeling approaches yielded higher power under complete data conditions compared to moderate and high missingness conditions.

Across all conditions, empirical power increased as a function of both sample size and group difference effect size. When the degree of group difference effect size becomes 0.5 or greater, the power rates of both MDLGM and the set of LGMs reach 0.8, indicating a sufficient power rate. In contrast, when effect sizes were small (d = 0.2), adequate power was attained only under the largest sample size condition (N = 800) for both modeling approaches. Specifically, sample size had a substantial influence on power rates for both modeling approaches. Empirical power rates increased monotonically with sample size, reflecting reductions in standard errors, resulting in enhancing the stability in parameter estimates.

In

Table 4. Power rates of MDLGM for the overall multivariate test across four repeated measures.

			High Missingness				Moderate Missingness				No Missingness
			Intercorrelation				Intercorrelation				Intercorrelation
Model	d	N	0.0	0.1	0.3	0.5	0.0	0.1	0.3	0.5	0.0	0.1	0.3	0.5
MD LGM	0.2	200	0.378	0.322	0.279	0.277	0.369	0.332	0.314	0.269	0.377	0.35	0.306	0.274
		400	0.637	0.618	0.528	0.514	0.65	0.598	0.556	0.509	0.676	0.626	0.575	0.494
		800	0.922	0.909	0.846	0.799	0.906	0.914	0.855	0.811	0.943	0.906	0.871	0.816
	0.5	200	0.987	0.983	0.974	0.948	0.984	0.986	0.969	0.952	0.989	0.989	0.968	0.954
		400	1	1	1	1	1	1	1	0.999	1	1	1	1
		800	1	1	1	1	1	1	1	1	1	1	1	1
	0.8	200	1	1	1	1	1	1	1	1	1	1	1	1
		400	1	1	1	1	1	1	1	1	1	1	1	1
		800	1	1	1	1	1	1	1	1	1	1	1	1
LGMs	0.2	200	0.319	0.296	0.284	0.297	0.332	0.305	0.318	0.299	0.331	0.334	0.305	0.283
		400	0.565	0.575	0.526	0.539	0.571	0.564	0.548	0.542	0.588	0.578	0.57	0.523
		800	0.884	0.871	0.835	0.826	0.861	0.874	0.849	0.824	0.902	0.869	0.856	0.828
	0.5	200	0.975	0.969	0.968	0.953	0.975	0.976	0.964	0.96	0.981	0.981	0.971	0.959
		400	1	1	1	1	1	1	1	0.998	1	1	1	1
		800	1	1	1	1	1	1	1	1	1	1	1	1
	0.8	200	1	1	1	1	1	1	1	0.999	1	1	1	1
		400	1	1	1	1	1	1	1	1	1	1	1	1
		800	1	1	1	1	1	1	1	1	1	1	1	1

Note. d = group difference effect size; Intercorrelation = intercorrelation between domains; MDLGM = multiple-domain latent growth model; LGMs = univariate latent growth models; N = sample size.

, the empirical power rate patterns for both modeling approaches under four repeated measures were consistent with those obtained under three measurement occasions.

Overall, both the MDLGM and the set of LGMs demonstrated slightly higher power when four repeated measures were included compared to three, as expected. Again, the power rates of the two modeling approaches were comparable. However, the MDLGM showed a power advantage when inter-domain correlations were low (ρ = 0.0, 0.1) and group difference effect sizes were small (d = 0.2). In contrast, when effect sizes were moderate to large (d = 0.5) and inter-domain correlations were higher (ρ = 0.3, 0.5), the power of the set of LGMs was indistinguishable from that of the MDLGM. Furthermore, as expected, both modeling approaches achieved higher power under complete data conditions relative to situations involving a moderate-to-high degree of missingness.

4. Discussion

The present study examined the relative performance of the MDLGM and a set of univariate LGMs in terms of their statistical power to detect group differences in growth rates under incomplete data conditions. The results show that both MDLGM and the set of LGMs provided comparable power rates across most simulation conditions. However, notably, in scenarios where there is relatively low intercorrelation between domains (ρ = 0.0, 0.1) paired with relatively low group difference effect sizes (d = 0.2), the empirical power rates of the MDLGM outperformed those of the set of LGMs. This advantage arises because inter-domain correlations influence the standard errors of the slope coefficients regressed on the exogenous grouping variable. Specifically, the MDLGM utilizes the joint distribution of multiple domains to reduce the standard errors of slope coefficients under weak cross-domain dependence. This finding indicates that joint modeling improves estimation efficiency, even with a relatively small sample size, a benefit particularly salient when associations between constructs are relatively weak between domains [48]. In addition, empirical power for both the MDLGM and the set of LGMs under high and moderate missingness conditions was lower than that observed under non-missingness conditions. Nonetheless, power estimates under missing data conditions were generally comparable to those obtained with complete data for both modeling approaches. This finding is attributable to the use of full information maximum likelihood (FIML) estimation, which appropriately handles missing data assumed to satisfy missing completely at random (MCAR) or missing at random (MAR) conditions [1]. Furthermore, the empirical Type I error rates of the MDLGM and the set of LGMs (with Bonferroni correction) were comparable across all simulation conditions.

Consistent with previous research, sample size and the number of measurement occasions were positively associated with empirical power for both the MDLGM and the set of LGMs [32,33]. Specifically, adequate statistical power (i.e., 0.80) was achieved when group difference effect sizes in both domains were 0.50 or larger across all conditions for both modeling approaches. In contrast, when group difference effect sizes were small (d = 0.20), sample size had a substantially greater influence on power. For example, acceptable power levels were attained only with the largest sample size (N = 800) when group differences in both domains were small.

These results suggest that researchers may reasonably expect to detect statistically significant group differences with moderate sample sizes (e.g., N = 200) when effect sizes are moderate (e.g., d = 0.50), regardless of whether the MDLGM or a set of univariate LGMs is used. However, recent methodological advancements emphasize that the choice of modeling approach should also consider the complexity of the measurement model and the potential for time-varying covariates, which can further shift the power dynamics in longitudinal designs [49].

This study addresses a gap in the methodological literature concerning the modeling of multiple latent growth trajectories. While the current study has addressed the methodological gap related to comparing two different growth modeling approaches, there are still a few limitations. The limitations include that this study’s assumption associated with LGM includes uncorrelated measurement errors across time points with homoscedastic error variance, and the functional form of the growth trajectory is linear for both domains. These assumptions may not fully reflect the complexity of longitudinal data observed in practice. Accordingly, future research should extend this work by examining nonlinear growth forms and more flexible error structures to evaluate the robustness and statistical power of growth models under more realistic conditions. Also, future research may extend this work to include real-data analysis using a real-world longitudinal dataset to further the practical implications of the results from the simulation study.

The findings from this study may be useful for researchers who plan to collect data to detect group differences using the MDLGM. Although comparable statistical power was observed for the MDLGM and the set of univariate LGMs under certain conditions, it should be noted that the MDLGM explicitly models cross-domain covariance through joint estimation of correlated growth processes [11]. In contrast, the set of LGMs estimates each domain separately without incorporating inter-domain associations. While statistical power was comparable under certain conditions, the MDLGM offers a coherent multivariate framework that explicitly accounts for cross-domain associations and preserves the rigor of inference when growth processes are correlated. We encourage researchers to aim for a minimum of 800 participants if small-group effect sizes are anticipated. Moreover, researchers should prioritize the interpretation of practical significance; even when a statistically significant group difference is identified through a large sample size, the magnitude of the effect must be evaluated within its specific educational or psychological context.