Abstract
This study evaluates a DR-GEE approach based on Doubly Robust Generalized Estimating Equations for marginal inference under a hybrid informative cluster size structure. Hybrid informative cluster size refers to situations where cluster size can be related to both the marginal response variable and the distribution of covariates associated with the response. The proposed approach aims to achieve a cluster-balanced marginal estimator designed to mitigate the excessive influence of cluster sizes. To this end, the method combines a flexible cluster-size weighting component, defined by the α adjustment parameter, with an augmentation term derived from the study’s outcome model. Thus, both the direct cluster size–outcome relationship and the imbalance in the distribution of covariates are taken into account. A comprehensive Monte Carlo simulation evaluated performance under varying informativeness levels (γ = 0.1, 0.5, 1.0) and average cluster sizes (λ = 3, 5, 8). DR-GEE was compared with standard GEE, CWGEE, WCR, and DWGEE across different tuning parameters (α = 0.25, 0.50, 1.0). The results show that DR-GEE with α = 1 generally achieved the most favorable performance under hybrid ICS conditions. For example, when γ = 1 and λ = 5, GEE exhibited substantial bias (0.538) and high RMSE (0.566), whereas DR-GEE (α = 1) markedly reduced bias (0.076) and RMSE (0.224). Unlike CWGEE and DWGEE, which address only one dimension of informativeness, DR-GEE balances both cluster size–outcome dependence and covariate information.
1. Introduction
The Informative Cluster Size (ICS) problem in clustered data defines situations where cluster size (the number of units in each cluster) is related to the outcome variable. In other words, if the average outcomes of a cluster change systematically as the number of observations in that cluster increases or decreases, then the cluster size is considered informative [1].
This situation can lead to significant biases in standard statistical analyses, as classical methods generally assume that cluster size is random (independent of the outcome). For example, if the average birth weight differs among offspring with higher litter sizes (cluster sizes), or if an individual with fewer female offspring has poorer oral health, then the cluster size contains information relevant to the outcome. When ICS is ignored, cluster-internal dependence and sampling structure may be incorrectly handled, leading to bias in estimates. Therefore, special methodological approaches that account for ICS have been developed [1,2,3,4].
To accommodate this problem, Hoffman et al. (2001) proposed the within-cluster resampling (WCR) method, which is based on analyzing repeated datasets containing a randomly selected observation from each cluster and taking the mean of the estimates [5]. Although WCR yields unbiased estimation under ICS, it is computationally intensive and often suffers from substantial variance due to the repeated subsampling mechanism.
To reduce the computational burden of the WCR, Williamson et al. (2003) proposed the Cluster-Weighted Generalized Estimating Equations (CWGEE) approach, which uses inverse cluster size weights [2]. By aiming to balance the total contribution of each cluster, CWGEE reduces the dominant influence of large clusters on the estimate and offers a computationally more feasible alternative compared to WCR. However, the use of inverse cluster size weights can increase the sensitivity of estimates to weight selection, particularly when cluster sizes are highly unbalanced. In this case, while small clusters receive relatively higher contributions, the influence of large clusters is significantly reduced; this can lead to increased variance or estimation instability in certain data structures. Furthermore, CWGEE was developed primarily to address cluster size informativeness directly; however, in hybrid structures where informativeness also arises through the joint distribution of variables, additional modeling components may be required.
A more comprehensive conceptualization of ICS was proposed by Huang and Leroux [6]. The authors demonstrated that informativeness may stem not only from the direct relationship between cluster size and the outcome variable, but also from the relationship between cluster size and the distribution of covariates associated with the outcome at the subcluster level [6]. Within this framework, the proposed double-weighted GEE (DWGEE) approach offers a robust structure by combining the outcome regression model with a covariate-based weighting model. In other words, under appropriate assumptions, it can allow for consistent marginal inference provided that at least one of the outcome model or the covariate-based weighting model is correctly specified.
However, the Huang–Leroux approach primarily focuses on the information structures arising from the distribution of covariates. Therefore, in hybrid ICS structures where cluster size is directly related to the outcome variable or where informativeness arises from both the direct cluster size–outcome relationship and the covariate distribution, an additional cluster size adjustment component may be required.
The robust estimation systems provide a strong theoretical framework for solving these complex structures. The foundation of double-robust (DR) estimators is based on the literature on missing data [7]. For longitudinal data, Van der Laan and Robins (2003) proposed a DR estimator for monotonically deficient responses [8]; Bang and Robins (2005) demonstrated how to perform DR inference on longitudinal data with missing values [9]; and Seaman and Copas (2009) developed a double-robust generalized estimation equation (DR-GEE) for longitudinal data with missing values [10]. Prague et al. (2016) adapted this approach to clustered data [11]. Furthermore, Rabideau et al. (2024) recently proposed the idea of simultaneously managing multiple confounding and informative mechanisms [12]. Inspired by these theoretical frameworks, our current study integrates the robust estimation system into the context of flexible cluster-size weighting. In this regard, this study evaluates the DR-GEE approach, which addresses cluster size adjustment in such hybrid structures in conjunction with an outcome-model-based expansion component.
While the WCR, CWGEE, and DWGEE methods have made significant contributions to the ICS literature, further methodological refinements are needed for hybrid ICS structures, where informativeness stems both from the direct relationship between cluster size and the outcome and from the relationship between the distribution of cluster size and the distribution of covariates associated with the outcome. In particular, computationally feasible approaches that can account for imbalances in the distribution of covariates while mitigating the dominant effect of cluster size on the estimate are limited.
This study evaluates the DR-GEE approach, which aims to perform marginal inference under hybrid ICS structures where there is bidirectional information flow between cluster size and the distributions of both the outcome variable and the covariates. The proposed method incorporates the direct effect of cluster size—which is typically ignored in classical GEE approaches—into the model via a flexible weighting mechanism, while also offering the advantage of double robustness through a correction term based on the outcome model. Thus, it aims to reduce systematic bias associated with cluster size and to obtain more consistent and cluster-balanced marginal parameter estimates in clustered data structures with high heterogeneity. In this regard, the study addresses the limitations of existing methods—such as ICS-sensitive WCR, CWGEE, and DWGEE—in a complementary manner, offering a computationally feasible alternative approach that can fill the methodological gap, particularly in mixed ICS scenarios. In addition, to comprehensively evaluate the performance of the proposed DR-GEE approach, we also considered simulation scenarios that included only outcome-dependent cluster size (pure) and covariate-dependent informative cluster size mechanisms.
2. Materials and Methods
2.1. GEE Approaches Under the Assumption of ICS
An important topic addressed in the clustered data literature is the concept of ICS. ICS (also referred to as non-ignorable cluster size) refers to a dependence between the outcome variable and the size of the cluster [13]. In formal terms, ICS arises when the is violated [2,3,4]. Here, denotes the marginal outcome of interest for the -th subunit within the -th cluster , represents the vector of subunit-level and cluster-level covariates, and signifies the cluster size (the total number of subunits within cluster i). The expectation is taken with respect to the true underlying joint distribution of the data. Under this violation, the cluster size carries explicit information about the marginal probability of the outcome, rendering standard unweighted estimation techniques biased.
This phenomenon is frequently encountered in reproductive toxicology studies, where a toxic substance is administered to a maternal rodent, and the birth defects in its offspring are observed. Due to increased fetal resorptions in litters with fewer pups, a greater proportion of birth defects may be observed, thereby introducing dependence between the number of offspring and the outcome. This exemplifies the notion of ICS.
In a study on periodontal health, when examining the relationship between risk factors (such as age, oral hygiene, smoking habits, and plaque) and tooth loss, the dependence between the number of teeth and tooth loss also introduces ICS [2].
Two principal approaches have been proposed for marginal modeling in the presence of ICS. The first is the WCR approach introduced by Hoffman et al. (2001) [5]. Due to its computational intensity, however, Williamson et al. (2003) later proposed an updated methodology known as the CWGEE approach [2].
2.1.1. Within-Cluster Resampling (WCR)
The number of datasets generated via Monte Carlo resampling is denoted by . For each resampled dataset, and represent the estimated parameter vector and its corresponding covariance matrix, respectively. The WCR estimator of is then defined as:
The asymptotic variance-covariance estimator of is given by [3,5]:
2.1.2. Cluster-Weighted Generalized Estimating Equations (CWGEE)
The WCR estimation approach, while robust, is computationally intensive. To address this limitation, Williamson et al. proposed the CWGEE method, which is asymptotically equivalent to WCR. The CWGEE approach offers a more computationally efficient alternative by incorporating cluster-level weights directly into the generalized estimating equations framework. The CWGEE estimating equation is defined as:
where and represents the marginal variance of the outcome for the j-th subunit within the i-th cluster. The parameter estimate is obtained by solving this single weighted estimating equation. The asymptotic variance-covariance matrix of is estimated using the sandwich formula:
Here,
and
Provided that (i) the parameter space is compact, (ii) the covariates are bounded, (iii) the expected derivative of the score function is non-singular, and (iv) the cluster sizes are independent and identically distributed with finite variance, it can be shown that both estimators converge in probability to the same true parameter vector as the number of clusters . Under these regularity conditions, the resampling-based estimator and the single-step CWGEE estimator satisfy:
Both marginal model-based WCR and CWGEE are essential for providing valid and consistent estimates in the presence of informative cluster size [2].
Seaman et al. [14] stated that observed-cluster inference can be obtained by defining the weight differently in the CWGEE approach. In this approach, under the assumption that losses occur with equal probability and , it is proposed to take the weight [14].
2.1.3. Doubly Weighted GEE (DWGEE)
Huang and Leroux (2011) extended the weighted GEE framework with a double-weighted estimating equation to account for situations where cluster size may be related to the distribution of covariates at the subcluster level [6]. This approach is based on the idea that informativeness may stem not only from the direct relationship between cluster size and the outcome variable but also from systematic differences in the distribution of covariates associated with the outcome across clusters of different sizes. To address these potential sources of bias, it has been proposed to combine a cluster-level weight with a covariate-based individual-level weight within the same estimating equation.
Here, wi represents the cluster-level weight and aims to balance the sampling contribution based on cluster size. denotes the covariate-based individual-level weight and is used to account for the potential information bias arising from the relationship between cluster size and the distribution of the covariate.
where
- is the derivative matrix,
- is the working covariance matrix,
- Aij is an augmentation term derived from a specified outcome regression model,
- and is the marginal mean vector.
The construction of wi and ωij is such that the estimator achieves double robustness, meaning that
Under appropriate assumptions, this property offers a two-sided robust structure that allows for consistent marginal inference provided that at least one of the outcome model or the covariate-based weighting model is correctly specified. Therefore, the Huang–Leroux formulation provides an important and theoretically robust framework for addressing the informativeness arising from the distribution of covariates.
However, the Huang–Leroux approach primarily focuses on information structures derived from covariates. Consequently, in hybrid ICS structures where information arises either directly from the cluster size–outcome relationship or through both the direct cluster size–outcome relationship and the covariate distribution, an additional cluster size adjustment component may be required. This distinction forms the rationale for the present study. The DR-GEE approach evaluated in this study aims to support cluster-balanced marginal inference under hybrid ICS conditions by combining flexible cluster-size weighting with an outcome-model-based extension component [6].
2.2. The Proposed Flexible Cluster-Size-Weighted DR-GEE Approach Within the Hybrid ICS Framework
Let i = 1, …, m index the clusters and j = 1, …, ni index the observations within cluster i. Under hybrid ICS, informativeness may arise not only from the direct relationship between cluster size and the response variable but also from the relationship between cluster size and the distribution of covariates associated with the response. This situation can be expressed as follows:
The first inequality shows that cluster size may be directly related to the distribution of results; the second inequality shows that the distribution of the covariate may vary depending on cluster size. The coexistence of these two mechanisms can amplify the effect of large clusters on the estimate in the standard GEE approach and lead to a bias from the targeted cluster-balanced marginal estimator.
The CWGEE approach aims to reduce the dominant contribution of large clusters by using inverse cluster size weights. However, in hybrid ICS frameworks where informativeness also arises through the covariate distribution, cluster size weighting alone may not be sufficient. Therefore, this study evaluates a flexible cluster-size-weighted DR-GEE approach aimed at cluster-balanced marginal inference. The proposed approach combines the cluster-size adjustment component with an outcome-model-based augmentation term, aiming to address both the direct cluster-size–outcome relationship and the informativeness arising from the covariate distribution simultaneously.
2.2.1. Flexible Cluster-Size Weighting
To mitigate the influence of cluster size on the estimate and allow varying degrees of cluster-size adjustment, a flexible sample size weighting defined by the parameter α is used.
where controls the degree of size adjustment [4]:
- α = 1: inverse-size weighting (CWGEE)
- α = 0: no weighting (standard GEE)
- 0 < α < 1: partial cluster-size adjustment
Normalization preserves the overall scale of the estimating equation by ensuring that . Rather than completely eliminating the increase in variance, this normalization helps reduce scale-induced instability in cases where cluster sizes are highly heterogeneous. The weight in Equation (2) adjusts each cluster’s contribution according to its size and aims to reduce bias that could arise directly from the cluster size–outcome relationship. This cluster size weighting component is conceptually distinct from the covariate-based weighting proposed by Huang and Leroux (2011), which primarily addresses the informativeness arising from covariate distributions at the subcluster level [6].
2.2.2. Augmentation Component for Outcome Modeling
To account for the information content arising from the joint distribution of the variables and its effect on the response variable, an augmentation term based on a parametric response model is included:
The augmentation term is defined as:
where
- , is the j-th row of ,
- is the corresponding diagonal element of .
This term aims to model the information that may arise from the relationship between cluster size and the distribution of covariates associated with the outcome. Thus, it provides an additional model-based adjustment component in hybrid ICS frameworks where adjustment based solely on cluster size weighting may not be sufficient.
2.2.3. Proposed Doubly Robust Estimating Equation
The cluster-size–weighted doubly robust GEE estimator is defined as the solution to
The estimating Equation (5) merges:
- Flexible cluster-size weighting, which aims to reduce bias that may arise from the direct relationship between cluster size and results,
- Outcome-model augmentation to correct for covariate imbalance, resulting in a structure that is doubly robust under hybrid ICS.
2.2.4. Double Robustness Under Hybrid ICS
The proposed DR-GEE approach aims to produce consistent estimates of the cluster-balanced marginal estimator under appropriate regularity conditions. In this framework, the performance of the estimator depends on two key components:
Under appropriate conditions, this is expected when the cluster size weighting component adequately balances the cluster size–outcome relationship, or when the study’s outcome model adequately captures the information derived from covariates.
Therefore, the proposed approach offers a more flexible model-based adjustment framework than a correction based solely on cluster size weighting in hybrid ICS structures. However, this feature should not be interpreted as an absolute guarantee of double robustness, but rather as a DR-type correction structure where the cluster size weighting and the outcome model-based expansion component are used together.
The consistency of the DR-GEE estimator is based on classical GEE assumptions, such as an increasing number of clusters, limited cluster sizes, the correct specification of the outcome model or weighting mechanism, and the variables and outcomes having limited moments. When these conditions are met, the method is expected to produce unbiased and reliable estimates.
2.2.5. Distinction from Existing DR-Type Estimators
The proposed DR-GEE differs from previous work as follows:
- CWGEE uses non-stabilized weights and is not doubly robust [2].
- WCR is unbiased but computationally intensive and has high variance [5].
- Huang & Leroux (2011) integrate outcome regression and covariate-based weights, not cluster-size weights; their method does not target direct size-outcome informativeness [6].
In contrast, our proposed method is the first DR-GEE estimator explicitly tailored for hybrid ICS, integrating:
- Flexible cluster-size weighting designed to reduce bias that may arise from the direct relationship between cluster size and results,
- An outcome-model-based expansion component designed to address the informativeness that may arise from imbalances in the distribution of covariates,
- A DR-type model-supported adjustment framework that combines cluster size weighting with outcome-model-based expansion.
2.3. Simulation Design
To evaluate the finite-sample performance of the proposed flexible cluster-size-weighted DR-GEE approach, Monte Carlo simulation experiments were conducted under pure, covariate-dependent and hybrid ICS conditions. This simulation framework is designed to represent complex clustered data structures where larger or smaller clusters may exhibit systematically different outcome distributions, and where the distributions of covariates may also vary depending on cluster size. Such structures may arise in multicenter clinical trials, healthcare research, toxicology experiments, and design-based clustered sampling studies. The simulation design is structured to allow for a comparison of the proposed DR-GEE approach with existing GEE-based methods under different levels of informativeness and average cluster sizes.
2.3.1. Data-Generating Mechanism
For each simulation run, a clustered dataset consisting of m = 200 clusters was generated under hybrid ICS. Let index the clusters, and let index the observations within cluster i. For each cluster, a latent cluster-level random effect was first generated as follows:
Cluster sizes were then generated according to the ICS mechanism. Under hybrid ICS scenarios, cluster size was allowed to depend on the latent cluster-level random effect:
where λ controls the baseline mean cluster size. Three levels were considered:
- (small average cluster size),
- (moderate average cluster size),
- (large average cluster size).
Within each cluster, a binary covariate was generated independently of :
This formulation allows the distribution of the outcome-related covariate to vary systematically across clusters of different sizes, thereby representing the covariate-driven component of ICS.
Binary responses were generated from the following logistic model:
Here, β0 = −0.5 denotes the intercept and β1 = 0.5 denotes the true covariate effect. The ICS strength was controlled by γ, and three levels were examined:
- γ = 0.1 (weak ICS),
- γ = 0.5 (moderate ICS),
- γ = 1.0 (strong ICS).
The hybrid ICS scenario combines both mechanisms, with cluster size related to the latent outcome-generating effect and the covariate distribution varying systematically with cluster size. This design enables comparison of the estimators under direct, covariate-driven, and hybrid forms of informative cluster size.
Following the hybrid scenario—which is the primary hypothesis—the production steps for the pure and covariate-dependent ICS scenarios are provided below.
In the pure ICS scenario, the cluster size is determined by , a hidden and cluster-specific random effect, and the data generation process works as follows:
- Latent Effect: A cluster-level random effect is generated from a normal distribution:
- Cluster Size: The size of the i-th cluster, , is simulated using a conditional Poisson distribution: where represents the baseline mean cluster size, and governs the strength of the informative cluster size mechanism. To avoid empty clusters, we restrict .
- Covariates: The subunit-level predictor is independently drawn from a Bernoulli distribution: , ensuring no baseline association between the covariate space and the cluster size ).
- Outcome: The binary outcome is generated via the following marginal logistic model:
In the Covariate-Dependent ICS scenario, the informativeness of the cluster size does not propagate through an unobserved latent vector, but is instead explicitly driven by the observed covariate space.
The subunit-level covariate prevalence explicitly shifts as a function of the realized cluster size. For a baseline cluster size , the probability of a subunit possessing the risk factor is governed by:
The outcome is subsequently simulated without a latent confounder:
2.3.2. Competing Estimators
Each simulated dataset was analyzed using five marginal estimators:
- Standard GEE
Ignores ICS and serves as a baseline.
- 2.
- CWGEE (Cluster-Weighted GEE)
Applies inverse-cluster-size weights , following Williamson et al. (2003) [2].
- 3.
- WCR (Within-Cluster Resampling)
Resamples one observation per cluster repeatedly and fits GEE to each pseudo-sample (Hoffman et al. 2001) [5].
- 4.
- Huang–Leroux Doubly Weighted GEE (DWGEE)
A covariate-driven doubly weighted approach designed for ICS induced through covariate–size interactions.
In pure ICS settings, this model is intentionally misspecified, enabling evaluation of its robustness.
- 5.
- Proposed DR-GEE
The proposed DR-GEE approach combines an outcome-model-based expansion component with flexible cluster-size weighting. This framework aims both to reduce bias that may arise from the direct cluster-size–outcome relationship and to account for the information derived from the joint distribution of variables in a model-based manner.
The cluster-level weight is defined as a flexible function of cluster size controlled by the α parameter . To preserve the overall scale of the estimating equation, this weight has been normalized:
Here, indicates the degree of cluster size adjustment. When α = 0, no cluster size weighting is applied, which corresponds to the standard GEE. When α = 1, full cluster size weighting is applied, which corresponds to the CWGEE type of full cluster size adjustment. Intermediate values of α = 0.25 and α = 0.50 represent partial cluster size adjustment. In this study, the DR-GEE approach was evaluated under three different levels of cluster size adjustment: α = 0.25, α = 0.50, and α = 1.00.
2.3.3. Simulation Scenarios
The data-generating design was defined by a full factorial combination of two simulation factors:
- ICS strength: γ ∈ {0.1, 0.5, 1.0}
- Average cluster size: λ ∈ {3, 5, 8}
This resulted in 9 distinct data-generating scenarios. For each data-generating scenario, the proposed DR-GEE approach was additionally evaluated under three values of the cluster-size adjustment parameter:
- α ∈ {0.25, 0.50, 1.00}
The α parameter was not part of the data-generating mechanism; rather, it defined alternative DR-GEE estimator variants corresponding to different degrees of cluster-size adjustment. Thus, the simulation study consisted of 9 data-generating scenarios, with three DR-GEE variants evaluated within each scenario. For each scenario, R = 1000 independent datasets were generated. To reduce Monte Carlo variability in the WCR estimator, B = 100 resamples were used per replication.
2.3.4. Performance Metrics
The following metrics were calculated based on the estimates obtained for each method:
- Root Mean Square Error (RMSE):
- Empirical Standard Error (Emp SE): The standard deviation of the estimated coefficients across simulation runs, capturing the observed variability.
- Model-based Standard Error (Model SE): The average of the robust standard errors reported by each method’s estimator, indicating the internal uncertainty quantification.
- Confidence Interval Coverage Rate: The rate at which the true value falls within the 95% confidence interval
- Confidence Interval Width (CI Width): Difference between lower and upper bound
2.3.5. Implementation
All simulations were implemented in R 4.3 using the geepack, nleqslv, and dplyr packages. The DR-GEE estimating equations were solved using a Broyden-type root-finding algorithm. To ensure reproducibility, each scenario was initialized with a fixed random seed.
3. Results
Table 1 presents the relationships between cluster size and two diagnostic indicators according to γ levels: the correlation between the latent cluster effect and cluster size, , and the correlation between the mean value of the common variable at the cluster level and cluster size, . The results indicate that as γ increases, the simulation mechanism strengthens in the expected direction. At a low level of informativeness (γ = 0.1), the correlation between cluster size and the latent cluster effect was found to be quite low (). In contrast, a moderate relationship was observed at the γ = 0.5 level (), and this relationship strengthened significantly at the γ = 1.0 level (). A similar trend was observed in the correlation between cluster size and the mean value of the covariate at the cluster level. While the value was 0.235 at γ = 0.1, it rose to 0.784 at γ = 1.0.
Table 1.
Strength of Informative Cluster Size Mechanisms: Correlation Between Cluster Size and Latent Outcome/Covariate Structures Across Varying γ Levels.
Table 2 presents the performance metrics obtained from simulations conducted under different levels of informativeness (γ = 0.1, 0.5, 1.0) and average cluster size conditions (λ = 3, 5, 8). In the λ = 3 scenario, the GEE approach exhibits systematic bias as the gamma value increases. When the gamma value is 0.1, the GEE method yields stable results with low bias (Bias = −0.012), low RMSE (0.159), and a very good coverage rate (Coverage = 0.96). However, when γ rises to 0.5, the bias increases to 0.158, creating a significant deviation, and the coverage rate drops to 89%. At γ = 1.0, the bias reaches 0.443, and the coverage rate is only 36%. Particularly in the λ = 8 scenario, the bias is very high at 0.586. The RMSE is 0.600, making it one of the largest errors. The coverage ratio has dropped to 1%, and the CI width is 0.47. In the λ = 3 scenario, under weak ICS conditions (γ = 0.1), the CWGEE approach performed relatively well with low bias (−0.020), acceptable RMSE (0.181), and high coverage (0.99). At γ = 0.5, the bias increased to 0.155, and the coverage rate dropped to 0.93. Under strong ICS conditions (γ = 1.0), this deterioration became more pronounced; the bias was calculated as 0.380, the RMSE as 0.439, and the coverage rate dropped to 0.57. Specifically, at γ = 1.0 and λ = 8, the bias increased to 0.562, while the coverage rate dropped to 1%. In the WCR approach under the λ = 3 scenario, under weak ICS conditions (γ = 0.1), the WCR bias was found to be close to zero (0.000), the RMSE value was 0.169, and the coverage rate was calculated as 1.00. However, this high coverage rate was accompanied by a wide confidence interval of 0.97. As the level of information increased, an increase in WCR bias and RMSE valueswas observed. At γ = 0.5, although the coverage rate remained at 0.99, the bias increased to 0.115. Under strong ICS conditions (γ = 1.0), the bias was found to be 0.347, the RMSE 0.403, and the confidence interval width 1.02. Similarly, in the λ = 5 and λ = 8 scenarios, the coverage rates at γ = 1.0 decreased to 0.56 and 0.44, respectively. The DWGEE approach exhibits acceptable performance, particularly at low gamma levels (γ = 0.1). For example, in the λ = 3 scenario, a γ = 0.1 value resulted in a bias of −0.043, an RMSE of 0.240, and a coverage rate of 97%. However, as the γ value increases, the method weakens in terms of statistical accuracy. For γ = 0.5, the bias increased to 0.089, while the confidence interval width reached 1.00; at γ = 1.0, the bias was calculated as 0.221 and the confidence interval width as 1.05. A similar situation applies to the λ = 5 and λ = 8 scenarios. Simulation findings demonstrate that the proposed DR-GEE (α = 1.0) approach exhibits the most stable and reliable performance under hybrid ICS scenarios. Particularly at high informativeness levels such as γ = 0.5 and γ = 1.0, the DR-GEE (α = 1.0) method stands out with low bias and low RMSE values; it also supports its statistical reliability by maintaining coverage rates close to 95%. In contrast, flexible variants such as α = 0.25 and α = 0.50 provided variance control by reducing the weighting degree, but failed to adequately correct the effect of informative clusters, leading to bias and coverage issues. This clearly highlights the need for strong weight correction under hybrid ICS and the advantage of the α = 1 level.
Table 2.
Simulation-Based Performance Metrics for Marginal Estimators Under Hybrid Informative Cluster Size Across Varying γ and λ Conditions.
As shown in Figure 1 and Figure 2, a comprehensive comparison of the performance of GEE-based estimators under hybrid ICS conditions is presented by summarizing their bias and RMSE trajectories across increasing levels of informativeness (γ = 0.1, 0.5, 1.0) and cluster sizes (λ = 3, 5, 8). Specifically, as γ increases, these methods fail to maintain statistical reliability, and the bias and RMSE values increase rapidly. In contrast, the proposed DR-GEE method with flexible cluster size weights (particularly with α = 1.00) demonstrated a more favorable bias and RMSE performance, maintaining low bias and consistent RMSE values across all settings.
Figure 1.
Comparison of Bias Across Gamma Levels for GEE-Based Estimators Under Varying Average Cluster Sizes.
Figure 2.
Comparison of RMSE Across Gamma Levels for GEE-Based Estimators Under Varying Average Cluster Sizes.
Under pure ICS conditions (Supplementary Table S1), it was found that the GEE approach suffers from a loss of performance at high γ values (e.g., 92% coverage for γ = 1.0 and λ = 3). CWGEE exhibits instability, with wide confidence intervals (CI Width ≈ 0.76–0.84) and a relatively higher RMSE. WCR is a highly inefficient method, characterized by very wide confidence intervals (CI Width > 1.0) and a high model standard error (Model SE > 0.25). DWGEE is the method that produces the widest CI width (ranging from 0.98 to 1.03) and a high standard error (Model SE ≈ 0.263 for λ = 8 and = 1.0). Among all the methods evaluated, DR-GEE with full cluster-size weighting ( = 1.00) produced relatively narrow confidence intervals while maintaining coverage probabilities close to the nominal 95% level, particularly with strong informative cluster-size adjustments.
Under covariate-dependent ICS conditions (Supplementary Table S2), DR-GEE methods—particularly the = 0.25 and = 0.50 variants—achieved the most favorable trade-off between bias and variance, offering high coverage with relatively narrow confidence intervals. While DR-GEE ( = 1.00) showed slightly higher RMSE in small cluster sizes, it remained competitive across most settings. In contrast, WCR offered inflated coverage with overly conservative intervals, and DWGEE suffered from high variance.
4. Discussion
Due to the relationship between the response variable and cluster size, the inadequacy of the classical GEE method in ICS situations has led to the development of two alternative approaches in the literature [15]. The first of these, the WCR approach, aims to eliminate the direct cluster effect on the response by selecting a single observation from each cluster; however, this method is computationally intensive. Therefore, its use has been criticized in the literature [16]. However, it is argued that the time required for resampling will decrease in parallel with the advancement of technology [5]. Nevertheless, Williamson et al. [2] proposed the CWGEE approach due to the criticisms of the WCR approach. In the CWGEE approach, is used instead of the inverse probability weight and thus CWGEE is expressed as a different case of WGEE [9,15]. Building on this literature, Huang and Leroux (2011) introduced a doubly weighted GEE method that integrates both outcome regression and covariate-based inverse probability weighting [6]. While effective for covariate-driven ICS, their approach does not target the direct outcome–cluster size association and is therefore inadequate under pure or hybrid ICS mechanisms. The proposed DR-GEE approach addresses these limitations by combining a flexible cluster size weighting component with an augmentation term based on the resulting model. In this approach, cluster size adjustment is treated not merely as a variance correction, but as a weighting strategy associated with the targeted cluster-balanced marginal estimator. This aligns with robust estimation methods such as those developed by Zhao et al. (2025), which focus on making reliable inferences in challenging data structures like heavy-tailed distributions [17]. This connection supports DR-GEE’s potential to generate robust inferences. While the cluster size weighting component aims to reduce bias that may arise directly from cluster size–outcome informativeness, the expansion component provides an additional model-based adjustment for covariate-induced informativeness. Extensive simulations under varying gamma levels and cluster size conditions show that DR-GEE consistently achieves lower bias and RMSE than GEE and CWGEE, particularly when the correlation between cluster size and both the outcome and covariate is strong (as is the case when γ ≥ 0.5).
In conclusion, the DR-GEE framework offers a flexible and methodologically sound alternative for modeling marginal effects under different mechanisms of ICS. Our extended simulation findings show that in pure ICS scenarios—where cluster size is related only to the outcome variable—the proposed method can limit the loss of statistical efficiency (SE) compared to standard weighted methods; in covariate-dependent ICS scenarios, where cluster size affects the distribution of covariates, the proposed method can reduce the bias observed in standard unweighted GEE models. The DR-GEE framework, especially with full weighting (α = 1), offers a promising and methodologically sound approach for modeling marginal effects in settings where both the covariate and outcome are correlated with cluster size. This is common in educational data (e.g., class size and achievement), multicenter clinical trials (e.g., center size and treatment response), or survey studies with design-based clustering.
Limitations
Although the DR-GEE method proposed in this study is evaluated under a comprehensive simulation framework, some limitations should be considered. First, only artificially generated simulation data are used in this study. Although real-world data applications are not within the scope of this study, the additional simulation scenarios (Supplementary Tables S1 and S2) are intended to represent the complex ICS structures that may be encountered in reproductive toxicology or dental health research. These scenarios aim to demonstrate the robustness of the DR-GEE approach under different ICS mechanisms. Another limitation is that the simulation study was conducted only on binary outcomes. The performance of DR-GEE for continuous or count-type (Poisson) data requires a separate evaluation.
5. Conclusions
In this study, the proposed flexible cluster-size-weighted DR-GEE approach was evaluated via simulation under pure, covariate-dependent, and hybrid ICS conditions. The simulation results revealed that, particularly in scenarios where the level of informativeness increased, the DR-GEE approach exhibited better performance in terms of bias and RMSE compared to the standard GEE and CWGEE. As the γ parameter, representing ICS strength, increased, the relationship between cluster size and the outcome-generation mechanism strengthened, leading to a significant loss of performance in classical GEE-based estimators. In particular, the DR-GEE variant incorporating full cluster size adjustment (α = 1.00) in the hybrid ICS scenario provided lower bias, lower RMSE, and confidence interval coverage rates close to the nominal level, especially under conditions of strong informativeness. Overall, the proposed DR-GEE framework offers an interpretable and computationally feasible approach to reduce cluster-size-dependent bias and enable cluster-balanced marginal inferences in hybrid ICS settings where the informative cluster size is related to both the outcome variable and covariates.
Supplementary Materials
The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/stats9040074/s1, Table S1: Simulation-Based Performance Metrics for Marginal Estimators Under Pure Informative Cluster Size Across Varying γ and λ Conditions; Table S2: Simulation-Based Performance Metrics for Marginal Estimators Under Covariate-Dependent Informative Cluster Size Across Varying γ and λ Conditions.
Author Contributions
Conceptualization: B.D.H. and Z.N.A. Data curation: B.D.H. and Z.N.A. Formal analysis: B.D.H. Funding acquisition: None. Methodology: B.D.H. and Z.N.A. Visualization: B.D.H. and Z.N.A. Writing—original draft: B.D.H. and Z.N.A. Writing—review & editing: B.D.H. and Z.N.A. All authors have read and agreed to the published version of the manuscript.
Funding
This research received no external funding.
Institutional Review Board Statement
Not applicable. This study was based exclusively on simulated data and did not involve human participants, animals, or identifiable personal data.
Informed Consent Statement
Not applicable.
Data Availability Statement
No empirical data were collected or analyzed in this study. The simulation design, data-generating mechanisms, parameter settings, and estimation procedures are described in the manuscript. The R code used to generate the simulated datasets and reproduce the analyses is available from the corresponding author upon reasonable request.
Conflicts of Interest
The authors declare no conflicts of interest.
References
- Senevirathne, H.K.W.; Dutta, S. Testing Informativeness of Covariate-Induced Group Sizes in Clustered Data. Mathematics 2024, 12, 1623. [Google Scholar] [CrossRef] [Scilit]
- Williamson, J.M.; Datta, S.; Satten, G.A. Marginal analyses of clustered data when cluster size is informative. Biometrics 2003, 59, 36–42. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Benhin, E.; Rao, J.N.K.; Scott, A.J. Mean estimating equation approach to analyzing cluster-correlated data with nonignorable cluster sizes. Biometrika 2005, 92, 435–450. [Google Scholar] [CrossRef] [Scilit]
- Seaman, S.; Pavlou, M.; Copas, A. Review of methods for handling confounding by cluster and informative cluster size in clustered data. Stat. Med. 2014, 33, 5371–5387. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Hoffman, E.B.; Sen, P.K.; Weinberg, C.R. Within-cluster resampling. Biometrika 2001, 88, 1121–1134. [Google Scholar] [CrossRef] [Scilit]
- Huang, Y.; Leroux, B. Informative cluster sizes for subcluster-level covariates and weighted generalized estimating equations. Biometrics 2011, 67, 843–851. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Scharfstein, D.O.; Rotnitzky, A.; Robins, J.M. Adjusting for nonignorable drop-out using semiparametric nonresponse models. J. Am. Stat. Assoc. 1999, 94, 1096–1120. [Google Scholar] [CrossRef]
- Laan, M.J.; Robins, J.M. Unified Methods for Censored Longitudinal Data and Causality; Springer: New York, NY, USA, 2003. [Google Scholar]
- Bang, H.; Robins, J.M. Doubly robust estimation in missing data and causal inference models. Biometrics 2005, 61, 962–973. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Seaman, S.; Copas, A. Doubly robust generalized estimating equations for longitudinal data. Stat. Med. 2009, 28, 937–955. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Prague, M.; Wang, R.; De Gruttola, V. CRTgeeDR: An R package for doubly robust generalized estimating equations estimations in cluster randomized trials with missing data. R J. 2017, 9, 105–115. [Google Scholar] [CrossRef] [Scilit]
- Rabideau, D.J.; Li, F.; Wang, R. Multiply robust generalized estimating equations for cluster randomized trials with missing outcomes. Stat. Med. 2024, 43, 1458–1474. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Pavlou, M.; Seaman, S.R.; Copas, A.J. An examination of a method for marginal inference when the cluster size is informative. Stat. Sin. 2013, 23, 791–808. [Google Scholar] [CrossRef] [Scilit]
- Seaman, S.R.; Pavlou, M.; Copas, A.J. Methods for observed-cluster inference when cluster size is informative: A review and clarifications. Biometrics 2014, 70, 449–456. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Kahan, B.C.; Li, F.; Blette, B.; Jairath, V.; Copas, A.; Harhay, M. Informative cluster size in cluster-randomised trials: A case study from the TRIGGER trial. Clin. Trials 2023, 20, 661–669. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Wang, M.; Kong, M.; Datta, S. Inference for marginal linear models for clustered longitudinal data with potentially informative cluster sizes. Stat. Methods Med. Res. 2011, 20, 347–367. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Zhao, P.; Wu, J.; Liu, Z.; Wang, C.; Fan, R.; Li, Q. Differential Private Stochastic Optimization with Heavy-tailed Data: Towards Optimal Rates. Proc. AAAI Conf. Artif. Intell. 2025, 39, 22795–22803. [Google Scholar] [CrossRef] [Scilit]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.

