1. Introduction
Synthetic data have been adopted in quantitative disciplines as a mechanism for privacy protection, reproducible research, and methodological benchmarking (
Drechsler, 2011;
Reiter, 2005). The core principle underlying synthetic data generation is to replace observed records with simulated observations drawn from models estimated on the original data, thereby breaking the direct linkage to real individuals while preserving inferential utility, the degree to which statistical inferences drawn from synthetic data replicate those obtainable from the original (
Raab et al., 2016;
Raghunathan et al., 2003;
Rubin, 1993). Traditional approaches to generating synthetic item response data have relied primarily on parametric item response theory (IRT) simulation, wherein item parameters are estimated from empirical data and new responses are generated by sampling abilities from assumed distributions (
Baker & Kim, 2004;
Harwell, 1997). While conceptually straightforward, this paradigm faces important limitations. Standard IRT models impose rigid assumptions regarding the functional form of item characteristic curves (ICCs), typically relying on logistic or normal ogive functions (
Hambleton et al., 1991). These parametric specifications may inadequately represent the complex response processes observed in real assessments, leading to model misspecification and synthetic data that diverge from original distributional features (
Junker & Sijtsma, 2001;
Sijtsma & Molenaar, 2002).
Standard IRT models traditionally assume strict unidimensionality and conditional independence. While multidimensional IRT theoretically accommodates multiple traits, it requires pre-specifying the number of latent dimensions (
Reckase, 1985). Exploratory factor analysis of categorical data (
Bartholomew, 1980;
Y. Yang & Xia, 2015) and multiple MIRT parameterizations, including compensatory and non-compensatory forms (
Wang & Nydick, 2015), offer some flexibility. However, these approaches limit analysis by decomposing item dependencies into a finite set of latent factors. Any residual inter-item covariance falling outside this specified structure is discarded rather than modeled. When data exhibit complex local item dependence (
Chen & Thissen, 1997;
Yen, 1984), this oversimplified latent representation distorts underlying correlation patterns and violates the local independence assumption (
Stout, 1987). Beyond these structural constraints, alternative methods like parametric bootstrapping (
Efron & Tibshirani, 1994), multiple imputation (
Rubin, 2018), and latent class modeling (
Formann, 2007;
Vermunt, 2004) struggle to balance flexibility with scalability. Relying on strict distributional assumptions, these approaches fail to capture the complex nonlinear dependencies inherent in large-scale binary response matrices (
Chalmers, 2016;
Si & Reiter, 2013).
Recent advances in deep learning have introduced flexible, data-driven alternatives for synthetic data generation that relax the rigid assumptions of parametric simulation (
LeCun et al., 2015). Deep generative models, including generative adversarial networks (GANs) (
I. J. Goodfellow et al., 2014) and variational autoencoders (VAEs) (
Kingma & Welling, 2014;
D. J. Rezende et al., 2014), have demonstrated the capacity to learn complex, nonlinear dependencies without explicit parametric specification (
Xu et al., 2019). However, directly applying these methods to item response data while preserving psychometric properties remains challenging. GANs are often unstable to train and susceptible to mode collapse, resulting in incomplete representation of response pattern variability (
Arjovsky et al., 2017;
Salimans et al., 2016). Similarly, VAEs typically impose strong distributional assumptions on the latent space that may not align with ability distributions or psychometric constructs (
Bowman et al., 2016). In both cases, the absence of an explicit mechanism for preserving marginal item properties means that downstream IRT-based analyses may be compromised, a limitation the present framework directly addresses.
Copula-based modeling, grounded in Sklar’s theorem (
Sklar, 1959), offers a complementary framework by decomposing multivariate distributions into univariate marginals and an explicit dependence structure (
Joe, 2014;
Nelsen, 2006). This separation is particularly well suited to psychometric data; marginal response probabilities can be directly estimated from observed item frequencies, while the copula captures complex dependencies induced by latent traits (
Braeken et al., 2007;
Nikoloulopoulos & Joe, 2015). Traditional copula approaches in psychometrics have employed parametric copula families such as Gaussian or factor copulas (
Kadhem & Nikoloulopoulos, 2023a,
2023b). Recent developments show that neural networks can automate copula construction, substantially improving distributional flexibility without requiring manual specification of parametric copula families (
Letizia et al., 2025;
R.-S. Yang et al., 2024). As a result, neural network copula (NNC) models can provide a principled mechanism for generating synthetic item response data that preserve both marginal item properties and dependence structures essential for IRT-based analyses.
In this study, we propose an NNC model for generating synthetic dichotomous item response data in educational and psychological assessments. The approach follows a three-stage process: (1) transforming binary responses to pseudo-uniform marginals via randomized probability integral transforms (
Genest et al., 2009;
Rüschendorf, 2009), (2) learning dependence structures using deep autoencoders (
Kingma & Welling, 2014;
D. J. Rezende et al., 2014), and (3) generating synthetic data via inverse transformations. By injecting controlled stochasticity, the pseudo-uniform transform resolves the tie-breaking problem inherent in discrete marginals (
Genest et al., 2009;
Mendes et al., 2007). This ensures that the variates are marginally uniform, fulfilling a prerequisite for Sklar’s theorem (
Nelsen, 2006;
Sklar, 1959) while preserving inter-item dependence. Critically, item discrimination and difficulty are maintained through the empirical marginal probabilities in the final binary generation step, allowing the design to accommodate the latent variable structure while minimizing distributional assumptions. Finally, to address the inherent risk of distributional divergence and the creation of plausible but statistically unfaithful records (
Xu et al., 2019), we utilize a multi-faceted validation framework.
Despite increasing interest in neural synthetic data generation (
Choi et al., 2017;
Xu et al., 2019), current validation practices often focus on distributional similarity rather than meaningful psychometric criteria (
Drechsler & Reiter, 2011). In particular, the reproduction of sampling variability relevant for statistical inference has received little systematic attention (
Raab et al., 2016). To address this gap, we conduct an IRT-grounded psychometric validation (
Baker & Kim, 2004;
Hambleton et al., 1991) evaluating data-level consistency, parameter recovery, and item and test information accuracy. Crucially, we extend standard protocols by comparing empirical asymptotic standard errors with Monte Carlo standard errors (MCSEs) (
Robert & Casella, 2004) derived from repeated synthetic generation. This comparative analysis assesses whether the NNC framework preserves both point estimates and the original inferential uncertainty. Through an empirical application to a large-scale numerical reasoning assessment of fluid intelligence, we demonstrate that the proposed approach accurately reproduces essential psychometric properties while protecting examinee anonymity. Generating such structurally faithful synthetic data is critical for intelligence research; operational datasets are rarely shareable due to privacy protocols, though they are essential for developing assessments and benchmarking cognitive measurement models.
4. Results
All computations utilized PyTorch 1.12 (
Paszke et al., 2019) within an environment featuring 32 CPU cores and a dedicated NVIDIA L40S GPU with CUDA acceleration. Training the model on the full dataset (
,
) to convergence required 679.4 s (approximately 11.3 min). Once trained, generating the primary synthetic dataset took only 0.02 s. Completing the
Monte Carlo replications for standard error estimation required 367.4 s (approximately 6.1 min).
Figure 2 illustrates the convergence trajectory of the composite loss function during training. Both the training and validation loss decreased rapidly within the first 50 epochs and stabilized thereafter, reaching a clear plateau by approximately epoch 150. The consistent alignment between the two curves indicates that the NNC successfully learned the underlying dependence structure of the response data without overfitting or optimization instability.
4.1. Sensitivity Analysis
We selected
latent dimensions to optimize the balance between reconstruction fidelity and parsimony (
Table 2). The candidate set
was chosen to span a range from under-parameterized to over-parameterized representations relative to the number of observed items (
). Specifically,
represents a compressed latent space (approximately half of
K), which tests the risk of information loss, whereas
and
exceed the observed dimensionality and allow evaluation of potential overfitting and redundancy in the latent representation. This range ensures that the selected dimensionality is not driven by an arbitrary choice but reflects a principled exploration of model capacity.
Evaluating a validation set across using synthetic replications per configuration revealed that caused over-compression, severely degrading (0.032) and RMSR (0.065) despite yielding the highest (0.980) and a relatively lower (0.988) compared to higher dimensions. Among higher dimensions, achieved the highest (0.942) with , while maintaining an excellent (0.015) and RMSR (0.030) comparable to . Notably, remained stable at 0.996 across all , indicating that difficulty parameter recovery is robust to latent dimension choice within this range, whereas showed greater sensitivity. This configuration naturally bounds model capacity to one coordinate per item (), relying on dropout and batch normalization to prevent trivial identity mapping.
For KDE, we employed a fixed bandwidth of to preserve meaningful tail densities for extreme scores. The candidate set was selected to represent a spectrum of smoothing levels, ranging from low smoothing (capturing fine-grained local structure) to high smoothing (emphasizing global density structure). In particular, allows evaluation of potential high-variance, under-smoothed estimates, whereas tests the impact of aggressive smoothing that may obscure inter-item dependencies. Intermediate values (h = 0.2, 0.3) provide practical trade-offs commonly recommended in the kernel density estimation literature.
Sensitivity evaluations across , also averaged over replications, confirmed this choice. Across all bandwidth values, remained highly stable (0.995–0.996), while ranged from 0.949 to 0.973 and RMSR varied more substantially. While overall performance remained stable for values up to , the widest bandwidth () over-smoothed the inter-item dependence structure, resulting in a substantially higher RMSR (0.070). Ultimately, yielded the optimal balance with the lowest RMSR (0.025), , and a of 0.016.
4.2. Data-Level Fidelity
4.2.1. Total Score Distribution
Generative quality at the respondent level was evaluated by comparing the distribution of observed total scores. As illustrated in
Figure 3, the NNC accurately reproduced the distributional shape, central tendency, and dispersion of the empirical scores. The synthetic data closely matched the real data in terms of mean total score (
versus
) and standard deviation (
versus
). The synthetic distribution (red, dashed) closely overlaps with the real distribution (blue, solid), successfully capturing the distinct negative skewness (Skewness
syn = −0.441 versus Skewness
real = −0.459) and kurtosis (Kurtosis
syn = −0.764 versus Kurtosis
real = −0.735), as well as density peaks in the upper score range (scores 15 to 19). However, the synthetic data exhibited a slight underrepresentation of the maximum possible score (20), only partially capturing the frequency of perfect scores in the empirical data. This boundary effect is consistent with the known tendency of fixed-bandwidth KDE to underestimate density at distributional boundaries (
Jones, 1993).
4.2.2. Marginal Probabilities
Item-level difficulty hierarchies were evaluated by contrasting the proportion of correct responses (
).
Figure 4 (left panel) presents a scatter plot of these probabilities, revealing a strong linear relationship where points lie almost precisely on the identity line (
). This indicates that the NNC maintained the rank-order difficulty of items, successfully distinguishing between easy items (Item 13,
) and difficult items (Item 09,
). As detailed in
Table 3 and visualized in
Figure 4 (right panel), the
across all 20 items was 0.019, with a maximum absolute difference of 0.045 for Item 19. The mean relative error of 3.398% demonstrates that univariate statistical features were preserved with high consistency. The right panel also displays bootstrap 95% confidence intervals computed from 1000 resamples of the training data; synthetic marginals fall within these intervals for all but one item, confirming that observed deviations are within expected sampling variability.
4.2.3. Pairwise Associations
The preservation of higher-order dependencies was assessed by examining the inter-item correlation structures.
Figure 5 presents the correlation matrices for the real data (left) and synthetic data (middle), alongside the difference matrix (right). Visual inspection confirms that the synthetic data accurately replicated the block-diagonal structure and intensity of the empirical correlations. The difference heatmap is predominantly neutral, indicating residuals close to zero and devoid of systematic bias. Quantitatively, this structural fidelity was confirmed by a low RMSR (0.032; values below 0.05 are generally considered indicative of good fit (
Hu & Bentler, 1999)), validating that the NNC effectively preserved the local dependence structure required for accurate psychometric dimensionality assessment.
4.3. Psychometric Parameter Recovery
4.3.1. IRT Parameter Consistency
The psychometric validity of the synthetic data was evaluated by examining the consistency of IRT parameter estimates and measurement precision. As illustrated in
Figure 6, the discrimination parameters (
a) showed strong alignment (
), although with slightly higher variability (
,
), primarily driven by items with high discrimination values (e.g., Items 13 and 18), as discussed further below. The difficulty parameters (
b) exhibited exceptional consistency (
,
,
). Despite the outliers in discrimination, the ICCs presented in
Figure 7 demonstrate that the probability functions of the synthetic items closely track the empirical functions across the ability scale.
A notable pattern warrants specific discussion. Items 13 and 18, which possess high real discrimination values (
,
), exhibited the largest positive bias in the synthetic data (
,
). This amplification is systematic rather than random: the corresponding MCSEs were substantially inflated (
and 0.234, respectively, versus asymptotic estimates of 0.094 and 0.121;
Table 4), and across all
replications the mean synthetic discrimination for these items consistently exceeded the real values (
Table 5). The ICCs for Items 13 and 18 in
Figure 7 confirm that synthetic response functions remain plausible across the ability continuum, with the primary consequence being a sharp concentration of information near
. This location reflects the real data: the empirical difficulty parameters (
,
) indicate that the original assessment purposefully anchored highly discriminating items at this lower ability threshold to distinguish baseline proficiency.
To evaluate measurement precision across the latent continuum, we examined the TIF and CSEM. As shown in
Figure 8, the synthetic TIF curve follows the general trajectory of the real data, with both curves peaking in the lower ability range (
) and declining symmetrically toward the extremes of the scale. Although slightly higher peak information appeared around
due to the high-discrimination amplification noted above, the overall profiles are highly consistent, yielding a TIF vector correlation of
. The corresponding CSEM profiles mirror this pattern inversely, as measurement error is minimized precisely where information is maximized. The synthetic CSEM curve closely tracked the real curve across the full ability range, with near-identical minimum error values near
and equivalent error inflation at the extremes (
and
), yielding a CSEM vector correlation of
. Together, these results indicate that the synthetic data preserves the measurement precision profile of the original instrument, supporting its use in applications requiring standard error estimation across the ability continuum.
Systematic bias was evaluated by comparing real item parameters against the mean synthetic estimates across all
replications (
Table 5). For discrimination parameters (
a), two opposing tendencies emerged. For the majority of items with moderate discrimination (Items 4, 11, 12, and 16), a slight attenuation bias was observed, with mean synthetic estimates under-predicting empirical values by approximately 0.069 to 0.172. This attenuation is consistent with the regularizing effect of dropout (
) and batch normalization in the encoder (
Srivastava et al., 2014). Conversely, significant positive bias appeared for Item 18 (+1.075), Item 13 (+0.889), and Item 15 (+0.416), reflecting the KDE-induced amplification mechanism described above. For difficulty parameters (
b), absolute differences were consistently low (mean absolute bias = 0.051), with the largest deviation for Item 5 (0.229).
4.3.2. Item Fit Statistics
Infit statistics demonstrated remarkable stability across all 20 items, with the average absolute deviation between real and synthetic values being negligible (<0.01), and the majority of items well within the acceptable range
for both datasets (
Wright & Stone, 1979). Outfit statistics were largely preserved, with most items showing differences of less than 0.05. However, two items revealed localized under-dispersion: Item 13 showed a reduction from 0.856 (real) to 0.466 (synthetic), and Item 18 from 0.733 to 0.413, both falling below the 0.5 threshold for severe under-dispersion and flagged accordingly in
Table 6. Item 15 showed a moderate reduction (0.776 → 0.659) but remained above the critical threshold. These patterns are consistent with the discrimination amplification mechanism described above: high-discrimination items generated response patterns that were too deterministic, suppressing the stochastic noise typically found in empirical outlier responses. Results are visualized in
Figure 9.
4.4. Inferential Precision
The synthetic data generally produced slightly larger standard errors than the real data, indicating conservative estimation of precision. On average, MCSEs exceeded ASEs for both discrimination (0.095 versus 0.074) and difficulty (0.037 versus 0.031) parameters, yielding mean MCSE/ASE ratios of 1.286 and 1.179, respectively. This conservative pattern was non-uniform across items. Items with low-to-moderate discrimination showed near-exact correspondence (e.g., Item 7:
,
, ratio = 1.005), while high-discrimination items exhibited substantial inflation (Item 13: ratio = 1.791; Item 18: ratio = 1.936), consistent with the amplification mechanism described in the IRT Parameter Consistency subsection above. Full item-level SE comparisons are reported in
Table 4.
4.5. Stability Across Initializations
Robustness was assessed by repeating the full analysis pipeline with five distinct random seeds {101, 202, 303, 404, 505} to evaluate sensitivity to initialization and stochastic optimization paths. As summarized in
Table 7, discrimination parameters (
a) showed strong but slightly more variable consistency, ranging from
(Seed 101) to
(Seed 303), averaging 0.944 (
). Difficulty parameters (
b) exhibited near-perfect convergence, with correlations ranging from
(Seed 505) to
(Seeds 101, 303, and 404), yielding a mean of 0.995. The
ranged from 0.014 (Seeds 202 and 404) to 0.019 (Seed 101), with a mean of 0.016 (
). These results confirm that the NNC reliably converges to a stable structural representation of the assessment data regardless of random initialization state.