1. Introduction
Uncertainty in model inputs—such as emission levels, chemical reaction rates, or financial risk factors—can propagate to outputs in ways that undermine reliability and decision-making. For instance, inaccuracies in air quality simulations can misguide public health strategies, while misestimation of risk factors in financial models can destabilize markets. Sensitivity analysis (SA) provides a principled framework to identify which inputs most strongly affect model behavior and outcomes, thereby supporting robust model calibration and policy design.
Among existing SA approaches, the Sobol’ sensitivity indices are particularly valuable because they decompose model variance into contributions from both main effects and higher-order interactions [
1,
2]. However, computing Sobol’ indices requires high-dimensional integration, which is computationally intensive for large-scale scientific and engineering models [
3,
4]. Consequently, there is a strong need for efficient numerical techniques that retain accuracy while reducing computational cost.
In other words, SA is a fundamental technique in modeling and simulation that investigates how variations in input parameters influence the output of a given system: financial modeling [
5], foundational sensitivity analysis methodology [
6,
7], standard references for Sobol’ indices [
8,
9], and error estimation in global sensitivity analysis [
10]. By identifying which inputs contribute most to uncertainty in the model results, SA provides valuable insights into the robustness and reliability of mathematical models. This approach is especially crucial in complex environmental, financial, and engineering systems, where numerous variables interact in nonlinear ways. SA not only enhances model transparency but also supports decision-making by highlighting the key drivers of system behavior.
The Sobol’ approach is central to our analysis. It involves decomposing the model function into components that represent the contributions of individual input parameters and their interactions. The Sobol’ global sensitivity indices, defined based on the decomposition of variance, help quantify the contributions of each input parameter and their interactions to the overall variance in the model output [
2,
9]. The calculation of these indices involves evaluating high-dimensional integrals, which is where QMC methods prove invaluable [
11].
This paper introduces an optimization method based on a particular polynomial lattice rule with an interlaced factor for estimating sensitivity indices. We compare our method with one of the best available methods and analyze the relative errors for key output quantities. Our results demonstrate that the proposed optimization method consistently outperforms other methods in accurately estimating both first-order and total-order sensitivity indices, particularly for parameters with smaller effects.
The primary objective of this work is to conduct a systematic comparative analysis of advanced polynomial lattice rules and modified Sobol’ sequences to efficiently compute Sobol’ sensitivity indices. By evaluating their behavior, accuracy, and computational performance, this study aims to provide deeper insights into the strengths and limitations of both approaches, offering practical guidance for selecting suitable methods in complex environmental, engineering, and financial modeling scenarios.
Quasi-Monte Carlo (QMC) methods—such as Sobol’ sequences and lattice rules—have emerged as powerful variance-reduction strategies [
12,
13,
14]. Modified Sobol’ sequences are widely used because of their simplicity and reliable accuracy in low to moderate dimensions [
15]. Polynomial lattice rules (PLRs), on the other hand, have theoretical advantages for high-dimensional integration [
12,
16], but their practical performance in environmental sensitivity analysis has not been systematically benchmarked. Recent developments in randomized and adaptive QMC highlight ongoing advances in variance reduction [
17,
18], while extensions to unbounded domains further illustrate the versatility of QMC [
19].
This study contributes to closing this gap. We conduct a comparative analysis of improved polynomial lattice rules with interlacing factors (IPLR-2 and IPLR-3) against several modified Sobol’ sequence variants (MSS-1, MSS-2, and MSS-2S). Our testbed is Unified Danish Eulerian Model (UNI-DEM), a benchmark air pollution model characterized by high dimensionality, nonlinear chemical interactions, and strong relevance for policy studies.
The novelty of this work lies in the following:
Introduces a new method based on a particular IPLRs for estimating Sobol’ sensitivity indices.
The first systematic evaluation of IPLR-based QMC strategies for Sobol’ index estimation in a realistic environmental model.
Demonstrating the complementary strengths of IPLR- (for weak indices) and IPLR- (for dominant indices and variance terms).
Providing practical guidelines for comparison of the best available QMC: IPLRs and modified Sobol’ sequences, offering a path toward more reliable and computationally efficient sensitivity analysis.
The rest of this paper is organised as follows:
Section 2 outlines the materials and methods used in our study, including detailed descriptions of the polynomial lattice rules and the UNI-DEM model.
Section 3 presents the results of our sensitivity analysis, highlighting the performance of different methods in estimating Sobol’ indices.
Section 4 discusses the implications of our findings and compares the effectiveness of the various methods. Finally,
Section 5 concludes the paper by summarizing our findings and suggesting potential directions for future research.
3. Results
Unless otherwise stated, all numerical experiments were performed using
quasi-Monte Carlo samples, interlacing factors
, and the parameter domains described in
Section 2.7. These settings were selected to ensure a consistent balance between computational efficiency and theoretical convergence requirements.
This section presents the comparative numerical results obtained from applying the modified Sobol’ sequence (MSS) and improved polynomial lattice rule (IPLR) methods to
Unified Danish Eulerian Model (UNI-DEM). The analysis focuses on three aspects: (i) the accuracy of estimated first-order and total-order Sobol’ indices, (ii) convergence behavior with increasing sample size, and (iii) computational efficiency in terms of runtime and memory usage. The results are organized to highlight the complementary performance of the MSS and IPLR approaches.
Section 3.1 discusses the overall convergence patterns and relative errors of the different QMC variants,
Section 3.2 presents the detailed sensitivity index distributions, and
Section 3.3 provides a quantitative evaluation of computational cost. Together, these results demonstrate how the interlacing order
influences both precision and scalability in high-dimensional sensitivity analysis.
The efficient MC algorithms for multidimensional numerical integration described above were applied to sensitivity studies of variations in the concentration of air pollutants with respect to emission levels and some chemical reaction rates. More information can be found in [
29,
35,
36].
3.1. Sensitivity Studies with Respect to Emission Levels
Firstly, we will study the sensitivity of the model output (in terms of mean monthly concentrations of several important pollutants) with respect to the variation of input emissions of the anthropogenic pollutants. The anthropogenic emissions input consists of 4 different components
, as follows:
The output of the model is the mean monthly concentration of the following 3 pollutants:
In our particular case, we are interested in sensitivity studies of the mean monthly concentrations of ammonia in Milan. The domain under consideration is the 4-dimensional hypercubic domain ).
Table 1 presents the relative error (RE) of the approximation errors (AEs) for the estimation of Sobol’ indices (SIs) using
samples. The column labeled
RV provides the reference (true) values, while the remaining columns correspond to different numerical strategies: quasi-Monte Carlo based on Sobol’ sequences (SOBOL), multi-sample stratification variants (MSS-1, MSS-2, and MSS-2S), and improved polynomial lattice rules with smoothness parameters
and
(denoted IPLR-
and IPLR-
).
For the mean value , the MSS-2S method attains the smallest RE (), outperforming all other approaches. In contrast, the variance is most accurately estimated by IPLR-, with an RE of .
Regarding first-order indices, the dominant terms and are captured most accurately by IPLR-, with REs of and , respectively. For the corresponding total indices, IPLR- also provides the best performance, with REs of for and for .
For weaker effects, the results differ. The very small sensitivity index and its total index are best approximated by IPLR- (REs of and , respectively), while IPLR- performs significantly worse. Conversely, the smallest index and its total index are best approximated by IPLR-, which achieves REs of and , far outperforming the other methods.
3.2. Sensitivity Studies Concerning Chemical Reaction Rates
The results in
Figure 2 demonstrate that IPLR-
and IPLR-
achieve consistently lower errors across most sensitivity indices, significantly outperforming MSS-2S in estimating S1–S4 and the total indices (Stot1–Stot4). While MSS-2S attains the highest accuracy for f0, its performance decreases when evaluating higher-order interactions, where the IPLR-based approaches show superior stability and precision. The SOBOL and MSS-1 methods exhibit moderate accuracy, whereas MSS-2 performed the worst overall. These findings highlight the effectiveness of IPLR techniques for reliable, efficient, and high-precision sensitivity analysis in high-dimensional environmental modeling.
In this part, we will study the sensitivity of ozone concentration in Genova according to the rate variation of some chemical reactions: reactions
(time-dependent) and
(time-independent) of the condensed CBM-IV scheme ([
23]). The simplified chemical equations of these reactions are as follows:
The domain under consideration is the 6-dimensional hypercubic domain
).
Table 2 reports the relative error (RE) for the approximation of Sobol’ indices (SIs) using
samples. The column labeled
RV provides the reference values, while the remaining columns correspond to the numerical methods under comparison: SOBOL sequences, multi-sample stratification variants (MSS-1, MSS-2, and MSS-2S), and improved polynomial lattice rules with smoothness parameters
and
(denoted IPLR-
and IPLR-
).
For the mean , IPLR- achieves the smallest error (), followed closely by MSS-1 (). The variance is also most accurately estimated by IPLR- (RE ).
For the first-order indices, the dominant terms and are best captured by IPLR- (REs of and , respectively). The medium-sized index is equally well-estimated by SOBOL and IPLR- (). For , IPLR- achieves the lowest error (). The smallest index is difficult to capture, but the best approximation is, again, provided by IPLR- (RE ). Finally, for , IPLR- yields the most accurate estimate ().
For total-order indices, IPLR- dominates: (), (), and () all reach their lowest errors using this method. An exception occurs for , where IPLR- provides the best estimate (). Higher-order interactions, such as , and , are also most accurately captured by IPLR-, with remarkably low REs (, , , and , respectively).
3.3. Deeper Analysis of the Performance
In the case of SA with respect to emission levels, the following can be observed. First, quasi-Monte Carlo sampling with Sobol’ sequences systematically improves upon the use of naive Monte Carlo sampling, but is outperformed by both stratified (MSS) and lattice-based (IPLR) approaches. This is consistent with theoretical expectations, as structure in the sampling design reduces variance in the estimation of sensitivity indices. Second, the MSS-2S method exhibits remarkable accuracy for estimating the mean value , suggesting that stratification is particularly effective for low-order statistics. However, its performance degrades for variance and sensitivity indices, indicating that stratification alone may not be sufficient for capturing higher-order effects. Third, the IPLR methods provide the most balanced and robust performance overall. The choice of the smoothness parameter plays a critical role: IPLR- excels in estimating large indices and variance-related terms, while IPLR- is better suited to capturing smaller indices such as . This complementary behavior reflects a subtle trade-off: higher smoothness () enhances accuracy for dominant effects, while moderate smoothness () improves sensitivity to weak effects.
An important implication is that the smallest indices are not only the most challenging to approximate but also the most discriminative when evaluating numerical methods. In practical sensitivity analysis, such indices are often essential for detecting negligible effects and informing model simplification. The fact that IPLR- achieves reliable accuracy in this regime highlights its value as a complement to IPLR-. A hybrid or adaptive strategy, switching between parameterizations depending on the relative importance of the index, could therefore provide the most comprehensive solution.
In the case of SA with respect to chemical reaction rates, similar observations can be made. The results clearly demonstrate the superiority of IPLR methods compared to the SOBOL and MSS strategies. While the SOBOL sequences and MSS variants offer improvements over naive Monte Carlo sampling, their accuracy is inconsistent across indices. In contrast, IPLR methods deliver reliable accuracy across the mean, variance, main indices, total indices, and higher-order interactions. Among the IPLR schemes, emerges as the most robust configuration overall. It consistently yields the smallest errors for the mean, variance, dominant first-order indices (, , and ), and total-order indices. Moreover, IPLR- excels in estimating small interaction terms such as and , where it outperforms other methods by several orders of magnitude. This ability to detect weak but non-negligible effects is particularly valuable in global sensitivity analysis, as it supports variable screening and model reduction. IPLR-, while generally less accurate than IPLR-, demonstrates strengths in specific cases, such as and . This indicates that moderate smoothness () can sometimes enhance performance for indices of intermediate magnitude. The SOBOL sequences perform best for but otherwise fall short compared to IPLR. The MSS methods show occasional success (e.g., MSS-1 for ), but they do not maintain accuracy across the full set of indices.
To summarize, the comparative study of relative errors for Sobol’ index estimation at samples highlights clear distinctions among the tested methods. MSS-2S demonstrates outstanding accuracy for estimating the mean response but shows limited effectiveness for variance and sensitivity indices. In contrast, improved interlaced polynomial lattice rules (IPLRs) consistently achieve superior accuracy across most quantities of interest. A critical observation is that the choice of the smoothness parameter determines performance: IPLR- delivers the best results for dominant indices and variance-related terms, whereas IPLR- provides more accurate estimates for small indices, such as and . This study demonstrates that structured sampling strategies significantly outperform traditional quasi-Monte Carlo methods in Sobol’ index estimation. IPLR- achieves the lowest relative errors for most quantities of interest, including dominant indices, variance-related terms, and higher-order interactions. Its ability to capture both strong and weak sensitivity indices with high precision makes it the most robust method overall. IPLR- provides complementary accuracy for specific cases, particularly for indices of intermediate magnitude, such as and . The complementary nature of the two IPLR schemes suggests that a hybrid strategy could provide an even more reliable framework for comprehensive sensitivity analysis.
3.4. Convergence Analysis
Now, we investigate the convergence behavior of the different quasi-Monte Carlo (QMC) methods in estimating first-order and total-order Sobol’ indices. Convergence was evaluated by computing the relative error of each estimator with respect to a high-accuracy reference solution obtained using
samples from the MSS-2S sequence. For each method, the mean relative error (RE) of the Sobol’ indices was calculated as
where
is the estimated first-order or total-order index for parameter
s, and
is the corresponding reference value. This metric quantifies global convergence trends across all
q input parameters of the UNI-DEM model.
Figure 3 presents the RE values as a function of the sample size
n for all considered methods: MSS-1, MSS-2, MSS-2S, IPLR-
, and IPLR-
. The results exhibit the expected quasi-Monte Carlo convergence pattern of
for the MSS variants and accelerated rates for the IPLR constructions. Specifically, IPLR-
achieves the lowest overall errors, followed by IPLR-
, confirming that higher interlacing orders enhance numerical precision at the cost of slightly increased computational effort. In contrast, MSS-2S maintains strong performance for moderate sample sizes but saturates for
due to its first-order structure.
The convergence slopes in
Figure 3 align closely with theoretical predictions for higher-order digital nets [
26,
33,
34]. For smooth model responses, IPLR-
attains an effective convergence order approaching
, while IPLR-
reaches between
and
depending on parameter smoothness. These results confirm that interlaced polynomial lattice rules can achieve the expected higher-order rates, even in complex, high-dimensional environmental models such as UNI-DEM.
3.5. Computational Cost Analysis
In addition to accuracy and convergence rate, we compared the computational cost of all quasi-Monte Carlo (QMC) methods in terms of average runtime and memory consumption.
The experiments were performed using MATLAB (R2022a (22.1)) on a workstation equipped with an AMD Ryzen 5 7600X processor and 64 GB RAM. Each method was executed for
samples and repeated 10 times to obtain stable averages.
Table 3 summarizes the mean runtime per run and peak memory usage for the main algorithms.
The results indicate that the MSS variants exhibit the lowest computational cost, with MSS-2S achieving the fastest runtime due to its radius-free symmetric sampling scheme. The IPLR- and IPLR- methods are approximately 1.5–2.0× slower than MSS-2S because of the overhead required to construct and store generating matrices. Nevertheless, these methods deliver up to an order-of-magnitude smaller relative errors for both weak and dominant Sobol’ indices.
Memory consumption remains moderate across all methods (<1 GB), with IPLR implementations requiring an additional 8–12% storage for the interlacing matrices. Given these modest overheads and the substantial gain in accuracy, the additional computational effort for the IPLR methods is fully justified for high-stakes sensitivity analyses where precision and robustness are critical.
The numerical evidence confirms that while IPLR approaches are somewhat more demanding computationally, their precision and consistency across all sensitivity indices outweigh the moderate increase in runtime.
4. Discussion
The present study contributes to the ongoing development of advanced quasi-Monte Carlo (QMC) techniques for reliable global sensitivity analysis. By systematically comparing improved polynomial lattice rules (IPLRs) with modified Sobol’ sequences (MSSs) in a high-dimensional environmental model, we aimed to clarify how sampling design influences the accuracy, efficiency, and stability of Sobol’ index estimation. Beyond detailed numerical results, the discussion below interprets these findings from both theoretical and practical perspectives—highlighting the reasons for the observed accuracy gains, identifying remaining limitations, and outlining future directions for adaptive and hybrid QMC approaches.
4.1. Key Insights
Our comparative analysis demonstrates several consistent trends. First, quasi-Monte Carlo sampling with Sobol’ sequences improves upon naive Monte Carlo sampling but is systematically outperformed by both stratified (MSS) and lattice-based (IPLR) approaches. This confirms theoretical expectations, since structured designs reduce estimator variance.
Second, the MSS-2S method shows remarkable accuracy for estimating mean values (), indicating the effectiveness of stratification for low-order statistics. However, its performance decreases for variance and sensitivity indices, where higher-order effects become dominant.
Third, IPLR methods provide the most balanced performance overall. The smoothness parameter plays a decisive role: IPLR-α3 achieves superior accuracy for dominant indices and variance-related terms, while IPLR-α2 performs better for weak indices. This complementary behavior highlights the potential of hybrid approaches that combine both configurations depending on the magnitude of the indices.
The results presented in
Section 3 provide clear evidence that structured quasi-Monte Carlo (QMC) sampling based on
polynomial lattice rules (PLRs) offers a significant accuracy advantage over traditional
modified Sobol’ sequences (MSSs), particularly in high-dimensional sensitivity analysis. The observed behavior of the IPLR configurations with interlacing factors
and 3 confirms the theoretical expectation that the order of interlacing directly influences convergence. Specifically, the higher-order construction (
) yields enhanced precision for dominant and variance-related indices, while the lower-order scheme (
) remains more efficient for weak indices. This complementarity reflects the trade-off between smoothness assumptions and computational complexity inherent in higher-order digital nets.
IPLR methods require more sophisticated matrix-generation construction, leading to higher runtime compared to MSS approaches. Nevertheless, the improved accuracy justifies this overhead in high-stakes applications.
From a theoretical standpoint, these findings are consistent with the error bounds established for weighted Walsh spaces and illustrate how interlacing modifies the effective dimension of the integration problem. Moreover, the complementary behavior of IPLR- and IPLR- provides a practical balance between computational complexity and convergence rate, enabling their application to a wide range of sensitivity studies.
As demonstrated in the computational cost analysis (
Section 3), the additional runtime required for IPLR-
and IPLR-
—approximately 1.5–2.0 times that of MSS-2S—is more than compensated by their markedly higher accuracy and numerical stability, confirming the practical value of these constructions for high-fidelity sensitivity analysis.
These results collectively suggest that higher-order digital constructions can serve as robust alternatives to conventional QMC designs, particularly when the computational budget permits moderate overhead in exchange for improved precision.
4.2. Limitations
While the results are encouraging, several limitations should be acknowledged. First, the current experiments were limited to the Unified Danish Eulerian Model (UNI-DEM), which, although representative of large-scale environmental systems, may not encompass all possible input dependencies and nonlinearities encountered in other domains. Testing the methods on models from finance or engineering design could further validate the generality of the conclusions.
Second, the efficiency of IPLR methods depends on the smoothness of the target integrand. For problems with discontinuities or sharp gradients, the theoretical higher-order convergence may not be realized, and classical Sobol’ or MSS methods could remain preferable.
Finally, although the computational overhead of IPLR methods is moderate, constructing the generating matrices and interlacing transformations remains more involved than implementing standard Sobol’ sequences. Nevertheless, this cost is predictable, scalable, and justified by the accuracy benefits demonstrated in this study.
4.3. Future Directions
Several promising directions emerge from these findings. First, the complementary performance of IPLR- and IPLR- motivates the development of adaptive hybrid strategies that dynamically switch between interlacing orders depending on the sensitivity magnitude of model parameters.
Second, recent findings in
adaptive and randomized QMC methods —such as those by Hickernell (2021) [
33] and Dick & Nuyens (2022) [
34]—highlight new opportunities to combine the deterministic structure of lattice rules with the flexibility of randomization. The proposed hybrid
–
approach naturally parallels these developments and could be extended to other domains of uncertainty quantification.
Third, recent developments in quasi-Monte Carlo (QMC) research have expanded both the theoretical foundation and practical scope of higher-order and adaptive methods. Adaptive sampling frameworks for uncertainty quantification [
37] and variance-reduction strategies for stochastic modeling have demonstrated the benefits of integrating structure-preserving designs with data-driven refinement. At the same time, refined error bounds for interlaced polynomial lattice rules have strengthened the mathematical guarantees of higher-order convergence, complementing our empirical results for IPLR-
and IPLR-
. Improvements in scrambling and digital net uniformity [
38] further highlight how enhanced sequence design can stabilize low-dimensional projections, offering pathways to extend our hybrid IPLR–MSS approach. Together, these advances confirm that the present work aligns with ongoing efforts to unify adaptive, high-order, and randomized QMC methodologies for robust global sensitivity analysis.
A notable open challenge concerns the limitations of modified Sobol’ sequences (MSSs) in high dimensions. Sobol’ sequences often lose uniformity in higher projections, leading to poor estimation of weak indices [
26]. Possible remedies include the following:
Scrambling and randomization (e.g., Owen scrambling and digital shifts) to restore uniformity and variance reduction.
Dimension re-ordering so that the most influential inputs are placed in lower dimensions where Sobol’ points perform best.
Hybrid approaches that combine Sobol’ sequences for low/moderate dimensions with lattice-based methods (e.g., IPLRs) for higher versions.
Adaptive Sobol’ constructions with randomized projection corrections [
17,
18] or guaranteed-quality projections [
39], which represent promising research directions for extending MSS applicability to large-scale problems.
Furthermore, ongoing research in alternative sequence constructions, such as improved Halton sequences [
40], confirms the importance of revisiting classical sequence designs for high-dimensional sensitivity analysis.
By highlighting these opportunities, our work not only benchmarks existing methods but also sets the stage for future developments in hybrid and adaptive QMC strategies for sensitivity analysis.
5. Conclusions
This study presents a systematic comparative analysis of two families of advanced quasi-Monte Carlo (QMC) techniques—modified Sobol’ sequences (MSS-1, MSS-2, and MSS-2S) and improved polynomial lattice rules (IPLR-, IPLR-)—for estimating Sobol’ sensitivity indices in the high-dimensional Unified Danish Eulerian Model (UNI-DEM).
Key findings indicate that IPLR-based approaches consistently outperform MSS variants in both accuracy and robustness. The IPLR-3 configuration provides the best precision for dominant and variance-related indices, while IPLR-2 excels for weak indices. MSS-2S remains useful for efficiently estimating mean responses. These complementary behaviors validate theoretical expectations regarding the role of interlacing order in determining convergence rate and effective dimensionality.
Accuracy trade-offs suggest that MSS methods, especially MSS-2S, are highly effective for mean estimation but less reliable for variance and higher-order indices. In contrast, IPLR methods deliver consistently superior accuracy, particularly in high-dimensional problems.
Practical implications include clear guidelines for method selection: use IPLR- for dominant effects and variance terms, IPLR- for weak effects, and MSS-2S when mean estimation is sufficient. Although IPLRs entail roughly 1.5–2× the computational cost of MSS-2S, this modest overhead is strongly justified by the substantial improvement in accuracy and robustness observed across all sensitivity indices. Therefore, the comparative results confirm that higher-order polynomial lattice rules provide a reliable trade-off between efficiency and precision, making them well-suited for high-dimensional uncertainty quantification problems where computational reliability is critical.
Taken together, these quantitative and practical observations provide a solid foundation for the conceptual advances discussed below, linking the empirical performance of IPLR methods to the broader theoretical and methodological innovations of this study.
Novel contributions of this work lie beyond empirical comparison. By linking interlacing order to sensitivity index behavior, we provide theoretical insight into higher-order digital constructions and propose a hybrid adaptive framework that combines IPLR- and IPLR-, depending on parameter influence. This concept parallels recent developments in adaptive QMC methods and opens new opportunities for scalable, accurate global sensitivity analysis.
Future research will focus on (i) designing adaptive IPLR algorithms that automatically adjust interlacing order, (ii) extending the methodology to non-smooth and time-dependent models, and (iii) testing hybrid schemes across broader domains such as financial risk modeling and engineering design. These directions will further consolidate structured QMC sampling as a cornerstone of modern uncertainty quantification.