3.1. Dataset and Models
In this section, we empirically evaluate the performance of the proposed framework using data from the Human Mortality Database (HMD) and conduct a comprehensive comparison with a classic mortality model. The HMD is widely regarded as the world’s leading scientific resource for mortality data, providing detailed, consistent, and reliable information for longevity research. Its high-quality data ensure that the models trained are grounded in realistic and actuarially meaningful observations. We obtain mortality data from 24 countries or populations, as listed in
Table 1. The dataset includes male and female mortality rates for ages 0 through 100, spanning a 50-year period from 1970 to 2019. Following established practice in longevity research (e.g.,
Lee and Miller 2001;
Tuljapurkar et al. 2000), we select a period of sufficient length that avoids apparent structural breaks. The chosen time frame excludes potential structural changes prior to 1970 and omits the COVID-19 pandemic years, whose long-term mortality effects are still under active investigation.
The dataset is split into a training set spanning from 1970 to 2010 and a test set covering from 2011 to 2019. Each prediction model is fitted using the training period and then extrapolated to the test period to generate mortality forecasts.
The models that we compare with our proposed models include the following.
LCAllAges: This is the traditional Lee–Carter model in which data from all available ages from one specific gender of one specific population are modeled separately in one model.
LCOneAge: This method only uses data from the target dataset to be trained in the underlying Lee–Carter model, without considering incorporating any other datasets.
While we continue to use the Lee–Carter model as the underlying mortality model, the methods within our proposed age grouping framework are distinguished by their respective choices of four linkage functions (centroid linkage, single linkage, complete linkage, and average linkage) and the following distance functions.
VarianceDiff: The distance between two age-specific logarithmic mortality rate sequences is defined as the variance in their difference sequences.
DTW: The DTW distance computed directly from the original age-specific logarithmic mortality rate sequences. The implementation of the DTW procedure is based on the
R package
dtw (
Giorgino 2009).
Standardized DTW (SDTW): The DTW distance computed from standardized age-specific logarithmic mortality rate sequences (scaled to zero mean and unit standard deviation).
DDTW: The DDTW distance computed from standardized age-specific logarithmic mortality rate sequences.
ShapeDTW: The ShapeDTW distance with window size , computed from standardized age-specific logarithmic mortality rate sequences.
This will yield the following
proposed age grouping base model for each predicting target. A validation step is required for each proposed age grouping base model to determine the optimal choice of
k from
for each predicting target, with the training set further decomposed into a modeling period from 1970 to 2001 and a validation period from 2002 to 2010 to support this selection. Setting the maximum value at
allows a balance between data sufficiency and diminishing marginal gains. Smaller values of
K do not provide adequate information for population–gender–age targets with sparse or highly volatile observations—particularly at older ages—whereas larger values of
K tend to introduce additional noise into the training process, thereby weakening the predictive performance. The final simple average step will take the average of the predictive results from base models that use the same linkage function but different distance measuring functions by assigning equal weights. All resulting methods are demonstrated in
Table 2.
3.2. Predicting Performance
The performance measure that we use to assess the predictive accuracy of a model is the total sum of squared errors (SSE), which represents the model’s performance on the test dataset. This method of measurement for mortality models is regarded as one of the standard paradigms for evaluating overall model performance and is widely used in the community (e.g.,
Diao et al. 2021,
2023;
Tsai and Cheng 2021, etc.).
For a given predicting target
, let
denote its age-aggregated test SSE, computed as
where
represents the observed age-specific mortality rate in the test period and
is the corresponding model prediction. The overall SSE for any model is then calculated as
, which measures the total prediction error for all ages
x in the predicting target
. To provide a comprehensive assessment of each model’s performance, we compute the overall test SSE across all target population–gender–age groups
and report the first quartile, median, sample mean, and third quartile for these SSE values. A smaller aggregate SSE indicates stronger predictive performance. The results are presented in
Table 3 and
Table 4 for the complete and average linkage methods, whereas the corresponding results for the centroid and single linkage methods are provided in
Table A1 and
Table A2 in the
Appendix A. In the tables, boldface numbers indicate the minimum values in each column within the panel. Additionally, we compute the rank of predictive performance for each reported summary statistic of the test SSEs among the methods reported. These ranks are shown in parentheses alongside each table entry, and an “Average Rank” column is included to demonstrate the average rank for each row. Lower ranks correspond to better performance.
The results in the table clearly provide some insights regarding the selection of different distance functions and the linkage functions. In terms of the mean test SSEs, the proposed methods outperform the benchmark approaches in most cases, as reflected by their lower mean SSE values for both female and male populations. The relatively inferior performance of the DTW-based method can be attributed to potential unintuitive temporal alignments for certain data, as illustrated in
Figure 2. In contrast, the refined DTW-based approaches mitigate these shortcomings and achieve substantially improved performance, comparable to that of the variance-based method. Although the mean test SSEs provides a direct measure of the overall predictive accuracy, the other summary statistics reported in the table are also informative for distinguishing performance across methods, as they better reflect robustness. Accordingly, we emphasize rank-based comparisons, summarized by the values in the “Average Rank” column, to assess the relative performance across methods. Based on these results, we recommend the ensemble approach, which averages all base learners using a simple mean, rather than selecting a single best-performing base learner. Because the identity of the best individual base learner varies across linkage functions and selection criteria, the SimAvg ensemble method exhibits more stable overall performance, with its average rank consistently being first or second among all methods. When comparing the linkage functions, we recommend the complete and average linkage methods over the other alternatives for two primary reasons. First, as discussed in
Section 2.2.4, complete linkage emphasizes global cohesion by defining groups as similar only when all pairwise distances are small, while average linkage strikes a balance between local and global similarities. Consequently, both methods are less susceptible to undue influences from isolated close pairs arising from noise. Second, based on the comparison of the mean test SSEs reported in the tables, the SimAvg ensemble method exhibits superior predictive performance when either complete or average linkage is employed.
The superiority of the SimAvg ensemble method is further supported by the following results of the one-sided Diebold–Mariano (DM) test, which was introduced by
Diebold and Mariano (
1995) and
Harvey et al. (
1997) to formally compare the predictive accuracy of two predicting models. Let
and
denote the models under comparison; the general procedure of the one-sided DM test can be described as follows.
- (1)
Calculate the forecast errors, defined as , where is the actual value and is the forecast from model i.
- (2)
Calculate the loss differential , where L is a loss function, commonly taken to be the squared error loss .
- (3)
Calculate the DM test statistic
, where the mean of the loss differentials is calculated as
with
T being the number of forecasts, and the variance in the loss differential is calculated as
- (4)
Impose the following one-side test hypotheses:
Assume that the loss differentials are stationary in the sense that they have the same mean and variance. Then, under the null hypothesis, the test statistic follows a standard normal distribution as T approaches infinity. If the calculated statistic exceeds the critical value from the normal distribution, one would reject the null hypothesis, concluding that model provides significantly better predictions than model since the expected value of the loss differential is negative.
We compare the prediction accuracy of each benchmark model against its corresponding model from the proposed method using two one-sided Diebold–Mariano (DM) tests based on the age-aggregated test SSEs. If the first null hypothesis that the benchmark model is no better than the proposed model is rejected, we conclude that the benchmark model performs better and therefore wins the comparison. Conversely, if the second null hypothesis that the proposed model is no better than the benchmark is rejected, the proposed model is deemed superior. If neither hypothesis is rejected, the comparison results in a tie. For each model pair, this win determination process is repeated across all 288 predicting targets, and a higher frequency of wins reflects better predictive performance. In
Table 5, we present the comparison results between the two groups of models, where the proposed age grouping models appear in the rows and the benchmark models in the columns. Each cell contains two integers: the first indicates the number of wins for the model in the row, and the second indicates the number of wins for the model in the column. To keep the comparison concise, we report only results for the base learners using a variance-based distance measure with different linkage choices, as the base learners using other distance measures (except for the original DTW) exhibit very similar performance. We also include the models that incorporate the simple averaging procedure in the comparison against the benchmarks.
The results from
Table 5 indicate that the VarianceDiff and SimAvg models, under different linkage functions, generally perform better than the benchmark models in terms of predictive accuracy, as reflected by their larger numbers of successes across most entries (except for LC-VarianceDiff-Single against LCOneAge). Moreover, the SimAvg method secures more DM test victories over the benchmarks than the VarianceDiff method. This again underscores the advantage of incorporating the ensemble-based simple averaging procedure, which strengthens the predictive performance by delivering more statistically robust outperformance relative to the benchmarks.
The DM test comparison results between the two groups of models across different age groups are further presented in
Table 6 for more detailed decomposition across different age groups. Across all age groups, SimAvg with complete linkage consistently outperforms the benchmarks in most cases, but the strength of its dominance varies across ages.
When compared with LCAllAges, all SimAvg methods record a substantial number of wins for the infant, kid, adult, and retiree age groups. For the teen and old groups, the wins still exceed the losses, although the margin narrows, and, in some cases, it approaches parity. This pattern is broadly consistent with intuitive expectations regarding data availability and information sharing across age groups. In particular, infant mortality exhibits distinct dynamics, while adult and retiree ages tend to display relatively stable patterns supported by large exposure sizes, limiting the effectiveness of excessive pooling. In contrast, the teen and old age groups are characterized by higher volatility and smaller exposure sizes, leading them to benefit more from information borrowed across ages, which makes LCAllAges relatively more competitive in these ranges. Nevertheless, the proposed SimAvg approach continues to deliver robust improvements overall, with especially pronounced gains observed at very young and middle ages.
When compared with LCOneAge, the SimAvg methods exhibit pronounced improvements for the infant, kid, teen, and old age groups, particularly under complete and average linkages. In contrast, the results for the adult and retiree groups are mixed, with several SimAvg methods recording more losses than wins against LCOneAge. Nevertheless, when complete linkage is employed, the proposed ensemble approach continues to achieve a net advantage over LCOneAge.
Overall, SimAvg with complete linkage demonstrates clear improvements over LCAllAges for most age groups, while its advantages over LCOneAge are primarily concentrated at the youngest and oldest ages; for the adult and retiree groups, the evidence of improvement is less pronounced.
To illustrate cases in which our approach performs particularly well, we consider the male and female populations of England and Wales as representative examples to compare the proposed ensemble-based model (LC-SimAvg-Complete) with the benchmark Lee–Carter model (LCAllAges).
Figure 4 displays the observed and forecasted average logarithmic mortality rates for the infant, child, retiree, and old age groups under both models. As noted earlier, the training sample covers the period 1970–2010, while the out-of-sample evaluation spans 2011–2019. The results show that the proposed method generally aligns more closely with the realized mortality rates, or performs at least comparably to the Lee–Carter model, across all targets presented, indicating the practical significance of the proposed method in terms of enhancing mortality predictions.
3.3. Stylized Facts in Reference Selections
In this subsection, we summarize several stylized facts regarding how, for different age groups, reference datasets are selected and information is borrowed in distinct ways. The findings in (
Meng et al. 2025) reveal a clear pattern in the amount of external data borrowed as the target age varies from 0 to 100. Middle-age groups tend to benefit from borrowing information from a moderate number of adjacent ages, which improves the prediction accuracy without introducing unnecessary noise. In contrast, both younger and older ages typically require information from a broader range of neighboring ages due to greater variability in their mortality patterns. Infants, however, tend to borrow from a smaller set of nearby ages, as their mortality behaviors are highly unique and do not gain much from incorporating a large number of reference ages. Since the selected value of
k from the proposed method represents the optimal number of reference groups used for each target population–gender–age group
, we present boxplots of the optimal chosen values of
k for each gender–age combination across all target populations from the VarianceDiff-Centroid method in
Figure 5. This visualization highlights the overall pattern in how many external reference age groups are incorporated to achieve the best predictive performance for each target group.
The averaged chosen optimal
k values for each gender–age combination across all target populations, shown in
Figure 5, reveal a consistent pattern, regardless of the chosen linkage method, illustrating how much external information each group borrows, as also noted in (
Meng et al. 2025). Specifically, the infant, adult, and retiree age groups, on average, tend to borrow less from other data, whereas the kid, teen, and old age groups incorporate a greater amount. The differences in the box widths in
Figure 5 further illustrate the degree of variation in the optimal amount of external data across gender–age combinations. The infant and retiree age groups exhibit noticeably narrower boxes, indicating greater stability in the selected values of
k, which represent the optimal number of reference groups used to enhance the predictive performance. In contrast, the adult and teenage groups show more variability across populations, reflected by their wider box widths, while the kid and old age groups display the largest variability in the chosen
k values in all figures. Overall, this suggests that the infant and retiree groups across all populations tend to consistently select relatively small numbers of reference groups, whereas other age groups generally rely on larger and more variable amounts of external data, with the results differing from one population to another.
We also analyze the age group compositions of the reference sets for different targets by calculating the average realized percentages of age groups selected by the proposed method (with the variance-based distance and centroid linkage functions) for each of the six target age groups across all 24 populations and both genders, as shown in
Figure 6. The visualizations illustrate the specific role that each age group plays within the system of information flow, as outlined below.
Target age groups tend to draw a substantial portion of their references from their own corresponding age groups across all populations. This pattern is especially pronounced for the infant, kid, retiree, and old age groups, where the same age groups across populations consistently constitute the largest share of the selected references.
As the reference age group moves further away from the target age group, it becomes less likely to be included in the selected reference set. This is evident from the consistently small proportions of the old age groups chosen as references when the target is infants or kids, and vice versa.
Unlike most other age groups, the retiree age groups stand out by appearing more frequently in the selected reference sets. Indeed, they even constitute the largest proportion of references for the teen and adult target groups. This suggests that the retiree age groups provide more universal information that can be effectively borrowed by a wide range of other age groups. Although this may sound counterintuitive at first glance, it arises naturally within mortality modeling framework, with several reasons. First, from a credibility perspective, the retiree age group has mortality data with large exposures and correspondingly low variance, making these rates statistically more reliable. Consequently, when predicting mortality for other age groups, the procedure tends to borrow more information from these highly credible sources to reduce estimation uncertainty. Second, the contribution reflects genuine alignment in mortality trends across age groups over time. In particular, the sequences of period effects
for the retiree groups tend to be closely correlated with those of other age groups, which allows the joint modeling procedure to borrow meaningful information across ages. To illustrate this graphically, we have plotted the age-specific number of deaths (representing exposure), the age-specific average of the realized squared residuals for Canadian females, and the cross-correlation heatmap between age-specific log-mortality rate sequences, which are presented in
Figure 7. The graphs reveal clear patterns across ages. First, the total number of deaths is dominated by the retiree age group, with the peak also occurring within this group, reflecting their large exposures. Second, the residuals are generally homoskedastic across most ages, with an upward trend at the oldest ages, indicating variance inflation, and occasional peaks at young and working ages. In contrast, the residuals remain small and stable for the retiree age groups, suggesting lower volatility in their mortality rate sequences. Moreover, the cross-correlation between age-specific log-mortality rate sequences is obviously positive for most pairs of ages; with only the very old age (near 100), the correlation becomes less positive.
3.4. Extending to LC2 Model
Another key factor influencing the effectiveness of mortality prediction is the choice of the underlying mortality model, which has been extensively examined throughout the literature (e.g.,
Cairns et al. 2009;
Li et al. 2015;
Li and Lee 2005;
Yang et al. 2016). In the preceding subsection, we embedded the classic Lee–Carter model into the age grouping framework under various distance measuring and linkage functions. This choice is natural because the selected reference population–gender–age groups are assumed to share a consistent underlying time trend with the target group, albeit potentially evolving at slightly different speeds. In this subsection, we introduce greater flexibility by replacing the embedded mortality model with a more complex alternative. This serves two purposes. First, we aim to explore whether a more flexible model can consistently enhance the predictive accuracy across different population–gender–age target groups. Second, we seek to assess the ability of our age grouping-based methods to integrate with alternative mortality models. To balance model complexity and implementation feasibility, we focus on the LC2 model, which sets the number of effect components
as in Equation (
3). The LC2 model has two pairs of age/period effects
and
to capture a more complex shared time trend across all included age groups, along with their relative rates of evolution.
The numerical comparison adopts the same HMD data and includes the benchmark “AllAges” and “OneAge” methods and the proposed VarianceDiff and SimAvg methods, using both Lee–Carter and LC2 as the underlying mortality models. This setup allows us to comprehensively assess the proposed methods relative to the benchmarks, including comparisons across different underlying mortality models and evaluations of the ensemble-based strategies against individual base learners. The comparison follows the same strategy as in
Section 3.2, and we report the first quartile, median, sample mean, and third quartile for the overall test SSEs across all target population–gender–age groups
, ranking the relative performance and calculating the average rank for each row. The results are presented in
Table 7 and
Table 8 for the complete and average linkage methods, whereas the corresponding results for the centroid and single linkage methods are provided in
Table A3 and
Table A4 in the
Appendix A.
Across both linkage strategies and genders, the benchmark LC models exhibit the weakest predictive performance, while the proposed ensemble-based LC2 models consistently achieve superior accuracy and robustness. Although the LC2AllAges and LC2OneAge benchmarks improve upon their LC counterparts, they remain clearly dominated by the ensemble LC2 approaches, indicating that the main performance gains arise from the aggregation mechanisms rather than from the LC2 extension alone. Interestingly, the simpler LCOneAge model is often competitive with—and in some cases outperforms—LC2AllAges, suggesting that increased model complexity does not automatically translate into better predictive accuracy. Overall, the results underscore the importance of targeted conditioning through the selection of reference ages, together with ensemble strategies that combine predictions from multiple base learners, in achieving consistent improvements in mortality forecasting performance.
The superiority of the SimAvg ensemble method is further supported by the pairwise comparison results based on the DM test, presented in
Table 9. In general, the proposed methods tend to outperform the benchmark models, as reflected by their larger numbers of wins in most comparisons (except LC2-VarianceDiff-Centroid against LC2OneAge). Moreover, when the same linkage function is used, the SimAvg method consistently achieves more DM test victories against the benchmarks than the VarianceDiff method, indicating further gains in predictive performance.