4.1. Selection of the Window Rejection Method
Table 4 reports the percentage of signal removed (mean ± standard deviation, with minimum and maximum values across subjects) for each tested method.
Among the evaluated configurations, and yielded only marginal improvements in correlation, whereas the remaining methods led to more substantial increases. In particular, showed low correlation while also removing the smallest fraction of segments, likely because the 5 s window is too short to reliably capture artifactual behavior. Conversely, produced the highest percentage of removed windows, as it relies solely on the number of outliers; indeed, in some cases this can lead to the exclusion of segments that still exhibit good agreement between HR and PR. and achieved some of the highest correlation values; however, they were found to be overly selective. Specifically, relies exclusively on the HR–PR differences, while applies a particularly strict threshold on allowable bpm discrepancies.
Based on these considerations,
M2 was selected as the optimal trade-off, balancing improved correlation, moderate signal removal, and robustness in identifying noisy segments without being overly restrictive (
Figure 3). As shown in
Figure S2 in the Supplementary Materials, following the application of
M2, the temporal trends of the features exhibit greater overlap, indicating improved agreement between HRV- and PRV-derived metrics.
Table 5 reports the proportion of segments identified as noisy and removed using
M2, across subject groups. As appreciable, the rejected percentage remains below 10% for all subjects (8.14 ± 1.81%), with the lowest values observed in the HC group.
4.2. Correlation Between Heart- and Pulse-Derived Features
Overall, correlation values increased after applying
M2 in all extracted features, indicating improved association between HRV and PRV after exclusion of low-quality windows. A comprehensive comparison of correlation values between
All Windows and
M2 is shown in
Supplementary Figure S3. Under the
All Windows condition, Pearson’s
r values were consistently above 0.5, with 66.7% of features exceeding 0.6. After applying
M2, correlations further improved, with all features exceeding 0.7, except for
, which remained slightly lower (0.66). A similar trend was observed for Spearman’s
, with most features exceeding 0.7 after
M2, while
again showed a lower value (0.64).
In addition to increasing correlation values,
M2 also reduced variability across subjects. As shown in
Figure 4, the distribution of both Pearson and Spearman coefficients becomes narrower after removal of artifactual segments, with a noticeable reduction in dispersion. This is reflected in lower IQR and higher median values compared to
All Windows, indicating more consistent agreement between subjects. This reduction in variability is further supported by the analysis of additional metrics, with both the CV and IQR decreasing after applying
M2 (
Figures S5 and S6 in the Supplementary Materials).
Figure 5 presents the correlation values by subject group. Higher agreement is generally observed in HC, OSAS, and PLM subjects, whereas lower values are found in the RBD and Mixed group. Despite this inter-group differences, the application of
M2 consistently improved correlation across all groups, although some variability within subjects persists. However, sub-group analyses are reported in an exploratory and descriptive framework due to the limited sample size within each clinical group.
Finally, agreement between HRV and PRV was further evaluated using Bland-Altman analysis (
Figure 6);
Supplementary Table S5 further reports the Bland–Altman bias for each feature together with its 95% bootstrap CI, for both the
All Windows and
M2 conditions, providing an estimate of the uncertainty of the systematic difference between HRV and PRV. Following the application of
M2, limits of agreement decreased for most features, indicating reduced dispersion between the two measures. In addition, the mean difference between HRV and PRV approached zero for the majority of features, suggesting a considerable reduction in systematic bias. However, a residual bias remains for specific features (as appreciable for
,
,
,
, and
) which continue to show a non-negligible difference even after noise removal.
4.3. Equivalence and Bias Analysis
Since correlation and Bland–Altman analyses describe the strength of association and the presence of systematic bias between HRV and PRV features, formal evaluation of whether the observed differences are acceptable for practical use in clinical screening studies was conducted. This approach is grounded on the idea that high correlation does not imply agreement, and small but statistically significant biases may still be compatible with screening applications, provided that accurate correction is performed. To address this, as described in
Section 3.2.2, a TOST procedure was applied, complemented with a Wilcoxon signed-rank test to further characterize residual bias.
Table 6 reports the equivalence summary for
All Windows and
M2, across all tested equivalence margins (
), and reports the robustness of features to the choice of
. Specifically, for each feature, the proportion of subjects satisfying the equivalence criterion was computed, providing a measure of both agreement and robustness. Overall, the application of
M2 resulted in a substantial increase in the percentage of subjects satisfying equivalence compared to the
All Windows condition.
In more detail, for = 0.2, 8 out of 15 features demonstrated high equivalence (i.e., ≥70% of subjects), while 5 showed moderate, and 2 low (average: 47%). Similar trends were observed across the other equivalence margins, with more stringent values leading to a reduction in the number of features meeting the equivalence criterion, as expected.
As appreciable, some features (, , , ) demonstrated good agreement across multiple values, indicating stable equivalence between HRV and PRV representations. Specifically, exhibited 100% concordance in all tested values with M2, and thus it could be considered reliable even with strict equivalence margins. Moderate-to-high equivalence was found for , , and at values of = [0.08, 0.1], suggesting their reliability in real-world scenarios, where inter-subject variability is high. Conversely, other features (, , , , , , ) exhibited sensitivity to the choice of , suggesting that their agreement depends on the tolerated level of deviation, and thus might not be adequate for use in screening purposes.
To complement the equivalence analysis, as described earlier, the Wilcoxon signed-rank test was used to assess the extent of systematic differences between HRV and PRV features, previously investigated with Bland–Altman plots (cf.
Section 4.2). The percentage of subjects for which no significant difference was observed (
0.05) was computed for each feature, along with the average effect size together with its 95% bootstrap CI. Subject-level CI for mean differences are reported in detail in
Supplementary Table S6.
The results show that for some of the other extracted features, statistically significant differences persist across subjects, despite high equivalence rates observed with TOST, revealing moderate-to-high percentage of bias.
In particular, for = 0.2, features , , , , , , and exhibited moderate-to-high equivalence rate, but relatively low percentage of non-significant Wilcoxon results, indicating the presence of consistent bias, though small, as previously highlighted through the Bland–Altman analysis. A similar trend is observed for = 0.1 (with , , ) and = 0.08 (, ). Effect size analysis revealed small-to-moderate effect sizes, suggesting that these differences remain limited in magnitude.
On the other hand, , describing the average time between successive heartbeats, consistently exhibited very low percentage of bias across all tested margins. Similarly, (which exhibited moderate-to-high equivalence rate for = [0.08, 0.1, 0.2]) consistently showed low bias in the tested subjects.
Overall, these results suggest that a large subset of features achieves practical equivalence between HRV and PRV, particularly after the application of M2. Residual biases identified through the Wilcoxon test are generally small and do not preclude the use of these features in screening contexts, where approximate agreement is considered sufficient.
4.4. Practical Implications for Screening
Based on the integrated assessment of TOST equivalence, Wilcoxon characterization, and effect size analysis, practical recommendations for feature use in screening applications were formulated. Features were hence classified according to a two-tier framework: (1) a primary classification based on TOST equivalence rate (i.e., percentage of subjects meeting the equivalence criterion, as described in the previous section), and (2) a complementary evaluation integrating Wilcoxon test results and effect size to characterize bias properties and variability.
Features achieving equivalence above 70% were deemed suitable for screening and were further stratified according to the presence and magnitude of bias. Specifically, features exhibiting both high equivalence and no significant bias were assigned a
“High Suitability” label. Features with high equivalence but systematic bias and small effect sizes (below 0.5) were classified as
“Suitability with bias correction”, as the observed bias, although statistically significant, remained within acceptable equivalence margins and could potentially be corrected with linear transformation. Features with moderate equivalence (50–70%) and favorable Wilcoxon characteristics (e.g., low bias percentage, small effect size) were assigned a
“Conditional Suitability” recommendation, and considered appropriate for screening only when combined with more robust features. Conversely, features achieving moderate TOST equivalence (50–70%) but exhibiting unfavorable bias characteristics, or features with high variability (large effect sizes irrespective of equivalence rate), were classified as
“Supplementary Features”, appropriate exclusively as auxiliary indicators rather than primary screening metrics. Finally, features failing to meet the 50% equivalence threshold were classified as
“Not Recommended” for screening applications.
Table 7 reports the recommendations for the best features in each of the explored equivalence margins; features that remain equivalent across multiple
thresholds indicate higher robustness and suitability for large-scale screening applications.
As mentioned in the previous Section, consistently exhibited high equivalence and low bias across all explored values, and was assigned a “High Suitability” label in all configurations.
This pragmatic classification prioritizes equivalence as the primary criterion while acknowledging that small, consistent biases do not preclude clinical utility in preliminary screening contexts, where subsequent confirmatory testing with gold standard PSG is performed.