1. Introduction
In the era of data-driven intelligent systems, fields such as text classification, image annotation, and bioinformatics often deal with complex situations involving “multi-label” associations, in which a single sample is connected to multiple semantic labels. These tasks are referred to as multi-label learning [
1]. Compared to single-label learning, multi-label learning more accurately reflects the intrinsic properties of the data. However, the high-dimensional feature space and intricate dependencies among labels often lead to the “curse of dimensionality,” resulting in inefficient model training and diminished generalization performance. Therefore, there is an urgent need for effective dimensionality reduction [
2] methods.
Dimensional reduction encompasses two main categories of methods: feature selection and feature extraction. Feature selection is widely used in scenarios requiring explainability, such as medical diagnosis and treatment evaluation, because it preserves the original physical semantics of features [
3,
4,
5]. However, when applied to continuous multi-label data, most of these methods require a discretization preprocessing step that inevitably causes information loss, and they inadequately capture the collaborative dependencies among multiple labels. Feature extraction methods [
6,
7,
8] can effectively reduce dimensionality, but their high computational complexity restricts their practicality for high-dimensional continuous data.
To mitigate information loss caused by discretization in the processing of continuous multi-label data, several methods have been developed. González-López et al. [
9] proposed a mutual information-based distributed continuous feature selection method. Yin et al. [
10] developed a feature selection approach applicable to continuous multi-label data by constructing a robust multi-neighborhood fuzzy
-covering granular space. Ma et al. [
11] introduced a discriminative feature selection method based on adaptive graph diffusion, which enhances feature discriminability by exploiting high-order structural information in continuous data. However, these methods do not sufficiently account for the correlations among multiple labels and thus fall short in meeting the requirements of multi-label collaborative classification.
From a theoretical perspective, the problem of dimensional reduction for multi-label continuous data can be naturally framed within the context of a decision information system and reformulated as an attribute reduction problem in rough set theory—that is, identifying the minimal subset of conditional attributes (features) that preserves the decision (label) information. Traditional rough set theory [
12], which is based on equivalence relations, is only applicable to discrete symbolic data. To this end, scholars have extended equivalence relations by introducing neighborhood relations, dominance relations, similarity relations, and others [
13,
14,
15]. It should be noted that these extended models, such as neighborhood rough sets and fuzzy rough set models, are already capable of processing continuous numerical attributes directly, and this line of research has continued to advance in recent years. Xia et al. [
16] unified the Pawlak rough set and the neighborhood rough set through granular-ball computing, enabling equivalence-class-based knowledge representation on continuous data; Wang and Zhao [
17] introduced a weighted k-nearest neighborhood mechanism to enhance the noise robustness of neighborhood models; Sewwandi et al. [
18] performed granule-specific feature selection, which selects local feature subsets for the granules identified by neighborhood rough sets; and Zhang et al. [
19] incorporated overlap functions into variable precision fuzzy rough sets, realizing fault tolerance at the fuzzy-membership level for attribute reduction. Despite their diverse mechanisms, these models share a common granulation paradigm: knowledge granules are constructed relative to individual objects, adaptive ball centers, or fuzzy similarity relations. In contrast, the tolerance maximal consistent block adopted in this study requires pairwise consistency among all its member objects together with maximality, which corresponds exactly to a maximal clique in the tolerance graph; it is therefore not centered at any specific object and does not rely on a center–radius representation. The distinction between this study and these models also lies in the reduction objective. Specifically, the reduction objectives of neighborhood rough sets, fuzzy rough sets, and classical variable precision rough sets are typically formulated at the object level, aiming to preserve the positive region or a (fuzzy) dependency degree of the decision; such union-level criteria do not constrain the class distribution carried by each individual granule, and two attribute subsets with identical positive regions may induce granules with very different decision distributions. In contrast, the objective of this study is distribution-level: it requires the generalized decision distribution of every non-redundant knowledge granule to be preserved, with the parameter
tolerating a controlled proportion of misclassified objects within each granule, which is particularly important for continuous data susceptible to noise. Moreover, formulated via the label inclusion degree, this distribution-level objective extends naturally to multi-label scenarios by preserving the support proportion of each granule for every label, thereby retaining label-correlation information, whereas dependency-degree-based objectives have no direct multi-label counterpart.
The “maximal consistent block,” defined as a set of objects satisfying both consistency and maximality, constitutes a non-redundant knowledge granule [
20], which provides a suitable granular carrier for the above distribution-level objective. Subsequent studies have extended its application: Zhang et al. [
21] integrated it with multi-granularity frameworks; Li et al. [
22] applied it to telecommunications fraud detection; and Sun et al. [
23] employed it for scale selection in incomplete multi-scale data. Sun et al. [
24] proposed a variable precision rough set model based on maximal consistent blocks for incomplete information systems. In the study of maximal consistent block computation, reference [
21] proposed an extended method based on the tolerance relation matrix; reference [
25] derived maximal consistent blocks by constructing similarity classes and covering structures; and reference [
26] introduced a novel construction method that incorporates computational complexity considerations and parallelization improvements. However, all three methods are designed for incomplete discrete data with missing values and rely on the logic of “missing value compatibility,” making them unsuitable for continuous data. In the context of continuous data, the binary relation of “feature set inclusion” adopted in [
24], together with its reduction objective built upon the “equality or missingness” logic, cannot quantify object differences in continuous spaces, and thus the variable precision model and the reduction objective of [
24] are not directly applicable to attribute reduction for continuous data. Nevertheless, the fault tolerance of the variable precision rough set model, achieved by balancing data uncertainty and reduction accuracy through the parameter
, is particularly important for continuous data susceptible to noise interference, as it prevents overfitting caused by rigid equivalence relations. Therefore, it is necessary to improve the method proposed in [
24] to enable its application to attribute reduction in continuous data settings.
In light of this, we explore the intrinsic connection between label learning and decision information systems, transforming the problem of single/multi-label dimensional reduction for continuous data into an attribute reduction problem within single/multi-label continuous decision information systems. The main contributions of this work are summarized as follows: (1) To address the limitation that classical rough-set models rely on discretization and that the approximation and reduction objectives of the existing maximal consistent block-based variable precision model [
24] are built upon the discrete “equality or missingness” logic, a maximal consistent block calculation framework based on distance tolerance relations is constructed. A complete algorithm flow covering data preprocessing, tolerance matrix construction, and maximal clique mining is designed to realize direct modeling of continuous data. Combined with the fault-tolerant idea of variable precision rough sets, a generalized model with distribution-level reduction objectives suitable for continuous data is established, which improves the adaptability to noisy samples in dimensional reduction tasks. (2) A unified distribution-based reduction objective is constructed for both single-label and multi-label dimensional reduction tasks. For each scenario,
-upper and -lower approximation sets as well as distribution consistent sets are formally defined. Following the discernibility matrix principle and Boolean function simplification, a targeted reduction solving algorithm that can remove redundant features while effectively preserving classification information and inherent label correlations is designed. (3) Empirical validation is conducted on fourteen public benchmark datasets spanning low-dimensional single-label data, dense multi-label data, sparse high-dimensional data, and continuous real-world tasks. The comparison includes seven feature-selection baselines, including a neighborhood rough-set dependency method. Equal-d and Nested-d evaluations use training-partition parameter selection, and the analysis covers primary performance, cross-dataset statistics, computational resources, distance metric comparison, parameter-selection patterns, and component ablation.
The remainder of this paper is organized as follows.
Section 2 introduces basic theoretical preliminaries, including the formal definition of decision information systems, distance-based tolerance relations, and the generalized variable precision rough set model.
Section 3 details the maximal consistent block construction algorithm and its stage-wise complexity analysis, and elaborates the dimensional reduction methods for single-label and multi-label continuous data, respectively.
Section 4 presents the experimental setup and comprehensive result analysis. Finally,
Section 5 concludes the whole work and discusses promising research directions for future improvement.
4. Experiments and Analysis
This section evaluates the proposed method on fourteen continuous single-label and multi-label datasets. The experiments cover the data and protocol settings, method comparisons under Equal-d and Nested-d, cross-dataset statistical tests, running time and scalability, distance-metric settings and parameter selection analysis, a comparison of candidate distance metrics, and component ablation.
4.1. Experimental Setup
4.1.1. Datasets
The evaluation corpus comprises five single-label and nine multi-label benchmark datasets. Dry Bean [
30], Glass Identification [
31], Iris [
32], Leaf [
33], and Wine [
34] are obtained from the UCI Machine Learning Repository; Bibtex [
35], Corel5k [
36], Delicious [
37], Emotions [
38], Enron [
39], Mediamill [
40], Scene [
41], TMC2007 [
42], and Yeast [
43] are obtained from the MULAN benchmark collection. Dataset provenance is documented through the original publication associated with each benchmark. Glass Identification, for which the repository provides no introductory publication, is cited as an electronic dataset resource. Mediamill-10k contains 10,000 instances.
Table 3 summarizes the dataset characteristics and primary score. Macro-F1 is used for single-label datasets and Micro-F1 for multi-label datasets. Each dataset uses five outer splits, and parameter and feature count selection is performed by three-fold cross-validation within the corresponding outer training partition.
4.1.2. Comparison Methods and Evaluation Metrics
The proposed method in this paper is denoted as Ours, and it is compared with seven baseline methods. These methods encompass mainstream technical approaches such as information theory, multi-criteria decision-making, and manifold learning:
The Fast Information-theoretic Mutual-information Feature ranking (FIMF) [
44]: An information-theoretic method that optimizes feature scoring by limiting label combination cardinality and reusing entropy calculations for efficient large-scale feature selection.
The VIKOR-based Multi-target Feature Selection (VMFS) [
45]: A multi-criteria decision-making approach that constructs a decision matrix using cosine similarity and ranks features via the VIKOR method.
The Multi-label Feature Selection using Multi-Criteria Decision Making (MFS-MCDM) [
46]: A method that employs ridge regression to build feature-label decision matrices and combines entropy weighting with TOPSIS for feature ranking.
The manifold-based constraint Laplacian score (MCLS) [
47]: A manifold learning-based algorithm that transforms logical labels into numerical ones and constructs scale-invariant similarity matrices to integrate local structural features.
The manifold regularization based multi-label feature selection (MDFS) [
48]: A manifold regularization approach that constructs low-dimensional embeddings to capture label correlations and uses
-norm regularization for sparse feature selection.
The Shared latent Structure feature Selection (SSFS) [
49]: A graph regularization method based on latent structure sharing that simultaneously models feature spaces and label structures for high-dimensional data.
The neighborhood rough-set dependency ranking (NRS-Dep) [
28,
50]: NRS-Dep denotes the neighborhood rough-set dependency ranking used in this comparison. After min–max scaling within the training partition, each feature is scored by the relative size of its neighborhood positive region. For multi-label data, the positive region uses a label-wise lower-approximation construction. The neighborhood radius is selected from
within each outer training partition, and dependency ties are resolved by neighborhood discernibility.
All methods are implemented under a unified data splitting, classifier, and evaluation pipeline.
The experiments adopt 5-fold cross-validation, with the k-nearest neighbors as the classifier where . For the single-label datasets, Accuracy and Macro-F1 are reported; for the multi-label datasets, Accuracy, Macro-F1, Micro-F1 and Hamming loss are reported.
The mathematical definitions of all evaluation metrics on the r-th test fold are given as follows. Let denote the set of test samples in the r-th fold, with a total number of samples. For single-label tasks, and represent the true label and predicted label of sample i, respectively. For multi-label tasks, and denote the true label vector and predicted label vector of sample i, respectively, where L is the total number of labels. is the indicator function, which takes value 1 when the condition inside holds, and 0 otherwise.
The evaluation metrics for single-label tasks are as follows:
Accuracy: Accuracy represents the proportion of samples with completely correct category prediction:
Macro-F1: Let
be the set of all categories. For each category
, the true positive (
), false positive (
) and false negative (
) are defined as
The F1 score of category
c is calculated as
Macro-F1 is the unweighted average of F1 scores across all categories:
The evaluation metrics for multi-label tasks are as follows:
Accuracy (Subset Accuracy): For multi-label tasks, Accuracy adopts subset accuracy, which means a sample is counted as correct only when all its labels are predicted correctly:
Macro-F1: For each label
, the true positive (
), false positive (
) and false negative (
) are defined as
The F1 score of label
ℓ is
Macro-F1 is the unweighted average of F1 scores across all labels:
Micro-F1: Micro-F1 first accumulates
,
and
over all labels, then calculates the overall F1 score:
If the denominator is 0, the corresponding Micro-F1 value is set to 0.
Hamming Loss: Hamming loss represents the average prediction error rate per sample and per label:
For Hamming loss, a lower value indicates better performance; for all other metrics above, a higher value indicates better performance.
To avoid confusion of evaluation metrics across different tasks, the main result ranking and statistical tests adopt primary evaluation metrics: Macro-F1 for single-label tasks and Micro-F1 for multi-label tasks. The complete experimental results of all evaluation metrics are presented in
Appendix A.
4.1.3. Parameter and Feature Number Protocol
The density-adaptive ranking profile is used throughout the evaluation. For each outer training partition, is selected from and from by three-fold inner cross-validation. Under Equal-d, the feature count is fixed at . Under Nested-d, the candidate set is after duplicate removal. The selected configuration maximizes the inner lower confidence bound, defined as the mean primary score minus its standard error. Model selection is completed before evaluation of the corresponding outer test partition. Here, is the gamma-quantile level used to derive the tolerance threshold from the empirical distribution of pairwise Euclidean distances in the current outer training partition.
Table 4 summarizes the modal parameter choices across the five outer training partitions for each dataset under both protocols, along with the full range of observed
k values.
Figure 1 aggregates the selected
–
combinations across Equal-d and Nested-d and displays their frequencies for each dataset.
4.2. Main Experimental Results
Table 5 and
Table 6 report Macro-F1 on the five single-label datasets under Equal-d and Nested-d, respectively;
Table 7 and
Table 8 report Micro-F1 on the nine multi-label datasets. Bold underlining marks the largest score in each dataset row, and italic underlining marks the second-largest score. All scores are means over five outer-test partitions, with parameters and feature counts selected only within the corresponding outer training partition.
Figure 2 displays the primary F1 scores across the fourteen evaluation datasets.
4.3. Statistical Significance Test
Table 9,
Table 10 and
Table 11 summarize the cross-dataset rank and statistical analyses. Lower average ranks indicate better performance.
Figure 3 visually compares the average rank of all methods under both evaluation protocols. Under Equal-d, Ours achieves the lowest average rank (
), and the Friedman test indicates an overall difference among methods (
,
p = 0.01261). Holm-adjusted Wilcoxon comparisons are significant for Ours–MCLS (
p = 0.000854;
win/tie/loss) and Ours–NRS-Dep (
p = 0.0232;
). Under Nested-d, Ours has an average rank of
, and the Ours–MCLS comparison is significant after Holm adjustment (
p = 0.0120;
).
4.4. Running Time and Scalability
Table 12 summarizes the observed computational range over five outer training partitions.
Across the fourteen datasets, the observed number of maximal consistent blocks ranged from 33–40 on Iris to 834–2411 on Leaf; Yeast spanned 423–3000. Leaf and Yeast showed the widest fold-to-fold ranges and also required longer fitting times than most datasets.
Clique enumeration remained short, with a maximum observed time of 0.14 s, whereas total fitting time ranged from 0.03 s on Iris to 22.12 s on Leaf. The gap between clique time and total fitting time indicates that the subsequent construction of block statistics, discernibility clauses, and inclusion-minimal hitting sets accounts for a substantial part of the computational cost. Peak memory ranged from 183 to 469 MiB, and the largest memory values did not occur on the datasets with the largest numbers of maximal consistent blocks, indicating that memory use depends on the complete fitting pipeline rather than block enumeration alone.
4.5. Metric Settings and Parameter Sensitivity Analysis
All numerical features are standardized using statistics computed from the corresponding training partition, and Euclidean distance is used to construct the tolerance relation for every dataset and outer split. The same metric is retained throughout inner selection and outer evaluation, so , , and the feature count are evaluated under a common geometry.
For each outer training partition, the tolerance threshold is set to the empirical -quantile of its pairwise Euclidean distances. The quantile rule adapts the distance scale to the current training data while preserving the same prespecified construction across datasets. A lower produces a more local tolerance relation because it selects a smaller quantile of the training-partition distance distribution.
Statistics and labels from the outer test partition are excluded from standardization, threshold construction, parameter selection, and feature count selection. Fixing the distance metric and restricting all data-dependent quantities to the training partition isolates the effects of , , and k and keeps the comparison between Equal-d and Nested-d consistent.
Under this configuration, we further examine how the three key parameters are actually selected by the inner-validation procedure across datasets and protocols.
and are critical parameters that affect the approximation relations of the model, the structure of the maximal consistent blocks, and the final reduction results.
The selected values in
Table 4 and
Figure 1 are obtained independently within each outer training partition. Across the twenty-eight dataset–protocol settings,
is the modal choice in twenty-five settings, while the selected
values span the complete candidate set. Under Nested-d, the selected feature count varies across outer partitions on thirteen datasets and remains
on every Iris partition. The observed frequencies characterize dataset-specific and partition-specific selection under the prespecified inner-validation rule. Because
is the lower candidate quantile, its predominance corresponds to a more local tolerance relation than
within the same training partition. These frequencies report inner-validation choices and contain no information from the corresponding outer test partitions.
4.6. Distance Metric Comparison
To verify the rationality of the selected distance metric, this section compares three distance metrics, namely, Euclidean, Manhattan, and cosine, under the same reduction framework.
All three distance metrics are evaluated using
and the quantile parameter
, the same Equal-d feature number, identical five-fold partitions, and the same evaluation population. The distance definition is the sole varying factor; the outer test folds are excluded from configuration decisions.
Table 13 reports Macro-F1 for the single-label datasets and Micro-F1 for the multi-label datasets.
The results demonstrate that no single distance metric achieves optimal performance on all datasets. Euclidean distance obtained the lowest average rank of 1.5357 and achieved the highest or tied-highest mean score on 10 of the 14 datasets. Manhattan and cosine distances obtained average ranks of 2.0357 and 2.4286, with the highest or tied-highest scores on four datasets and one dataset, respectively. Euclidean distance outperformed Manhattan on nine datasets, tied on one, and underperformed on four. It outperformed cosine on 11 datasets and underperformed on three. The lowest average rank and the broadest coverage of best-performing datasets show that Euclidean distance provides the most stable aggregate performance across the evaluated single-label and multi-label datasets. Euclidean distance is therefore adopted as the default setting in the main experiments. This comparison indicates that the distance metric affects the tolerance relation and the structure of the maximal consistent blocks, and the distance form can be further adjusted according to data types in practical applications.
4.7. Ablation Study
The ablation study examines the structural and relevance terms in the ranking profile used by the proposed method. The Full profile combines maximal-block structural evidence, label relevance, the soft-reduct membership contribution, and redundancy control. The structure-removed profile suppresses the maximal-block structural terms and the soft-reduct membership contribution while retaining label relevance and redundancy control. The relevance-removed profile sets the label-relevance contribution to zero while retaining the structural terms, the soft-reduct membership contribution, and redundancy control. The three profiles use identical outer folds, candidate budgets, classifiers, and evaluation metrics. Parameters and feature counts are selected within the corresponding outer training partition for each profile. Macro-F1 is used for the five single-label datasets, and Micro-F1 is used for the nine multi-label datasets.
Table 14 reports the primary F1 scores under Equal-d and Nested-d,
Table 15 summarizes the paired dataset-level contrasts, and
Figure 4 displays the score differences between the Full profile and each ablated profile.
The component effects vary across datasets. Under Equal-d, the full profile records wins/ties/losses against the structure-removed profile and against the relevance-removed profile. Under Nested-d, the corresponding counts are and . The positive mean differences for both Equal-d contrasts and for the Nested-d relevance contrast indicate an average benefit from the corresponding complete profile terms within those comparisons. The Nested-d structure contrast varies in the opposite direction on more datasets. These results characterize dataset-dependent contributions of structural evidence and label relevance without implying a universal component effect.
Across the fourteen datasets, Ours obtains the lowest average rank under Equal-d. The Equal-d Friedman test detects an overall method difference, and Holm-adjusted comparisons are significant against MCLS and NRS-Dep. Under Nested-d, the Holm-adjusted comparison with MCLS is significant. The parameter selections in
Table 4 are confined to the outer training partitions, and the resource audit reports the observed computational range of maximal-block and inclusion-minimal hitting-set enumeration.