Next Article in Journal
Constrained Boundary Enhancement for SAM 2-Based Ship Segmentation in UAV Berthing and Unberthing Videos
Previous Article in Journal
Correction: Öztürk, A.; Katırcıoğlu, F. SIMRET: A Similarity-Guided Retinex Approach for Low-Light Enhancement. Appl. Sci. 2026, 16, 3517
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

FedBudget: A Budget-Aware Federated Learning Method for Communication-Constrained Distributed Data Mining

1
School of Information Science and Engineering, Yanshan University, Qinhuangdao 066004, China
2
School of Mathematics and Information Technology, Hebei Normal University of Science & Technology, Qinhuangdao 066004, China
*
Author to whom correspondence should be addressed.
Appl. Sci. 2026, 16(15), 7728; https://doi.org/10.3390/app16157728
Submission received: 8 July 2026 / Revised: 24 July 2026 / Accepted: 27 July 2026 / Published: 4 August 2026

Abstract

Federated learning enables collaborative data mining without centralizing raw data, but communication budgets remain a practical bottleneck in distributed deployment. Existing federated optimization methods mainly address statistical heterogeneity or aggregation stability, while client participation is often treated as full participation or random sampling. This paper proposes FedBudget, a budget-aware client selection method for communication-constrained federated data mining. In each round, FedBudget constructs a scheduling score from historical utility, stability, freshness, communication cost, and a coverage-aware penalty, and then greedily selects clients under a given communication budget. The aggregation stage follows the standard sample-size-weighted selected-client FedAvg rule, which makes the scheduling contribution directly attributable. Experiments on AI4I, Mammography, Shuttle, SMD, and SWaT compare FedBudget with representative federated optimization and scheduling baselines. Statistical analysis shows that FedBudget significantly reduces communication cost and improves communication-normalized performance relative to budgeted optimization baselines, while maintaining competitive AUC and PR-AUC. Larger-scale experiments with 20 and 50 simulated clients show mean performance-per-MB improvements of 4.019 and 1.945, respectively, together with lower mean communication cost. Sensitivity and convergence analyses confirm the robustness of the proposed scheduling mechanism and its stable communication–performance trade-off. These results indicate that explicit budget-aware participation modeling improves communication efficiency in federated data mining while preserving a simple and compatible training pipeline.

1. Introduction

Federated learning (FL) is a collaborative learning paradigm in which multiple clients train a shared model without centralizing their raw data [1,2,3]. It is particularly suitable for distributed data mining scenarios such as industrial monitoring, anomaly detection, predictive maintenance, medical screening, and cross-institutional analytics, where data ownership, privacy, compliance, and communication constraints prevent conventional centralized training. In such scenarios, data are naturally distributed across heterogeneous clients, and the clients may differ in sample size, class ratio, feature distribution, noise level, device availability, and network condition.
A large body of FL research has focused on optimization under non-independent and identically distributed (non-IID) data. FedAvg reduces communication rounds by combining local training with server-side averaging [1]. FedProx mitigates local objective drift by adding a proximal term [4]. SCAFFOLD uses control variates to correct client drift [5]. FedNova normalizes heterogeneous local update steps [6], and adaptive federated optimization methods improve server-side update dynamics [7]. These methods are important for training stability, but they usually regard client participation as an external protocol, such as full participation, uniform random sampling, or a fixed participation ratio. Communication cost is then reported as an outcome rather than modeled as an explicit decision constraint during training.
This treatment is insufficient in communication-constrained deployment. Full participation requires every client to transmit model updates in every round, even when some clients provide limited incremental benefit or communicate over expensive links. Random sampling reduces the number of participating clients, but it does not exploit information already observed during training, such as historical utility, update stability, participation freshness, and client-specific communication cost. For distributed data mining tasks, a more appropriate server behavior is to select clients that are expected to provide useful and stable updates within the available communication budget, while avoiding repeated concentration on a small set of low-cost clients.
This paper studies budget-aware client selection for communication-constrained federated data mining. The goal is not to maximize a single task metric in isolation, but to improve the trade-off between task quality and communication cost. In this setting, deployment value depends on how much effective model improvement can be obtained per unit of communication. Therefore, communication-normalized utility, measured by performance-per-MB, becomes a central evaluation dimension together with task metrics such as AUC and PR-AUC.
Similar resource-awareness requirements also arise beyond conventional mobile and edge FL deployments. In heterogeneous distributed communication systems, such as low-Earth-orbit satellite networks, link quality, coverage, mobility, and power limitations make dynamic resource allocation important for maintaining service efficiency [8]. Although this paper focuses on federated data mining rather than satellite networking, these systems illustrate a broader deployment pattern: distributed participants may have unequal communication links and limited transmission opportunities, so the learning server should treat communication as a first-class scheduling constraint.
We propose FedBudget, a lightweight server-side scheduling method compatible with standard federated training. Its core function is to decide which clients participate in each round. For each client, the server maintains lightweight historical states and computes a score based on five factors: historical utility, update stability, freshness, communication cost, and a coverage-aware penalty. Clients are selected greedily under a per-round communication budget. Unobserved clients can be explored within the same budget, avoiding an expensive all-client warm-up phase. The selected updates are aggregated by the usual sample-size-weighted selected-client FedAvg rule.
The main contributions of this paper are summarized as follows.
  • We propose a communication-budget-constrained federated data mining setting and explicitly model client participation as a trade-off between task performance and communication cost.
  • We design the FedBudget client scheduling method, which combines historical utility, stability, freshness, communication cost, and a coverage-aware penalty for budgeted client selection.
  • We keep selected-client FedAvg aggregation unchanged, making the scheduling effect directly attributable and easy to combine with existing FL optimizers.
  • We adopt an ablation-first experimental protocol to verify the necessity of the complete scheduling mechanism and compare it with multiple strong FL optimization baselines and simple scheduling baselines.
  • Real server experiments show that FedBudget improves communication efficiency and performance-per-MB while maintaining competitive task performance.

2. Related Work

2.1. Federated Learning Under Heterogeneous Data

FL trains models across distributed clients while keeping raw data local. Beyond the seminal FedAvg algorithm [1], later studies, system designs, benchmarks, and open-source platforms have investigated optimization, privacy, heterogeneity, scalability, and reproducible FL implementation [2,3,9,10,11,12,13,14]. Under non-IID data, local updates can drift away from the global update trend and destabilize aggregation [15,16,17]. FedProx adds a proximal regularization term to local objectives [4]. SCAFFOLD introduces control variates to correct client drift [5]. FedNova addresses objective inconsistency caused by heterogeneous local steps [6]. Adaptive federated optimization methods modify server-side optimization dynamics [7]. These methods primarily improve optimization stability. In contrast, FedBudget focuses on client participation under communication budgets and can be viewed as complementary to these optimizers.

2.2. Communication-Efficient Federated Learning

Communication efficiency is a core FL challenge. Existing studies reduce communication cost by decreasing communication rounds, compressing gradients, quantizing updates, sparsifying transmissions, or designing periodic averaging mechanisms [18,19,20,21,22]. These methods usually change the content or representation of transmitted updates. FedBudget follows a complementary route: it does not compress or alter model updates, but optimizes which clients communicate in each round. This makes the method easy to combine with compression or quantization techniques in future work.

2.3. Client Selection and Resource-Aware Scheduling

Client selection is a direct way to reduce communication burden. FedCS selects feasible clients under heterogeneous resource constraints in mobile edge environments [23]. Oort uses guided participant selection to improve large-scale FL efficiency [24]. TiFL stratifies clients according to system performance [25]. Clustered sampling improves representativeness and reduces sampling variance [26]. Power-of-choice strategies analyze how client selection affects convergence [27]. These studies show that participation strategy affects both system cost and learning quality. Different from generic multi-objective scheduling, FedBudget treats communication cost as a resource denominator and combines historical utility, stability, freshness, and coverage as a budgeted participation score for distributed data mining tasks.

2.4. Distributed Data Mining and Anomaly-Oriented Tasks

Anomaly detection and distributed data mining appear widely in industrial maintenance, medical screening, cybersecurity, and sensor monitoring. Such tasks often involve class imbalance, rare positive samples, and heterogeneous distributions [28,29,30,31]. Standard accuracy is often insufficient, so AUC, PR-AUC, F1, and balanced accuracy are commonly reported. In the FL setting, these task challenges are coupled with data decentralization and communication limits. This paper does not restrict FedBudget to one specific data modality; instead, it uses AI4I, Mammography, and Shuttle as distributed data mining benchmarks to evaluate budget-aware scheduling.

2.5. Positioning of This Paper

FedBudget is positioned as a server-side participation scheduler rather than a compression, local-objective, or aggregation redesign method. Compared with cost-only scheduling, it considers historical learning utility and stability in addition to communication cost. Compared with fixed rotation, it updates client priority adaptively from training history. The proposed score is therefore intended to approximate a benefit-cost participation decision under a round budget, rather than to replace federated optimizers or to maximize a single predictive metric in isolation. Its core contribution is a low-overhead and interpretable budget-aware scheduling mechanism for communication-constrained federated data mining.

3. Materials and Methods

3.1. Problem Definition

Consider an FL system with K clients. Client i owns local data D i , and the server holds the global model parameter w t at communication round t. In each round, the server selects a client subset S t under a communication budget B t :
i S t C i ( t ) B t ,
where C i ( t ) denotes the communication cost of selecting client i in round t. Selected clients conduct local training and return model updates. The objective is to improve the trade-off between task performance and communication cost, rather than to optimize task performance alone.
More specifically, the considered decision problem is a repeated budgeted client-selection problem. At each round, the server aims to choose a feasible subset that maximizes an expected task-quality improvement surrogate under the communication budget:
S t arg max S t { 1 , , K } Δ Φ ^ t ( S t ) , s . t . i S t C i ( t ) B t .
The true future improvement is unavailable before a client is selected and its update is returned. Therefore, FedBudget constructs Δ Φ ^ t from server-observable historical signals, including utility, stability, freshness, communication cost, and coverage history. This formulation makes the scheduling objective explicit while preserving the standard FL training objective on the selected clients.

3.2. FedBudget Framework

FedBudget modifies server-side client selection and preserves the standard local training and aggregation pipeline. Figure 1 shows the overall architecture. The method uses client-side local training and validation feedback to update server-side scheduling states. The budget-aware scheduler then selects clients under the communication constraint, after which selected-client FedAvg produces the next global model.
If n i denotes the local sample size and w t + 1 i denotes the locally updated model from client i, the server aggregates selected clients by
w t + 1 = i S t n i j S t n j w t + 1 i .
The scheduling process includes four steps: budgeted exploration for clients without history, factor computation for clients with history, greedy selection under the communication budget, and client-state update after receiving local feedback.

3.3. Historical Utility

After local training, each selected client produces lightweight validation feedback. Let L i before and L i after denote validation losses before and after local training, and let M i before and M i after denote task metrics before and after local training. The immediate utility signal is
r i ( t ) = 0.7 max ( 0 , L i before L i after ) + 0.3 max ( 0 , M i after M i before ) .
The server maintains an exponential moving average:
u i ( t ) = 0.6 u i ( t 1 ) + 0.4 r i ( t ) .
To avoid excessive suppression of clients with small raw utility, FedBudget converts utility into a bounded multiplicative factor:
U i ( t ) = 1 + λ u min u i ( t ) median ( P t ) + ϵ , 2 ,
where P t is the set of positive utilities and ϵ is a small constant.

3.4. Stability, Freshness, and Communication Cost

Clients with highly volatile recent utility may provide unstable updates. FedBudget maintains a sliding window of recent utilities and denotes its standard deviation by σ i ( t ) . The stability factor is
S i ( t ) = 1 1 + λ s σ i ( t ) .
To avoid long-term exclusion, the freshness factor uses the number of rounds since the last selection, denoted by a i ( t ) :
F i ( t ) = 1 + λ f min a i ( t ) 5 , 1 .
The communication cost is measured in megabytes and modeled as
C i ( t ) = bytes ( update i ) · multiplier i ,
where multiplier i represents client-specific communication conditions.
The constants used in these factors are chosen as conservative scale controls rather than dataset-specific tuning terms. The utility scaling prevents unusually large utility estimates from dominating the score, the stability coefficient controls the attenuation of volatile updates, the freshness cap limits the maximum priority boost from delayed participation, and the small ϵ only prevents division by zero when communication cost or normalization statistics are close to zero. The default values keep the utility, stability, freshness, and cost terms on comparable numerical scales; their empirical influence is examined in the sensitivity analysis in Section 4.7.

3.5. Coverage-Aware Penalty and Budgeted Exploration

Selecting clients only by utility and cost can over-concentrate training on a small group of low-cost clients. Figure 2 visualizes the resulting cost–coverage correction mechanism. Raw utility evidence is attenuated by cost and coverage pressure, bounded within a feasible selection band, and converted into a budgeted priority score.
FedBudget first defines the base score
Q i ( t ) = U i ( t ) S i ( t ) F i ( t ) C i ( t ) + ϵ .
Let N i ( t ) be the historical number of selections for client i. The coverage-aware score is
Q i cov ( t ) = Q i ( t ) 1 + N i ( t ) .
For clients without historical information, FedBudget uses budgeted exploration within the same communication constraint instead of performing an all-client warm-up phase.
The score in Equations (5)–(10) is designed as a lightweight benefit–cost surrogate for budgeted participation. The numerator combines three factors related to useful participation: historical utility estimates the observed learning contribution, stability suppresses highly volatile recent updates, and freshness reduces long-term exclusion of clients that have not participated recently. The denominator models communication cost, so that clients with similar expected utility but lower communication burden receive higher priority. The coverage term further penalizes repeated concentration on frequently selected clients. This formulation differs from a generic weighted-sum multi-objective score because cost is treated as a resource denominator and coverage is applied as a participation-history correction. The ablation and scheduling-baseline experiments in Section 4 are used to empirically verify the role of these components.

3.6. Analytical Rationale, Selection Algorithm, and Complexity

At communication round t, FedBudget can be interpreted as solving a budgeted surrogate selection problem. Let V i ( t ) = U i ( t ) S i ( t ) F i ( t ) / 1 + N i ( t ) denote the surrogate participation value. The idealized one-round selection objective is
max S t { 1 , , K } i S t V i ( t ) , s . t . i S t C i ( t ) B t .
This problem has a knapsack-like form. FedBudget uses Q i cov ( t ) = V i ( t ) / ( C i ( t ) + ϵ ) as a benefit–cost priority and greedily adds clients until the round budget is reached. This analytical view explains why the proposed score is aligned with a budgeted participation objective: it ranks clients by surrogate contribution per unit communication while preserving the standard local objective and selected-client aggregation. Therefore, FedBudget is compatible with standard selected-client federated training pipelines. The computational overhead mainly comes from scoring and sorting. For K clients, direct sorting costs O ( K log K ) , and historical state storage costs O ( K h ) , where h is the sliding-window size. The method only maintains lightweight scheduling states on the server and uses the standard model-update interface.
The greedy procedure provides an efficient online approximation to the one-round combinatorial problem. This choice is appropriate for the present setting because the surrogate values are updated from noisy historical feedback after every communication round, and the scheduler must make repeated low-latency decisions. Ranking by contribution per unit cost preserves the desired monotonic behavior: a client with larger estimated contribution and lower communication cost receives higher priority, while the coverage term moderates repeated selection of the same clients.

4. Experiments and Results

4.1. Experimental Setting, Baseline Groups, and Statistical Protocol

Experiments are conducted on AI4I [32,33], Mammography and Shuttle [34], SMD, and SWaT. AI4I is a predictive-maintenance benchmark, Mammography and Shuttle are anomaly-oriented data mining benchmarks, SMD provides a sensor-oriented anomaly setting for larger-scale validation, and SWaT represents a processed industrial-anomaly benchmark. Table 1 summarizes the basic dataset characteristics. The AI4I–Mammography–Shuttle main comparison in Table 2 uses 10 simulated clients, three random seeds, five communication budgets, and 20 communication rounds. To strengthen statistical robustness, the same-budget paired analysis in Table 3 is expanded to five random seeds on Mammography and Shuttle. The expanded SMD and SWaT protocols are described in Section 4.4.
The compared methods are divided into two groups. The first group contains federated optimization baselines, including FedAvg, FedProx, FedNova, SCAFFOLD, and FedOpt, which are included to compare with representative FL training strategies under the same evaluation protocol. The second group contains scheduling baselines, including budgeted random FedAvg, FedCS-Cost, and RoundRobin, which are used to isolate the client-participation decision. FedCS-Cost selects clients mainly by communication cost, whereas RoundRobin rotates clients under the budget.
Reported results are computed from completed server-side simulation runs. Mean values are reported together with standard deviations when repeated runs are available. For paired comparisons, runs are matched by dataset, budget, and random seed. We use Wilcoxon signed-rank tests for paired differences and bootstrap 95% confidence intervals for mean paired differences. The statistical analysis focuses on communication cost and performance-per-MB, because these metrics directly reflect the communication-budgeted scheduling objective. AUC and PR-AUC are retained as primary task-quality metrics.
The performance metrics are defined as follows. Accuracy is the fraction of correctly classified test samples. Balanced accuracy is the average of sensitivity and specificity, which reduces the influence of class imbalance. F1 is the harmonic mean of precision and recall. AUC is the area under the receiver operating characteristic curve and measures threshold-independent ranking quality. PR-AUC is the area under the precision–recall curve and is informative for rare positive classes. Communication MB is the total transmitted model-update volume in megabytes after applying client-specific communication multipliers. performance-per-MB is computed as AUC divided by total communication MB and is used as the main communication-normalized efficiency indicator.

4.2. Main Comparison with Representative FL Baselines

Table 2 reports the average results over AI4I, Mammography, and Shuttle across budgets and seeds. This main table compares FedBudget with representative FL optimization baselines and the budgeted random-selection baseline under the same evaluation protocol. FedBudget obtains the highest mean performance-per-MB and the lowest mean communication cost in this comparison, while AUC and PR-AUC remain close to those of the optimization-oriented methods. Overall, FedBudget supports the intended trade-off: improving communication-normalized efficiency while retaining competitive predictive quality. Cost-priority and fixed-rotation scheduling policies are analyzed separately in Section 4.6.

4.3. Same-Budget Paired Statistical Analysis

To strengthen the statistical robustness of the same-budget paired analysis, Table 3 uses an expanded five-seed protocol (seeds 0–4) on Mammography and Shuttle, while the other supplementary experiments follow their stated protocols. The table reports paired differences between FedBudget and budgeted optimization baselines. Positive performance-per-MB differences indicate higher communication-normalized performance, and AUC differences provide a task-quality reference under the same paired protocol. Across all five paired baselines, the performance-per-MB improvement is statistically significant, while the AUC differences remain small in magnitude, supporting the communication-efficiency claim under a larger random-seed protocol.

4.4. Expanded Dataset and Scale Validation

This subsection consolidates the expanded validation beyond the initial three-dataset, 10-client setting. SMD is included in the larger-scale simulations to evaluate behavior under a sensor-oriented anomaly dataset when the number of simulated clients increases, while SWaT is used as an industrial-anomaly benchmark with a separate task-quality and communication-efficiency comparison. The SMD scale experiments include a 10-client reference setting and 20/50-client extensions, and SWaT uses 10 clients, three seeds, budgets 0.4 and 0.6, and 20 communication rounds. These extensions increase the simulation setting along both dataset coverage and client-population size while keeping the same server-side scheduling rule. As shown in Table 4, Mammography, Shuttle, and SMD are reported with 10-client reference rows and 20/50-client scale rows. FedBudget keeps positive mean performance-per-MB differences in all listed scale settings, and the communication reduction remains observable when the number of simulated clients increases.
FedCS-Cost and RoundRobin are included as simple client-selection policies. FedCS-Cost represents a cost-priority scheduler that selects inexpensive clients, whereas RoundRobin represents a fixed rotation policy under the budget. Table 5 reports paired differences of FedBudget minus these scheduling baselines on AI4I, Mammography, and SWaT. Compared with FedCS-Cost, FedBudget improves AUC and PR-AUC and preserves or improves F1, showing that pure cost-priority selection can lose task-quality information. Compared with RoundRobin, FedBudget consistently improves performance-per-MB and reduces communication cost, showing the benefit of score-based budgeted scheduling over fixed rotation. These results indicate that the proposed scheduler is most useful when client selection must balance task-quality evidence and communication cost, rather than only minimizing the cost of the selected clients.

4.5. Convergence Behavior

Round-level metrics are recorded for convergence analysis. Figure 3 reports the F1 trajectory across communication rounds on SWaT, Figure 4 reports loss as a function of cumulative communication on Mammography, and Figure 5 reports the relative communication-normalized AUC gain over the strongest non-FedBudget baseline after the initial transient rounds on SWaT. These three views are complementary: the F1 curve provides a conventional round-wise convergence view, the loss curve examines whether FedBudget maintains stable optimization behavior under reduced communication, and the relative gain curve directly evaluates the budgeted scheduling objective. Overall, FedBudget converges rapidly to a competitive F1 level, reaches a competitive loss trajectory with lower cumulative communication, and shows a clear advantage in communication-normalized convergence behavior.

4.6. Performance-per-MB Analysis

The performance-per-MB metric is defined as task performance divided by total communication cost. It is therefore an efficiency indicator rather than a standalone task-quality metric, and it should be examined together with AUC, PR-AUC, and F1. In Table 2, FedBudget achieves the best communication-efficiency values among the optimization baselines. Table 5 further shows the role of simple scheduling policies. FedCS-Cost can substantially reduce communication, while FedBudget provides higher task-quality metrics than this cost-priority policy. RoundRobin maintains rotation fairness, and FedBudget obtains higher communication-normalized efficiency with lower communication cost. FedBudget is therefore positioned as a balanced scheduler rather than a pure cost-minimization rule.
From an application perspective, the metric is useful for deployments where each round has an explicit bandwidth or energy budget. In predictive maintenance, medical screening, or industrial monitoring, the server may prefer a client subset that contributes reliable learning signals while keeping communication consumption predictable. The paired results therefore should be read as a communication-efficiency analysis: FedBudget is designed to allocate limited communication to clients with stronger expected contribution per unit cost, and the task metrics verify that this allocation does not rely on sacrificing predictive quality.

4.7. Sensitivity Analysis

To examine sensitivity to empirical coefficients, we conduct one-at-a-time sensitivity analysis around the default setting. The tested grid varies utility, stability, and freshness weights. The default setting is retained as the primary configuration, and Table 6 reports the average results of the default setting and six one-factor perturbations across the sensitivity runs. The values show that moderate coefficient changes preserve comparable AUC, PR-AUC, F1, communication cost, and communication-normalized performance.

4.8. Ablation Study

Table 7 reports the component ablation results. The complete method achieves the highest mean AUC among the ablation variants. Some simplified variants reduce communication more strongly and may therefore obtain high performance-per-MB, while their lower AUC indicates that utility, freshness, and coverage-related balancing contribute to the task-quality side of the trade-off. This supports the use of a combined scheduling score instead of a single-factor policy.

4.9. Implementation and Reproducibility Details

The federated simulations use a NumPyClient-style Flower implementation with a logistic prediction model initialized from zero weights. Each client performs local gradient updates with class-imbalance weighting, learning rate 0.05, weight decay 10 4 , three base local epochs, and deterministic client–epoch jitter of two epochs in the reported experiments. The FedProx coefficient is 0.5, and the FedOpt server learning rate and momentum are 0.7 and 0.5, respectively. Client data are partitioned by a non-IID label-sorted/random-mix rule with strength 0.6 unless otherwise specified. Communication cost is measured in megabytes from model-update size multiplied by a client-specific communication multiplier. Reported rows are generated by server-side federated simulations under the same evaluation protocol. Scikit-learn and SciPy are used for data preprocessing, metric computation, and statistical analysis [35,36].

5. Discussion

The experimental results suggest three practical implications. First, communication-aware participation modeling can be separated from the local optimizer and aggregation rule. Because FedBudget preserves the selected-client FedAvg aggregation interface, it can be used as a server-side scheduling layer for existing FL pipelines. This is valuable for distributed data mining systems in which model updates are allowed but client communication must be budgeted by bandwidth, energy, or operational cost.
Second, the comparison with FedCS-Cost and RoundRobin shows why client selection should not be reduced to a single scheduling factor. Cost-priority selection can save communication but may underrepresent clients with higher learning utility, whereas fixed rotation provides simple coverage but does not use training feedback. The proposed score combines utility, stability, freshness, cost, and coverage so that the selected set reflects both learning evidence and system cost. The ablation results further indicate that removing these factors changes the balance between task quality and communication-normalized efficiency.
Third, the method is particularly relevant to anomaly-oriented and sensor-oriented distributed data mining. In such tasks, positive events are rare, client distributions can differ substantially, and communication infrastructure may be uneven. The AI4I, Mammography, Shuttle, SMD, and SWaT experiments cover predictive-maintenance, anomaly-oriented, and sensor-based settings, showing that the same scheduling principle can be applied across several data-mining scenarios. The expanded 20-client and 50-client experiments further indicate that the communication-efficiency pattern remains visible as the simulated client pool grows.
Several future research directions follow from these observations. The scheduler can be evaluated with deeper neural architectures and streaming clients, where communication and participation availability vary over time. It can also be combined with compression, quantization, secure aggregation, or privacy-preserving accounting, because these techniques reduce or protect the transmitted update while FedBudget decides which clients should communicate. Finally, a tighter theoretical analysis of coverage-aware benefit–cost scheduling under non-IID data would further clarify the relation between client-selection dynamics and convergence behavior.

6. Conclusions

This paper proposed FedBudget, a budget-aware federated learning scheduling method for communication-constrained distributed data mining. FedBudget selects clients according to historical utility, stability, freshness, communication cost, and a coverage-aware penalty, while keeping selected-client FedAvg aggregation unchanged. This design makes the method a lightweight server-side participation scheduler that can be integrated into standard FL workflows without modifying the local training objective or the aggregation interface.
Across representative FL baselines, FedBudget achieves the highest mean performance-per-MB and the lowest mean communication cost, and paired statistical tests show significant communication-efficiency gains over budget-matched baselines. The expanded SMD and SWaT validation, sensitivity analysis, ablation study, and convergence analysis further support the effectiveness of the proposed scheduling formulation. The 20-client and 50-client simulations show that the communication-normalized advantage remains observable when the number of simulated participants increases, while the SWaT experiment provides an additional sensor-oriented industrial-anomaly setting.
Overall, the results show that explicit budget-aware participation modeling can improve communication-normalized efficiency while maintaining competitive task performance. This makes FedBudget suitable for distributed data mining scenarios where client communication is limited but task quality cannot be ignored, such as predictive maintenance, medical screening, and industrial sensor monitoring. Future work will extend the method to additional real-world deployments, dynamic communication budgets, deeper model architectures, and theoretical analysis of coverage-aware scheduling under non-IID clients.

Supplementary Materials

The following supporting information can be downloaded at https://www.mdpi.com/article/10.3390/app16157728/s1.

Author Contributions

Conceptualization, J.S.; methodology, J.S. and A.L.; software, J.S.; validation, J.S. and A.L.; formal analysis, J.S.; investigation, J.S.; resources, K.L. and Z.Z.; data curation, J.S.; writing—original draft preparation, J.S.; writing—review and editing, A.L., K.L. and Z.Z.; visualization, J.S.; supervision, K.L. and Z.Z.; project administration, K.L. and Z.Z.; funding acquisition, Z.Z. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the Science Foundation of Hebei Normal University of Science and Technology (Grant No. 2025YB043) and the Hebei Innovation Center for Smart Perception and Applied Technology of Agricultural Data (Grant No. ADIC2025Y006).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The public benchmark datasets used in this study are available from the UCI Machine Learning Repository and the ODDS Library. The minimal dataset supporting the reported experimental results is provided as Supplementary Material in CSV format. It includes the main expanded-baseline results, ablation results, statistical summaries, dataset protocol metadata, simple scheduling baseline results, public dataset sources, a data dictionary, a manifest file, and SHA-256 checksums. Further inquiries can be directed to the corresponding author.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. McMahan, B.; Moore, E.; Ramage, D.; Hampson, S.; y Arcas, B.A. Communication-efficient learning of deep networks from decentralized data. In Artificial Intelligence and Statistics; PMLR: Lodon, UK, 2017. [Google Scholar]
  2. Kairouz, P.; McMahan, H.B.; Avent, B.; Bellet, A.; Bennis, M.; Bhagoji, A.N.; Bonawitz, K.; Charles, Z.; Cormode, G.; Cummings, R.; et al. Advances and open problems in federated learning. Found. Trends Mach. Learn. 2021, 14, 1–210. [Google Scholar] [CrossRef]
  3. Yang, Q.; Liu, Y.; Chen, T.; Tong, Y. Federated machine learning: Concept and applications. ACM Trans. Intell. Syst. Technol. (TIST) 2019, 10, 1–19. [Google Scholar] [CrossRef]
  4. Li, T.; Sahu, A.K.; Zaheer, M.; Sanjabi, M.; Talwalkar, A.; Smith, V. Federated optimization in heterogeneous networks. In Proceedings of the Third Conference on Machine Learning and Systems, Austin, TX, USA, 2–4 March 2020. [Google Scholar]
  5. Karimireddy, S.P.; Kale, S.; Mohri, M.; Reddi, S.J.; Stich, S.; Suresh, A.T. SCAFFOLD: Stochastic controlled averaging for federated learning. In Proceedings of the 37th International Conference on Machine Learning, Virtual, 13–18 July 2020; PMLR: London, UK, 2020; Volume 119, pp. 5132–5143. [Google Scholar]
  6. Wang, J.; Liu, Q.; Liang, H.; Joshi, G.; Poor, H.V. Tackling the objective inconsistency problem in heterogeneous federated optimization. Adv. Neural Inf. Process. Syst. 2020, 33, 7611–7623. [Google Scholar]
  7. Reddi, S.; Charles, Z.; Zaheer, M.; Garrett, Z.; Rush, K.; Konečný, J.; Kumar, S.; McMahan, H.B. Adaptive federated optimization. In Proceedings of the 9th International Conference on Learning Representations, Virtual Event, 3–7 May 2021. [Google Scholar]
  8. Ivanov, A.; Stoliarenko, M.; Kruglik, S.; Novichkov, S.; Savinov, A. Dynamic resource allocation in LEO satellite. In Proceedings of the 2019 15th International Wireless Communications and Mobile Computing Conference (IWCMC), Tangier, Morocco, 24–28 June 2019; pp. 930–935. [Google Scholar] [CrossRef]
  9. Li, T.; Sahu, A.K.; Talwalkar, A.; Smith, V. Federated learning: Challenges, methods, and future directions. IEEE Signal Process. Mag. 2020, 37, 50–60. [Google Scholar] [CrossRef]
  10. Bonawitz, K.; Eichner, H.; Grieskamp, W.; Huba, D.; Ingerman, A.; Ivanov, V.; Kiddon, C.; Konečný, J.; Mazzocchi, S.; McMahan, B.; et al. Towards federated learning at scale: System design. Proc. Mach. Learn. Syst. 2019, 1, 374–388. [Google Scholar]
  11. Bonawitz, K.; Ivanov, V.; Kreuter, B.; Marcedone, A.; McMahan, H.B.; Patel, S.; Ramage, D.; Segal, A.; Seth, K. Practical secure aggregation for privacy-preserving machine learning. In Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security, Dallas, TX, USA, 30 October–3 November 2017. [Google Scholar]
  12. Caldas, S.; Duddu, S.M.K.; Wu, P.; Li, T.; Konečný, J.; McMahan, H.B.; Smith, V.; Talwalkar, A. LEAF: A benchmark for federated settings. arXiv 2018, arXiv:1812.01097. [Google Scholar]
  13. He, C.; Li, S.; So, J.; Zeng, X.; Zhang, M.; Wang, H.; Wang, X.; Vepakomma, P.; Singh, A.; Qiu, H.; et al. FedML: A research library and benchmark for federated machine learning. arXiv 2020, arXiv:2007.13518. [Google Scholar]
  14. Beutel, D.J.; Topal, T.; Mathur, A.; Qiu, X.; Fernandez-Marques, J.; Gao, Y.; Sani, L.; Li, K.H.; Parcollet, T.; de Gusmão, P.P.B.; et al. Flower: A friendly federated learning research framework. arXiv 2020, arXiv:2007.14390. [Google Scholar]
  15. Hsieh, K.; Phanishayee, A.; Mutlu, O.; Gibbons, P. The non-IID data quagmire of decentralized machine learning. In Proceedings of the 37th International Conference on Machine Learning, Online, 12–18 July 2020; PMLR: London, UK, 2020; Volume 119, pp. 4387–4398. [Google Scholar]
  16. Zhao, Y.; Li, M.; Lai, L.; Suda, N.; Civin, D.; Chandra, V. Federated learning with non-IID data. arXiv 2018, arXiv:1806.00582. [Google Scholar]
  17. Zhu, H.; Xu, J.; Liu, S.; Jin, Y. Federated learning on non-IID data: A survey. Neurocomputing 2021, 465, 371–390. [Google Scholar] [CrossRef]
  18. Konecny, J.; McMahan, H.B.; Yu, F.X.; Richtarik, P.; Suresh, A.T.; Bacon, D. Federated learning: Strategies for improving communication efficiency. arXiv 2016, arXiv:1610.05492. [Google Scholar]
  19. Konecny, J.; McMahan, H.B.; Ramage, D.; Richtarik, P. Federated optimization: Distributed machine learning for on-device intelligence. arXiv 2016, arXiv:1610.02527. [Google Scholar]
  20. Lin, Y.; Han, S.; Mao, H.; Wang, Y.; Dally, W.J. Deep gradient compression: Reducing the communication bandwidth for distributed training. In Proceedings of the International Conference on Learning Representations, Vancouver, BC, Canada, 30 April–3 May 2018. [Google Scholar]
  21. Reisizadeh, A.; Mokhtari, A.; Hassani, H.; Jadbabaie, A.; Pedarsani, R. FedPAQ: A communication-efficient federated learning method with periodic averaging and quantization. In Proceedings of the Twenty Third International Conference on Artificial Intelligence and Statistics, Online, 26–28 August 2020; PMLR: London, UK, 2020; Volume 108, pp. 2021–2031. [Google Scholar]
  22. Sattler, F.; Wiedemann, S.; Muller, K.R.; Samek, W. Robust and communication-efficient federated learning from non-IID data. IEEE Trans. Neural Netw. Learn. Syst. 2020, 31, 3400–3413. [Google Scholar] [CrossRef] [PubMed]
  23. Nishio, T.; Yonetani, R. Client selection for federated learning with heterogeneous resources in mobile edge. In Proceedings of the ICC 2019-2019 IEEE International Conference on Communications (ICC), Shanghai, China, 20–24 May 2019. [Google Scholar]
  24. Lai, F.; Zhu, X.; Madhyastha, H.V.; Chowdhury, M. Oort: Efficient federated learning via guided participant selection. In Proceedings of the 15th USENIX Symposium on Operating Systems Design and Implementation OSDI, Virtual Event, 14–16 July 2021. [Google Scholar]
  25. Chai, Z.; Ali, A.; Zawad, S.; Truex, S.; Anwar, A.; Baracaldo, N.; Zhou, Y.; Ludwig, H.; Yan, F. TiFL: A tier-based federated learning system. In Proceedings of the 29th International Symposium on High-Performance Parallel and Distributed Computing, Stockholm, Sweden, 23–26 June 2020. [Google Scholar]
  26. Fraboni, Y.; Vidal, R.; Kameni, L.; Lorenzi, M. Clustered sampling: Low-variance and improved representativity for clients selection in federated learning. In Proceedings of the 38th International Conference on Machine Learning, Virtual, 18–24 July 2021; PMLR: London, UK, 2021; Volume 139, pp. 3407–3416. [Google Scholar]
  27. Cho, Y.J.; Wang, J.; Joshi, G. Client selection in federated learning: Convergence analysis and power-of-choice selection strategies. In Proceedings of the 25th International Conference on Artificial Intelligence and Statistics, Virtual, 28–30 March 2022. [Google Scholar]
  28. Chandola, V.; Banerjee, A.; Kumar, V. Anomaly detection: A survey. ACM Comput. Surv. 2009, 41, 1–58. [Google Scholar] [CrossRef]
  29. Ruff, L.; Vandermeulen, R.; Goernitz, N.; Deecke, L.; Siddiqui, S.A.; Binder, A.; Müller, E.; Kloft, M. Deep one-class classification. In Proceedings of the International Conference on Machine Learning, Stockholm, Sweden, 10–15 July 2018; PMLR: London, UK, 2018; Volume 80, pp. 4393–4402. [Google Scholar]
  30. Zhao, Y.; Nasrullah, Z.; Li, Z. PyOD: A Python toolbox for scalable outlier detection. J. Mach. Learn. Res. 2019, 20, 1–7. [Google Scholar] [CrossRef]
  31. Pang, G.; Shen, C.; Cao, L.; van den Hengel, A. Deep learning for anomaly detection: A review. ACM Comput. Surv. 2021, 54, 1–38. [Google Scholar] [CrossRef]
  32. Matzka, S. AI4I 2020 predictive maintenance dataset. In UCI Machine Learning Repository; University of California, Irvine: Irvine, CA, USA, 2020. [Google Scholar]
  33. Dua, D.; Graff, C. UCI Machine Learning Repository; University of California, Irvine: Irvine, CA, USA, 2019. [Google Scholar]
  34. Rayana, S. ODDS Library; Stony Brook University: New York, NY, USA, 2016. [Google Scholar]
  35. Pedregosa, F.; Varoquaux, G.; Gramfort, A.; Michel, V.; Thirion, B.; Grisel, O.; Blondel, M.; Prettenhofer, P.; Weiss, R.; Dubourg, V.; et al. Scikit-learn: Machine learning in Python. J. Mach. Learn. Res. 2011, 12, 2825–2830. [Google Scholar]
  36. Virtanen, P.; Gommers, R.; Oliphant, T.E.; Haberland, M.; Reddy, T.; Cournapeau, D.; Burovski, E.; Peterson, P.; Weckesser, W.; Bright, J.; et al. SciPy 1.0: Fundamental algorithms for scientific computing in Python. Nat. Methods 2020, 17, 261–272. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Overall framework of FedBudget. Clients perform local training and return model updates together with lightweight metadata, while the server constructs budget-aware scheduling scores from historical utility, stability, freshness, communication cost, and coverage information. Selected clients are aggregated by sample-size-weighted selected-client FedAvg.
Figure 1. Overall framework of FedBudget. Clients perform local training and return model updates together with lightweight metadata, while the server constructs budget-aware scheduling scores from historical utility, stability, freshness, communication cost, and coverage information. Selected clients are aggregated by sample-size-weighted selected-client FedAvg.
Applsci 16 07728 g001
Figure 2. Mechanism of budget-aware client prioritization. Historical utility evidence is modulated by cost and coverage pressure, clipped into a feasible selection band, and used to form the budgeted client priority under the communication constraint.
Figure 2. Mechanism of budget-aware client prioritization. Historical utility evidence is modulated by cost and coverage pressure, clipped into a feasible selection band, and used to form the budgeted client priority under the communication constraint.
Applsci 16 07728 g002
Figure 3. F1 convergence on SWaT across communication rounds. Higher values indicate better classification performance at the corresponding training round.
Figure 3. F1 convergence on SWaT across communication rounds. Higher values indicate better classification performance at the corresponding training round.
Applsci 16 07728 g003
Figure 4. Loss convergence on Mammography with respect to cumulative communication. Lower values indicate better optimization behavior under the consumed communication budget.
Figure 4. Loss convergence on Mammography with respect to cumulative communication. Lower values indicate better optimization behavior under the consumed communication budget.
Applsci 16 07728 g004
Figure 5. Relative communication-normalized AUC gain on SWaT after the initial transient rounds. The y-axis reports the percentage gain of FedBudget over the strongest non-FedBudget baseline at each round.
Figure 5. Relative communication-normalized AUC gain on SWaT after the initial transient rounds. The y-axis reports the percentage gain of FedBudget over the strongest non-FedBudget baseline at each round.
Applsci 16 07728 g005
Table 1. Dataset characteristics used in the experiments.
Table 1. Dataset characteristics used in the experiments.
DatasetSamplesFeaturesPositive Rate
AI4I500090.0500
Mammography500060.0500
Shuttle500090.0714
SMD50003800.0500
SWaT50005100.0500
Table 2. Main comparison with representative FL baselines, reported as mean ± standard deviation. Upward arrows indicate that larger values are better, whereas the downward arrow indicates that smaller values are better. Bold values denote the best result in each column.
Table 2. Main comparison with representative FL baselines, reported as mean ± standard deviation. Upward arrows indicate that larger values are better, whereas the downward arrow indicates that smaller values are better. Bold values denote the best result in each column.
MethodPerf./MB ↑Comm. MB ↓AUC ↑PR-AUC ↑F1 ↑
FedAvg 52.75 ± 12.76 0.01739 ± 0.00277 0.8863 ± 0.1119 0 . 5054 ± 0 . 2402 0.4420 ± 0.4090
FedAvg-Random 168.20 ± 74.19 0.00594 ± 0.00172 0.8843 ± 0.1111 0.4995 ± 0.2453 0.4319 ± 0.4151
FedProx 168.18 ± 74.22 0.00594 ± 0.00172 0.8842 ± 0.1114 0.4996 ± 0.2453 0.4335 ± 0.4148
FedNova 168.53 ± 74.43 0.00594 ± 0.00172 0.8855 ± 0.1100 0.5010 ± 0.2440 0.4575 ± 0.4118
SCAFFOLD 169.15 ± 75.68 0.00594 ± 0.00172 0 . 8875 ± 0 . 1094 0.5022 ± 0.2410 0 . 4933 ± 0 . 3999
FedOpt 168.51 ± 74.07 0.00594 ± 0.00172 0.8860 ± 0.1084 0.4978 ± 0.2456 0.4218 ± 0.4188
FedBudget 181 . 49 ± 69 . 59 0 . 00535 ± 0 . 00140 0.8848 ± 0.1132 0.4992 ± 0.2437 0.4149 ± 0.4187
Table 3. Five-seed paired differences on Mammography and Shuttle between FedBudget and strong budgeted baselines with 95% confidence intervals and Wilcoxon p-values. The upward arrow indicates that a larger positive Δ Perf./MB value favors FedBudget.
Table 3. Five-seed paired differences on Mammography and Shuttle between FedBudget and strong budgeted baselines with 95% confidence intervals and Wilcoxon p-values. The upward arrow indicates that a larger positive Δ Perf./MB value favors FedBudget.
Baseline Δ Perf./MB↑ (95% CI) Δ AUC (95% CI)Perf./MB p-Value
FedAvg-Random + 23.71 [ + 18.28 , + 29.33 ] 0.0006 [ 0.0016 , + 0.0006 ]<0.001
FedProx + 23.70 [ + 18.27 , + 29.27 ] 0.0006 [ 0.0016 , + 0.0004 ]<0.001
FedNova + 23.74 [ + 18.38 , + 29.38 ] 0.0005 [ 0.0014 , + 0.0006 ]<0.001
FedOpt + 23.78 [ + 18.49 , + 29.39 ] 0.0003 [ 0.0014 , + 0.0008 ]<0.001
SCAFFOLD + 23.42 [ + 17.94 , + 29.10 ] 0.0011 [ 0.0023 , 0.0001 ]<0.001
Table 4. Dataset-wise scale validation from the 10-client reference protocol to 20 and 50 simulated clients.
Table 4. Dataset-wise scale validation from the 10-client reference protocol to 20 and 50 simulated clients.
DatasetClientsPerf./MBComm. MBAUCMean Δ Perf./MBMean Δ Comm. MBMean Δ AUC
Mammography10236.1700.00420.9267+42.301−0.0019−0.0007
Shuttle10176.5040.00590.9879+31.532−0.0028+0.0000
SMD102.6500.37000.9801+0.178−0.0299−0.0081
Mammography2096.7230.00940.9102+6.874−0.0008+0.0003
Shuttle2073.7820.01350.9914+5.073−0.0012+0.0000
SMD201.8720.52060.9722+0.111−0.0368+0.0029
Mammography5039.5110.02320.9170+3.273−0.0024−0.0001
Shuttle5029.9060.03320.9919+2.514−0.0035−0.0001
SMD500.7541.29960.9793+0.049−0.1003+0.0056
Table 5. Paired differences between FedBudget and simple client-selection policies. Positive task-metric and performance-per-MB differences favor FedBudget; negative communication differences indicate lower communication cost. Upward arrows indicate that larger values are favorable, whereas the downward arrow indicates that smaller communication differences are favorable.
Table 5. Paired differences between FedBudget and simple client-selection policies. Positive task-metric and performance-per-MB differences favor FedBudget; negative communication differences indicate lower communication cost. Upward arrows indicate that larger values are favorable, whereas the downward arrow indicates that smaller communication differences are favorable.
DatasetBaseline Policy Δ AUC↑ Δ PR-AUC↑ Δ F1↑ Δ Perf./MB↑ Δ Comm. MB↓
AI4IFedCS-Cost + 0.1234 + 0.1465 + 0.0000 15.75 + 0.00133
AI4IRoundRobin + 0.0008 0.0074 + 0.0000 + 12.29 0.00080
MammographyFedCS-Cost + 0.0230 + 0.0081 + 0.2391 67.49 + 0.00093
MammographyRoundRobin 0.0030 0.0119 0.0911 + 21.80 0.00058
SWaTFedCS-Cost + 0.0303 + 0.0586 + 0.0160 0.59 + 0.06786
SWaTRoundRobin + 0.0051 0.0150 0.0076 + 0.36 0.04703
Table 6. Sensitivity analysis of scheduling coefficients around the default setting. Upward arrows indicate that larger values are better, whereas the downward arrow indicates that smaller values are better.
Table 6. Sensitivity analysis of scheduling coefficients around the default setting. Upward arrows indicate that larger values are better, whereas the downward arrow indicates that smaller values are better.
SettingPerf./MB ↑Comm. MB ↓AUC ↑PR-AUC ↑F1 ↑
Default ( 1.0 , 1.0 , 0.15 ) 156.3780.005860.88540.49970.4138
Utility weight = 0.5 160.5850.005700.88390.50060.4146
Utility weight = 1.5 154.6630.005930.88570.49740.4125
Stability weight = 0.5 156.0340.005870.88520.49960.4138
Stability weight = 1.5 156.1600.005860.88540.49880.4138
Freshness weight = 0.05 157.3200.005810.88450.49640.4151
Freshness weight = 0.30 155.0520.005910.88500.49860.4194
Table 7. Ablation results of FedBudget components, reported as mean ± standard deviation. Upward arrows indicate that larger values are better, whereas the downward arrow indicates that smaller values are better. Bold values denote the best result in each column.
Table 7. Ablation results of FedBudget components, reported as mean ± standard deviation. Upward arrows indicate that larger values are better, whereas the downward arrow indicates that smaller values are better. Bold values denote the best result in each column.
VariantAUC ↑Comm. MB ↓Perf./MB ↑
Full 0 . 8855 ± 0 . 1184 0.00580 ± 0.00097 157.99 ± 40.15
No utility 0.8762 ± 0.1256 0.00522 ± 0.00089 173.62 ± 44.21
No stability 0.8851 ± 0.1197 0.00582 ± 0.00097 157.40 ± 39.78
No freshness 0.8658 ± 0.1389 0 . 00494 ± 0 . 00087 181 . 65 ± 49 . 17
Utility only 0.8678 ± 0.1379 0.00501 ± 0.00089 179.77 ± 48.34
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Song, J.; Li, A.; Li, K.; Zheng, Z. FedBudget: A Budget-Aware Federated Learning Method for Communication-Constrained Distributed Data Mining. Appl. Sci. 2026, 16, 7728. https://doi.org/10.3390/app16157728

AMA Style

Song J, Li A, Li K, Zheng Z. FedBudget: A Budget-Aware Federated Learning Method for Communication-Constrained Distributed Data Mining. Applied Sciences. 2026; 16(15):7728. https://doi.org/10.3390/app16157728

Chicago/Turabian Style

Song, Junhui, Afei Li, Ke Li, and Zhangqi Zheng. 2026. "FedBudget: A Budget-Aware Federated Learning Method for Communication-Constrained Distributed Data Mining" Applied Sciences 16, no. 15: 7728. https://doi.org/10.3390/app16157728

APA Style

Song, J., Li, A., Li, K., & Zheng, Z. (2026). FedBudget: A Budget-Aware Federated Learning Method for Communication-Constrained Distributed Data Mining. Applied Sciences, 16(15), 7728. https://doi.org/10.3390/app16157728

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop