Sign in to use this feature.

Years

Between: -

Subjects

remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline

Journals

Article Types

Countries / Regions

Search Results (6)

Search Parameters:
Keywords = AdaBelief

Order results
Result details
Results per page
Select all
Export citation of selected articles as:
25 pages, 3326 KiB  
Article
An Adaptive Regressor with Layered Featuring Based on Federated Learning
by Chuan’gang Zhao, Yang Li, Bin Sun and Tao Shen
Electronics 2025, 14(13), 2573; https://doi.org/10.3390/electronics14132573 - 26 Jun 2025
Viewed by 278
Abstract
Artificial-intelligence-based robotics has recently garnered considerable attention, with the prediction of sample attributes becoming essential for artificial-intelligence-based environmental data analysis and decision-making processes in smart equipment and IoT devices. Based on a masked autoencoder (MAE), this study introduces the FedMAE regressor, a federated [...] Read more.
Artificial-intelligence-based robotics has recently garnered considerable attention, with the prediction of sample attributes becoming essential for artificial-intelligence-based environmental data analysis and decision-making processes in smart equipment and IoT devices. Based on a masked autoencoder (MAE), this study introduces the FedMAE regressor, a federated learning regression framework designed to precisely predict critical nutrients such as nitrogen, phosphorus, and potassium in agricultural and environmental monitoring devices while ensuring data privacy. The proposed adaptive regressor integrates deep learning methodologies within a federated learning architecture. Layer normalization is employed to enhance the model’s stability in distributed environments, and its structure is optimized with residual connections and GELU activation functions. An adaptive normalization method, a multi-layer feature transformation system, and a balanced data allocation technique are introduced to mitigate data distribution biases in edge devices. Furthermore, the AdaBelief optimizer and a dynamic learning rate scheduling approach are implemented to improve the model’s resilience. Experimental results show that the proposed method outperforms baseline and state-of-the-art models in terms of nitrogen prediction and demonstrates notable adaptability in phosphorus and potassium prediction tasks. This research paves the way for the application of federated-learning-based approaches in various ecological and industrial contexts, providing a robust solution for time-series prediction challenges in diverse domains. Full article
Show Figures

Figure 1

22 pages, 868 KiB  
Article
An Efficient Optimization Technique for Training Deep Neural Networks
by Faisal Mehmood, Shabir Ahmad and Taeg Keun Whangbo
Mathematics 2023, 11(6), 1360; https://doi.org/10.3390/math11061360 - 10 Mar 2023
Cited by 70 | Viewed by 13401
Abstract
Deep learning is a sub-branch of artificial intelligence that acquires knowledge by training a neural network. It has many applications in the field of banking, automobile industry, agriculture, and healthcare industry. Deep learning has played a significant role in solving complex tasks related [...] Read more.
Deep learning is a sub-branch of artificial intelligence that acquires knowledge by training a neural network. It has many applications in the field of banking, automobile industry, agriculture, and healthcare industry. Deep learning has played a significant role in solving complex tasks related to computer vision, such as image classification, natural language processing, and object detection. On the other hand, optimizers also play an intrinsic role in training the deep learning model. Recent studies have proposed many deep learning models, such as VGG, ResNet, DenseNet, and ImageNet. In addition, there are many optimizers such as stochastic gradient descent (SGD), Adam, AdaDelta, Adabelief, and AdaMax. In this study, we have selected those models that require lower hardware requirements and shorter training times, which facilitates the overall training process. We have modified the Adam based optimizers and minimized the cyclic path. We have removed an additional hyper-parameter from RMSProp and observed that the optimizer works with various models. The learning rate is set to minimum and constant. The initial weights are updated after each epoch, which helps to improve the accuracy of the model. We also changed the position of the epsilon in the default Adam optimizer. By changing the position of the epsilon, it accumulates the updating process. We used various models with SGD, Adam, RMSProp, and the proposed optimization technique. The results indicate that the proposed method is effective in achieving the accuracy and works well with the state-of-the-art architectures. Full article
Show Figures

Figure 1

19 pages, 7388 KiB  
Article
Self-Attention-Based Short-Term Load Forecasting Considering Demand-Side Management
by Fan Yu, Lei Wang, Qiaoyong Jiang, Qunmin Yan and Shi Qiao
Energies 2022, 15(12), 4198; https://doi.org/10.3390/en15124198 - 7 Jun 2022
Cited by 10 | Viewed by 2650
Abstract
Accurate and rapid forecasting of short-term loads facilitates demand-side management by electricity retailers. The complexity of customer demand makes traditional forecasting methods incapable of meeting the accuracy requirements, so a self-attention based short-term load forecasting (STLF) considering demand-side management is proposed. In the [...] Read more.
Accurate and rapid forecasting of short-term loads facilitates demand-side management by electricity retailers. The complexity of customer demand makes traditional forecasting methods incapable of meeting the accuracy requirements, so a self-attention based short-term load forecasting (STLF) considering demand-side management is proposed. In the data preprocessing stage, non-parametric kernel density estimation is used to construct customer electricity consumption feature curves, and then historical load data are used to delineate the feasible domain range for outlier detection. In the feature selection stage, the feature data are selected using variational modal decomposition and a maximum information coefficient to enhance the model prediction accuracy. In the model prediction stage, the decomposed intrinsic mode function components are independently predicted and reconstructed using an Informer based on improved self-attention. Additionally, the novel AdaBlief optimizer is used to optimize the model parameters. Cross-sectional and longitudinal experiments are conducted on a regional-level load dataset set in Spain. The experimental results prove that the proposed method is superior to other methods in STLF. Full article
(This article belongs to the Topic Short-Term Load Forecasting)
Show Figures

Figure 1

32 pages, 3845 KiB  
Article
Hybrid Verification Technique for Decision-Making of Self-Driving Vehicles
by Mohammed Al-Nuaimi, Sapto Wibowo, Hongyang Qu, Jonathan Aitken and Sandor Veres
J. Sens. Actuator Netw. 2021, 10(3), 42; https://doi.org/10.3390/jsan10030042 - 29 Jun 2021
Cited by 17 | Viewed by 5501
Abstract
The evolution of driving technology has recently progressed from active safety features and ADAS systems to fully sensor-guided autonomous driving. Bringing such a vehicle to market requires not only simulation and testing but formal verification to account for all possible traffic scenarios. A [...] Read more.
The evolution of driving technology has recently progressed from active safety features and ADAS systems to fully sensor-guided autonomous driving. Bringing such a vehicle to market requires not only simulation and testing but formal verification to account for all possible traffic scenarios. A new verification approach, which combines the use of two well-known model checkers: model checker for multi-agent systems (MCMAS) and probabilistic model checker (PRISM), is presented for this purpose. The overall structure of our autonomous vehicle (AV) system consists of: (1) A perception system of sensors that feeds data into (2) a rational agent (RA) based on a belief–desire–intention (BDI) architecture, which uses a model of the environment and is connected to the RA for verification of decision-making, and (3) a feedback control systems for following a self-planned path. MCMAS is used to check the consistency and stability of the BDI agent logic during design-time. PRISM is used to provide the RA with the probability of success while it decides to take action during run-time operation. This allows the RA to select movements of the highest probability of success from several generated alternatives. This framework has been tested on a new AV software platform built using the robot operating system (ROS) and virtual reality (VR) Gazebo Simulator. It also includes a parking lot scenario to test the feasibility of this approach in a realistic environment. A practical implementation of the AV system was also carried out on the experimental testbed. Full article
(This article belongs to the Special Issue Agents and Robots for Reliable Engineered Autonomy)
Show Figures

Figure 1

28 pages, 936 KiB  
Article
Sovereign Debt and Currency Crises Prediction Models Using Machine Learning Techniques
by David Alaminos, José Ignacio Peláez, M. Belén Salas and Manuel A. Fernández-Gámez
Symmetry 2021, 13(4), 652; https://doi.org/10.3390/sym13040652 - 12 Apr 2021
Cited by 16 | Viewed by 4508
Abstract
Sovereign debt and currencies play an increasingly influential role in the development of any country, given the need to obtain financing and establish international relations. A recurring theme in the literature on financial crises has been the prediction of sovereign debt and currency [...] Read more.
Sovereign debt and currencies play an increasingly influential role in the development of any country, given the need to obtain financing and establish international relations. A recurring theme in the literature on financial crises has been the prediction of sovereign debt and currency crises due to their extreme importance in international economic activity. Nevertheless, the limitations of the existing models are related to accuracy and the literature calls for more investigation on the subject and lacks geographic diversity in the samples used. This article presents new models for the prediction of sovereign debt and currency crises, using various computational techniques, which increase their precision. Also, these models present experiences with a wide global sample of the main geographical world zones, such as Africa and the Middle East, Latin America, Asia, Europe, and globally. Our models demonstrate the superiority of computational techniques concerning statistics in terms of the level of precision, which are the best methods for the sovereign debt crisis: fuzzy decision trees, AdaBoost, extreme gradient boosting, and deep learning neural decision trees, and for forecasting the currency crisis: deep learning neural decision trees, extreme gradient boosting, random forests, and deep belief network. Our research has a large and potentially significant impact on the macroeconomic policy adequacy of the countries against the risks arising from financial crises and provides instruments that make it possible to improve the balance in the finance of the countries. Full article
(This article belongs to the Special Issue Symmetry and IoT Intelligence in the Post Pandemic Economy)
Show Figures

Figure 1

19 pages, 282 KiB  
Article
Exploring Adversarial Attacks and Defences for Fake Twitter Account Detection
by Panagiotis Kantartopoulos, Nikolaos Pitropakis, Alexios Mylonas and Nicolas Kylilis
Technologies 2020, 8(4), 64; https://doi.org/10.3390/technologies8040064 - 6 Nov 2020
Cited by 18 | Viewed by 4705
Abstract
Social media has become very popular and important in people’s lives, as personal ideas, beliefs and opinions are expressed and shared through them. Unfortunately, social networks, and specifically Twitter, suffer from massive existence and perpetual creation of fake users. Their goal is to [...] Read more.
Social media has become very popular and important in people’s lives, as personal ideas, beliefs and opinions are expressed and shared through them. Unfortunately, social networks, and specifically Twitter, suffer from massive existence and perpetual creation of fake users. Their goal is to deceive other users employing various methods, or even create a stream of fake news and opinions in order to influence an idea upon a specific subject, thus impairing the platform’s integrity. As such, machine learning techniques have been widely used in social networks to address this type of threat by automatically identifying fake accounts. Nonetheless, threat actors update their arsenal and launch a range of sophisticated attacks to undermine this detection procedure, either during the training or test phase, rendering machine learning algorithms vulnerable to adversarial attacks. Our work examines the propagation of adversarial attacks in machine learning based detection for fake Twitter accounts, which is based on AdaBoost. Moreover, we propose and evaluate the use of k-NN as a countermeasure to remedy the effects of the adversarial attacks that we have implemented. Full article
(This article belongs to the Section Information and Communication Technologies)
Show Figures

Figure 1

Back to TopTop