You are currently viewing a new version of our website. To view the old version click .

58 Results Found

  • Article
  • Open Access
8 Citations
2,944 Views
24 Pages

Clustered Federated Learning Based on Momentum Gradient Descent for Heterogeneous Data

  • Xiaoyi Zhao,
  • Ping Xie,
  • Ling Xing,
  • Gaoyuan Zhang and
  • Huahong Ma

Data heterogeneity may significantly deteriorate the performance of federated learning since the client’s data distribution is divergent. To mitigate this issue, an effective method is to partition these clients into suitable clusters. However,...

  • Article
  • Open Access
23 Citations
3,566 Views
23 Pages

Discrete Missing Data Imputation Using Multilayer Perceptron and Momentum Gradient Descent

  • Hu Pan,
  • Zhiwei Ye,
  • Qiyi He,
  • Chunyan Yan,
  • Jianyu Yuan,
  • Xudong Lai,
  • Jun Su and
  • Ruihan Li

28 July 2022

Data are a strategic resource for industrial production, and an efficient data-mining process will increase productivity. However, there exist many missing values in data collected in real life due to various problems. Because the missing data may re...

  • Feature Paper
  • Article
  • Open Access
30 Citations
4,122 Views
21 Pages

20 August 2022

This paper presents an adaptive PID using stochastic gradient descent with momentum (SGDM) for a proton exchange membrane fuel cell (PEMFC) power system. PEMFC is a nonlinear system that encounters external disturbances such as inlet gas pressures an...

  • Article
  • Open Access
1,260 Views
27 Pages

Three-Dimensional Pulsed-Laser Imaging via Compressed Sensing Reconstruction Based on Proximal Momentum-Gradient Descent

  • Han Gao,
  • Guifeng Zhang,
  • Min Huang,
  • Yanbing Xu,
  • Yucheng Zheng,
  • Shuai Yuan and
  • Huan Li

7 December 2024

Compressed sensing (CS) is a promising approach to enhancing the spatial resolution of images obtained from few-pixel array sensors in three-dimensional (3D) laser imaging scenarios. However, traditional CS-based methods suffer from insufficient rang...

  • Article
  • Open Access
4 Citations
2,082 Views
15 Pages

An Improved Reacceleration Optimization Algorithm Based on the Momentum Method for Image Recognition

  • Haijing Sun,
  • Ying Cai,
  • Ran Tao,
  • Yichuan Shao,
  • Lei Xing,
  • Can Zhang and
  • Qian Zhao

5 June 2024

The optimization algorithm plays a crucial role in image recognition by neural networks. However, it is challenging to accelerate the model’s convergence and maintain high precision. As a commonly used stochastic gradient descent optimization a...

  • Article
  • Open Access
3 Citations
2,435 Views
23 Pages

3 October 2024

Accurate monitoring of estuarine turbidity patterns is important for maintaining aquatic ecological balance and devising informed estuarine management strategies. This study aimed to enhance the prediction of estuarine turbidity patterns by enhancing...

  • Communication
  • Open Access
11 Citations
4,080 Views
12 Pages

CoolMomentum-SPGD Algorithm for Wavefront Sensor-Less Adaptive Optics Systems

  • Zhiguang Zhang,
  • Yuxiang Luo,
  • Huizhen Yang,
  • Hang Su and
  • Jinlong Liu

18 January 2023

Instead of acquiring the previous aberrations of an optical wavefront with a sensor, wavefront sensor-less (WFSless) adaptive optics (AO) systems compensate for wavefront distortion by optimizing the performance metric directly. The stochastic parall...

  • Article
  • Open Access
832 Views
12 Pages

3 April 2025

Aiming at the problem of nonlinear coupling error in the measurement of parallel six-axis accelerometers, this study improves the back propagation (BP) neural network and proposes an improved BP neural network decoupling model that introduces the gra...

  • Article
  • Open Access
663 Views
45 Pages

31 October 2025

Diverse learning algorithms, optimization methods, and natural selection share a common mathematical structure despite their apparent differences. Here, I show that a simple notational partitioning of change by the Price equation reveals a universal...

  • Article
  • Open Access
1 Citations
1,306 Views
18 Pages

28 January 2025

This study introduces an innovative, non-contact method for classifying the hardness of austenitic stainless steels (grade AISI 304) based on their intrinsic magnetic fields. Utilizing a 3 × 3 matrix sensor system, this research captures weak m...

  • Article
  • Open Access
1,620 Views
26 Pages

Generalized Adaptive Diversity Gradient Descent Bit-Flipping with a Finite State Machine

  • Jovan Milojković,
  • Srdjan Brkić,
  • Predrag Ivaniš and
  • Bane Vasić

9 January 2025

In this paper, we introduce a novel gradient descent bit-flipping algorithm with a finite state machine (GDBF-wSM) for iterative decoding of low-density parity-check (LDPC) codes. The algorithm utilizes a finite state machine to update variable node...

  • Article
  • Open Access
6 Citations
4,342 Views
16 Pages

Stochastic gradient descent is the method of choice for solving large-scale optimization problems in machine learning. However, the question of how to effectively select the step-sizes in stochastic gradient descent methods is challenging, and can gr...

  • Article
  • Open Access
7 Citations
2,287 Views
9 Pages

16 January 2023

To be able to predict the DC flashover characteristics of composite insulators, a four-layer BP neural network model is established with composite insulator shed structure parameters as the input. Three algorithms (gradient descent with momentum, RMS...

  • Article
  • Open Access
4 Citations
2,599 Views
20 Pages

Accelerated Randomized Coordinate Descent for Solving Linear Systems

  • Qin Wang,
  • Weiguo Li,
  • Wendi Bao and
  • Feiyu Zhang

21 November 2022

The randomized coordinate descent (RCD) method is a simple but powerful approach to solving inconsistent linear systems. In order to accelerate this approach, the Nesterov accelerated randomized coordinate descent method (NARCD) is proposed. The rand...

  • Article
  • Open Access
4 Citations
3,187 Views
11 Pages

26 December 2021

The performance of various multilayer neural network algorithms to predict the energy consumption of an absorption chiller in an air conditioning system under the same conditions was compared and evaluated in this study. Each prediction model was cre...

  • Article
  • Open Access
2 Citations
2,055 Views
30 Pages

A Multilayer Perceptron Feedforward Neural Network and Particle Swarm Optimization Algorithm for Optimizing Biogas Production

  • Arief Abdurrakhman,
  • Lilik Sutiarso,
  • Makhmudun Ainuri,
  • Mirwan Ushada and
  • Md Parvez Islam

19 February 2025

Efficient biogas production significantly impacts greenhouse gas (GHG) emissions and carbon sequestration by reducing emissions and enhancing carbon storage. Nonetheless, the consistency and optimization of biogas production are hindered by fluctuati...

  • Article
  • Open Access
1,241 Views
21 Pages

11 December 2024

In this paper, we develop momentum-based adaptive update laws for parameter identification and control to improve parameter estimation error convergence and control system performance for uncertain dynamical systems. Specifically, we introduce three...

  • Article
  • Open Access
177 Citations
10,215 Views
19 Pages

State-of-the-Art CNN Optimizer for Brain Tumor Segmentation in Magnetic Resonance Images

  • Muhammad Yaqub,
  • Jinchao Feng,
  • M. Sultan Zia,
  • Kaleem Arshid,
  • Kebin Jia,
  • Zaka Ur Rehman and
  • Atif Mehmood

Brain tumors have become a leading cause of death around the globe. The main reason for this epidemic is the difficulty conducting a timely diagnosis of the tumor. Fortunately, magnetic resonance images (MRI) are utilized to diagnose tumors in most c...

  • Article
  • Open Access
7 Citations
3,412 Views
16 Pages

This paper mainly proposes some improved stochastic gradient descent (SGD) algorithms with a fractional order gradient for the online optimization problem. For three scenarios, including standard learning rate, adaptive gradient learning rate, and mo...

  • Article
  • Open Access
3 Citations
3,203 Views
19 Pages

19 May 2023

Digital Elevation Models (DEMs) are commonly used for environment, engineering, and architecture-related studies. One of the most important factors for the accuracy of DEM generation is the process of spatial interpolation, which is used for estimati...

  • Article
  • Open Access
17 Citations
5,053 Views
14 Pages

Prediction of Draft Force of a Chisel Cultivator Using Artificial Neural Networks and Its Comparison with Regression Model

  • Yousef Abbaspour-Gilandeh,
  • Masoud Fazeli,
  • Ali Roshanianfard,
  • Mario Hernández-Hernández,
  • Iván Gallardo-Bernal and
  • José Luis Hernández-Hernández

25 March 2020

In this study, artificial neural networks (ANNs) were used to predict the draft force of a rigid tine chisel cultivator. The factorial experiment based on the randomized complete block design (RCBD) was used to obtain the required data and to determi...

  • Article
  • Open Access
18 Citations
2,973 Views
9 Pages

12 October 2021

Deep learning proves its promising results in various domains. The automatic identification of plant diseases with deep convolutional neural networks attracts a lot of attention at present. This article extends stochastic gradient descent momentum op...

  • Article
  • Open Access
10 Citations
2,587 Views
24 Pages

Sensitivity of Fractional-Order Recurrent Neural Network with Encoded Physics-Informed Battery Knowledge

  • Yanan Wang,
  • Xuebing Han,
  • Languang Lu,
  • Yangquan Chen and
  • Minggao Ouyang

In the field of state estimation for the lithium-ion battery (LIB), model-based methods (white box) have been developed to explain battery mechanism and data-driven methods (black box) have been designed to learn battery statistics. Both white box me...

  • Technical Note
  • Open Access
1,179 Views
11 Pages

Swelling Prediction for Fissured Expansive Soil Used in Dam Construction, Based on a BP Neural Network

  • Shuangping Li,
  • Han Tang,
  • Bin Zhang,
  • Hang Zheng,
  • Zuqiang Liu,
  • Xin Zhang,
  • Linjie Guan and
  • Junxing Zheng

Fissured expansive soils exhibit pronounced moisture-induced swelling, posing significant risks to the stability of geotechnical structures such as dam foundations and core zones. To improve predictive capacity in such environments, this study develo...

  • Article
  • Open Access
5 Citations
1,296 Views
25 Pages

13 June 2025

We propose a novel dynamic gradient descent (DGD) framework integrated with reinforcement learning (RL) for AI-enhanced indoor environmental simulation, addressing the limitations of static optimization in dynamic settings. The proposed method combin...

  • Article
  • Open Access
1 Citations
648 Views
18 Pages

22 May 2025

The zero-inflated Bernoulli model, enhanced with elastic net regularization, effectively handles binary classification for zero-inflated datasets. This zero-inflated structure significantly contributes to data imbalance. To improve the ZIBer model&rs...

  • Article
  • Open Access
70 Citations
6,740 Views
10 Pages

Optimization of CNN through Novel Training Strategy for Visual Classification Problems

  • Sadaqat Ur Rehman,
  • Shanshan Tu,
  • Obaid Ur Rehman,
  • Yongfeng Huang,
  • Chathura M. Sarathchandra Magurawalage and
  • Chin-Chen Chang

17 April 2018

The convolution neural network (CNN) has achieved state-of-the-art performance in many computer vision applications e.g., classification, recognition, detection, etc. However, the global optimization of CNN training is still a problem. Fast classific...

  • Article
  • Open Access
1 Citations
2,401 Views
13 Pages

A Scaling Transition Method from SGDM to SGD with 2ExpLR Strategy

  • Kun Zeng,
  • Jinlan Liu,
  • Zhixia Jiang and
  • Dongpo Xu

24 November 2022

In deep learning, the vanilla stochastic gradient descent (SGD) and SGD with heavy-ball momentum (SGDM) methods have a wide range of applications due to their simplicity and great generalization. This paper uses an exponential scaling method to reali...

  • Article
  • Open Access
15 Citations
3,647 Views
15 Pages

29 January 2022

Sensor-less adaptive optics (SLAO) based on stochastic parallel gradient descent (SPGD) is effective for the compensation of atmospheric turbulence in coherent free-space optical communication (CFSOC) systems. However, SPGD converges slowly and easil...

  • Article
  • Open Access
11 Citations
2,307 Views
25 Pages

This paper presents an improved artificial neural network (ANN) training using response surface methodology (RSM) optimization for membrane flux prediction. The improved ANN utilizes the design of experiment (DoE) technique to determine the neural ne...

  • Article
  • Open Access
3 Citations
2,435 Views
17 Pages

Zero-Inflated Binary Classification Model with Elastic Net Regularization

  • Hua Xin,
  • Yuhlong Lio,
  • Hsien-Ching Chen and
  • Tzong-Ru Tsai

25 September 2024

Zero inflation and overfitting can reduce the accuracy rate of using machine learning models for characterizing binary data sets. A zero-inflated Bernoulli (ZIBer) model can be the right model to characterize zero-inflated binary data sets. When the...

  • Article
  • Open Access
13 Citations
4,484 Views
16 Pages

Automatic Classification of Bagworm, Metisa plana (Walker) Instar Stages Using a Transfer Learning-Based Framework

  • Siti Nurul Afiah Mohd Johari,
  • Siti Khairunniza-Bejo,
  • Abdul Rashid Mohamed Shariff,
  • Nur Azuan Husin,
  • Mohamed Mazmira Mohd Masri and
  • Noorhazwani Kamarudin

14 February 2023

Bagworms, particularly Metisa plana Walker (Lepidoptera: Psychidae), are one of the most destructive leaf-eating pests, especially in oil palm plantations, causing severe defoliation which reduces yield. Due to the delayed control of the bagworm popu...

  • Article
  • Open Access
15 Citations
4,608 Views
17 Pages

HW-ADAM: FPGA-Based Accelerator for Adaptive Moment Estimation

  • Weiyi Zhang,
  • Liting Niu,
  • Debing Zhang,
  • Guangqi Wang,
  • Fasih Ud Din Farrukh and
  • Chun Zhang

The selection of the optimizer is critical for convergence in the field of on-chip training. As one second moment optimizer, adaptive moment estimation (ADAM) shows a significant advantage compared with non-moment optimizers such as stochastic gradie...

  • Article
  • Open Access
15 Citations
4,140 Views
20 Pages

4 April 2020

To improve the intelligence and accuracy of the Situation Assessment (SA) in complex scenes, this work develops an improved fuzzy deep neural network approach to the situation assessment for multiple Unmanned Aerial Vehicle(UAV)s. Firstly, this work...

  • Article
  • Open Access
13 Citations
3,760 Views
46 Pages

Fast Quantum State Reconstruction via Accelerated Non-Convex Programming

  • Junhyung Lyle Kim,
  • George Kollias,
  • Amir Kalev,
  • Ken X. Wei and
  • Anastasios Kyrillidis

22 January 2023

We propose a new quantum state reconstruction method that combines ideas from compressed sensing, non-convex optimization, and acceleration methods. The algorithm, called Momentum-Inspired Factored Gradient Descent (MiFGD), extends the applicability...

  • Article
  • Open Access
6 Citations
1,976 Views
17 Pages

30 August 2024

This paper presents an innovative approach that utilizes infused images from vibration signals and visual inspections to enhance the efficiency and accuracy of structure health monitoring through GoogLeNet. Scrutiny of the structure of GoogLeNet iden...

  • Article
  • Open Access
1 Citations
1,258 Views
19 Pages

CSEM Optimization Using the Correspondence Principle

  • Adriany Valente,
  • Deivid Nascimento and
  • Jessé Costa

1 October 2024

Traditionally, 3D modeling of marine controlled-source electromagnetic (CSEM) data (in the frequency domain) involves high-memory demand, requiring solving a large linear system for each frequency. To address this problem, we propose to solve Maxwell...

  • Article
  • Open Access
56 Citations
7,162 Views
36 Pages

An Evaluation of ANN Algorithm Performance for MPPT Energy Harvesting in Solar PV Systems

  • Md Tahmid Hussain,
  • Adil Sarwar,
  • Mohd Tariq,
  • Shabana Urooj,
  • Amal BaQais and
  • Md. Alamgir Hossain

17 July 2023

In this paper, the Levenberg–Marquardt (LM), Bayesian regularization (BR), resilient backpropagation (RP), gradient descent momentum (GDM), Broyden–Fletcher–Goldfarb–Shanno (BFGS), and scaled conjugate gradient (SCG) algorithm...

  • Article
  • Open Access
10 Citations
3,174 Views
16 Pages

20 February 2023

Rockbursts are serious threats to the safe production of mining, resulting in great casualties and property losses. The accurate prediction of rockburst is an important premise that influences the safety and health of miners. As a classical machine l...

  • Article
  • Open Access
3 Citations
2,035 Views
23 Pages

Settlement Forecast of Marine Soft Soil Ground Improved with Prefabricated Vertical Drain-Assisted Staged Riprap Filling

  • Xue-Ting Wu,
  • Jun-Ning Liu,
  • Adel Alowaisy,
  • Noriyuki Yasufuku,
  • Ryohei Ishikura and
  • Meilani Adriyati

By comparing different settlement forecast methods, eight methods were selected considering the creep of marine soft soils in this case study, including the Hyperbolic Method (HM), Exponential Curve Method (ECM), Pearl Growth Curve Modeling (PGCM), G...

  • Article
  • Open Access
28 Citations
4,040 Views
28 Pages

9 July 2020

Bond strength assessment is important for reinforced concrete structures with rebar corrosion since the bond degradation can threaten the structural safety. In this study, to assess the bond strength in concrete-corroded rebar interface, one of the m...

  • Article
  • Open Access
72 Citations
7,216 Views
13 Pages

4 June 2021

Cracking in concrete structures affects performance and is a major durability problem. Cracks must be detected and repaired in time in order to maintain the reliability and performance of the structure. This study focuses on vision-based crack detect...

  • Article
  • Open Access
7 Citations
3,631 Views
34 Pages

6 February 2023

This paper presents a practical usability investigation of recurrent neural networks (RNNs) to determine the best-suited machine learning method for estimating electric vehicle (EV) batteries’ state of charge. Using models from multiple publish...

  • Article
  • Open Access
1,120 Views
20 Pages

19 × 1 Photonic Lantern for Mode Conversion: Simulation and Adaptive Control for Enhanced Mode Output Quality

  • Pengfei Liu,
  • Yuxuan Ze,
  • Hanwei Zhang,
  • Baozhu Yan,
  • Qiong Zhou,
  • Dan Zhang,
  • Yimin Yin and
  • Wenguang Liu

11 September 2025

High-order linear polarization (LP) modes and vortex beams carrying orbital angular momentum (OAM) are highly useful in various fields. High-order LP modes provide higher thresholds for nonlinear effects, reduced sensitivity to distortions, and bette...

  • Article
  • Open Access
33 Citations
5,479 Views
19 Pages

Time-Frequency Image Analysis and Transfer Learning for Capacity Prediction of Lithium-Ion Batteries

  • Ma’d El-Dalahmeh,
  • Maher Al-Greer,
  • Mo’ath El-Dalahmeh and
  • Michael Short

19 October 2020

Energy storage is recognized as a key technology for enabling the transition to a low-carbon, sustainable future. Energy storage requires careful management, and capacity prediction of a lithium-ion battery (LIB) is an essential indicator in a batter...

  • Article
  • Open Access
34 Citations
5,268 Views
26 Pages

17 July 2023

Detecting small targets and handling target occlusion and overlap are critical challenges in weld defect detection. In this paper, we propose the S-YOLO model, a novel weld defect detection method based on the YOLOv8-nano model and several mathematic...

  • Article
  • Open Access
3 Citations
2,309 Views
19 Pages

A Bearing Fault Diagnosis Method under Small Sample Conditions Based on the Fractional Order Siamese Deep Residual Shrinkage Network

  • Tao Li,
  • Xiaoting Wu,
  • Zhuhui Luo,
  • Yanan Chen,
  • Caichun He,
  • Rongjun Ding,
  • Changfan Zhang and
  • Jun Yang

A bearing fault is one of the major causes of rotating machinery faults. However, in real industrial scenarios, the harsh and complex environment makes it very difficult to collect sufficient fault data. Due to this limitation, most of the current me...

  • Article
  • Open Access
5 Citations
2,068 Views
20 Pages

A BP-Neural-Network-Based PID Control Algorithm of Shipborne Stewart Platform for Wave Compensation

  • Daoxi Li,
  • Shuqing Wang,
  • Xiancang Song,
  • Zepeng Zheng,
  • Wei Tao and
  • Jvpeng Che

26 November 2024

In order to carry out offshore operations smoothly in severe sea conditions, a shipborne Stewart platform for wave compensation is required. Due to the random characteristics of waves, traditional control algorithms cannot accurately compensate for t...

  • Article
  • Open Access
959 Views
19 Pages

Recently, the concept of cell-free massive multiple-input multiple-output (CF-mMIMO) has been implemented in low-Earth-orbit (LEO) constellations to enhance energy efficiency. However, signal distortion caused by nonlinear power amplifiers (NPAs) sig...

  • Article
  • Open Access
93 Citations
3,074 Views
20 Pages

Artificial Neural Network with a Cross-Validation Technique to Predict the Material Design of Eco-Friendly Engineered Geopolymer Composites

  • Yaswanth Kuppusamy,
  • Revathy Jayaseelan,
  • Gajalakshmi Pandulu,
  • Veerappan Sathish Kumar,
  • Gunasekaran Murali,
  • Saurav Dixit and
  • Nikolai Ivanovich Vatin

10 May 2022

A material-tailored special concrete composite that uses a synthetic fiber to make the concrete ductile and imposes strain-hardening characteristics with eco-friendly ingredients is known as an “engineered geopolymer composite (EGC)”. Mix...

of 2