Sign in to use this feature.

Years

Between: -

Subjects

remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline

Journals

Article Types

Countries / Regions

Search Results (9)

Search Parameters:
Keywords = cosine annealing scheduler

Order results
Result details
Results per page
Select all
Export citation of selected articles as:
24 pages, 7924 KiB  
Article
Optimizing Car Collision Detection Using Large Dashcam-Based Datasets: A Comparative Study of Pre-Trained Models and Hyperparameter Configurations
by Muhammad Shahid, Martin Gregurić, Amirhossein Hassani and Marko Ševrović
Appl. Sci. 2025, 15(13), 7001; https://doi.org/10.3390/app15137001 - 21 Jun 2025
Viewed by 469
Abstract
The automatic identification of traffic collisions is an emerging topic in modern traffic surveillance systems. The increasing number of surveillance cameras at urban intersections connected to traffic surveillance systems has created new opportunities for leveraging computer vision techniques for automatic collision detection. This [...] Read more.
The automatic identification of traffic collisions is an emerging topic in modern traffic surveillance systems. The increasing number of surveillance cameras at urban intersections connected to traffic surveillance systems has created new opportunities for leveraging computer vision techniques for automatic collision detection. This study investigates the effectiveness of transfer learning utilizing pre-trained deep learning models for collision detection through dashcam images. We evaluated several state-of-the-art (SOTA) image classification models and fine-tuned them using different hyperparameter combinations to test their performance on the car collision detection problem. Our methodology systematically investigates the influence of optimizers, loss functions, schedulers, and learning rates on model generalization. A comprehensive analysis is conducted using 7 performance metrics to assess classification performance. Experiments on a large dashcam-based images dataset show that ResNet50, optimized with AdamW, a learning rate of 0.0001, CosineAnnealingLR scheduler, and Focal Loss, emerged as the top performer, achieving an accuracy of 0.9782, F1-score of 0.9617, and IoU of 0.9262, indicating a strong ability to reduce false negatives. Full article
Show Figures

Figure 1

20 pages, 2292 KiB  
Article
A Study on Small-Scale Snake Image Classification Based on Improved SimCLR
by Lingyan Li, Ruiqing Kang, Wenjie Huang and Wenhui Feng
Appl. Sci. 2025, 15(11), 6290; https://doi.org/10.3390/app15116290 - 3 Jun 2025
Viewed by 553
Abstract
The exotic pet trade is a major driver of alien species invasions. Improper introductions or a lack of management can result in severe ecological consequences. Therefore, accurate identification of exotic pets is essential for the prevention and early warning of species invasions. This [...] Read more.
The exotic pet trade is a major driver of alien species invasions. Improper introductions or a lack of management can result in severe ecological consequences. Therefore, accurate identification of exotic pets is essential for the prevention and early warning of species invasions. This paper proposes a novel recognition method for fine-grained images of small-scale exotic pet snakes in complex backgrounds based on an improved SimCLR framework. A hierarchical window attention mechanism is introduced into the encoder network to enhance feature extraction. In the loss function, a supervised contrastive mechanism is introduced to exclude false negative samples using label information, which helps reduce representation noise and enhance training stability. The training strategy incorporates random erasing and random grayscale data augmentation techniques to improve performance further. The projection head is constructed using a two-layer multilayer perceptron (MLP), and the cosine annealing schedule combined with the AdamW optimizer is adopted for learning rate adjustment. Experimental results on a self-constructed dataset demonstrate that the proposed model achieves a recognition accuracy of 97.5%, outperforming existing baseline models. This study fills a gap in exotic pet snake classification and provides a practical tool for species invasion prevention and early detection. Full article
(This article belongs to the Section Optics and Lasers)
Show Figures

Figure 1

23 pages, 4678 KiB  
Article
GC-Faster RCNN: The Object Detection Algorithm for Agricultural Pests Based on Improved Hybrid Attention Mechanism
by Bolun Guan, Yaqian Wu, Jingbo Zhu, Juanjuan Kong and Wei Dong
Plants 2025, 14(7), 1106; https://doi.org/10.3390/plants14071106 - 2 Apr 2025
Cited by 3 | Viewed by 772
Abstract
Pest infestations remain a critical threat to global agriculture, significantly compromising crop yield and quality. While accurate pest detection forms the foundation of precision pest management, current approaches face two primary challenges: (1) the scarcity of comprehensive multi-scale, multi-category pest datasets and (2) [...] Read more.
Pest infestations remain a critical threat to global agriculture, significantly compromising crop yield and quality. While accurate pest detection forms the foundation of precision pest management, current approaches face two primary challenges: (1) the scarcity of comprehensive multi-scale, multi-category pest datasets and (2) performance limitations in detection models caused by substantial target scale variations and high inter-class morphological similarity. To address these issues, we present three key contributions: First, we introduce Insect25—a novel agricultural pest detection dataset containing 25 distinct pest categories, comprising 18,349 high-resolution images. This dataset specifically addresses scale diversity through multi-resolution acquisition protocols, significantly enriching feature distribution for robust model training. Second, we propose GC-Faster RCNN, an enhanced detection framework integrating a hybrid attention mechanism that synergistically combines channel-wise correlations and spatial dependencies. This dual attention design enables more discriminative feature extraction, which is particularly effective for distinguishing morphologically similar pest species. Third, we implement an optimized training strategy featuring a cosine annealing scheduler with linear warm-up, accelerating model convergence while maintaining training stability. Experiments have shown that compared with the original Faster RCNN model, GC-Faster RCNN has improved the average accuracy mAP0.5 on the Insect25 dataset by 4.5 percentage points, and mAP0.75 by 20.4 percentage points, mAP0.5:0.95 increased by 20.8 percentage points, and the recall rate increased by 16.6 percentage points. In addition, experiments have also shown that the GC-Faster RCNN detection method can reduce interference from multiple scales and high similarity between categories, improving detection performance. Full article
(This article belongs to the Special Issue Embracing Systems Thinking in Crop Protection Science)
Show Figures

Figure 1

22 pages, 2713 KiB  
Article
An Efficient 3D Convolutional Neural Network for Dose Prediction in Cancer Radiotherapy from CT Images
by Lam Thanh Hien, Pham Trung Hieu and Do Nang Toan
Diagnostics 2025, 15(2), 177; https://doi.org/10.3390/diagnostics15020177 - 14 Jan 2025
Cited by 1 | Viewed by 1469
Abstract
Introduction: Cancer is a highly lethal disease with a significantly high mortality rate. One of the most commonly used methods for treatment is radiation therapy. However, cancer treatment using radiotherapy is a time-consuming process that requires significant manual work from planners and [...] Read more.
Introduction: Cancer is a highly lethal disease with a significantly high mortality rate. One of the most commonly used methods for treatment is radiation therapy. However, cancer treatment using radiotherapy is a time-consuming process that requires significant manual work from planners and doctors. In radiation therapy treatment planning, determining the dose distribution for each of the regions of the patient’s body is one of the most difficult and important tasks. Nowadays, artificial intelligence has shown promising results in improving the quality of disease treatment, particularly in cancer radiation therapy. Objectives: The main objective of this study is to build a high-performance deep learning model for predicting radiation therapy doses for cancer and to develop software to easily manipulate and use this model. Materials and Methods: In this paper, we propose a custom 3D convolutional neural network model with a U-Net-based architecture to automatically predict radiation doses during cancer radiation therapy from CT images. To ensure that the predicted doses do not have negative values, which are not valid for radiation doses, a rectified linear unit (ReLU) function is applied to the output to convert negative values to zero. Additionally, a proposed loss function based on a dose–volume histogram is used to train the model, ensuring that the predicted dose concentrations are highly meaningful in terms of radiation therapy. The model is developed using the OpenKBP challenge dataset, which consists of 200, 100, and 40 head and neck cancer patients for training, testing, and validation, respectively. Before the training phase, preprocessing and augmentation techniques, such as standardization, translation, and flipping, are applied to the training set. During the training phase, a cosine annealing scheduler is applied to update the learning rate. Results and Conclusions: Our model achieved strong performance, with a good DVH score (1.444 Gy) on the test dataset, compared to previous studies and state-of-the-art models. In addition, we developed software to display the dose maps predicted by the proposed model for each 2D slice in order to facilitate usage and observation. These results may help doctors in treating cancer with radiation therapy in terms of both time and effectiveness. Full article
(This article belongs to the Special Issue Deep Learning Techniques for Medical Image Analysis)
Show Figures

Figure 1

12 pages, 4072 KiB  
Article
Early Parkinson’s Disease Diagnosis through Hand-Drawn Spiral and Wave Analysis Using Deep Learning Techniques
by Yingcong Huang, Kunal Chaturvedi, Al-Akhir Nayan, Mohammad Hesam Hesamian, Ali Braytee and Mukesh Prasad
Information 2024, 15(4), 220; https://doi.org/10.3390/info15040220 - 13 Apr 2024
Cited by 6 | Viewed by 6408
Abstract
Parkinson’s disease (PD) is a chronic brain disorder affecting millions worldwide. It occurs when brain cells that produce dopamine, a chemical controlling movement, die or become damaged. This leads to PD, which causes problems with movement, balance, and posture. Early detection is crucial [...] Read more.
Parkinson’s disease (PD) is a chronic brain disorder affecting millions worldwide. It occurs when brain cells that produce dopamine, a chemical controlling movement, die or become damaged. This leads to PD, which causes problems with movement, balance, and posture. Early detection is crucial to slow its progression and improve the quality of life for PD patients. This paper proposes a handwriting-based prediction approach combining a cosine annealing scheduler with deep transfer learning. It utilizes the NIATS dataset, which contains handwriting samples from individuals with and without PD, to evaluate six different models: VGG16, VGG19, ResNet18, ResNet50, ResNet101, and Vit. This paper compares the performance of these models based on three metrics: accuracy, precision, and F1 score. The results showed that the VGG19 model, combined with the proposed method, achieved the highest average accuracy of 96.67%. Full article
(This article belongs to the Special Issue Editorial Board Members’ Collection Series: "Information Processes")
Show Figures

Figure 1

28 pages, 5928 KiB  
Article
An Effective 4–Phased Framework for Scheduling Job-Shop Manufacturing Systems Using Weighted NSGA-II
by Aidin Delgoshaei, Mohd Khairol Anuar Bin Mohd Ariffin and Zulkiflle B. Leman
Mathematics 2022, 10(23), 4607; https://doi.org/10.3390/math10234607 - 5 Dec 2022
Cited by 7 | Viewed by 2383
Abstract
Improving the performance of manufacturing systems is a vital issue in today’s rival market. For this purpose, during the last decade, scientists have considered more than one objective function while scheduling a production line. This paper develops a 4-phased fuzzy framework to identify [...] Read more.
Improving the performance of manufacturing systems is a vital issue in today’s rival market. For this purpose, during the last decade, scientists have considered more than one objective function while scheduling a production line. This paper develops a 4-phased fuzzy framework to identify effective factors, determine their weights on multi-objective functions, and, accordingly, schedule manufacturing systems in a fuzzy environment. The aim is to optimize product completion time and operational and product defect costs in a job-shop-based multi-objective fuzzy scheduling problem. In the first and second phases of the proposed framework, it was shown that the existing uncertainty of the internal factors for the studied cases causes the weights of factors to change up to 44.5%. Then, a fuzzy-weighted NSGA-II is proposed (FW-NSGA-II) to address the developed Non-linear Fuzzy Multi-objective Dual resource-constrained scheduling problem. Comparing the outcomes of the proposed method with other solving algorithms, such as the Sine Cosine Algorithm, Simulated Annealing, Tabu Search, and TLBO heuristic, using seven series of comprehensive computational experiments, indicates the superiority of the proposed framework in scheduling manufacturing systems. The outcomes indicated that using the proposed method for the studied cases saved up to 5% in the objective function for small-scale, 11.2% for medium-scale, and 3.8% for large-scale manufacturing systems. The outcomes of this study can help production planning managers to provide more realistic schedules by considering fuzzy factors in their manufacturing systems. Further investigating the proposed method for dynamic product conditions is another direction for future research. Full article
Show Figures

Figure 1

21 pages, 11255 KiB  
Article
A Lightweight Network for Point Cloud Analysis via the Fusion of Local Features and Distribution Characteristics
by Qiang Zheng, Jian Sun and Wei Chen
Sensors 2022, 22(13), 4742; https://doi.org/10.3390/s22134742 - 23 Jun 2022
Cited by 2 | Viewed by 2480
Abstract
Effectively integrating the local features and their spatial distribution information for more effective point cloud analysis is a subject that has been explored for a long time. Inspired by convolutional neural networks (CNNs), this paper studies the relationship between local features and their [...] Read more.
Effectively integrating the local features and their spatial distribution information for more effective point cloud analysis is a subject that has been explored for a long time. Inspired by convolutional neural networks (CNNs), this paper studies the relationship between local features and their spatial characteristics and proposes a concise architecture to effectively integrate them instead of designing more sophisticated feature extraction modules. Different positions in the feature map of the 2D image correspond to different weights in the convolution kernel, making the obtained features that are sensitive to local distribution characteristics. Thus, the spatial distribution of the input features of the point cloud within the receptive field is critical for capturing abstract regional aggregated features. We design a lightweight structure to extract local features by explicitly supplementing the distribution information of the input features to obtain distinctive features for point cloud analysis. Compared with the baseline, our model shows improvements in accuracy and convergence speed, and these advantages facilitate the introduction of the snapshot ensemble. Aiming at the shortcomings of the commonly used cosine annealing learning schedule, we design a new annealing schedule that can be flexibly adjusted for the snapshot ensemble technology, which significantly improves the performance by a large margin. Extensive experiments on typical benchmarks verify that, although it adopts the basic shared multi-layer perceptrons (MLPs) as feature extractors, the proposed model with a lightweight structure achieves on-par performance with previous state-of-the-art (SOTA) methods (e.g., MoldeNet40 classification, 0.98 million parameters and 93.5% accuracy; S3DIS segmentation, 1.4 million parameters and 68.7% mIoU). Full article
(This article belongs to the Section Intelligent Sensors)
Show Figures

Figure 1

24 pages, 7438 KiB  
Article
A Robust Fabric Defect Detection Method Based on Improved RefineDet
by Huosheng Xie and Zesen Wu
Sensors 2020, 20(15), 4260; https://doi.org/10.3390/s20154260 - 30 Jul 2020
Cited by 50 | Viewed by 7045
Abstract
This paper proposes a robust fabric defect detection method, based on the improved RefineDet. This is done using the strong object localization ability and good generalization of the object detection model. Firstly, the method uses RefineDet as the base model, inheriting the advantages [...] Read more.
This paper proposes a robust fabric defect detection method, based on the improved RefineDet. This is done using the strong object localization ability and good generalization of the object detection model. Firstly, the method uses RefineDet as the base model, inheriting the advantages of the two-stage and one-stage detectors and can efficiently and quickly detect defect objects. Secondly, we design an improved head structure based on the Full Convolutional Channel Attention (FCCA) block and the Bottom-up Path Augmentation Transfer Connection Block (BA-TCB), which can improve the defect localization accuracy of the method. Finally, the proposed method applies many general optimization methods, such as attention mechanism, DIoU-NMS, and cosine annealing scheduler, and verifies the effectiveness of these optimization methods in the fabric defect localization task. Experimental results show that the proposed method is suitable for the defect detection of fabric images with unpattern background, regular patterns, and irregular patterns. Full article
(This article belongs to the Section Intelligent Sensors)
Show Figures

Figure 1

18 pages, 420 KiB  
Article
Sine-Cosine Algorithm to Enhance Simulated Annealing for Unrelated Parallel Machine Scheduling with Setup Times
by Hamza Jouhari, Deming Lei, Mohammed A. A. Al-qaness, Mohamed Abd Elaziz, Ahmed A. Ewees and Osama Farouk
Mathematics 2019, 7(11), 1120; https://doi.org/10.3390/math7111120 - 16 Nov 2019
Cited by 44 | Viewed by 4376
Abstract
This paper presents a hybrid method of Simulated Annealing (SA) algorithm and Sine Cosine Algorithm (SCA) to solve unrelated parallel machine scheduling problems (UPMSPs) with sequence-dependent and machine-dependent setup times. The proposed method, called SASCA, aims to improve the SA algorithm using the [...] Read more.
This paper presents a hybrid method of Simulated Annealing (SA) algorithm and Sine Cosine Algorithm (SCA) to solve unrelated parallel machine scheduling problems (UPMSPs) with sequence-dependent and machine-dependent setup times. The proposed method, called SASCA, aims to improve the SA algorithm using the SCA as a local search method. The SCA provides a good tool for the SA to avoid getting stuck in a focal point and improving the convergence to an efficient solution. SASCA algorithm is used to solve UPMSPs by minimizing makespan. To evaluate the performance of SASCA, a set of experiments were performed using 30 tests for 4 problems. Moreover, the performance of the proposed method was compared with other meta-heuristic algorithms. The comparison results showed the superiority of SASCA over other methods in terms of performance dimensions. Full article
Show Figures

Figure 1

Back to TopTop