Skip to Content
You are currently on the new version of our website. Access the old version .

118 Results Found

  • Article
  • Open Access
11 Citations
2,538 Views
27 Pages

Recognition of Sheep Feeding Behavior in Sheepfolds Using Fusion Spectrogram Depth Features and Acoustic Features

  • Youxin Yu,
  • Wenbo Zhu,
  • Xiaoli Ma,
  • Jialei Du and ,
  • Yu Liu,
  • Linhui Gan,
  • Xiaoping An,
  • Honghui Li,
  • Buyu Wang and
  • Xueliang Fu
  • + 5 authors+ 0 author

13 November 2024

In precision feeding, non-contact and pressure-free monitoring of sheep feeding behavior is crucial for health monitoring and optimizing production management. The experimental conditions and real-world environments differ when using acoustic sensors...

(This article belongs to the Special Issue Monitoring of Behavior, Affective States, and Health to Identify Welfare Concerns of Farm Animals)
  • Article
  • Open Access
3 Citations
1,975 Views
14 Pages

6 December 2023

The CMT welding process has been widely used for aluminum alloy welding. The weld’s penetration state is essential for evaluating the welding quality. Arc sound signals contain a wealth of information related to the penetration state of the wel...

  • Article
  • Open Access
319 Views
34 Pages

Adaptive Flight Maneuver Boundary Localization via Spectral Entropy-Weighted Multi-Channel Spectrogram Fusion

  • Shansong Song,
  • Wei Han,
  • Bing Wan,
  • Xiangyi Liu and ,
  • Xichao Su,
  • Chao Li and
  • Yunyang Cao
  • + 2 authors+ 0 author

17 August 2026

To address ambiguous maneuver boundaries, background interference, and uneven multi-sensor quality in long-duration flight parameter recordings, this paper proposes an adaptive flight maneuver boundary localization algorithm that integrates spectral...

(This article belongs to the Section Signal and Data Analysis)
  • Article
  • Open Access
1 Citations
1,080 Views
15 Pages

Multi-Feature Fusion for Automatic Piano Transcription Based on Mel Cyclic and STFT Spectrograms

  • Jinliang Dai,
  • Qiuyue Zheng,
  • Yang Wang,
  • Qihuan Shan and ,
  • Jie Wan and
  • Weiwei Zhang
  • + 1 author+ 0 author

29 November 2025

Automatic piano transcription (APT) is a challenging problem in music information retrieval. In recent years, most APT approaches have been based on neural networks and have demonstrated higher performance. However, most previous works utilize a shor...

(This article belongs to the Special Issue Recent Advances in Audio, Speech and Music Processing and Analysis, 2nd Edition)
  • Article
  • Open Access
28 Citations
6,235 Views
12 Pages

Bird Species Identification Using Spectrogram Based on Multi-Channel Fusion of DCNNs

  • Feiyu Zhang,
  • Luyang Zhang,
  • Hongxiang Chen and
  • Jiangjian Xie

13 November 2021

Deep convolutional neural networks (DCNNs) have achieved breakthrough performance on bird species identification using a spectrogram of bird vocalization. Aiming at the imbalance of the bird vocalization dataset, a single feature identification model...

(This article belongs to the Special Issue Towards Image/Video Perception with Entropy-Aware Features and Its Applications)
  • Article
  • Open Access
28 Citations
5,134 Views
16 Pages

30 October 2024

This paper introduces a novel deep learning model for ECG signal classification using feature fusion. The proposed methodology transforms the ECG time series into a spectrogram image using a short-time Fourier transform (STFT). This spectrogram is fu...

(This article belongs to the Topic Applications in Image Analysis and Pattern Recognition)
  • Article
  • Open Access
2 Citations
1,783 Views
23 Pages

Anchor-Free SNR-Aware Signal Detector for Wideband Signal Detection Framework

  • Chunhui Li,
  • Xin Xiang,
  • Hu Mao,
  • Rui Wang and
  • Yonglei Qi

The spectrogram-based wideband signal detection framework has garnered increasing attention in various wireless communication applications. However, the front-end spectrograms in existing methods suffer from visual and informational deficiencies. Thi...

(This article belongs to the Section Artificial Intelligence)
  • Article
  • Open Access
22 Citations
2,885 Views
22 Pages

Augmenting Aquaculture Efficiency through Involutional Neural Networks and Self-Attention for Oplegnathus Punctatus Feeding Intensity Classification from Log Mel Spectrograms

  • Usama Iqbal,
  • Daoliang Li,
  • Zhuangzhuang Du,
  • Muhammad Akhter and ,
  • Zohaib Mushtaq,
  • Muhammad Farrukh Qureshi and
  • Hafiz Abbad Ur Rehman
  • + 2 authors+ 0 author

5 June 2024

Understanding the feeding dynamics of aquatic animals is crucial for aquaculture optimization and ecosystem management. This paper proposes a novel framework for analyzing fish feeding behavior based on a fusion of spectrogram-extracted features and...

(This article belongs to the Special Issue Animal Health and Welfare in Aquaculture)
  • Article
  • Open Access
2 Citations
2,080 Views
28 Pages

ADFF-Net: An Attention-Based Dual-Stream Feature Fusion Network for Respiratory Sound Classification

  • Bing Zhu,
  • Lijun Chen,
  • Xiaoling Li,
  • Songnan Zhao and ,
  • Shaode Yu and
  • Qiurui Sun
  • + 1 author+ 0 author

Deep learning-based respiratory sound classification (RSC) has emerged as a promising non-invasive approach to assist clinical diagnosis. However, existing methods often face challenges, such as sub-optimal feature representation and limited model ex...

  • Article
  • Open Access
11 Citations
4,344 Views
16 Pages

16 August 2021

In the important and challenging field of environmental sound classification (ESC), a crucial and even decisive factor is the feature representation ability, which can directly affect the accuracy of classification. Therefore, the classification perf...

(This article belongs to the Section Intelligent Sensors)
  • Article
  • Open Access
6 Citations
2,175 Views
20 Pages

4 October 2024

Most existing target recognition methods based on high-resolution range profiles (HRRPs) use data from only one domain. However, the information contained in HRRP data from different domains is not exactly the same. Therefore, in the context of inver...

(This article belongs to the Special Issue Target Recognition and Change Detection for High-Resolution Remote Sensing Images)
  • Article
  • Open Access
1 Citations
1,094 Views
26 Pages

9 April 2026

Speech deception detection often suffers from overly narrow feature representations and limited robustness under changing recording conditions. To address these limitations, we propose MFF-Net, a multi-feature fusion network with three modules. The f...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
2 Citations
2,875 Views
22 Pages

8 January 2026

Background and Objective: The accurate detection of sleep stages and disorders in older adults is essential for the effective diagnosis and treatment of sleep disorders affecting millions worldwide. Although Polysomnography (PSG) remains the primary...

(This article belongs to the Special Issue Advanced Methods of Biomedical Signal Processing II)
  • Article
  • Open Access
1,018 Views
31 Pages

Background/Objectives: Reliable detection of epileptic seizures using electroencephalography (EEG) is crucial for clinical diagnosis and for alleviating clinicians’ workload. However, existing studies still make insufficient use of phase inform...

(This article belongs to the Section Machine Learning and Artificial Intelligence in Diagnostics)
  • Article
  • Open Access
22 Citations
9,084 Views
18 Pages

15 October 2024

Background/Objectives: This study investigates the classification of Major Depressive Disorder (MDD) using electroencephalography (EEG) Short-Time Fourier-Transform (STFT) spectrograms and audio Mel-spectrogram data of 52 subjects. The objective is t...

(This article belongs to the Special Issue Computational Intelligence and Brain Plasticity)
  • Proceeding Paper
  • Open Access
547 Views
10 Pages

2 September 2026

This study aims to autonomously detect and classify Unmanned Aerial Vehicles (UAVs), which are becoming increasingly widespread, based on their emitted radio frequency (RF) signals in highly noisy and interference-prone RF environments where traditio...

(This article belongs to the Proceedings of The International Conference on Electronics, Engineering Physics and Earth Science (EEPES2026))
  • Article
  • Open Access
37 Citations
7,018 Views
13 Pages

14 May 2021

Audio signal classification finds various applications in detecting and monitoring health conditions in healthcare. Convolutional neural networks (CNN) have produced state-of-the-art results in image classification and are being increasingly used in...

(This article belongs to the Special Issue Sensors and Applications in Predictive and Personalised Healthcare)
  • Article
  • Open Access
1 Citations
2,984 Views
21 Pages

Speech lie detection is a technique that analyzes speech signals in detail to determine whether a speaker is lying. It has significant application value and has attracted attention from various fields. However, existing speech lie detection algorithm...

  • Article
  • Open Access
4 Citations
1,477 Views
16 Pages

Identifying instruments in polyphonic audio is challenging due to overlapping spectra and variations in timbre and playing styles. This task is central to music information retrieval, with applications in transcription, recommendation, and indexing....

  • Technical Note
  • Open Access
16 Citations
4,134 Views
16 Pages

3 July 2024

Although recent data-driven Underwater Acoustic Target Recognition (UATR) methods have played a dominant role in marine acoustics, they suffer from complex ocean environments and rather small datasets. To tackle such challenges, researchers have reso...

(This article belongs to the Special Issue Space-Air-Ground-Ocean Integrated Sensing and Information Transmission)
  • Article
  • Open Access
29 Citations
8,916 Views
39 Pages

A Combined CNN Architecture for Speech Emotion Recognition

  • Rolinson Begazo,
  • Ana Aguilera,
  • Irvin Dongo and
  • Yudith Cardinale

6 September 2024

Emotion recognition through speech is a technique employed in various scenarios of Human–Computer Interaction (HCI). Existing approaches have achieved significant results; however, limitations persist, with the quantity and diversity of data be...

(This article belongs to the Special Issue Emotion Recognition Based on Sensors (3rd Edition))
  • Article
  • Open Access
11 Citations
3,439 Views
22 Pages

Lightweight Multi-Domain Fusion Model for Through-Wall Human Activity Recognition Using IR-UWB Radar

  • Ling Huang,
  • Dong Lei,
  • Bowen Zheng,
  • Guiping Chen and ,
  • Huifeng An and
  • Mingxuan Li
  • + 1 author+ 0 author

18 October 2024

Impulse radio ultra-wideband (IR-UWB) radar, operating in the low-frequency band, can penetrate walls and utilize its high range resolution to recognize different human activities. Complex deep neural networks have demonstrated significant performanc...

  • Article
  • Open Access
4 Citations
1,852 Views
17 Pages

A Multi-Scale Feature Fusion Hybrid Convolution Attention Model for Birdsong Recognition

  • Lianglian Gu,
  • Guangzhi Di,
  • Danju Lv,
  • Yan Zhang and ,
  • Yueyun Yu,
  • Wei Li and
  • Ziqian Wang
  • + 2 authors+ 0 author

21 April 2025

Birdsong is a valuable indicator of rich biodiversity and ecological significance. Although feature extraction has demonstrated satisfactory performance in classification, single-scale feature extraction methods may not fully capture the complexity o...

  • Article
  • Open Access
4 Citations
2,580 Views
26 Pages

Marine Mammal Call Classification Using a Multi-Scale Two-Channel Fusion Network (MT-Resformer)

  • Xiang Li,
  • Chao Dong,
  • Guixin Dong,
  • Xuerong Cui and ,
  • Yankun Chen,
  • Peng Zhang and
  • Zhanwei Li
  • + 2 authors+ 0 author

The classification of high-frequency marine mammal vocalizations often faces challenges due to the limitations of acoustic features, which are sensitive to mid-to-low frequencies but offer low resolution in high-frequency ranges. Additionally, single...

(This article belongs to the Section Marine Biology)
  • Article
  • Open Access
94 Citations
12,963 Views
28 Pages

Feature-Based Fusion Using CNN for Lung and Heart Sound Classification

  • Zeenat Tariq,
  • Sayed Khushal Shah and
  • Yugyung Lee

16 February 2022

Lung or heart sound classification is challenging due to the complex nature of audio data, its dynamic properties of time, and frequency domains. It is also very difficult to detect lung or heart conditions with small amounts of data or unbalanced an...

(This article belongs to the Special Issue Computer Aided Diagnosis Sensors)
  • Article
  • Open Access
2 Citations
2,359 Views
17 Pages

Fusion Classification Method Based on Audiovisual Information Processing

  • Peiju Chen,
  • Xuan Zhang,
  • Huijun Zhao,
  • Huiliang Cao and ,
  • Xuemei Chen and
  • Xiaochen Liu
  • + 1 author+ 0 author

8 April 2025

In the presence of external interference, multimodal target classification plays a crucial role. Traditional single-modal classification systems are limited by the singularity of data representation and their sensitivity to environmental conditions,...

  • Article
  • Open Access
17 Citations
7,534 Views
17 Pages

A Machine Anomalous Sound Detection Method Using the lMS Spectrogram and ES-MobileNetV3 Network

  • Mei Wang,
  • Qingshan Mei,
  • Xiyu Song,
  • Xin Liu and ,
  • Ruixiang Kan,
  • Fangzhi Yao,
  • Junhan Xiong and
  • Hongbing Qiu
  • + 3 authors+ 0 author

2 December 2023

Unsupervised anomalous sound detection by machines holds significant importance within the realm of industrial automation. Currently, the task of machine-based anomalous sound detection in complex industrial settings is faced with issues such as the...

  • Article
  • Open Access
6 Citations
5,509 Views
22 Pages

Multi-Label Emotion Recognition of Korean Speech Data Using Deep Fusion Models

  • Seoin Park,
  • Byeonghoon Jeon,
  • Seunghyun Lee and
  • Janghyeok Yoon

28 August 2024

As speech is the most natural way for humans to express emotions, studies on Speech Emotion Recognition (SER) have been conducted in various ways However, there are some areas for improvement in previous SER studies: (1) while some studies have perfo...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
7 Citations
4,545 Views
15 Pages

Prosodic Spatio-Temporal Feature Fusion with Attention Mechanisms for Speech Emotion Recognition

  • Kristiawan Nugroho,
  • Imam Husni Al Amin,
  • Nina Anggraeni Noviasari and
  • De Rosal Ignatius Moses Setiadi

31 August 2025

Speech Emotion Recognition (SER) plays a vital role in supporting applications such as healthcare, human–computer interaction, and security. However, many existing approaches still face challenges in achieving robust generalization and maintain...

(This article belongs to the Special Issue Multimodal Pattern Recognition of Social Signals in HCI (2nd Edition))
  • Article
  • Open Access
39 Citations
7,669 Views
22 Pages

Early diagnosis of medical conditions in infants is crucial for ensuring timely and effective treatment. However, infants are unable to verbalize their symptoms, making it difficult for healthcare professionals to accurately diagnose their conditions...

(This article belongs to the Section Machine Learning and Artificial Intelligence in Diagnostics)
  • Article
  • Open Access
1 Citations
688 Views
27 Pages

Spectral Multi-Representation Fusion for Audio Deepfake Detection

  • Dora Ballesteros,
  • Daniel Suarez and
  • Cesar Pachon

5 July 2026

Audio deepfake detection systems often achieve excellent internal validation performance but fail to generalize under real-world inference conditions involving synthetic speech generated with previously unseen AI tools. To address this limitation, th...

(This article belongs to the Special Issue Machine Learning Algorithms for Signal Processing)
  • Article
  • Open Access
34 Citations
7,347 Views
17 Pages

Spectrogram Classification Using Dissimilarity Space

  • Loris Nanni,
  • Andrea Rigo,
  • Alessandra Lumini and
  • Sheryl Brahnam

17 June 2020

In this work, we combine a Siamese neural network and different clustering techniques to generate a dissimilarity space that is then used to train an SVM for automated animal audio classification. The animal audio datasets used are (i) birds and (ii)...

(This article belongs to the Special Issue Texture and Colour in Image Analysis)
  • Article
  • Open Access
2 Citations
2,241 Views
19 Pages

Multi-Channel Spectro-Temporal Representations for Speech-Based Parkinson’s Disease Detection

  • Hadi Sedigh Malekroodi,
  • Nuwan Madusanka,
  • Byeong-il Lee and
  • Myunggi Yi

1 October 2025

Early, non-invasive detection of Parkinson’s Disease (PD) using speech analysis offers promise for scalable screening. In this work, we propose a multi-channel spectro-temporal deep-learning approach for PD detection from sentence-level speech,...

(This article belongs to the Special Issue Celebrating the 10th Anniversary of the Journal of Imaging)
  • Article
  • Open Access
17 Citations
4,363 Views
13 Pages

8 September 2022

Sensor fusion is becoming increasingly popular in condition monitoring. Many studies rely on a fusion-level strategy to enable the most effective decision-making and improve classification accuracy. Most studies rely on feature-level fusion with a cu...

(This article belongs to the Section Fault Diagnosis & Sensors)
  • Article
  • Open Access
3 Citations
1,882 Views
25 Pages

6 April 2026

To address the challenge of accurately distinguishing UAVs and birds in a low-altitude detection field, this paper proposes a classification algorithm of UAVs and birds based on L/K dual-band micro-Doppler spectrograms and Mamba. We establish a dual-...

(This article belongs to the Section Drone Communications)
  • Article
  • Open Access
716 Views
17 Pages

Robust vessel detection from low-Signal-to-Noise Ratio (SNR) Distributed Acoustic Sensing (DAS) data benefits from exploiting spatial correlations among adjacent channels. The Cross-Channel Attention Fusion Network (CASFNet) is presented, utilizing a...

(This article belongs to the Special Issue Artificial Intelligence Technology and Application in Marine Science and Engineering)
  • Article
  • Open Access
23 Citations
7,960 Views
10 Pages

1 March 2023

Bird sound classification plays an important role in large-scale temporal and spatial environmental monitoring. In this paper, we investigate both transfer learning and training from scratch for bird sound classification, where pre-trained models are...

(This article belongs to the Special Issue Feature Papers of Birds 2022–2023)
  • Article
  • Open Access
4 Citations
3,193 Views
15 Pages

13 November 2023

Predicting the remaining time before the next earthquake based on seismic signals generated in a laboratory setting is a challenging research task that is of significant importance for earthquake hazard assessment. In this study, we employed a mel sp...

(This article belongs to the Special Issue Machine Learning Approaches for Geophysical Data Analysis)
  • Article
  • Open Access
28 Citations
11,515 Views
18 Pages

21 June 2025

Speech emotion recognition (SER) plays a vital role in enhancing human–computer interaction (HCI) and can be applied in affective computing, virtual support, and healthcare. This research presents a high-performance SER framework based on a lig...

(This article belongs to the Special Issue Artificial Intelligence Methods for Human-Computer Interaction)
  • Article
  • Open Access
1 Citations
1,810 Views
23 Pages

Visual-to-Tactile Cross-Modal Generation Using a Class-Conditional GAN with Multi-Scale Discriminator and Hybrid Loss

  • Nikolay Neshov,
  • Krasimir Tonchev,
  • Agata Manolova,
  • Radostina Petkova and
  • Ivaylo Bozhilov

9 January 2026

Understanding surface textures through visual cues is crucial for applications in haptic rendering and virtual reality. However, accurately translating visual information into tactile feedback remains a challenging problem. To address this challenge,...

(This article belongs to the Special Issue Intelligent Sensing and Artificial Intelligence for Image Processing)
  • Article
  • Open Access
9 Citations
3,942 Views
15 Pages

Radar Emitter Identification with Multi-View Adaptive Fusion Network (MAFN)

  • Shuyuan Yang,
  • Tongqing Peng,
  • Huiling Liu,
  • Chen Yang and ,
  • Zhixi Feng and
  • Min Wang
  • + 1 author+ 0 author

24 March 2023

Radar emitter identification (REI) aims to extract the fingerprint of an emitter and determine the individual to which it belongs. Although many methods have used deep neural networks (DNNs) for an end-to-end REI, most of them only focus on a single...

  • Article
  • Open Access
692 Views
18 Pages

DroneAVFusion: Towards Drone-Incursion Detection and Classification Using Acoustic–Visual Fusion

  • Sanad Asim Barsiq,
  • Shafíi Nour Iśhak,
  • Zeyad Aljundi,
  • Taqwa Alhaj and ,
  • Jonghyuk Kim and
  • Shifeng Wang
  • + 1 author+ 0 author

27 October 2026

The rapid development of small unmanned aerial vehicles (UAVs) has introduced significant challenges in both civilian and defense security domains, such as public safety and protecting critical infrastructure. Detecting and classifying misused drones...

(This article belongs to the Special Issue AI-Enhanced Perception and Multi-Sensor Fusion for Unmanned Systems)
  • Article
  • Open Access
2 Citations
2,679 Views
16 Pages

24 April 2025

In the field of voice cryptography, detecting forged speech is crucial for secure communication and identity authentication. While most existing spoof detection methods rely on monaural audio, the characteristics of dual-channel signals remain undere...

(This article belongs to the Special Issue Applications Based on Symmetry in Applied Cryptography)
  • Article
  • Open Access
47 Citations
5,637 Views
18 Pages

Recognizing the speaker’s emotional state from speech signals plays a very crucial role in human–computer interaction (HCI). Nowadays, numerous linguistic resources are available, but most of them contain samples of a discrete length. In...

(This article belongs to the Special Issue Human Emotion Recognition)
  • Article
  • Open Access
14 Citations
4,404 Views
13 Pages

9 May 2024

Inertial signals are the most widely used signals in human activity recognition (HAR) applications, and extensive research has been performed on developing HAR classifiers using accelerometer and gyroscope data. This study aimed to investigate the po...

(This article belongs to the Section Wearables)
  • Article
  • Open Access
7 Citations
3,277 Views
18 Pages

24 October 2024

In urban environments, noise significantly impacts daily life and presents challenges for Environmental Sound Classification (ESC). The structural influence of urban noise on audio signals complicates feature extraction and audio classification for e...

  • Article
  • Open Access
17 Citations
5,097 Views
13 Pages

An Automatic Classification System for Environmental Sound in Smart Cities

  • Dongping Zhang,
  • Ziyin Zhong,
  • Yuejian Xia,
  • Zhutao Wang and
  • Wenbo Xiong

31 July 2023

With the continuous promotion of “smart cities” worldwide, the approach to be used in combining smart cities with modern advanced technologies (Internet of Things, cloud computing, artificial intelligence) has become a hot topic. However,...

(This article belongs to the Section Sensor Networks)
  • Article
  • Open Access
36 Citations
4,698 Views
14 Pages

25 July 2021

Electromyogram (EMG) signals cannot be forged and have the advantage of being able to change the registered data as they are characterized by the waveform, which varies depending on the gesture. In this paper, a two-step biometrics method was propose...

(This article belongs to the Special Issue Advances in Biosignal Processing and Biomedical Data Analysis)
  • Article
  • Open Access
405 Views
14 Pages

LM-GDMAF: A Lightweight Mamba Multimodal Fusion Algorithm for Small-Sample Modulation Recognition

  • Zhaoguang Zhang,
  • Zhenhua Wei,
  • Siming Han,
  • Yuxin Yang and ,
  • Jianwei Zhan,
  • Wenpeng Wu,
  • Haiyang You and
  • Chenxi Li
  • + 3 authors+ 0 author

1 July 2026

Automatic modulation recognition (AMR) is a key technique in modern communications. We propose LM-GDMAF, which integrates lightweight Mamba modules with a GDMAF fusion module. The lightweight Mamba modules efficiently extract temporal features, while...

(This article belongs to the Section Evolutionary Algorithms and Machine Learning)
  • Article
  • Open Access
689 Views
26 Pages

An Adaptive Audiovisual Fusion Method Based on Prediction Confidence for Fine Granularity Bird Species Recognition

  • Xinliang Xu,
  • Qiming Liu,
  • Xin Wen,
  • Heng Zhao and ,
  • Zhenhao Wang and
  • Chong Wang
  • + 1 author+ 0 author

20 May 2026

To address the inherent limitations of single-modality approaches in fine-grained bird species recognition, this paper proposes an adaptive audiovisual fusion method based on prediction confidence. The proposed framework comprises three core componen...

(This article belongs to the Special Issue AI-Based Supervised Prediction Models)

of 3