Skip to Content

4,567 Results Found

  • Article
  • Open Access
53 Citations
6,347 Views
18 Pages

Feature selection for multiple types of data has been widely applied in mild cognitive impairment (MCI) and Alzheimer’s disease (AD) classification research. Combining multi-modal data for classification can better realize the complementarity o...

(This article belongs to the Special Issue New Insight into Cellular and Molecular Bases of Brain Disorders)
  • Article
  • Open Access
1,943 Views
21 Pages

25 October 2024

Magnetic resonance (MR) imaging is widely used in the clinical field due to its non-invasiveness, but the long scanning time is still a bottleneck for its popularization. Using the complementary information between multi-modal imaging to accelerate i...

(This article belongs to the Topic Deep Learning for Medical Image Analysis and Medical Natural Language Processing)
  • Article
  • Open Access
9 Citations
3,254 Views
23 Pages

With the development of internet technology, fake news has become a multi-modal collection. The current news detection methods cannot fully extract semantic information between modalities and ignore the rumor properties of fake news, making it diffic...

  • Article
  • Open Access
4 Citations
2,518 Views
22 Pages

Multi-Modal Entity Alignment Based on Enhanced Relationship Learning and Multi-Layer Feature Fusion

  • Huayu Li,
  • Yujie Hou,
  • Jing Liu,
  • Peiying Zhang and ,
  • Cuicui Wang and
  • Kai Liu
  • + 1 author+ 0 author

23 June 2025

Entity alignment is a critical technique for integrating diverse knowledge graphs. Although existing methods have achieved impressive success in traditional entity alignment, they may struggle to handle the complexities arising from interactions and...

(This article belongs to the Section A: Computer Science)
  • Article
  • Open Access
1 Citations
1,138 Views
26 Pages

3 December 2025

In the field of remote sensing, accurate semantic segmentation is crucial for applications such as environmental monitoring and urban planning. Effective fusion of multi-modal data is a key factor in improving land cover classification accuracy. To a...

(This article belongs to the Section A: Computer Science)
  • Article
  • Open Access
829 Views
22 Pages

14 August 2026

Multi-modal image matching (MIM) remains a challenging problem due to nonlinear radiometric variations and geometric distortions across heterogeneous sensors. This paper proposes a robust feature-based matching framework that reduces reliance on inte...

  • Article
  • Open Access
3 Citations
3,755 Views
15 Pages

7 March 2019

When using traditional knowledge retrieval algorithms to analyze whether the feature input of words in multi-modal natural language library is symmetrical, the symmetry of words cannot be analyzed, resulting in inaccurate analysis results. A feature...

(This article belongs to the Special Issue New Trends in Dynamics)
  • Article
  • Open Access
3 Citations
1,792 Views
23 Pages

Multi-Granularity and Multi-Modal Feature Fusion for Indoor Positioning

  • Lijuan Ye,
  • Yi Wang,
  • Shenglei Pei,
  • Yu Wang and ,
  • Hong Zhao and
  • Shi Dong
  • + 1 author+ 0 author

15 April 2025

Despite the widespread adoption of indoor positioning technology, the existing solutions still face significant challenges. On one hand, Wi-Fi-based positioning struggles to balance accuracy and efficiency in complex indoor environments and architect...

(This article belongs to the Section B: Mathematics)
  • Article
  • Open Access
24 Citations
7,362 Views
23 Pages

1 October 2022

Building information extraction utilizing remote sensing technology has vital applications in many domains, such as urban planning, cadastral mapping, geographic information censuses, and land-cover change analysis. In recent years, deep learning alg...

(This article belongs to the Special Issue Pattern Recognition and Image Processing for Remote Sensing II)
  • Article
  • Open Access
40 Citations
5,708 Views
22 Pages

MFST: Multi-Modal Feature Self-Adaptive Transformer for Infrared and Visible Image Fusion

  • Xiangzeng Liu,
  • Haojie Gao,
  • Qiguang Miao,
  • Yue Xi and ,
  • Yunfeng Ai and
  • Dingguo Gao
  • + 1 author+ 0 author

5 July 2022

Infrared and visible image fusion is to combine the information of thermal radiation and detailed texture from the two images into one informative fused image. Recently, deep learning methods have been widely applied in this task; however, those meth...

(This article belongs to the Special Issue Image Processing and Analysis: Trends in Registration, Data Fusion, 3D Reconstruction, and Change Detection II)
  • Article
  • Open Access
1,895 Views
18 Pages

A Uniform Multi-Modal Feature Extraction and Adaptive Local–Global Feature Fusion Structure for RGB-X Marine Animal Segmentation

  • Yue Jiang,
  • Yan Gao,
  • Yifei Wang,
  • Yue Wang and ,
  • Hong Yu and
  • Yuanshan Lin
  • + 1 author+ 0 author

2 October 2025

Marine animal segmentation aims at segmenting marine animals in complex ocean scenes, which plays an important role in underwater intelligence research. Due to the complexity of underwater scenes, relying solely on a single RGB image or learning from...

(This article belongs to the Section Computer Science & Engineering)
  • Article
  • Open Access
1 Citations
1,372 Views
29 Pages

Metallogenic Prediction for Copper–Nickel Sulfide Deposits in the Eastern and Central Tianshan Based on Multi-Modal Feature Fusion

  • Haonan Wang,
  • Bimin Zhang,
  • Miao Xie,
  • Yue Sun and ,
  • Wei Ye,
  • Chunfang Dong,
  • Zimu Yang and
  • Xueqiu Wang
  • + 3 authors+ 0 author

18 March 2026

The deep integration of machine learning technology with geological prospecting has brought to the forefront a key challenge: how to construct geological-mineralization models by fusing multi-source data, select model features with guidance from meta...

(This article belongs to the Special Issue Geochemical Exploration for Critical Mineral Resources, 2nd Edition)
  • Article
  • Open Access
8 Citations
3,607 Views
26 Pages

30 June 2025

Multi-modal remote sensing images often exhibit complex and nonlinear radiation differences which significantly hinder the performance of traditional feature-based image registration methods such as Scale-Invariant Feature Transform (SIFT). In contra...

  • Letter
  • Open Access
3 Citations
3,788 Views
16 Pages

28 August 2020

Due to the limitation of less information in a single image, it is very difficult to generate a high-precision 3D model based on the image. There are some problems in the generation of 3D voxel models, e.g., the information loss at the upper level of...

(This article belongs to the Special Issue Sensors and Computer Vision Techniques for 3D Object Modeling)
  • Article
  • Open Access
482 Views
23 Pages

24 August 2026

Vibration signals of planetary gearboxes under variable-speed conditions exhibit strong non-stationarity and modulation, so a single feature representation cannot comprehensively describe intricate fault patterns, and distribution discrepancies acros...

(This article belongs to the Section Machines Testing and Maintenance)
  • Article
  • Open Access
2 Citations
2,698 Views
39 Pages

2 April 2026

Automated recognition of equine–human interaction behaviors from video represents a significant challenge in computational ethology, with critical applications spanning animal welfare assessment, equine-assisted services evaluation, and safety...

(This article belongs to the Special Issue Innovative Sensing Methods for Motion and Behavior Analysis)
  • Article
  • Open Access
6 Citations
2,597 Views
25 Pages

13 December 2024

Sea surface target detectors are often interfered by various complex sea surface factors such as sea clutter. Especially when the signal-to-clutter ratio (SCR) is low, it is difficult to achieve high-performance detection. This paper proposes a tripl...

(This article belongs to the Special Issue Application of Shore-Based, Sky-Based and Marine Radars to Ocean and Target Parameter Extraction)
  • Article
  • Open Access
6 Citations
6,479 Views
38 Pages

12 November 2021

We present a multi-modal genre recognition framework that considers the modalities audio, text, and image by features extracted from audio signals, album cover images, and lyrics of music tracks. In contrast to pure learning of features by a neural n...

(This article belongs to the Special Issue Artificial Intelligence and Complexity in Art, Music, Games and Design II)
  • Article
  • Open Access
14 Citations
5,248 Views
16 Pages

27 July 2023

Learning concentration, as a crucial factor influencing learning outcomes, provides the basis for learners’ self-regulation and teachers’ instructional adjustments and intervention decisions. However, the current research on learning conc...

  • Article
  • Open Access
179 Citations
7,932 Views
16 Pages

Blended Multi-Modal Deep ConvNet Features for Diabetic Retinopathy Severity Prediction

  • Jyostna Devi Bodapati,
  • Veeranjaneyulu Naralasetti,
  • Shaik Nagur Shareef,
  • Saqib Hakak and ,
  • Muhammad Bilal,
  • Praveen Kumar Reddy Maddikunta and
  • Ohyun Jo
  • + 2 authors+ 0 author

Diabetic Retinopathy (DR) is one of the major causes of visual impairment and blindness across the world. It is usually found in patients who suffer from diabetes for a long period. The major focus of this work is to derive optimal representation of...

(This article belongs to the Special Issue Computational Intelligence in Healthcare)
  • Article
  • Open Access
596 Views
21 Pages

Structure-Aware Feature Descriptor with Multi-Scale Side Window Filtering for Multi-Modal Image Matching

  • Junhong Guo,
  • Lixing Zhao,
  • Quan Liang,
  • Xinwang Du and ,
  • Yixuan Xu and
  • Xiaoyan Li
  • + 1 author+ 0 author

20 March 2026

Traditional image feature matching methods often fail to achieve satisfactory performance on multimodal remote sensing images (MRSIs), mainly due to significant nonlinear radiometric distortion (NRD) and complex geometric deformation caused by differ...

  • Article
  • Open Access
2 Citations
1,243 Views
23 Pages

This paper proposes an SOH estimation method that fuses mechanical–electrical–thermal multi-modal features by introducing expansion force monitoring. Aging tests on 16 prismatic 530 Ah LiFePO4 batteries from two brands are conducted at 25...

(This article belongs to the Section Energy Storage System Aging, Diagnosis and Safety)
  • Article
  • Open Access
239 Views
21 Pages

VesselRegNet: Multi-Scale Feature Fusion Network for Multi-Modal Joint Retinal Vessel Segmentation and Registration

  • Anyu Cao,
  • Maosong Jiang,
  • Qinghong Gao,
  • Xuelian Yang and ,
  • Caiye Fan,
  • Shu’an Liu,
  • Zuoping Tan and
  • Yuanyuan Wang
  • + 3 authors+ 0 author

Multimodal retinal image registration remains challenging due to nonlinear intensity discrepancies and insufficient feature representation across modalities. To address these limitations, we propose VesselRegNet, a joint retinal vessel segmentation a...

(This article belongs to the Special Issue Machine Learning and Deep Learning Applications in Healthcare, 2nd Edition)
  • Article
  • Open Access
14 Citations
5,408 Views
15 Pages

Multimodal Feature Fusion Method for Unbalanced Sample Data in Social Network Public Opinion

  • Jian Zhao,
  • Wenhua Dong,
  • Lijuan Shi,
  • Wenqian Qiang and ,
  • Zhejun Kuang,
  • Dawei Xu and
  • Tianbo An
  • + 2 authors+ 0 author

25 July 2022

With the wide application of social media, public opinion analysis in social networks has been unable to be met through text alone because the existing public opinion information includes data information of various modalities, such as voice, text, a...

(This article belongs to the Special Issue Security and Privacy in Large-Scale Data Networks)
  • Article
  • Open Access
8 Citations
1,830 Views
31 Pages

26 March 2026

Anti-unmanned aerial vehicle (Anti-UAV) detection is critical for airspace security, yet existing single-modality approaches suffer from severe performance degradation under adverse illumination, thermal crossover, and extreme scale variation. In thi...

(This article belongs to the Topic Theoretical Foundations and Applications of Deep Learning Techniques)
  • Article
  • Open Access
9 Citations
3,864 Views
13 Pages

Multi-Modal Entity Alignment Method Based on Feature Enhancement

  • Huansha Wang,
  • Qinrang Liu,
  • Ruiyang Huang and
  • Jianpeng Zhang

1 June 2023

Multi-modal entity alignment refers to identifying equivalent entities between two different multi-modal knowledge graphs that consist of multi-modal information such as structural triples and descriptive images. Most previous multi-modal entity alig...

(This article belongs to the Topic Recent Advances in Data Mining)
  • Article
  • Open Access
22 Citations
4,798 Views
27 Pages

18 May 2022

The results of aerial scene classification can provide valuable information for urban planning and land monitoring. In this specific field, there are always a number of object-level semantic classes in big remote-sensing pictures. Complex label-space...

(This article belongs to the Special Issue Advances in Hyperspectral Remote Sensing: Methods and Applications)
  • Article
  • Open Access
656 Views
20 Pages

TSFPTD: A Multimodal Model Integrating Temporal and Spectral Features for Electricity Theft Detection

  • Shijie Gao,
  • Xin He,
  • Qiang Wang,
  • Lufeng Yuan and ,
  • Zihao Li and
  • Zhenhua Wei
  • + 1 author+ 0 author

In modern power grids, the detection of electricity theft is crucial for ensuring the safety and stability of the power system and reducing revenue losses. Current electricity theft detection methods do not take into account the spectral space featur...

  • Article
  • Open Access
10 Citations
7,620 Views
18 Pages

PhotoMatch: An Open-Source Tool for Multi-View and Multi-Modal Feature-Based Image Matching

  • Esteban Ruiz de Oña,
  • Inés Barbero-García,
  • Diego González-Aguilera,
  • Fabio Remondino and ,
  • Pablo Rodríguez-Gonzálvez and
  • David Hernández-López
  • + 1 author+ 0 author

27 April 2023

The accurate and reliable extraction and matching of distinctive features (keypoints) in multi-view and multi-modal datasets is still an open research topic in the photogrammetric and computer vision communities. However, one of the main milestones i...

(This article belongs to the Special Issue Digital Image Processing: Advanced Technologies and Applications)
  • Article
  • Open Access
4 Citations
4,567 Views
17 Pages

A Multi-Modal Entity Alignment Method with Inter-Modal Enhancement

  • Song Yuan,
  • Zexin Lu,
  • Qiyuan Li and
  • Jinguang Gu

Due to inter-modal effects hidden in multi-modalities and the impact of weak modalities on multi-modal entity alignment, a Multi-modal Entity Alignment Method with Inter-modal Enhancement (MEAIE) is proposed. This method introduces a unique modality...

  • Article
  • Open Access
2,096 Views
19 Pages

Deep learning technology has been widely used in brain tumor segmentation with multi-modality magnetic resonance imaging, helping doctors achieve faster and more accurate diagnoses. Previous studies have demonstrated that the weighted fusion segmenta...

(This article belongs to the Special Issue New Sights of Deep Learning in Bioengineering: Updates and Future Directions)
  • Article
  • Open Access
31 Citations
5,859 Views
18 Pages

2 February 2021

Semantic segmentation of multi-modal remote sensing images is an important branch of remote sensing image interpretation. Multi-modal data has been proven to provide rich complementary information to deal with complex scenes. In recent years, semanti...

(This article belongs to the Special Issue Big Remotely Sensed Data)
  • Article
  • Open Access
2 Citations
3,628 Views
24 Pages

11 September 2020

Facial expression recognition (FER) technology has made considerable progress with the rapid development of deep learning. However, conventional FER techniques are mainly designed and trained for videos that are artificially acquired in a limited env...

(This article belongs to the Section Intelligent Sensors)
  • Article
  • Open Access
2 Citations
1,974 Views
24 Pages

27 March 2025

Building extraction plays a pivotal role in enabling rapid and accurate construction of urban maps, thereby supporting urban planning, smart city development, and urban management. Buildings in remote sensing imagery exhibit diverse morphological att...

(This article belongs to the Special Issue Multi-Modal Image Processing Methods, Systems, and Applications: 2nd Edition)
  • Article
  • Open Access
35 Citations
7,810 Views
13 Pages

User Identification from Gait Analysis Using Multi-Modal Sensors in Smart Insole

  • Sang-Il Choi,
  • Jucheol Moon,
  • Hee-Chan Park and
  • Sang Tae Choi

31 August 2019

Recent studies indicate that individuals can be identified by their gait pattern. A number of sensors including vision, acceleration, and pressure have been used to capture humans’ gait patterns, and a number of methods have been developed to r...

(This article belongs to the Section Physical Sensors)
  • Article
  • Open Access
16 Citations
5,664 Views
21 Pages

29 October 2024

Coronary artery disease (CAD) is an irreversible and fatal disease. It necessitates timely and precise diagnosis to slow CAD progression. Electrocardiogram (ECG) and phonocardiogram (PCG), conveying abundant disease-related information, are prevalent...

(This article belongs to the Section Biomedical Sensors)
  • Article
  • Open Access
25 Citations
4,357 Views
15 Pages

21 October 2024

With the simultaneous acquisition of the infrared and optical remote sensing images of the same target becoming increasingly easy, using multi-modal data for high-performance object detection has become a research focus. In remote sensing multi-modal...

(This article belongs to the Section Remote Sensing Image Processing)
  • Article
  • Open Access
27 Citations
6,545 Views
18 Pages

12 August 2021

Emotion recognition is an important research field for human–computer interaction. Audio–video emotion recognition is now attacked with deep neural network modeling tools. In published papers, as a rule, the authors show only cases of the superiority...

(This article belongs to the Special Issue Emotion Recognition Based on Sensors)
  • Article
  • Open Access
3 Citations
4,252 Views
17 Pages

4 May 2023

Multi-modal deep learning methods have achieved great improvements in visual grounding; their objective is to localize text-specified objects in images. Most of the existing methods can localize and classify objects with significant appearance differ...

(This article belongs to the Special Issue Big Data Analysis and Management Based on Deep Learning)
  • Article
  • Open Access
2 Citations
2,927 Views
13 Pages

6 November 2024

Cymbidium goeringii (Rchb. f.) is a traditional Chinese flower with highly valued biological, cultural, and artistic properties. However, the valuation of Rchb. f. mainly relies on subjective judgment, lacking a standardized digital evaluation and gr...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
1 Citations
1,236 Views
28 Pages

25 February 2026

Optical and synthetic aperture radar (SAR) image registration faces challenges from nonlinear radiometric distortions and geometric deformations caused by different imaging mechanisms. This paper proposes a coarse-to-fine registration algorithm integ...

(This article belongs to the Special Issue Deep Learning-Based Analysis of High-Resolution Remote Sensing Images: Registration, Fusion, and Change Detection)
  • Article
  • Open Access
32 Citations
12,046 Views
22 Pages

Research on uni-modal sentiment analysis has achieved great success, but emotions in real life are mostly multi-modal; there are not only texts but also images, audio, video, and other forms. The various modes play a role in mutual promotion. If the...

(This article belongs to the Special Issue Application of Data Mining in Social Media)
  • Article
  • Open Access
2 Citations
990 Views
23 Pages

SAR and Visible Image Fusion via Retinex-Guided SAR Reconstruction

  • Yuman Yuan,
  • Tianyu Deng,
  • Yi Le,
  • Hongyang Bai and ,
  • Shuai Guo,
  • Shangjing Sun and
  • Yuanbo Chen
  • + 2 authors+ 0 author

28 December 2025

The fusion of synthetic aperture radar (SAR) and visible images offers complementary spatial and spectral information, enabling more reliable and comprehensive scene interpretation. However, SAR speckle noise and the intrinsic modality gap pose signi...

  • Article
  • Open Access
39 Citations
5,099 Views
16 Pages

Fusion of Multi-Modal Features to Enhance Dense Video Caption

  • Xuefei Huang,
  • Ka-Hou Chan,
  • Weifan Wu,
  • Hao Sheng and
  • Wei Ke

14 June 2023

Dense video caption is a task that aims to help computers analyze the content of a video by generating abstract captions for a sequence of video frames. However, most of the existing methods only use visual features in the video and ignore the audio...

(This article belongs to the Special Issue Deep Learning for Information Fusion and Pattern Recognition)
  • Article
  • Open Access
33 Citations
6,663 Views
18 Pages

13 November 2024

Semantic segmentation of remote sensing images is a fundamental task in computer vision, holding substantial relevance in applications such as land cover surveys, environmental protection, and urban building planning. In recent years, multi-modal fus...

(This article belongs to the Section Remote Sensors)
  • Article
  • Open Access
19 Citations
7,377 Views
23 Pages

An Evaluation of the Pedestrian Classification in a Multi-Domain Multi-Modality Setup

  • Alina Miron,
  • Alexandrina Rogozan,
  • Samia Ainouz,
  • Abdelaziz Bensrhair and
  • Alberto Broggi

12 June 2015

The objective of this article is to study the problem of pedestrian classification across different light spectrum domains (visible and far-infrared (FIR)) and modalities (intensity, depth and motion). In recent years, there has been a number of appr...

(This article belongs to the Special Issue Frontiers in Infrared Photodetection)
  • Article
  • Open Access
6 Citations
4,971 Views
13 Pages

28 October 2024

In this paper, we present a novel model that enhances performance by extending the dual-modality TEVAD model—originally leveraging visual and textual information—into a multi-modal framework that integrates visual, audio, and textual data...

(This article belongs to the Topic Applied Computer Vision and Pattern Recognition: 2nd Edition)
  • Article
  • Open Access
16 Citations
4,926 Views
19 Pages

Mixture of Attention Variants for Modal Fusion in Multi-Modal Sentiment Analysis

  • Chao He,
  • Xinghua Zhang,
  • Dongqing Song,
  • Yingshan Shen and ,
  • Chengjie Mao,
  • Huosheng Wen,
  • Dingju Zhu and
  • Lihua Cai
  • + 3 authors+ 0 author

With the popularization of better network access and the penetration of personal smartphones in today’s world, the explosion of multi-modal data, particularly opinionated video messages, has created urgent demands and immense opportunities for...

(This article belongs to the Special Issue Research Progress in Artificial Intelligence and Social Network Analysis)
  • Article
  • Open Access
3 Citations
2,070 Views
17 Pages

16 September 2025

Cameras and LiDAR are the primary sensors utilized in contemporary 3D object perception, leading to the development of various multi-modal detection algorithms for images, point clouds, and their fusion. Given the demanding accuracy requirements in a...

(This article belongs to the Special Issue Advances in Sensing, Imaging and Computing for Autonomous Driving: 2nd Edition)
  • Article
  • Open Access
2 Citations
1,385 Views
18 Pages

10 November 2025

Radar space target recognition is faced with inherent challenges due to complex electromagnetic scattering properties and limited training samples. Conventional single-modality approaches cannot fully characterize targets due to information incomplet...

(This article belongs to the Special Issue AI-Driven Computer Vision and Pattern Recognition: Challenges and Applications)

of 92