Skip to Content

1,706 Results Found

  • Article
  • Open Access
829 Views
22 Pages

14 August 2026

Multi-modal image matching (MIM) remains a challenging problem due to nonlinear radiometric variations and geometric distortions across heterogeneous sensors. This paper proposes a robust feature-based matching framework that reduces reliance on inte...

  • Review
  • Open Access
15 Citations
5,524 Views
25 Pages

20 February 2022

The rapid growth of online data has made it very convenient for people to obtain information. However, it also leads to the problem of “information overload”. Therefore, how to detect hot events from the massive amount of information has...

  • Article
  • Open Access
16 Citations
8,815 Views
15 Pages

7 October 2023

The integration of information from multiple modalities is a highly active area of research. Previous techniques have predominantly focused on fusing shallow features or high-level representations generated by deep unimodal networks, which only captu...

(This article belongs to the Special Issue Deep Learning Models and Applications to Computer Vision)
  • Article
  • Open Access
22 Citations
4,798 Views
27 Pages

18 May 2022

The results of aerial scene classification can provide valuable information for urban planning and land monitoring. In this specific field, there are always a number of object-level semantic classes in big remote-sensing pictures. Complex label-space...

(This article belongs to the Special Issue Advances in Hyperspectral Remote Sensing: Methods and Applications)
  • Article
  • Open Access
9 Citations
3,864 Views
13 Pages

Multi-Modal Entity Alignment Method Based on Feature Enhancement

  • Huansha Wang,
  • Qinrang Liu,
  • Ruiyang Huang and
  • Jianpeng Zhang

1 June 2023

Multi-modal entity alignment refers to identifying equivalent entities between two different multi-modal knowledge graphs that consist of multi-modal information such as structural triples and descriptive images. Most previous multi-modal entity alig...

(This article belongs to the Topic Recent Advances in Data Mining)
  • Article
  • Open Access
2 Citations
1,204 Views
33 Pages

12 March 2026

Emotions and affective responses are core intervention targets in music therapy. Through acoustic elements, music can evoke emotional responses at physiological and neurological levels, influencing cognition and behavior while providing an important...

(This article belongs to the Section A: Computer Science)
  • Article
  • Open Access
10 Citations
4,609 Views
12 Pages

Designing Multi-Modal Embedding Fusion-Based Recommender

  • Anna Wróblewska,
  • Jacek Dąbrowski,
  • Michał Pastuszak,
  • Andrzej Michałowski and ,
  • Michał Daniluk,
  • Barbara Rychalska,
  • Mikołaj Wieczorek and
  • Sylwia Sysko-Romańczuk
  • + 3 authors+ 0 author

Recommendation systems have lately been popularised globally. However, often they need to be adapted to particular data and the use case. We have developed a machine learning-based recommendation system, which can be easily applied to almost any item...

(This article belongs to the Special Issue Recommender Systems: Approaches, Challenges and Applications)
  • Article
  • Open Access
2 Citations
990 Views
23 Pages

SAR and Visible Image Fusion via Retinex-Guided SAR Reconstruction

  • Yuman Yuan,
  • Tianyu Deng,
  • Yi Le,
  • Hongyang Bai and ,
  • Shuai Guo,
  • Shangjing Sun and
  • Yuanbo Chen
  • + 2 authors+ 0 author

28 December 2025

The fusion of synthetic aperture radar (SAR) and visible images offers complementary spatial and spectral information, enabling more reliable and comprehensive scene interpretation. However, SAR speckle noise and the intrinsic modality gap pose signi...

  • Article
  • Open Access
1,156 Views
19 Pages

13 April 2026

This paper presents a deep reinforcement learning framework for autonomous navigation based on multi-modal belief state representation learned from LiDAR and depth sensors. To address the challenges posed by partial observability and sensor-specific...

(This article belongs to the Special Issue AI Applications in Modern Industrial Systems)
  • Article
  • Open Access
3,757 Views
16 Pages

13 September 2020

Multimodal representations play an important role in multimodal learning tasks, including cross-modal retrieval and intra-modal clustering. However, existing multimodal representation learning approaches focus on building one common space by aligning...

(This article belongs to the Special Issue Symmetry in Artificial Visual Perception and Its Application)
  • Article
  • Open Access
4,195 Views
13 Pages

Multiple Network Fusion with Low-Rank Representation for Image-Based Age Estimation

  • Chaoqun Hong,
  • Zhiqiang Zeng,
  • Xiaodong Wang and
  • Weiwei Zhuang

10 September 2018

Image-based age estimation is a challenging task since there are ambiguities between the apparent age of face images and the actual ages of people. Therefore, data-driven methods are popular. To improve data utilization and estimation performance, we...

(This article belongs to the Special Issue Advanced Intelligent Imaging Technology)
  • Article
  • Open Access
581 Views
17 Pages

2s-DAS: Two-Stream Diffusion with Multi-Modal Fusion for Temporal Action Segmentation

  • Ce Li,
  • Xuli Guo,
  • Ruijie Wang,
  • Kaipan Zhao and ,
  • Linlin Yang and
  • Fang Wan
  • + 1 author+ 0 author

Human temporal action segmentation (TAS) is a fundamental video understanding task aimed at partitioning untrimmed videos into semantically coherent action segments. While temporal convolutional networks and transformers have significantly improved f...

(This article belongs to the Topic Visual Computing and Understanding: New Developments and Trends)
  • Article
  • Open Access
19 Citations
5,438 Views
22 Pages

MMKG-PAR: Multi-Modal Knowledge Graphs-Based Personalized Attraction Recommendation

  • Gengyue Zhang,
  • Hao Li,
  • Shuangling Li,
  • Beibei Wang and
  • Zhixing Ding

6 March 2024

As the tourism industry rapidly develops, providing personalized attraction recommendations has become a hot research area. Knowledge graphs, with their rich semantic information and entity relationships, not only enhance the accuracy and personaliza...

(This article belongs to the Section Tourism, Culture, and Heritage)
  • Article
  • Open Access
144 Views
23 Pages

27 October 2026

Scene text recognition (STR) has benefited from vision–language modeling and multi-modal in-context learning, which enables models to exploit annotated demonstrations during inference without parameter updating. However, existing in-context STR...

(This article belongs to the Special Issue Advances in Image Recognition, Image Segmentation, Image Fusion, and Singal Processing)
  • Article
  • Open Access
58 Views
38 Pages

9 November 2026

Visible and synthetic aperture radar (SAR) sensors provide heterogeneous yet complementary observations for remote-sensing object detection. However, effective multimodal sensing fusion remains challenging because SAR features may contain locally uns...

(This article belongs to the Special Issue Multi-Modality Sensing Data Analysis and Its Application in Image Processing and Vision)
  • Review
  • Open Access
1 Citations
2,268 Views
38 Pages

14 April 2026

Multimodal biomedical machine learning increasingly integrates heterogeneous data sources (including medical imaging, multi-omics profiles, electronic health records, and wearable sensor signals) to support clinical diagnosis, prognosis, and treatmen...

(This article belongs to the Special Issue Artificial Intelligence and Machine Learning for Biomedical Applications: Entropy and Information-Theoretic Perspectives)
  • Article
  • Open Access
427 Views
43 Pages

21 July 2026

Medical image retrieval plays an important role in computer-aided diagnosis by enabling access to clinically relevant images from large repositories to support diagnostic decision-making. Despite significant advances, existing Content-Based Medical I...

  • Article
  • Open Access
9 Citations
5,639 Views
30 Pages

11 April 2025

Detecting fake news has become a critical challenge in today’s information-dense society. Existing research on fake news detection predominantly emphasizes multi-modal approaches, focusing primarily on textual and visual features. However, desp...

  • Article
  • Open Access
6 Citations
2,523 Views
16 Pages

MGKGR: Multimodal Semantic Fusion for Geographic Knowledge Graph Representation

  • Jianqiang Zhang,
  • Renyao Chen,
  • Shengwen Li,
  • Tailong Li and
  • Hong Yao

23 December 2024

Geographic knowledge graph representation learning embeds entities and relationships in geographic knowledge graphs into a low-dimensional continuous vector space, which serves as a basic method that bridges geographic knowledge graphs and geographic...

(This article belongs to the Section Algorithms for Multidisciplinary Applications)
  • Article
  • Open Access
4 Citations
2,375 Views
17 Pages

Reliable three-dimensional (3D) object detection is critical for intelligent vehicles to ensure safety in complex traffic environments, and recent progress in multi-modal sensor fusion, particularly between LiDAR and camera, has advanced environment...

(This article belongs to the Special Issue Recent Advances in Intelligent Vehicle)
  • Article
  • Open Access
440 Views
31 Pages

Accurate point-cloud registration is a fundamental task in intelligent 3D perception systems, including autonomous robotics, indoor digital twins, augmented reality, smart sensing, and scene-level spatial understanding. However, reliable registration...

(This article belongs to the Topic Advances in Robot Vision Perception and Control Technology)
  • Article
  • Open Access
563 Views
23 Pages

Text-to-motion generation aims to synthesize realistic human motion sequences that accurately reflect natural language descriptions. While recent approaches have improved motion quality, achieving strong semantic alignment between text and motion, es...

(This article belongs to the Topic AI-Based Interactive and Immersive Systems)
  • Article
  • Open Access
4 Citations
3,351 Views
17 Pages

The Kolmogorov–Arnold network (KAN) is a regression model that is based on a representation of an arbitrary continuous multivariate function by a composition of functions of a single variable. Experimentally obtained datasets for regression mod...

  • Article
  • Open Access
1 Citations
503 Views
45 Pages

TRT-GLA: Tri-Representation Transformers with Global–Local Attention for High-Fidelity Multi-Modal MRI Super-Resolution

  • Suhaila Abuowaida,
  • Hamza Abu Owida,
  • Tareq Hamadneh,
  • Nawaf Alshdaifat and ,
  • Hamza A. Mashagba,
  • Mwaffaq Abu Alhaija and
  • Azlan B. Abd Aziz
  • + 2 authors+ 0 author

21 July 2026

The super-resolution (SR) of Magnetic Resonance Imaging (MRI) is essential for utilizing clinical scans with limited resolution, noise, and anisotropic sampling, such as multi-modal brain tumor imaging. In this work, we propose a Tri-Representation h...

(This article belongs to the Special Issue Artificial Intelligence in Sustainable Development)
  • Article
  • Open Access
6 Citations
3,968 Views
28 Pages

Accessible IoT Dashboard Design with AI-Enhanced Descriptions for Visually Impaired Users

  • George Alex Stelea,
  • Livia Sangeorzan and
  • Nicoleta Enache-David

The proliferation of the Internet of Things (IoT) has led to an abundance of data streams and real-time dashboards in domains such as smart cities, healthcare, manufacturing, and agriculture. However, many current IoT dashboards emphasize complex vis...

(This article belongs to the Special Issue Human-Centered Artificial Intelligence)
  • Article
  • Open Access
6 Citations
3,443 Views
20 Pages

Recommendations for Different Tasks Based on the Uniform Multimodal Joint Representation

  • Haiying Liu,
  • Sinuo Deng,
  • Lifang Wu,
  • Meng Jian and ,
  • Bowen Yang and
  • Dai Zhang
  • + 1 author+ 0 author

4 September 2020

Content curation social networks (CCSNs), such as Pinterest and Huaban, are interest driven and content centric. On CCSNs, user interests are represented by a set of boards, and a board is composed of various pins. A pin is an image with a descriptio...

(This article belongs to the Special Issue Artificial Intelligence for Multimedia Signal Processing)
  • Article
  • Open Access
230 Views
44 Pages

1 October 2026

Industrial robot maintenance knowledge graphs often contain missing relationships, while semantic differences among maintenance text, graph structure, and operational condition signals complicate multimodal link prediction. Sparsely connected entitie...

(This article belongs to the Special Issue Human–Robot Interaction and Communication Towards Industry 5.0)
  • Article
  • Open Access
710 Views
31 Pages

LGCDF: Label-Guided Contrastive Disentanglement Fusion of Sensitive Attribute-Free Representations for Fair Multimodal Sentiment Analysis

  • Rongfei Chen,
  • Xinming Zhang,
  • Siwei Cheng,
  • Tingting Zhang and ,
  • Hanlin Zhang and
  • Wei Zhang
  • + 1 author+ 0 author

19 March 2026

Multimodal sentiment analysis (MSA) has emerged as a prominent research frontier, enabling a comprehensive understanding of complex human emotions through the synergistic integration of heterogeneous multimodal signals. However, most existing approac...

(This article belongs to the Special Issue Robust and Secure Learning and Applications for Heterogeneous Data from Multiple Sources)
  • Article
  • Open Access
1,068 Views
17 Pages

Recent vision-language pre-training models, like CLIP, have been shown to generalize well across a variety of multitask modalities. Nonetheless, their generalization for downstream tasks is limited. As a lightweight adaptation approach, prompt learni...

  • Article
  • Open Access
1,463 Views
20 Pages

Molecular representation learning (MRL) has garnered significant attention due to its pivotal role in downstream applications such as molecular property prediction and drug discovery. In most MRL approaches, molecules are encoded into 2D topological...

(This article belongs to the Special Issue Latest Advances in Molecular Docking Involved in Biophysics)
  • Article
  • Open Access
11 Citations
3,474 Views
27 Pages

13 October 2021

Multi-modality image fusion applied to improve image quality has drawn great attention from researchers in recent years. However, noise is actually generated in images captured by different types of imaging sensors, which can seriously affect the per...

(This article belongs to the Special Issue Feature Paper in Computers)
  • Article
  • Open Access
3 Citations
3,493 Views
15 Pages

21 July 2025

The rise of artificial intelligence (AI) has revolutionized the processing and analysis of video sensor data, driving advancements in areas such as surveillance, autonomous driving, and personalized content recommendations. However, leveraging video...

(This article belongs to the Special Issue Multimodal Perception Modeling Based on Advanced Computational Technologies)
  • Article
  • Open Access
6 Citations
4,842 Views
13 Pages

Multimodal AutoML via Representation Evolution

  • Blaž Škrlj,
  • Matej Bevec and
  • Nada Lavrač

With the increasing amounts of available data, learning simultaneously from different types of inputs is becoming necessary to obtain robust and well-performing models. With the advent of representation learning in recent years, lower-dimensional vec...

(This article belongs to the Collection Extravaganza Feature Papers on Hot Topics in Machine Learning and Knowledge Extraction)
  • Article
  • Open Access
1,007 Views
15 Pages

13 January 2026

Targeted multimodal sentiment classification is frequently impeded by the semantic sparsity of social media content, where text is brief and context is implicit. Traditional methods that rely on direct concatenation of textual and visual features oft...

(This article belongs to the Section AI-Driven Innovations)
  • Article
  • Open Access
1 Citations
3,100 Views
24 Pages

PolSAR Scene Classification via Low-Rank Constrained Multimodal Tensor Representation

  • Bo Ren,
  • Mengqian Chen,
  • Biao Hou,
  • Danfeng Hong and ,
  • Shibin Ma,
  • Jocelyn Chanussot and
  • Licheng Jiao
  • + 2 authors+ 0 author

28 June 2022

Polarimetric synthetic aperture radar (PolSAR) data can be acquired at all times and are not impacted by weather conditions. They can efficiently capture geometrical and geographical structures on the ground. However, due to the complexity of the dat...

(This article belongs to the Special Issue State-of-the-Art Remote Sensing Image Scene Classification)
  • Article
  • Open Access
376 Views
23 Pages

7 September 2026

This study addresses the insufficient representation of key regions, such as shock waves and boundary layers, in classical implicit neural representations (INRs) for super-resolution reconstruction of complex aerodynamic flow fields. A physics-aware...

(This article belongs to the Section Aeronautics)
  • Article
  • Open Access
1 Citations
878 Views
29 Pages

LRCFuse: Infrared and Visible Image Fusion Based on Low-Rank Representation and Convolutional Sparse Learning

  • Jingjing Liu,
  • Yujie Zhu,
  • Yuhao Zhang,
  • Aiying Guo and ,
  • Mengjiao Li and
  • Jianhua Zhang
  • + 1 author+ 0 author

11 March 2026

With the development of cross-modal image fusion in multi-sensor systems, current fusion technologies have made significant progress in feature extraction, facilitating more effective image analysis. However, insufficient fusion information may degra...

(This article belongs to the Special Issue Machine Learning in Image/Video Processing and Sensing)
  • Article
  • Open Access
2 Citations
4,670 Views
12 Pages

MHAiR: A Dataset of Audio-Image Representations for Multimodal Human Actions

  • Muhammad Bilal Shaikh,
  • Douglas Chai,
  • Syed Mohammed Shamsul Islam and
  • Naveed Akhtar

25 January 2024

Audio-image representations for a multimodal human action (MHAiR) dataset contains six different image representations of the audio signals that capture the temporal dynamics of the actions in a very compact and informative way. The dataset was extra...

  • Article
  • Open Access
816 Views
15 Pages

7 May 2026

Accurate matching between molecular structures and NMR spectra is an important task in automated structure elucidation. However, existing methods still face difficulties in jointly modeling multi-scale molecular topology and effectively exploiting th...

(This article belongs to the Section Multidisciplinary Applications)
  • Article
  • Open Access
1 Citations
747 Views
22 Pages

8 July 2026

Multimodal remote sensing segmentation commonly integrates optical imagery with Digital Surface Models (DSMs) to improve land-cover understanding. However, existing methods often overlook a critical issue, namely the inconsistency between spatial-dom...

(This article belongs to the Special Issue Remote Sensing Intelligent Interpretation in the Era of Large Models and Intelligent Agents: New Challenges, Methods and Opportunities)
  • Article
  • Open Access
1 Citations
1,376 Views
19 Pages

A Real Time Multi Modal Computer Vision Framework for Automated Autism Spectrum Disorder Screening

  • Lehel Dénes-Fazakas,
  • Ioan Catalin Mateas,
  • Alexandru George Berciu,
  • László Szilágyi and ,
  • Levente Kovács and
  • Eva-H. Dulf
  • + 1 author+ 0 author

Background: The early detection of autism spectrum disorder (ASD) is imperative for enhancing long-term developmental outcomes. Nevertheless, conventional screening methods depend on time-consuming, expert-driven behavioral assessments and are charac...

(This article belongs to the Section Bioelectronics)
  • Article
  • Open Access
1,075 Views
27 Pages

Multimodal Depression Detection Based on Modality Feature Decomposition and Contrastive Learning

  • Jingxia Chen,
  • Yikun Ning,
  • Pengwei Zhang,
  • Haifeng Chen and
  • Huiru Zheng

3 June 2026

Multimodal depression detection aims to identify depressive states by integrating complementary affective cues from audio, visual, and textual modalities. However, existing approaches often directly fuse multimodal features, which may introduce seman...

(This article belongs to the Special Issue Machine Learning Techniques for Brain Data Analysis Using EEG, EMG or Image Data)
  • Article
  • Open Access
19 Citations
4,829 Views
20 Pages

23 December 2021

The rising use of online media has changed the social customs of the public. Users have become accustomed to sharing daily experiences and publishing personal opinions on social networks. Social data carrying emotion and attitude has provided signifi...

(This article belongs to the Section Sensor Networks)
  • Article
  • Open Access
742 Views
29 Pages

CMYD-SurfaceNet: Scale-Aware Cascaded Multimodal MRI Segmentation via Representation-Level Structural Decoupling and Boundary-Constrained Learning

  • Chaymae El Mechal,
  • Mostefa Mesbah,
  • Loubna Mazgouti,
  • Fatima Zahra Ammor and
  • Najiba El Amrani El Idrissi

16 June 2026

Reliable delineation of brain tumor boundaries in multimodal magnetic resonance imaging (MRI) remains challenging despite substantial advances in deep learning–based segmentation. Although modern encoder–decoder architectures achieve stro...

(This article belongs to the Topic Artificial Intelligence Models, Tools and Applications: 2nd Edition)
  • Article
  • Open Access
1,107 Views
16 Pages

18 December 2025

Multimodal emotion recognition (MER) often relies on single-scale representations that fail to capture the hierarchical structure of emotional signals. This paper proposes a Dual Routing Mixture-of-Experts (MoE) model that dynamically selects between...

(This article belongs to the Special Issue Artificial Intelligence and Advanced Signal Processing Techniques and Their Applications)
  • Article
  • Open Access
4 Citations
3,634 Views
16 Pages

14 September 2023

With the development of multimedia systems in wireless environments, the rising need for artificial intelligence is to design a system that can properly communicate with humans with a comprehensive understanding of various types of information in a h...

(This article belongs to the Special Issue Next-Generation Wireless Systems for the Internet of Things (IoT))
  • Review
  • Open Access
2 Citations
792 Views
38 Pages

20 August 2026

Artificial intelligence has emerged as a promising paradigm for advancing the screening, diagnosis support, and monitoring of autism spectrum disorder (ASD) through scalable and data-driven clinical augmentation. Recent advances in machine learning,...

(This article belongs to the Section Information Processes)
  • Article
  • Open Access
4 Citations
1,626 Views
19 Pages

7 April 2025

Given that rotating machinery is one of the most commonly used types of mechanical equipment in industrial applications, the identification of its health status is crucial for the safe operation of the entire system. Traditional equipment health stat...

  • Article
  • Open Access
1,905 Views
33 Pages

Autism classification is challenging due to the subtle, heterogeneous, and overlapping neural activation profiles that occur in individuals with autism. Novel deep learning approaches, such as Convolutional Neural Networks (CNNs) and their variants,...

(This article belongs to the Section Medical Imaging)
  • Article
  • Open Access
235 Views
22 Pages

10 October 2026

Driven by the advancement of intelligent security, person re-identification has evolved from single-modality imagery to complex multimodal tasks involving infrared, text, sketches, and paintings. However, most existing methods are restricted to fixed...

(This article belongs to the Section Intelligent Sensors)

of 35