Skip to Content

141 Results Found

  • Article
  • Open Access
8 Citations
2,516 Views
18 Pages

Lightweight RepVGG-Based Cross-Modality Data Prediction Method for Solid Rocket Motors

  • Huixin Yang,
  • Shangshang Zheng,
  • Xu Wang,
  • Mingze Xu and
  • Xiang Li

14 November 2023

Solid rocket motors (SRMs) have been popularly used in the current aerospace industry. Performance indicators, such as pressure and thrust, are of great importance for rocket monitoring and design. However, the measurement of such signals requires hi...

(This article belongs to the Section Physical Sensors)
  • Communication
  • Open Access
17 Citations
5,808 Views
14 Pages

CMBF: Cross-Modal-Based Fusion Recommendation Algorithm

  • Xi Chen,
  • Yangsiyi Lu,
  • Yuehai Wang and
  • Jianyi Yang

4 August 2021

A recommendation system is often used to recommend items that may be of interest to users. One of the main challenges is that the scarcity of actual interaction data between users and items restricts the performance of recommendation systems. To solv...

(This article belongs to the Section Sensing and Imaging)
  • Feature Paper
  • Article
  • Open Access
34 Citations
7,186 Views
30 Pages

27 March 2025

Multimodal emotion recognition involves leveraging complementary relationships across modalities to enhance the assessment of human emotions. Networks that integrate diverse information sources outperform single-modal approaches while offering greate...

(This article belongs to the Section E1: Mathematics and Computer Science)
  • Article
  • Open Access
3 Citations
2,477 Views
20 Pages

With the rapid development of mobile internet technology, the explosive growth of image–text multimodal data generated by social networking platforms has provided rich practical scenarios and theoretical research value for multimodal sentiment...

  • Article
  • Open Access
8 Citations
3,120 Views
12 Pages

In the field of cognitive workload assessment for aerospace training, existing methods exhibit significant limitations in unimodal feature extraction and in leveraging complementary synergy among multimodal signals, while current fusion paradigms str...

(This article belongs to the Special Issue Human-AI Collaborative Interaction Design: Rethinking Human-Computer Symbiosis in the Age of Intelligent Systems)
  • Article
  • Open Access
9 Citations
4,020 Views
14 Pages

21 December 2023

The ability to translate Generative Adversarial Networks (GANs) and Variational Autoencoders (VAEs) into different modalities and data types is essential to improve Deep Learning (DL) for predictive medicine. This work presents DACMVA, a novel framew...

(This article belongs to the Section Biomedical Information and Health)
  • Article
  • Open Access
5 Citations
2,096 Views
17 Pages

Background: Accurate and early diagnosis of autism spectrum disorder (ASD) is essential for timely intervention. Structural magnetic resonance imaging (sMRI) and functional magnetic resonance imaging (fMRI) provide complementary insights into brain s...

(This article belongs to the Special Issue Progress in Neurodevelopmental Disorders Research)
  • Article
  • Open Access
3 Citations
1,742 Views
26 Pages

EAR-CCPM-Net: A Cross-Modal Collaborative Perception Network for Early Accident Risk Prediction

  • Wei Sun,
  • Lili Nurliyana Abdullah,
  • Fatimah Binti Khalid and
  • Puteri Suhaiza Binti Sulaiman

24 August 2025

Early traffic accident risk prediction in complex road environments poses significant challenges due to the heterogeneous nature and incomplete semantic alignment of multimodal data. To address this, we propose a novel Early Accident Risk Cross-modal...

  • Article
  • Open Access
542 Views
24 Pages

CogSent: Cognition-Driven Multimodal Sentiment Analysis Through Fast–Slow Thinking

  • Guoguo Ye,
  • Qiqi Chen,
  • Liqi Yan,
  • Zhexuan Li and ,
  • Fangli Guan,
  • Jianhui Zhang and
  • Pan Li
  • + 2 authors+ 0 author

Sentiment analysis of multimodal social media data is of great importance, not only for recognizing objective information but also for capturing subjective emotional states. While single-modal sentiment analysis has achieved notable progress, existin...

(This article belongs to the Special Issue Sentiment Analysis in the Context of Big Data)
  • Article
  • Open Access
261 Views
30 Pages

9 October 2026

Unpaired single-cell gene expression and chromatin accessibility data lack the cell-level correspondence needed to directly link measurements across modalities. We present scAICT, a two-stage framework that infers this correspondence through integrat...

(This article belongs to the Section Bioinformatics)
  • Article
  • Open Access
659 Views
21 Pages

MFD-DF: A PM2.5 Concentration Prediction Method Based on Multimodal Feature Decomposition and Dynamic Fusion

  • Chen Song,
  • Quanbo Long,
  • Zhaobo Su,
  • Yanchao Jiang and ,
  • Li Wan,
  • Xiankun Zhang,
  • Tiantian Lv,
  • Wenhu Hao and
  • Zuxuan Shi
  • + 4 authors+ 0 author

18 June 2026

Accurate air pollutant concentration prediction is crucial for public health and sustainable urban development. Existing methods predominantly rely on single-modal data, resulting in inadequate representation of pollutant spatiotemporal evolution, po...

(This article belongs to the Section Air Quality)
  • Article
  • Open Access
176 Views
23 Pages

29 October 2026

Stock movement prediction remains challenging because financial time series are nonstationary, noisy, and interdependent across heterogeneous information sources. Conventional multimodal forecasting methods often integrate price, text, and inter-firm...

(This article belongs to the Special Issue Applied Mathematics in Financial Markets and Risk Analysis)
  • Article
  • Open Access
1 Citations
1,956 Views
24 Pages

An Optical–SAR Remote Sensing Image Automatic Registration Model Based on Multi-Constraint Optimization

  • Yaqi Zhang,
  • Shengbo Chen,
  • Xitong Xu,
  • Jiaqi Yang and ,
  • Yuqiao Suo,
  • Jinchen Zhu,
  • Menghan Wu,
  • Aonan Zhang and
  • Qiqi Li
  • + 4 authors+ 0 author

19 January 2026

Accurate registration of optical and synthetic aperture radar (SAR) images is a fundamental prerequisite for multi-source remote sensing data fusion and analysis. However, due to the substantial differences in imaging mechanisms, optical–SAR im...

(This article belongs to the Section Remote Sensing Image Processing)
  • Article
  • Open Access
9 Citations
3,161 Views
24 Pages

25 August 2023

Detecting anomalies in data streams from smart communication environments is a challenging problem that can benefit from novel learning techniques. The Attention Mechanism is a very promising architecture for addressing this problem. It allows the mo...

(This article belongs to the Special Issue Advances in Cybersecurity: Challenges and Solutions)
  • Article
  • Open Access
1 Citations
985 Views
19 Pages

24 December 2025

Emotion matching prediction between music and video segments is essential for intelligent mobile sensing systems, where multimodal affective cues collected from smart devices must be jointly analyzed for context-aware media understanding. However, tr...

(This article belongs to the Special Issue Recent Advances in Smart Mobile Sensing Technology)
  • Article
  • Open Access
154 Views
18 Pages

An Uncertainty-Aware Cross-Modal Fusion Network for Domain Generalization in Mechanical Fault Diagnosis

  • He Ren,
  • Manman Bian,
  • Weifeng Lian,
  • Chaoyang Wu and ,
  • Qiuyu Song and
  • Yi Zhang
  • + 1 author+ 0 author

2 November 2026

Condition monitoring of modern industrial machinery increasingly relies on data-driven deep learning methods. However, domain shifts caused by dynamic working conditions often lead to substantial accuracy degradation in unseen target domains. Single-...

(This article belongs to the Section Machines Testing and Maintenance)
  • Article
  • Open Access
1 Citations
1,250 Views
24 Pages

25 December 2025

In froth flotation, the features of froth images are important information to predict the concentrate grade. However, the froth structure is influenced by multiple factors, such as air flowrate, slurry level, ore properties, reagents, etc., which lea...

(This article belongs to the Special Issue Deep Learning for Perception and Recognition Based on Sensor Data: Methods and Applications, 2nd Edition)
  • Article
  • Open Access
547 Views
24 Pages

14 October 2026

Objective: The aim of this study was to determine whether smartphone- and intraoral camera-derived CIELAB parameters reproduce spectrophotometric colour variation across ICDAS defined occlusal caries severity, agree with spectrophotometric measuremen...

(This article belongs to the Collection Digital Dentistry: State of the Art and Future Perspectives)
  • Article
  • Open Access
15 Citations
3,020 Views
15 Pages

Aiming at addressing the problem of insufficient fusion of multi-source heterogeneous features in short-term power load forecasting, this paper proposes a three-channel LSTM-CNN hybrid forecasting model. This method extracts the temporal characterist...

  • Article
  • Open Access
423 Views
18 Pages

Source-free domain adaptation (SFDA) for cross-modality prostate MRI segmentation is challenging because source data are unavailable and pseudo-labels on target ADC images are often noisy. To address this problem, we propose Curriculum Anatomy-guided...

(This article belongs to the Section Biomedical Information and Health)
  • Article
  • Open Access
14 Citations
2,161 Views
15 Pages

Remaining Useful Life (RUL) prediction is crucial for optimizing predictive maintenance and resource management in industrial machinery. However, existing methods struggle with rigid spatiotemporal feature fusion, difficulty in capturing long-term de...

(This article belongs to the Special Issue Data Science in Prognostics and Health Management of Industrial Equipment)
  • Article
  • Open Access
971 Views
24 Pages

Against the global carbon neutrality target, predictive maintenance (PdM) of automotive engines represents a core technical strategy to advance the sustainable development of the automotive industry. Conventional single-modal diagnostic approaches fo...

  • Article
  • Open Access
3 Citations
2,429 Views
19 Pages

27 May 2025

Multimodal amed entity recognition (MNER) is a natural language-processing technique that integrates text and visual modalities to detect and segment entity boundaries and their types from unstructured multimodal data. Although existing methods allev...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
21 Citations
4,211 Views
14 Pages

30 June 2025

Crop diseases pose a significant threat to agricultural productivity and global food security. Timely and accurate disease identification is crucial for improving crop yield and quality. While most existing deep learning-based methods focus primarily...

(This article belongs to the Section Smart Agriculture)
  • Article
  • Open Access
2 Citations
1,432 Views
30 Pages

Artificial Intelligence-Driven Multimodal Sensor Fusion for Complex Market Systems via Federated Transformer-Based Learning

  • Lei Shi,
  • Mingran Tian,
  • Yinfei Yi,
  • Xinyi Hu and ,
  • Xiaoya Wang,
  • Yating Yang and
  • Manzhou Li
  • + 2 authors+ 0 author

15 April 2026

In highly digitalized and networked modern trading systems, large volumes of heterogeneous data are continuously generated from multiple sources during market operations. However, due to the complexity of data structures, significant differences in t...

(This article belongs to the Special Issue Artificial Intelligence-Driven Sensing)
  • Article
  • Open Access
1 Citations
1,839 Views
33 Pages

16 September 2025

This study conducted field experiments in 2024 in Meidaizhao Town, Tumed Right Banner, Baotou City, Inner Mongolia Autonomous Region, adopting a plant-level sampling design with 10 maize plots selected as sampling areas (20 plants per plot). At four...

(This article belongs to the Section Precision and Digital Agriculture)
  • Article
  • Open Access
674 Views
18 Pages

CAEP: Cross-Modal Adaptive Embedding Prediction for Self-Supervised Modulation Classification

  • Yuanfeng Wu,
  • Yuhang Hong,
  • Zuqi Ma,
  • Ao Wu and ,
  • Xiang Huang,
  • Mengfan Xue and
  • Shuyuan Yang
  • + 2 authors+ 0 author

Although self-supervised learning methods have shown promising progress in addressing the issue of scarce labeled data in automatic modulation classification, they remain constrained by heavy reliance on extensive negative samples and an inability to...

  • Article
  • Open Access
7 Citations
6,508 Views
23 Pages

TS-HTFA: Advancing Time-Series Forecasting via Hierarchical Text-Free Alignment with Large Language Models

  • Pengfei Wang,
  • Huanran Zheng,
  • Qi’ao Xu,
  • Silong Dai and ,
  • Yiqiao Wang,
  • Wenjing Yue,
  • Wei Zhu,
  • Tianwen Qian and
  • Liang Zhao
  • + 4 authors+ 0 author

7 March 2025

Given the significant potential of large language models (LLMs) in sequence modeling, emerging studies have begun applying them to time-series forecasting. Despite notable progress, existing methods still face two critical challenges: (1) their relia...

(This article belongs to the Section A: Computer Science)
  • Article
  • Open Access
3 Citations
2,557 Views
28 Pages

Effective website usability assessment is crucial for improving user experience, driving customer satisfaction, and ensuring business success, particularly in the competitive e-commerce sector. Traditional methods, such as expert reviews and user tes...

  • Article
  • Open Access
10 Citations
2,340 Views
34 Pages

11 February 2026

The increasing deployment of uncrewed aerial vehicles (UAVs) in cyber-physical and safety-critical missions has amplified the need for intrusion detection systems that are accurate, privacy-preserving, and resilient to adversarial manipulation. In th...

(This article belongs to the Section Artificial Intelligence in Drones (AID))
  • Article
  • Open Access
673 Views
26 Pages

Audio-visual deepfake detection remains challenging under cross-dataset distribution shift, especially when the source-domain training data are severely imbalanced. Existing middle-fusion detectors often rely on softmax-based cross-attention, which c...

(This article belongs to the Special Issue Cybersecurity and Resilience in IoT and Distributed Networks (Including AI‑Enabled Approaches))
  • Article
  • Open Access
503 Views
32 Pages

Asynchronous Cross-Modal Dynamic Graph Learning for Intelligent Sensing of AI Computing Infrastructure Expansion

  • Zhe Xiang,
  • Shangshan Chen,
  • Xinrui Hu,
  • Xu Xu and ,
  • Yang Yang,
  • Jingyi Yang and
  • Yan Zhan
  • + 2 authors+ 0 author

3 August 2026

The rapid expansion of artificial intelligence computing infrastructure and the semiconductor industry has made the dynamic sensing of policy planning, technological innovation, capital investment, and physical construction essential for industrial m...

(This article belongs to the Special Issue Artificial Intelligence-Driven Sensing)
  • Article
  • Open Access
207 Views
16 Pages

FusionEP: Adaptive Cross-Modal Deep Fusion Network for Essential Protein Identification via Multi-Omics Integration and Contrastive Learning

  • Chuanyan Wu,
  • Bentao Lin,
  • Qingju Zhang,
  • Jialin Zhang and ,
  • Rui Gao and
  • Zhi-Ping Liu
  • + 1 author+ 0 author

13 October 2026

Identifying essential proteins lays a foundation for dissecting disease mechanisms and mining therapeutic targets. Existing algorithms mostly adopt unimodal inputs and struggle to capture multi-level biological interactions from genomics, subcellular...

(This article belongs to the Section Entropy and Biology)
  • Article
  • Open Access
916 Views
32 Pages

DIGSFNet: Deformation-Integrity-Guided Symmetric Fusion Network for High-Risk Landslide Extraction from Multi-Source Remote Sensing Images

  • Zixuan Ni,
  • Lieyun Hu,
  • Huini Wang,
  • Fengxiaoxiao Li and ,
  • Meng Tang,
  • Guorui Ma and
  • Haigang Sui
  • + 2 authors+ 0 author

11 August 2026

High-risk landslide extraction from remote sensing imagery is a fundamental task for geological disaster prevention, emergency response, and land-use planning in mountainous regions. Although deep-learning semantic segmentation has substantially adva...

(This article belongs to the Special Issue Advances in SAR Remote Sensing for Landslide Monitoring and Hazard Assessment)
  • Article
  • Open Access
8 Citations
3,243 Views
19 Pages

MIFM: Multimodal Information Fusion Model for Educational Exercises

  • Jianfeng Song,
  • Hui Chen,
  • Chuan Li and
  • Kun Xie

16 September 2023

Educational exercises are crucial factors in the successful implementation of online education as they play a key role in assessing students’ learning and supporting teachers in instruction. These exercises encompass two primary types of data:...

(This article belongs to the Section Artificial Intelligence)
  • Article
  • Open Access
22 Citations
12,115 Views
19 Pages

MM-iTransformer: A Multimodal Approach to Economic Time Series Forecasting with Textual Data

  • Shangyang Mou,
  • Qiang Xue,
  • Jinhui Chen,
  • Tetsuya Takiguchi and
  • Yasuo Ariki

25 January 2025

This paper introduces a novel multimodal framework for economic time series forecasting, integrating textual information with historical price data to enhance predictive accuracy. The proposed method employs a multi-head attention mechanism to dynami...

  • Review
  • Open Access
19 Citations
6,916 Views
28 Pages

AI-Driven Transcriptome Prediction in Human Pathology: From Molecular Insights to Clinical Applications

  • Xiaoya Chen,
  • Huinan Xu,
  • Shengjie Yu,
  • Wan Hu and ,
  • Zhongjin Zhang,
  • Xue Wang,
  • Yue Yuan,
  • Mingyue Wang,
  • Liang Chen and
  • Pengfei Cai
  • + 7 authors+ 2 authors

4 June 2025

Gene expression regulation underpins cellular function and disease progression, yet its complexity and the limitations of conventional detection methods hinder clinical translation. In this review, we define “predict” as the AI-driven inf...

(This article belongs to the Section Genetics and Genomics)
  • Article
  • Open Access
1 Citations
757 Views
25 Pages

18 April 2026

Intensive care units (ICUs) generate heterogeneous data streams, including structured electronic health records, physiological time series, and medical imaging, that describe the same patient state through different observational forms. Effective mul...

(This article belongs to the Special Issue Symmetry and Asymmetry in Machine Learning and Data Mining)
  • Article
  • Open Access
258 Views
19 Pages

6 October 2026

Osteosarcoma is an aggressive bone malignancy in children and adolescents, where early and accurate classification is essential for improving clinical outcomes. While deep learning methods have shown promising results in medical image analysis, most...

(This article belongs to the Section Medical Imaging)
  • Article
  • Open Access
3,720 Views
16 Pages

31 December 2022

Link prediction aims at predicting missing or potential links based on the known information of complex networks. Most existing methods focus on pairwise low-order relationships while ignoring the high-order interaction and the rich attribute informa...

(This article belongs to the Section Complexity)
  • Article
  • Open Access
14 Citations
4,486 Views
20 Pages

Text-Centric Multimodal Contrastive Learning for Sentiment Analysis

  • Heng Peng,
  • Xue Gu,
  • Jian Li,
  • Zhaodan Wang and
  • Hao Xu

Multimodal sentiment analysis aims to acquire and integrate sentimental cues from different modalities to identify the sentiment expressed in multimodal data. Despite the widespread adoption of pre-trained language models in recent years to enhance m...

(This article belongs to the Special Issue Multimodal Data Fusion and Computational Optimization for Intelligent Perception)
  • Article
  • Open Access
22 Citations
4,866 Views
16 Pages

19 April 2025

The clinical diagnosis of Parkinson’s disease (PD) primarily relies on clinician-administered observational assessment tools, such as the Unified Parkinson’s Disease Rating Scale (UPDRS). However, these approaches are significantly influe...

(This article belongs to the Section Biomedical Engineering)
  • Review
  • Open Access
7 Citations
3,720 Views
22 Pages

Biological Sequence Representation Methods and Recent Advances: A Review

  • Hongwei Zhang,
  • Yan Shi,
  • Yapeng Wang,
  • Xu Yang and ,
  • Kefeng Li,
  • Sio-Kei Im and
  • Yu Han
  • + 2 authors+ 0 author

27 August 2025

Biological-sequence representation methods are pivotal for advancing machine learning in computational biology, transforming nucleotide and protein sequences into formats that enhance predictive modeling and downstream task performance. This review c...

(This article belongs to the Special Issue Machine Learning Applications in Biology—2nd Edition)
  • Article
  • Open Access
2 Citations
773 Views
31 Pages

Multimodal Deep Learning for Pest and Disease Recognition and Crop Growth Assessment in Open-Field Agricultural Environments

  • Jiayu Xiang,
  • Jianxiang Pan,
  • Hanwen Zhang,
  • Xuekun Liu and ,
  • Boxiu Liu,
  • Jieling Tian and
  • Shuo Yan
  • + 2 authors+ 0 author

Against the backdrop of the rapid development of smart agriculture, pest and disease monitoring and crop growth assessment for large-scale farmlands are of substantial importance for precision management and risk early warning. However, traditional u...

(This article belongs to the Section Artificial Intelligence and Digital Agriculture)
  • Article
  • Open Access
2 Citations
1,207 Views
33 Pages

12 March 2026

Emotions and affective responses are core intervention targets in music therapy. Through acoustic elements, music can evoke emotional responses at physiological and neurological levels, influencing cognition and behavior while providing an important...

(This article belongs to the Section A: Computer Science)
  • Article
  • Open Access
10 Citations
2,984 Views
17 Pages

18 May 2022

Sound event localization and detection (SELD) is a joint task that unifies sound event detection (SED) and direction-of-arrival estimation (DOAE). The task has become such a popular topic that it was introduced into the challenge on Detection and Cla...

(This article belongs to the Section Acoustics and Vibrations)
  • Article
  • Open Access
3 Citations
2,089 Views
15 Pages

Abdominal organ segmentation in CT images is crucial for accurate diagnosis, treatment planning, and condition monitoring. However, the annotation process is often hindered by challenges such as low contrast, artifacts, and complex organ structures....

  • Article
  • Open Access
2 Citations
788 Views
33 Pages

A Genomics-Guided Multimodal Contrastive Learning Framework for Clinically Significant Prostate Cancer Risk Stratification with Missing Clinical Data

  • Abdullah,
  • Muhammad Shahid,
  • Muhammad Ateeb Ather,
  • Zulaikha Fatima and ,
  • Carlos Guzmán Sánchez Mejorada,
  • Miguel Jesús Torres Ruiz,
  • Rolando Quintero Téllez,
  • Miguel Félix Mata-Rivera and
  • Roberto Zagal-Flores
  • + 4 authors+ 0 author

16 June 2026

Background: Heterogeneous data integration remains a major challenge in intelligent information systems, particularly under missing-modality and cross-domain conditions. Existing multimodal fusion approaches often rely on complete datasets and weak a...

(This article belongs to the Section Molecular Cancer Biology)
  • Article
  • Open Access
491 Views
17 Pages

3 July 2026

Global public safety is increasingly threatened by frequent road traffic accidents, making early accident risk prediction essential for intelligent transportation systems. However, incomplete multimodal data and insufficient spatiotemporal modeling l...

  • Article
  • Open Access
1 Citations
1,828 Views
31 Pages

27 October 2025

Event cameras provide microsecond temporal resolution, high dynamic range, and low latency by asynchronously capturing per-pixel luminance changes, thereby introducing a novel sensing paradigm. These advantages render them well-suited for high-speed...

(This article belongs to the Section Image and Video Processing)

of 3