Skip to Content

333 Results Found

  • Article
  • Open Access
11 Citations
5,759 Views
21 Pages

22 June 2024

Image–text multimodal deep semantic segmentation leverages the fusion and alignment of image and text information and provides more prior knowledge for segmentation tasks. It is worth exploring image–text multimodal semantic segmentation...

(This article belongs to the Special Issue Image Processing from Aerial and Satellite Imagery)
  • Article
  • Open Access
522 Views
47 Pages

4 August 2026

Demand forecasting for emergency supplies is critical for public health emergency response, but demand sequences are strongly affected by external factors such as epidemic progression, traffic control, medical resource adjustments, and weather condit...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
3 Citations
843 Views
25 Pages

AI-Driven Sensing for Cross-Lingual Risk Prediction via Semantic Alignment and Multimodal Temporal Fusion

  • Yida Zhang,
  • Ceteng Fu,
  • Xi Wang,
  • Yiheng Zhang and ,
  • Ziyu Xiong,
  • Jingjin Pan and
  • Jinghui Yin
  • + 2 authors+ 0 author

10 April 2026

In the context of highly interconnected global markets and the rapid dissemination of multilingual information, traditional risk prediction methods that rely on single numerical sequences or monolingual text are insufficient for achieving early perce...

  • Article
  • Open Access
6 Citations
1,442 Views
26 Pages

17 November 2025

With the proliferation of social media platforms, misinformation has evolved toward more diverse modalities and complex cross-semantic correlations. Accurately detecting such content, particularly under conditions of semantic inconsistency and uneven...

(This article belongs to the Special Issue Advances in Biological and Bio-Inspired Algorithms)
  • Article
  • Open Access
254 Views
30 Pages

26 October 2026

Multimodal entity alignment identifies equivalent entities referring to the same real-world object across heterogeneous multimodal knowledge graphs and is essential for multi-source knowledge integration. Existing methods often rely on manually label...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
351 Views
57 Pages

Multimodal Knowledge Graphs (MMKGs) offer a promising paradigm for integrating heterogeneous sources into a unified, queryable, semantically structured representation. However, existing MMKG construction pipelines remain predominantly text-centric, e...

  • Article
  • Open Access
1 Citations
944 Views
21 Pages

AttriMOT: Semantic-Aware Multimodal 3D Multi-Object Tracking with Attribute-Level Alignment

  • Youlin Liu,
  • Mohammad Faidzul Nasrudin and
  • Zainal Rasyid Mahayuddin

26 May 2026

3D multi-object tracking (MOT) in complex and dynamic environments remains challenging due to the time-varying reliability of sensor modalities, severe occlusions, and the difficulty of distinguishing instances with similar appearances. Existing meth...

(This article belongs to the Section A: Computer Science)
  • Article
  • Open Access
1 Citations
2,971 Views
20 Pages

Under the growing demand for processing multimodal and cross-lingual information, traditional retrieval systems have encountered substantial limitations when handling heterogeneous inputs such as images, textual layouts, and multilingual language exp...

(This article belongs to the Section Artificial Intelligence)
  • Article
  • Open Access
3 Citations
2,429 Views
19 Pages

27 May 2025

Multimodal amed entity recognition (MNER) is a natural language-processing technique that integrates text and visual modalities to detect and segment entity boundaries and their types from unstructured multimodal data. Although existing methods allev...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
1,072 Views
17 Pages

Recent vision-language pre-training models, like CLIP, have been shown to generalize well across a variety of multitask modalities. Nonetheless, their generalization for downstream tasks is limited. As a lightweight adaptation approach, prompt learni...

  • Article
  • Open Access
1,070 Views
31 Pages

4 May 2026

Multimodal sentiment analysis aims to infer sentiment polarity by jointly modeling textual and visual information. Despite recent advances in pretrained language and vision encoders, sentiment prediction from social media posts remains challenging be...

  • Article
  • Open Access
4 Citations
3,434 Views
25 Pages

6 August 2025

Multimodal sentiment analysis (MSA) benefits from integrating diverse modalities (e.g., text, video, and audio). However, challenges remain in effectively aligning non-text features and mitigating redundant information, which may limit potential perf...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
2 Citations
2,239 Views
27 Pages

12 September 2025

In the era of big-data-driven multi-platform and multimodal health information dissemination, the rapid spread of false and misleading content poses a critical threat to public health awareness and decision making. To address this issue, a dual-strea...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
568 Views
23 Pages

Text-to-motion generation aims to synthesize realistic human motion sequences that accurately reflect natural language descriptions. While recent approaches have improved motion quality, achieving strong semantic alignment between text and motion, es...

(This article belongs to the Topic AI-Based Interactive and Immersive Systems)
  • Article
  • Open Access
3 Citations
1,310 Views
22 Pages

12 September 2025

Semantic segmentation of urban scenes from red–green–blue and thermal infrared imagery enables per-pixel categorization, delivering precise environmental understanding for autonomous driving and urban planning. However, existing methods s...

  • Article
  • Open Access
3 Citations
1,353 Views
24 Pages

Tree-Guided Transformer for Sensor-Based Ecological Image Feature Extraction and Multitarget Recognition in Agricultural Systems

  • Yiqiang Sun,
  • Zigang Huang,
  • Linfeng Yang,
  • Zihuan Wang and ,
  • Mingzhuo Ruan,
  • Jingchao Suo and
  • Shuo Yan
  • + 2 authors+ 0 author

7 October 2025

Farmland ecosystems present complex pest–predator co-occurrence patterns, posing significant challenges for image-based multitarget recognition and ecological modeling in sensor-driven computer vision tasks. To address these issues, this study...

(This article belongs to the Special Issue Image Feature Extraction for Computer Vision Tasks in Sensor Systems and Applications)
  • Article
  • Open Access
557 Views
32 Pages

12 June 2026

Joint classification of hyperspectral images (HSI) and light detection and ranging (LiDAR) data is important for land-cover recognition, as it can exploit both spectral discrimination and structural elevation information. However, existing methods ma...

(This article belongs to the Special Issue Deep Learning for Multi-Sensor Remote Sensing: Advancements in Image Classification and Semantic Segmentation)
  • Article
  • Open Access
1 Citations
1,639 Views
23 Pages

LPDiag: LLM-Enhanced Multimodal Prototype Learning Framework for Intelligent Tomato Leaf Disease Diagnosis

  • Heng Dong,
  • Xuemei Qiu,
  • Dawei Fan,
  • Mingyue Han and ,
  • Jiaming Yu,
  • Changcai Yang,
  • Jinghu Li,
  • Ruijun Liu,
  • Riqing Chen and
  • Qiufeng Chen
  • + 5 authors+ 0 author

12 February 2026

Tomato leaf diseases exhibit subtle inter-class differences and substantial intra-class variability, making accurate identification challenging for conventional deep learning models, especially under real-world conditions with diverse lighting, occlu...

(This article belongs to the Section Artificial Intelligence and Digital Agriculture)
  • Article
  • Open Access
526 Views
28 Pages

20 August 2026

Optical–elevation data fusion is widely used in aerial remote sensing semantic segmentation, as optical imagery provides rich spectral and textural information, while DSM or DEM data offer complementary elevation-related structural cues. Howeve...

(This article belongs to the Section Remote Sensing Image Processing)
  • Article
  • Open Access
6 Citations
2,447 Views
20 Pages

21 January 2026

Recent advances in Large Vision–Language Models (LVLMs) have demonstrated strong cross-modal reasoning capabilities, offering new opportunities for decision-making in autonomous driving. However, existing end-to-end approaches still suffer from...

(This article belongs to the Special Issue Control and Path Planning for Autonomous Vehicles)
  • Article
  • Open Access
1 Citations
2,305 Views
13 Pages

1 October 2022

Entity alignment is used to determine whether entities from different sources refer to the same object in the real world. It is one of the key technologies for constructing large-scale knowledge graphs and is widely used in the fields of knowledge gr...

  • Article
  • Open Access
2 Citations
5,001 Views
20 Pages

VL-Few: Vision Language Alignment for Multimodal Few-Shot Meta Learning

  • Han Ma,
  • Baoyu Fan,
  • Benjamin K. Ng and
  • Chan-Tong Lam

30 January 2024

Complex tasks in the real world involve different modal models, such as visual question answering (VQA). However, traditional multimodal learning requires a large amount of aligned data, such as image text pairs, and constructing a large amount of tr...

(This article belongs to the Special Issue Natural Language Processing (NLP) and Applications—2nd Edition)
  • Article
  • Open Access
792 Views
24 Pages

VSGN: Visual–Semantic Guided Interaction Network for Multimodal Named Entity Recognition

  • Jianjun Yao,
  • Zhikun Zhou,
  • Ruisheng Li,
  • Jiaming Zhang and
  • Zhiwei Qi

29 April 2026

Multimodal Named Entity Recognition (MNER) aims to integrate textual and visual information to identify entities with specific semantic categories. However, existing methods often suffer from insufficient intra-modal semantic modeling, coarse cross-m...

(This article belongs to the Section A: Computer Science)
  • Article
  • Open Access
2 Citations
2,639 Views
14 Pages

8 December 2024

To improve the accuracy and reliability of LiDAR semantic segmentation, previous studies have introduced multi-modal approaches that utilize additional modalities, such as 2D RGB images, to provide complementary information. However, these methods in...

(This article belongs to the Section Sensing and Imaging)
  • Article
  • Open Access
3 Citations
3,086 Views
17 Pages

Fusion-Optimized Multimodal Entity Alignment with Textual Descriptions

  • Chenchen Wang,
  • Chaomurilige,
  • Yu Weng,
  • Xuan Liu and
  • Zheng Liu

24 June 2025

Multimodal knowledge graph entity alignment is a key basic task of knowledge fusion and integration, which is used to identify entities with semantic equivalent but different representation forms in different knowledge graphs. Previous entity alignme...

(This article belongs to the Section Artificial Intelligence)
  • Article
  • Open Access
5 Citations
2,612 Views
22 Pages

17 April 2025

The rapid development of social media has driven the need for opinion mining and sentiment analysis based on multimodal samples. As a fine-grained task within multimodal sentiment analysis, aspect-based multimodal sentiment analysis (ABMSA) enables t...

(This article belongs to the Special Issue Advanced Signal Processing for Affective Computing)
  • Article
  • Open Access
2 Citations
2,022 Views
23 Pages

9 January 2026

Remote sensing image semantic segmentation (RSISS) aims to assign a correct class label to each pixel in remote sensing images and has wide applications. With the development of artificial intelligence, RSISS based on deep learning has made significa...

  • Article
  • Open Access
3 Citations
2,394 Views
18 Pages

26 November 2024

Video-based pedestrian re-identification (Re-ID) is used to re-identify the same person across different camera views. One of the key problems is to learn an effective representation for the pedestrian from video. However, it is difficult to learn an...

(This article belongs to the Special Issue Sensor-Based Behavioral Biometrics)
  • Article
  • Open Access
1,124 Views
19 Pages

Multimodal Arabic sentiment analysis has gained increasing attention due to the growing volume of user-generated multimedia content. However, effectively integrating textual, acoustic, and visual modalities remains challenging because of modality imb...

(This article belongs to the Section Learning)
  • Article
  • Open Access
607 Views
34 Pages

CMEpiNet: Complex-Valued Multimodal Epilepsy Detection Network Model

  • Tianyi Su,
  • Haiyan Zhu,
  • Shuai Chen and
  • Haifeng Wang

2 July 2026

Existing seizure detection methods cannot fully exploit the spatiotemporal features of multimodal signals. They also fail to capture deep associations among cross-modal features. This limits their ability to learn unified representations of spatiotem...

(This article belongs to the Special Issue Machine Learning in Biomedical Signal Processing)
  • Article
  • Open Access
393 Views
22 Pages

30 September 2026

Multimodal large language models and diffusion transformers have made text-to-video generation accessible to film production, advertising and social-media editing, but the assessment of generated video aesthetics remains poorly aligned with how viewe...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
3 Citations
4,253 Views
17 Pages

4 May 2023

Multi-modal deep learning methods have achieved great improvements in visual grounding; their objective is to localize text-specified objects in images. Most of the existing methods can localize and classify objects with significant appearance differ...

(This article belongs to the Special Issue Big Data Analysis and Management Based on Deep Learning)
  • Feature Paper
  • Article
  • Open Access
3 Citations
1,590 Views
23 Pages

24 May 2025

The rapid growth of social media and online information-sharing platforms facilitates the spread of rumors. Accurate rumor detection to minimize manual verification efforts remains a critical research challenge. While multimodal rumor detection lever...

  • Article
  • Open Access
8 Citations
2,041 Views
25 Pages

24 May 2025

Domain shifts pose significant challenges for cross-domain semantic segmentation in high-resolution remote sensing imagery. Inspired by the cognitive mechanisms of the human brain, we propose a Brain-Inspired Style Transfer and Semantic Segmentation...

  • Article
  • Open Access
373 Views
28 Pages

Multimodal Sequential recommendation alleviates the semantic insufficiency and data sparsity of item-ID-based models by incorporating side information such as text and images. However, multimodal systems face the dual challenges of feature-space hete...

(This article belongs to the Section Artificial Intelligence and Multi-Agent Systems)
  • Article
  • Open Access
5 Citations
1,904 Views
24 Pages

An Enhanced Misinformation Detection Model Based on an Improved Beluga Whale Optimization Algorithm and Cross-Modal Feature Fusion

  • Guangyu Mu,
  • Xiaoqing Ju,
  • Hongduo Yan,
  • Jiaxue Li and ,
  • He Gao and
  • Xiurong Li
  • + 1 author+ 0 author

20 February 2025

The proliferation of multimodal misinformation on social media has become a critical concern. Although detection methods have advanced, feature representation and cross-modal semantic alignment challenges continue to hinder the effective use of multi...

(This article belongs to the Special Issue Nature-Inspired Metaheuristic Optimization Algorithms 2025)
  • Article
  • Open Access
2 Citations
1,734 Views
25 Pages

UMEAD: Unsupervised Multimodal Entity Alignment for Equipment Knowledge Graphs via Dual-Space Embedding

  • Siyu Zhu,
  • Qitao Tai,
  • Jingbo Wang,
  • Mingfei Tang and ,
  • Liang Wang,
  • Ning Li,
  • Shoulu Hou and
  • Xiulei Liu
  • + 3 authors+ 0 author

5 November 2025

The symmetry between different representation spaces plays a crucial role in effectively modeling complex multimodal data. To address the challenge of equipment knowledge graphs containing hierarchical relationships that cannot be fully represented i...

(This article belongs to the Special Issue Symmetry and Its Applications in Computer Vision)
  • Article
  • Open Access
483 Views
31 Pages

Image–Text Multimodal Sentiment Analysis with Large Model-Generated Descriptive Semantics and Difference-Aware Gated Fusion

  • Hengyuan Zhang,
  • Aizihaierjiang Yusufu,
  • Jiang Liu,
  • Abidan Ainiwaer and
  • Aizierguli Yusufu

15 August 2026

Image–text multimodal sentiment analysis aims to integrate textual and visual information to comprehensively understand sentiment expressions in complex scenarios. However, existing methods focus on cross-modal feature interaction and fusion, a...

  • Article
  • Open Access
6 Citations
3,638 Views
16 Pages

Multimodal Contrastive Learning for Remote Sensing Image Feature Extraction Based on Relaxed Positive Samples

  • Zhenshi Zhang,
  • Qiujun Li,
  • Wenxuan Jing,
  • Guangjun He and ,
  • Lili Zhu and
  • Shijuan Gao
  • + 1 author+ 0 author

3 December 2024

Traditional multimodal contrastive learning brings text and its corresponding image closer together as a positive pair, where the text typically consists of fixed sentence structures or specific descriptive statements, and the image features are gene...

(This article belongs to the Section Remote Sensors)
  • Article
  • Open Access
9 Citations
3,133 Views
17 Pages

Visual Description Augmented Integration Network for Multimodal Entity and Relation Extraction

  • Min Zuo,
  • Yingjun Wang,
  • Wei Dong,
  • Qingchuan Zhang and ,
  • Yuanyuan Cai and
  • Jianlei Kong
  • + 1 author+ 0 author

18 May 2023

Multimodal Named Entity Recognition (MNER) and multimodal Relationship Extraction (MRE) play an important role in processing multimodal data and understanding entity relationships across textual and visual domains. However, irrelevant image informati...

  • Article
  • Open Access
2,002 Views
23 Pages

14 August 2025

With the increasing content richness of social media platforms, Multimodal Named Entity Recognition (MNER) faces the dual challenges of heterogeneous feature fusion and accurate entity recognition. Aiming at the key problems of inconsistent distribut...

(This article belongs to the Section Algorithms for Multidisciplinary Applications)
  • Article
  • Open Access
3 Citations
2,405 Views
13 Pages

17 February 2025

Few-shot multimodal sentiment analysis (FMSA) has garnered substantial attention due to the proliferation of multimedia applications, especially given the frequent difficulty in obtaining large quantities of training samples. Previous works have dire...

(This article belongs to the Special Issue Recent Applications of Machine Learning in Natural Language Processing (NLP))
  • Article
  • Open Access
686 Views
16 Pages

Prompt-Guided Structured Multimodal NER with SVG and ChatGPT

  • Yuzhou Ma,
  • Haolong Qian,
  • Shujun Xia and
  • Wei Li

Multimodal named entity recognition (MNER) leverages both textual and visual information to improve entity recognition, particularly in unstructured scenarios such as social media. While existing approaches predominantly rely on raster images (e.g.,...

(This article belongs to the Section Artificial Intelligence)
  • Article
  • Open Access
82 Views
28 Pages

6 November 2026

Fine-grained Multimodal Named-Entity Recognition and Grounding (FMNERG) aims to extract entity–type–object triples from image–text pairs. However, existing methods still struggle with two major challenges: distinguishing semanticall...

(This article belongs to the Special Issue Multimodal Learning for Multimedia Content Analysis and Understanding, 2nd Edition)
  • Article
  • Open Access
571 Views
24 Pages

Background: Drug–drug interactions (DDIs) account for about 30% of adverse drug reactions and 5–10% of hospital deaths. Combination therapy increases DDI risks, yet extracting DDIs from biomedical text remains challenging: existing method...

(This article belongs to the Section Drug Discovery, Development and Delivery)
  • Article
  • Open Access
1 Citations
607 Views
31 Pages

Diffusion-based image super-resolution (SR) has recently achieved impressive perceptual quality by progressively generating plausible high-resolution details. However, its restoration performance still depends strongly on the reliability of the condi...

(This article belongs to the Special Issue Advanced Clustering and Data Mining: Deep Learning and Big Data Perspectives)
  • Article
  • Open Access
675 Views
27 Pages

Align and Fuse: A Transformer-Based Framework for EEG-Augmented Visual Recognition

  • Chao Zhang,
  • Youpeng Ma,
  • Mengting Li,
  • Xiangping Gao and
  • Xiaopei Wu

Background: Integrating human neural signals with computational vision systems offers a promising route toward more robust visual recognition, yet supporting mixed-granularity recognition, where both coarse- and fine-grained categories must be distin...

(This article belongs to the Section Computational Neuroscience, Neuroinformatics, and Neurocomputing)
  • Article
  • Open Access
3 Citations
2,145 Views
22 Pages

MFSM-Net: Multimodal Feature Fusion for the Semantic Segmentation of Urban-Scale Textured 3D Meshes

  • Xinjie Hao,
  • Jiahui Wang,
  • Wei Leng,
  • Rongting Zhang and
  • Guangyun Zhang

28 April 2025

The semantic segmentation of textured 3D meshes is a critical step in constructing city-scale realistic 3D models. Compared to colored point clouds, textured 3D meshes have the advantage of high-resolution texture image patches embedded on each mesh...

(This article belongs to the Special Issue Urban Planning Supported by Remote Sensing Technology II)
  • Article
  • Open Access
1,275 Views
21 Pages

OPICE: Ontology-Guided Pseudo-Label Generation and Inter-Modal Consistency Enhancement for Self-Supervised Multi-Modal Entity Alignment

  • Yingdi Wang,
  • Ziyu Guo,
  • Yongheng Mu,
  • Xuewei Li and ,
  • Lixu Shao,
  • Guangxu Mei and
  • Feng Li
  • + 2 authors+ 0 author

Multi-modal entity alignment (MMEA) identifies identical real-world entities across two multi-modal knowledge graphs. Most existing methods heavily rely on costly manually labeled seed alignments; in response, self-supervised MMEA has emerged to redu...

  • Article
  • Open Access
6 Citations
3,834 Views
16 Pages

23 May 2024

As a prominent topic in food computing, cross-modal recipe retrieval has garnered substantial attention. However, the semantic alignment across food images and recipes cannot be further enhanced due to the lack of intra-modal alignment in existing so...

(This article belongs to the Special Issue Applications of Artificial Intelligence in Food Industry)

of 7