Skip to Content

659 Results Found

  • Article
  • Open Access
1,989 Views
29 Pages

Enhancing Collaborative AI Learning: A Blockchain-Secured, Edge-Enabled Platform for Multimodal Education in IIoT Environments

  • Ahsan Rafiq,
  • Eduard Melnik,
  • Alexey Samoylov,
  • Alexander Kozlovskiy and
  • Irina Safronenkova

As industries deploy more connected devices in factories, warehouses, and smart facilities, the need for artificial intelligence (AI) systems that can operate securely in distributed, data-intensive environments is growing. Traditional centralized le...

  • Article
  • Open Access
2 Citations
1,510 Views
28 Pages

Multimodal Deep Learning Framework for Profiling Socio-Economic Indicators and Public Health Determinants in Urban Environments

  • Esaie Dufitimana,
  • Jean Pierre Bizimana,
  • Ernest Uwayezu,
  • Paterne Gahungu and
  • Emmy Mugisha

Urbanization significantly enhances socio-economic conditions, health, and well-being for many by improving access to services, education, and economic opportunities. However, socio-economic and public health disparities are also being exacerbated by...

(This article belongs to the Topic Geospatial AI: Systems, Model, Methods, and Applications)
  • Article
  • Open Access
14 Citations
5,248 Views
16 Pages

27 July 2023

Learning concentration, as a crucial factor influencing learning outcomes, provides the basis for learners’ self-regulation and teachers’ instructional adjustments and intervention decisions. However, the current research on learning conc...

  • Article
  • Open Access
13 Citations
4,710 Views
13 Pages

9 August 2020

Deep learning (DL) models have emerged in recent years as the state-of-the-art technique across numerous machine learning application domains. In particular, image processing-related tasks have seen a significant improvement in terms of performance d...

(This article belongs to the Section Internet of Things)
  • Proceeding Paper
  • Open Access
2 Citations
1,817 Views
5 Pages

Recreating Lunar Environments by Fusion of Multimodal Data Using Machine Learning Models

  • Ana C. Castillo,
  • Jesus A. Marroquin-Escobedo,
  • Santiago Gonzalez-Irigoyen,
  • Marlene Martinez-Santoyo and ,
  • Rafaela Villalpando-Hernandez and
  • Cesar Vargas-Rosales
  • + 1 author+ 0 author

1 November 2022

The latest satellite infrastructure for data processing, transmission and reception can certainly be improved by upgrading tools used to deal with very large amounts of data from every different sensor incorporated within the space missions. In order...

(This article belongs to the Proceedings of The 9th International Electronic Conference on Sensors and Applications)
  • Article
  • Open Access
324 Views
17 Pages

Teachers’ Digital Competence for Multimodal Learning Environments: A Comparative Study Across Educational Levels in Galicia (Spain)

  • Carmen Fernández-Morante,
  • Beatriz Cebreiro-López,
  • Antonio Palacios-Rodríguez and
  • Lorena Casal-Otero

The assessment of teachers’ digital competence has become a key challenge for educational systems seeking to foster effective multimodal, online, and blended learning environments. This study examines the level of self-perceived digital compete...

  • Article
  • Open Access
509 Views
20 Pages

3 August 2026

Unmanned mining trucks operate in harsh environments such as those in open-pit mines, where online fault diagnosis of critical drivetrain bearings faces severe challenges including slow response, high precision requirements, and strong interference f...

(This article belongs to the Section Fault Diagnosis & Sensors)
  • Article
  • Open Access
13 Citations
6,294 Views
20 Pages

Theories of embodied cognition argue that human processes of thinking and reasoning are deeply connected with the actions and perceptions of the body. Recent research suggests that these theories can be successfully applied to the design of learning...

(This article belongs to the Special Issue Multimodal Learning)
  • Article
  • Open Access
16 Citations
5,621 Views
26 Pages

Mobile Sensing with Smart Wearables of the Physical Context of Distance Learning Students to Consider Its Effects on Learning

  • George-Petru Ciordas-Hertel,
  • Sebastian Rödling,
  • Jan Schneider,
  • Daniele Di Mitri and ,
  • Joshua Weidlich and
  • Hendrik Drachsler
  • + 1 author+ 0 author

7 October 2021

Research shows that various contextual factors can have an impact on learning. Some of these factors can originate from the physical learning environment (PLE) in this regard. When learning from home, learners have to organize their PLE by themselves...

(This article belongs to the Special Issue From Sensor Data to Educational Insights)
  • Article
  • Open Access
518 Views
37 Pages

A Multi-Modal Deep Learning Framework for High-Resolution Alpine Land Use/Land Cover

  • Paolo Dabove,
  • Deepak Sairam Madhusudhana Rao,
  • Luca Olivotto,
  • Ludovico Pividori and ,
  • Gianluca Filippa and
  • Umberto Morra di Cella
  • + 1 author+ 0 author

17 September 2026

Accurate Land Use and Land Cover (LULC) mapping in high-resolution alpine environments is challenging due to complex terrain, heterogeneous vegetation, seasonal snow and ice cover, and the limited spectral information provided by conventional aerial...

(This article belongs to the Special Issue Remote Sensing of the Mountain Eco-Environment)
  • Article
  • Open Access
8 Citations
3,699 Views
27 Pages

23 June 2025

Chinese, a tonal language with inherent homophonic ambiguity, poses significant challenges for semantic disambiguation in natural language processing (NLP), hindering applications like speech recognition, dialog systems, and assistive technologies. T...

(This article belongs to the Special Issue Natural Language Processing (NLP) and Applications—2nd Edition)
  • Article
  • Open Access
2 Citations
972 Views
15 Pages

22 April 2026

Analyzing classroom engagement is essential for developing effective smart learning environments. Conventional methods often face challenges in achieving reliable identification of individual students, accurately recognizing their behavioral states,...

(This article belongs to the Section Electrical, Electronics and Communications Engineering)
  • Article
  • Open Access
3 Citations
1,373 Views
18 Pages

A Comparative Investigation of Study ROI: Multimodal Personalized English Learning Environment Versus Traditional English Learning Environment

  • Cunqian You,
  • Yang Wang,
  • Ping Li,
  • Xiaoyu Zhao and ,
  • Huijuan Lu,
  • Xiaojun Wang,
  • Yudong Yao and
  • Wenzhong Chen
  • + 3 authors+ 0 author

Limited study time constrains university EFL vocabulary learning, so efficiency should be evaluated alongside accuracy. A web-based multimodal environment was developed that uses a large language model for contextualized drills and tutoring, text-to-...

(This article belongs to the Special Issue Emerging Technologies Integration in IoT and Wireless Networks: Advancing Security and Performance in Cross-Domain Applications)
  • Article
  • Open Access
2 Citations
769 Views
31 Pages

Multimodal Deep Learning for Pest and Disease Recognition and Crop Growth Assessment in Open-Field Agricultural Environments

  • Jiayu Xiang,
  • Jianxiang Pan,
  • Hanwen Zhang,
  • Xuekun Liu and ,
  • Boxiu Liu,
  • Jieling Tian and
  • Shuo Yan
  • + 2 authors+ 0 author

Against the backdrop of the rapid development of smart agriculture, pest and disease monitoring and crop growth assessment for large-scale farmlands are of substantial importance for precision management and risk early warning. However, traditional u...

(This article belongs to the Section Artificial Intelligence and Digital Agriculture)
  • Article
  • Open Access
18 Citations
5,513 Views
19 Pages

A Deep Learning-Enhanced Multi-Modal Sensing Platform for Robust Human Object Detection and Tracking in Challenging Environments

  • Peng Cheng,
  • Zinan Xiong,
  • Yajie Bao,
  • Ping Zhuang and ,
  • Yunqi Zhang,
  • Erik Blasch and
  • Genshe Chen
  • + 2 authors+ 0 author

12 August 2023

In modern security situations, tracking multiple human objects in real-time within challenging urban environments is a critical capability for enhancing situational awareness, minimizing response time, and increasing overall operational effectiveness...

(This article belongs to the Special Issue Multimodal Data Fusion and Computational Optimization for Intelligent Perception)
  • Article
  • Open Access
82 Citations
10,984 Views
19 Pages

Multimodal Technologies in Precision Education: Providing New Opportunities or Adding More Challenges?

  • Umar Bin Qushem,
  • Athanasios Christopoulos,
  • Solomon Sunday Oyelere,
  • Hiroaki Ogata and
  • Mikko-Jussi Laakso

Personalized or precision education (PE) considers the integration of multimodal technologies to tailor individuals’ learning experiences based on their preferences and needs. To identify the impact that emerging multimodal technologies have on perso...

  • Review
  • Open Access
127 Citations
10,499 Views
33 Pages

2 June 2023

Smart living, a concept that has gained increasing attention in recent years, revolves around integrating advanced technologies in homes and cities to enhance the quality of life for citizens. Sensing and human action recognition are crucial aspects...

(This article belongs to the Special Issue Signal, Image Processing and Computer Vision in Smart Living Applications: Part II)
  • Systematic Review
  • Open Access
27 Citations
11,914 Views
72 Pages

Assessing Cognitive Load Using EEG and Eye-Tracking in 3-D Learning Environments: A Systematic Review

  • Rozemun Khan,
  • Johannes Vernooij,
  • Daniela Salvatori and
  • Beerend P. Hierck

The increasing use of immersive 3-D technologies in education raises critical questions about their cognitive impact on learners. This systematic review evaluates how electroencephalography (EEG) and eye-tracking have been used to objectively measure...

  • Article
  • Open Access
21 Citations
6,829 Views
39 Pages

2 May 2022

With the advent of digital technologies, the computer has become a generalized tool for music production. Music can be seen as a creative form of human–human communication via a computer, and therefore, research on human–computer and comp...

(This article belongs to the Special Issue 800 Years of Research at Padova University)
  • Article
  • Open Access
11 Citations
4,454 Views
18 Pages

Multimodal Environmental Sensing Using AI & IoT Solutions: A Cognitive Sound Analysis Perspective

  • Alexandros Emvoliadis,
  • Nikolaos Vryzas,
  • Marina-Eirini Stamatiadou,
  • Lazaros Vrysis and
  • Charalampos Dimoulas

26 April 2024

This study presents a novel audio compression technique, tailored for environmental monitoring within multi-modal data processing pipelines. Considering the crucial role that audio data play in environmental evaluations, particularly in contexts with...

(This article belongs to the Special Issue Multimodal Sensing Technologies for IoT and AI-Enabled Systems)
  • Article
  • Open Access
2 Citations
2,236 Views
20 Pages

16 August 2024

For high-precision navigation, obtaining and maintaining high-precision point-of-interest (POI) data on the road network is crucial. In urban areas with complex terrains, the accuracy of traditional road network POI acquisition methods often falls sh...

(This article belongs to the Section Remote Sensing Image Processing)
  • Article
  • Open Access
1,219 Views
27 Pages

VIRTUES: A Virtual Reality Multimodal Sensing Platform for Quantifying and Supporting Cross-Neurotype Collaboration

  • Ashwaq Zaini Amat,
  • Mahrukh Tauseef,
  • Deeksha Adiani,
  • Amy S. Weitlauf and
  • Nilanjan Sarkar

6 May 2026

Effective workplace collaboration is essential for productivity and creativity, yet achieving the necessary mutual understanding can be challenging, particularly involving individuals from different neurotypes. This work evaluates VIRTUES, a Virtual...

(This article belongs to the Special Issue Virtual Reality and Sensing Techniques for Human: 2nd Edition)
  • Review
  • Open Access
3 Citations
1,148 Views
33 Pages

16 June 2026

Plant diseases result in the estimated loss of 20–40% of the world’s crop production annually, amounting to more than $220 billion in economic losses and threatening food security for a rapidly expanding world population. While the conven...

(This article belongs to the Special Issue Advances in Sensor Technologies and Measurement Techniques for Smart Agri-Food)
  • Article
  • Open Access
4 Citations
2,483 Views
19 Pages

Parks are an important component of urban ecosystems, yet traditional research often relies on single-modal data, such as text or images alone, making it difficult to comprehensively and accurately capture the complex emotional experiences of visitor...

(This article belongs to the Special Issue Practice and Application of Artificial Intelligence in Urban Decision-Making)
  • Review
  • Open Access
284 Views
37 Pages

Hydroponic production enables precise control of nutrient supply, irrigation, lighting and root-zone conditions, creating a need for rapid, reliable and biologically meaningful monitoring. Optical and spectroscopic approaches can non-destructively as...

(This article belongs to the Topic Digital Agriculture, Smart Farming and Crop Monitoring)
  • Article
  • Open Access
7 Views
31 Pages

15 November 2026

Macroeconomic uncertainty motivates financial distress models that combine firm financial indicators with numerical and textual macroeconomic information. Using nonfinancial A-share firms during 2008–2024, this study integrates long short-term...

(This article belongs to the Special Issue Recent Advances in Mathematical Economics and Statistical Modeling)
  • Article
  • Open Access
14 Citations
4,809 Views
23 Pages

16 March 2024

Multimodal remote sensing data classification can enhance a model’s ability to distinguish land features through multimodal data fusion. In this context, how to help models understand the relationship between multimodal data and target tasks ha...

  • Article
  • Open Access
7 Citations
2,430 Views
20 Pages

Design of Multimodal Obstacle Avoidance Algorithm Based on Deep Reinforcement Learning

  • Wenming Zhu,
  • Xuan Gao,
  • Haibin Wu,
  • Jiawei Chen and ,
  • Xuehua Zhou and
  • Zhiguo Zhou
  • + 1 author+ 0 author

The navigation obstacle avoidance method based on deep reinforcement learning has stronger adaptability and better performance compared to traditional algorithms in complex unknown dynamic environments, and has been widely developed and applied. Howe...

  • Article
  • Open Access
2 Citations
2,580 Views
21 Pages

Exploring Parent and Teacher Perceptions of Multimodal Educational Games for Engaging Girls in STEM

  • Sarika Kewalramani,
  • Gerarda Richards,
  • Chris Speldewinde,
  • George Aranda and ,
  • Linda Hobbs and
  • Lihua Xu
  • + 1 author+ 0 author

This study co-designed and developed multimodal educational games in collaboration with parents and teachers to engage girls in STEM from early childhood onward. Recent studies examine the supportive and complementary role of digital educational tech...

(This article belongs to the Special Issue 21st Century Science Classrooms: Innovative Approaches to Technology Integration)
  • Article
  • Open Access
54 Citations
17,892 Views
17 Pages

Can Gamification Influence the Academic Performance of Students?

  • Víctor Arufe Giráldez,
  • Alberto Sanmiguel-Rodríguez,
  • Oliver Ramos Álvarez and
  • Rubén Navarro-Patón

24 April 2022

Gamification along with a whole range of other active methodologies are being incorporated into university classrooms due to their potential benefits for student learning. The aim of this paper was to analyse how a multimodal learning environment bas...

(This article belongs to the Collection Mobile Technology, Gamification and Artificial Intelligence to Improve Sustainability in Education)
  • Article
  • Open Access
24 Citations
8,166 Views
18 Pages

11 September 2024

This study deeply integrates multimodal data analysis and big data technology, proposing a multimodal learning framework that consolidates various information sources, such as user geographic location, behavior data, and product attributes, to achiev...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Review
  • Open Access
25 Citations
6,244 Views
17 Pages

3 April 2025

Multimodal interaction technology has become a key aspect of remote education by enriching student engagement and learning results as it utilizes the speech, gesture, and visual feedback as various sensory channels. This publication reflects on the l...

(This article belongs to the Special Issue Current Status and Perspectives in Human–Computer Interaction)
  • Article
  • Open Access
41 Citations
6,991 Views
17 Pages

15 February 2021

It is an essential capability of indoor mobile robots to avoid various kinds of obstacles. Recently, multimodal deep reinforcement learning (DRL) methods have demonstrated great capability for learning control policies in robotics by using different...

(This article belongs to the Section Sensors and Robotics)
  • Review
  • Open Access
155 Citations
23,298 Views
26 Pages

30 November 2020

Multimodal learning analytics (MMLA), which has become increasingly popular, can help provide an accurate understanding of learning processes. However, it is still unclear how multimodal data is integrated into MMLA. By following the Preferred Report...

(This article belongs to the Special Issue New Trends on Multimodal Learning Analytics: Using Sensors to Understand and Improve Learning)
  • Article
  • Open Access
29 Citations
6,433 Views
13 Pages

28 July 2021

Recent technological advancements in immersive reality technologies have become a focus area in the virtual heritage (VH) domain. In this regard, this paper attempts to design and implement clouds-based collaborative and multi-modal MR application ai...

(This article belongs to the Special Issue Mixed Reality in Culture and Heritage)
  • Article
  • Open Access
3 Citations
2,625 Views
23 Pages

Machine Learning Models for Indoor Positioning Using Bluetooth RSSI and Video Data: A Case Study

  • Tomás Mamede,
  • Nuno Silva,
  • Eduardo R. B. Marques and
  • Luís M. B. Lopes

29 October 2025

Indoor Positioning Systems (IPSs) are essential for applications requiring accurate location awareness in indoor environments. However, achieving high precision remains challenging due to signal interference and environmental variability. This study...

(This article belongs to the Section Communications)
  • Review
  • Open Access
5 Citations
2,625 Views
43 Pages

Challenges and Opportunities in Tomato Leaf Disease Detection with Limited and Multimodal Data: A Review

  • Yingbiao Hu,
  • Huinian Li,
  • Chengcheng Yang,
  • Ningxia Chen and ,
  • Zhenfu Pan and
  • Wei Ke
  • + 1 author+ 0 author

26 January 2026

Tomato leaf diseases cause substantial yield and quality losses worldwide, yet reliable detection in real fields remains challenging. Two practical bottlenecks dominate current research: (i) limited data, including small samples for rare diseases, cl...

(This article belongs to the Special Issue Structural Networks for Image Application)
  • Article
  • Open Access
38 Citations
7,081 Views
17 Pages

On Robustness of Multi-Modal Fusion—Robotics Perspective

  • Michal Bednarek,
  • Piotr Kicki and
  • Krzysztof Walas

The efficient multi-modal fusion of data streams from different sensors is a crucial ability that a robotic perception system should exhibit to ensure robustness against disturbances. However, as the volume and dimensionality of sensory-feedback incr...

(This article belongs to the Special Issue Artificial Intelligence and Ambient Intelligence)
  • Article
  • Open Access
2 Citations
2,799 Views
15 Pages

The factors that affect learning efficiency in different environments have been considered in many studies, but multimode mood-consistent learning has not been considered specifically. In this paper, a neural network circuit based on memristors to de...

(This article belongs to the Special Issue High-Performance Embedded Computing)
  • Article
  • Open Access
2 Citations
1,734 Views
24 Pages

Multimodal Learning Interactions Using MATLAB Technology in a Multinational Statistical Classroom

  • Qiaoyan Cai,
  • Mohd Razip Bajuri,
  • Kwan Eu Leong and
  • Liangliang Chen

This study explores and models the use of MATLAB technology in multimodal learning interactions to address the challenges of teaching and learning statistics in a multinational postgraduate classroom. The term multimodal refers to the deliberate inte...

  • Article
  • Open Access
55 Citations
8,494 Views
17 Pages

The Influence of Collaborative and Multi-Modal Mixed Reality: Cultural Learning in Virtual Heritage

  • Mafkereseb Kassahun Bekele,
  • Erik Champion,
  • David A. McMeekin and
  • Hafizur Rahaman

Studies in the virtual heritage (VH) domain identify collaboration (social interaction), engagement, and a contextual relationship as key elements of interaction design that influence users’ experience and cultural learning in VH applications....

(This article belongs to the Special Issue Feature Papers of MTI in 2021)
  • Article
  • Open Access
16 Citations
5,501 Views
12 Pages

This article explores how online videos with a pedagogical focus can possibly make an impact on our current language teaching and learning practices. The affordance of videos to create multimodal content that can be shared with the public allows cont...

(This article belongs to the Special Issue MOBILLE 2019)
  • Article
  • Open Access
14 Citations
4,153 Views
15 Pages

26 July 2022

This estimation method operates by integrating the input values that are redundantly collected from heterogeneous devices through the selection of a representative value and estimating missing values by using a multimodal RNN. Users use a heterogeneo...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
877 Views
20 Pages

A Multimodal Fake News Detection Method Based on Contrastive Learning and Variational Autoencoder

  • Baowen Wu,
  • Ruijiao Hu,
  • Jilin Wang,
  • Xin Sui and ,
  • Jiaxing Sun,
  • Jie Liu and
  • Youli Qu
  • + 2 authors+ 0 author

21 May 2026

Fake news often exhibits pronounced bias and misleading content. To foster a harmonious information environment, there is an urgent need for rapid fake news identification. Fake news detection can assess news authenticity by analyzing multidimensiona...

(This article belongs to the Section E: Applied Mathematics)
  • Article
  • Open Access
55 Citations
10,727 Views
13 Pages

25 November 2022

Considering that the occurrence and spread of diseases are closely related to the planting environment, a tomato disease diagnosis method based on Multi-ResNet34 multi-modal fusion learning based on residual learning is proposed for the problem of li...

(This article belongs to the Section Artificial Intelligence and Digital Agriculture)
  • Review
  • Open Access
98 Citations
28,431 Views
32 Pages

Multimodal Interaction, Interfaces, and Communication: A Survey

  • Elias Dritsas,
  • Maria Trigka,
  • Christos Troussas and
  • Phivos Mylonas

Multimodal interaction is a transformative human-computer interaction (HCI) approach that allows users to interact with systems through various communication channels such as speech, gesture, touch, and gaze. With advancements in sensor technology an...

(This article belongs to the Special Issue Multimodal User Interfaces and Experiences: Challenges, Applications, and Perspectives—2nd Edition)
  • Systematic Review
  • Open Access
1,683 Views
87 Pages

3 August 2026

Continual learning (CL) aims to develop intelligent systems capable of learning continuously from sequential data while retaining previously acquired knowledge. As AI systems are increasingly deployed in dynamic real-world environments, CL has become...

  • Article
  • Open Access
3 Citations
4,449 Views
17 Pages

Despite the increasing use of technologies in the classroom, there are concerns that technology-enhanced learning environments may hinder students’ communication and interaction. In this study, we investigated how tangible technologies can enha...

(This article belongs to the Special Issue Feature Papers in Multimodal Technologies and Interaction—Edition 2023)
  • Review
  • Open Access
2 Citations
1,448 Views
34 Pages

9 May 2026

Smart home environments are evolving toward context-aware intelligent systems with the rapid integration of the Internet of Things (IoT), edge computing, and artificial intelligence. In such settings, large volumes of heterogeneous sensor data must b...

(This article belongs to the Special Issue Sensor Signal Analysis for Intelligent Health Management and Autonomous Systems)
  • Proceeding Paper
  • Open Access
1 Citations
2,769 Views
9 Pages

My talk consists of three parts. First, I present the urges and antecedents that are present in the current development of the concept of visuality and can affect education as a considerable development potential. Almost half a century ago something...

(This article belongs to the Proceedings of Proceedings of the International and Interdisciplinary Conference IMMAGINI? Brixen, Italy, 27–28 November 2017.)

of 14