This paper investigates the integration of emotional, cognitive, and interactional processes in the design of educational technologies through the lens of Human–Computer Interaction (HCI). While previous studies have focused on cognitive and in...
Human–computer interaction (HCI) is essential for optimizing smart greenhouse management and for fostering efficient and sustainable agricultural practices. A synthesis of recent advancements in diverse interfaces, including digital twins, virt...
Smart spaces foster the development of natural and appropriate forms of human-computer interaction by taking advantage of home customization. The interaction potential of the Smart Home, which is a special type of smart space, is of particular inter...
Most industrial workplaces involving robots and other apparatus operate behind the fences to remove defects, hazards, or casualties. Recent advancements in machine learning can enable robots to co-operate with human co-workers while retaining safety,...
Raster maps provide intuitive visualizations of remote sensing data representing various phenomena on the Earth’s surface. Reading raster maps with intricate information requires a high cognitive workload, especially when it is necessary to ide...
We introduce a new perspective for musical interaction tailored to a specific class of sonic resources: impact sounds. Our work is informed by the field of ubiquitous music (ubimus) and engages with the demands of artistic practices. Through a series...
Understanding and accurately estimating cognitive workload is crucial for the development of adaptive, user-centered interactive systems across a variety of domains including augmented reality, automotive driving assistance, and intelligent tutoring...
The static nature of traditional military symbology, such as MIL-STD-2525D, hinders effective real-time threat detection and response in modern cybersecurity operations. This research introduces the Dynamic Adaptive Symbol System (DASS), a novel fram...
The article presents a contextual survey of eight contributions in the special issue Musical Interactions (Volume I) in Multimodal Technologies and Interaction. The presentation includes (1) a critical examination of what it means to be musical, to d...
Sentiment analysis is pivotal in advancing human–computer interaction (HCI) systems as it enables emotionally intelligent responses. While existing models show potential for HCI applications, current conversational datasets exhibit critical lim...
Technological advancements have revolutionized the proliferation and availability of information to users, which has created more complex and intensive interactions between users and systems. The learning process of users is essential in the construc...
The understanding of human cognition has not been fully achieved; therefore, Information Systems (IS) are not yet fully synchronized with humans. By understanding the cognition process, we will be able to create a human-tailored Cognitive Information...
The creation of digital educational games often lacks strong user-centered design despite available frameworks, which tend to focus on technical and instructional aspects. This paper presents the Empathic Design Thinking Framework (EDTF), a structure...
Climate change has had a significant impact on the tourism industry in many countries, leading to changes in policies and adaptations to attract more visitors. However, there are few studies on the effects of climate change on Sri Lanka’s touri...
Eye gaze interfaces are an emerging technology that allows users to control graphical user interfaces (GUIs) simply by looking at them. However, using gaze-controlled GUIs can be a demanding task, resulting in high cognitive and physical load and fat...
Human-computer interaction (HCI) has contributed to the design and development of some efficient, user-friendly, cost-effective, and adaptable digital mental health solutions. But HCI has not been well-combined into technological developments resulti...
Intelligent user interfaces (IUI) are driven by the goal of improvement in human–computer interaction (HCI), mainly improving user interfaces’ user experience (UX) or usability with the help of artificial intelligence. The main goal of th...
Digital applications in health care are a concurrent research and management question, where implementation experiences are a core field of information systems research. It also contributes to fighting pandemic crises like COVID-19 because contactles...
Affect monitoring is being discussed as a novel strategy to make adaptive systems more user-oriented. Basic knowledge about oscillatory processes and functional connectivity underlying affect during naturalistic human–computer interactions (HCI...
Technologies, such as smart sensors, actuators, and other kinds of devices, are often installed in our environments (e.g., our Homes) and available to integrate our daily lives. Despite their installation being motivated by the pursuit of automation...
The essence of biomimetics in human–computer interaction (HCI) is the inspiration derived from natural systems to drive innovations in modern-day technologies. With this in mind, this paper introduces a biomimetic adaptive pure pursuit (A-PP) a...
In an era where dietary habits significantly impact health, technological interventions can offer personalized and accessible food choices. This paper introduces Chef Dalle, a recipe recommendation system that leverages multi-model and multimodal hum...
In this paper, we show that the evolution of artificial intelligence (AI) and its increased presence within an interactive system pushes designers to rethink the way in which AI and its users interact and to highlight users’ feelings towards AI...
In the field of computer vision, hand pose estimation (HPE) has attracted significant attention from researchers, especially in the fields of human–computer interaction (HCI) and virtual reality (VR). Despite advancements in 2D HPE, challenges...
Multimodal emotion recognition has gained much traction in the field of affective computing, human–computer interaction (HCI), artificial intelligence (AI), and user experience (UX). There is growing demand to automate analysis of user emotion...
A core challenge in multimodal emotion recognition lies in the precise capture of the inherent multimodal interactive nature of human emotions. Addressing the limitation of existing methods, which often process visual signals (facial expressions) and...
Immersive technologies such as virtual reality (VR), augmented reality (AR), mixed reality (MR), and multisensory interaction are increasingly deployed to support the transmission and presentation of intangible cultural heritage (ICH), particularly w...
Multimodal interaction is a transformative human-computer interaction (HCI) approach that allows users to interact with systems through various communication channels such as speech, gesture, touch, and gaze. With advancements in sensor technology an...
Understanding how cognitive differences shape visitor behavior in digital heritage experiences is essential for designing inclusive and engaging museum technologies. This study explores the relationship between cognitive level and interaction behavio...
With the recent development of small radars with high resolution, various human–computer interaction (HCI) applications using them have been developed. In particular, a method of applying a user’s hand gesture recognition using a short-ra...
Unmanned Aerial Vehicle (UAVs) have become very popular in the last decade due to some advantages such as strong terrain adaptation, low cost, zero casualties, and so on. One of the most interesting advances in this field is the automation of mission...
Affective computing systems can decode cortical activities to facilitate emotional human–computer interaction. However, personalities exist in neurophysiological responses among different users of the brain–computer interface leads to a difficulty fo...
Gesture recognition technology has emerged as a transformative solution for natural and intuitive human–computer interaction (HCI), offering touch-free operation across diverse fields such as healthcare, gaming, and smart home systems. In mobil...
Dual connectivity (DC) was first proposed in 3GPP Release 12 which allows one piece of user equipment (UE) to connect to two base stations in heterogeneous networks (HetNet) at the same time, to increase the flexibility of resource utilization. DC ha...
Emotion recognition plays an essential role in human–computer interaction. Previous studies have investigated the use of facial expression and electroencephalogram (EEG) signals from single modal for emotion recognition separately, but few have...
Human–computer interaction (HCI) drives innovation by bridging humans and technology, with human activity recognition (HAR) playing a key role. Traditional HAR systems require user cooperation and infrastructure, raising privacy concerns. In re...
The rapid proliferation of misinformation on social media underscores the urgent need for scalable digital-literacy instruction. This study presents the design and evaluation of a Generative AI-enhanced serious game system that integrates Large Langu...
Human–automation etiquette applies human–human etiquette conventions to human–computer interaction (HCI). The research described in this paper investigates how to mitigate user frustration and support student learning through change...
The integration of digital serious games into speech learning (rehabilitation) has demonstrated significant potential in enhancing accessibility and inclusivity for children with speech disabilities. This review of the state of the art examines the r...
With the proliferation of the Internet of Things (IoT), gesture recognition has attracted attention as a core technology in human–computer interaction (HCI). In particular, mmWave frequency-modulated continuous-wave (FMCW) radar has emerged as...
Designing inclusive multimedia systems that meet diverse accessibility needs remains a complex challenge requiring iterative refinement and sustained collaboration with end-users. This paper presents an empirically grounded case study of an accessibl...
Gestures serve as an intuitive and natural medium for conveying human intent and personal identity, offering a convenient, contactless, and privacy-preserving interaction modality for human–computer interaction (HCI) systems. This paper propose...
Remote photoplethysmography (rPPG) enables non-contact physiological measurement for emotion recognition, yet the temporally sparse nature of emotional cardiovascular responses, intrinsic measurement noise, weak session-level labels, and subtle corre...
This paper presents a novel hybrid multimodal deep learning model for robust and real-time eye gaze estimation. Accurate gaze tracking is essential for advancing human–computer interaction (HCI) and assistive technologies, but existing methods...
Tracking detailed hand motion is a fundamental research topic in the area of human-computer interaction (HCI) and has been widely studied for decades. Existing solutions with single-model inputs either require tedious calibration, are expensive or la...
Radar-based gesture recognition technology has gained increasing attention in the context of contactless human–computer interaction (HCI). Micro gestures have smaller motion amplitudes and shorter duration compared with traditional gestures, wh...
Emotion recognition from speech is essential for human–computer interaction (HCI) and affective computing, with applications in virtual assistants, healthcare, and education. Although deep learning has made significant advancements in Automatic...
Wi-Fi-based device-free human activity recognition has recently become a vital underpinning for various emerging applications, ranging from the Internet of Things (IoT) to Human–Computer Interaction (HCI). Although this technology has been successful...
Occupational therapy (OT) is vital in improving functional outcomes and aiding recovery for individuals with long-term disabilities, particularly those resulting from neurological diseases. Traditional assessment methods often rely on clinical judgme...
Using multimodal signals to solve the problem of emotion recognition is one of the emerging trends in affective computing. Several studies have utilized state of the art deep learning methods and combined physiological signals, such as the electrocar...
of 2