The salient object detection (SOD) task aims to automatically detect the most prominent areas observed by the human eye in an image. Since RGB images and depth images contain different information, how to effectively integrate cross-modal features in...
When tubing is in a high-temperature and high-pressure environment, it will be affected by the impact of non-constant fluid and other dynamic loads, which will easily cause the tubing to vibrate or even resonate, affecting the integrity of the wellbo...
In recent years, the proliferation of fake news and misinformation has grown exponentially, far surpassing that of genuine news and posing a serious threat to social stability. Existing research in fake news detection primarily applies contrastive le...
Emotion recognition in conversations (ERC), which aims to capture the dynamic changes in emotions during conversations, has recently attracted a huge amount of attention due to its importance in providing engaging and empathetic services. Considering...
The main purpose of infrared and visible image fusion is to produce a fusion image that incorporates less redundant information while incorporating more complementary information, thereby facilitating subsequent high-level visual tasks. However, obta...
Visualization systems play a crucial role in industry, education, and research domains by offering valuable insights and enhancing decision making. These systems enable the representation of complex workflows and data in a visually intuitive manner,...
This paper presents a new technique for the extraction of high-order wave-damage interaction coefficients (WDIC) through modal decomposition. The frequency and direction dependent complex-valued WDIC are used to model the scattering and mode conversi...
Reliable prediction of chemical–protein interactions (CPIs) remains a key challenge in drug discovery, especially under sparse or noisy biological data. We present MM-TCoCPIn, a Multi-Modal Topology-aware Chemical–Protein Interaction Netw...
Fluid-structure interaction (FSI) was used to determine the structural mechanical characteristics of full tubular and axial-flow pumps. The results showed that as the flow rate increases, the total deformation and equivalent stress are significantly...
An experiment with a two interaction modalities (traditional: touch; novel: touch–speech) × two task complexities (low: visual single task; high: audio–visual dual task) within-subjects design was conducted to observe alterations in...
This study takes an interactional linguistics and conversation analysis-based approach to analyze the modal verb huì ‘will’ in the recurrent formular of commissive actions, [wǒ huì X (de)] ‘I will X.’ D...
Cameras and LiDAR are the primary sensors utilized in contemporary 3D object perception, leading to the development of various multi-modal detection algorithms for images, point clouds, and their fusion. Given the demanding accuracy requirements in a...
This study investigated the impacts of different notification modalities used in low and high ambient sound environments for mobile phone interaction. Three different notification modalities—Shaking Visual, Shaking Visual + Vibration, and Vibration—w...
Accurate comprehension of others’ thoughts and intentions is crucial for smooth social interactions, wherein understanding their perceptual experiences serves as a fundamental basis for this high-level social cognition. However, previous resear...
System identification proves in general to be very efficient in the extraction of modal parameters of a structure under ambient vibrations. However, great difficulties can arise in the case of structures composed of many connected bodies, whose mutua...
Syntheticaperture radar (SAR) object detection offers significant advantages in remote sensing applications, particularly under adverse weather conditions or low-light environments. However, single-modal SAR image object detection encounters numerous...
The characterization of target binding interactions is critical at each stage of antibody therapeutic development. During early development, it is important to design fit-for-purpose in vitro molecular interaction characterization (MIC) assays that a...
Hands-free computer interaction is a key topic in assistive technology, with camera-based and voice-based systems being the most common methods. Recent camera-based solutions leverage facial expressions or head movements to simulate mouse clicks or k...
This work aimed at investigating red wine olfactory–oral cross-modal interactions, and at testing their impact on the correlations between sensory and chemical variables. Seventy-four Italian red whole wines (WWs) from 10 varieties, and corresp...
A human can infer the magnitude of interaction force solely based on visual information because of prior knowledge in human–robot interaction (HRI). A method of reconstructing tactile information through cross-modal signal processing is propose...
With the recent advances in deep learning, wearable sensors have increasingly been used in automated animal activity recognition. However, there are two major challenges in improving recognition performance—multi-modal feature fusion and imbalanced d...
Traffic accidents on the road lead to serious personal and material damage. Furthermore, preventing secondary accidents caused by traffic accidents is crucial. As various technologies for detecting traffic accidents in videos using deep learning are...
Skeleton-based human interaction recognition is a challenging task in the field of vision and image processing. Graph Convolutional Networks (GCNs) achieved remarkable performance by modeling the human skeleton as a topology. However, existing GCN-ba...
Magnetic resonance (MR) imaging is widely used in the clinical field due to its non-invasiveness, but the long scanning time is still a bottleneck for its popularization. Using the complementary information between multi-modal imaging to accelerate i...
Graph convolution network-based approaches have been recently used to model region-wise relationships in region-level prediction problems in urban computing. Each relationship represents a kind of spatial dependency, such as region-wise distance or f...
Golog Tibetan grammaticalizes both evidentiality and egophoricity, but the two categories interact in a constrained way: evidential marking neutralizes the binary egophoric versus non-egophoric contrast. This paper develops LEE (Logic of Evidentialit...
This paper presents an implementation of RoSA, a Robot System Assistant, for safe and intuitive human-machine interaction. The interaction modalities were chosen and previously reviewed using a Wizard of Oz study emphasizing a strong propensity for s...
Our study investigates how the sequencing of text and image inputs within multi-modal prompts affects the reasoning performance of Large Language Models (LLMs). Through empirical evaluations of three major commercial LLM vendors—OpenAI, Google,...
Accurate trajectory prediction is an essential task in automated driving, which is achieved by sensing and analyzing the behavior of surrounding vehicles. Although plenty of research works have been invested in this field, it is still a challenging s...
With the emergence of slimmer footbridges and the introduction of lighter materials, the challenge of vibrational comfort assessment becomes more and more relevant. Previous studies have shown that each pedestrian will act both as an inducer and a da...
Increasing nonlinearity in today’s grid challenges the conventional small-signal (modal) analysis (SSA) tools. For instance, the interactions among modes, which are not captured by SSA, may play significant roles in a stressed power system. Con...
Studies in the virtual heritage (VH) domain identify collaboration (social interaction), engagement, and a contextual relationship as key elements of interaction design that influence users’ experience and cultural learning in VH applications....
Technology developments have expanded the diversity of interaction modalities that can be used by an agent (either a human or machine) to interact with a computer system. This expansion has created the need for more natural and user-friendly interfac...
“Interaction” represents a critical term in the augmented and mixed reality ecosystem. Today, in mixed reality environments and applications, interaction occupies the joint space between any combination of humans, physical environment, and computers....
Visual grounding aims to recognize and locate the target in the image according to human intention, which provides a new intelligent interaction idea and method for augmented reality (AR) and virtual reality (VR) devices. However, existing vision lan...
The proliferation of power electronics in renewable-integrated grids exacerbates the challenges of nonlinearity and multivariable coupling. While the modal series method (MSM) offers theoretical foundations, it fails to provide tools to systematicall...
Electric shovels are used in surface mining operations to achieve economic production capacities. The capital investments and operating costs associated with the shovels deployed in the Athabasca oil sands formation are high due to the abrasive condi...
Artificial emotional intelligence is a sub-domain of human–computer interaction research that aims to develop deep learning models capable of detecting and interpreting human emotional states through various modalities. A major challenge in thi...
Single-mode (SM) vertical-cavity surface-emitting lasers (VCSELs) have often been demonstrated with an unusually long transmission reach at very high data rates while today’s multimode VCSEL transmission has been limited by the fiber modal band...
Spatial Augmented Reality (SAR) has evolved in the past fifteen years from a whimsical, projection-based approach to a socially nuanced medium of interpretative scholarship for culture, education, and storytelling. This paper presents a critical lite...
Prey-predator interactions play a pivotal role in elucidating the evolution and adaptation of various organism’s traits. Numerous approaches have been employed to study the dynamics of prey-predator interaction systems, with agent-based methodo...
Renewable energy sources such as wind power and photovoltaics (PVs) have been increasingly integrated into the power system through power electronic converters in recent years. However, power electronic converter-driven stability has issues under spe...
Recent technological advancements in immersive reality technologies have become a focus area in the virtual heritage (VH) domain. In this regard, this paper attempts to design and implement clouds-based collaborative and multi-modal MR application ai...
This study aims to generate visually useful imagery by preventing cropping while maintaining resolution and minimizing the degradation of stability and distortion to enhance the stability of a video for Augmented Reality applications. The focus is pl...
Web3.0 aims to foster a trustworthy environment enabling user trust and content verifiability. However, the proliferation of fake news undermines this trust and disrupts social ecosystems, making the effective alignment of visual-textual semantics an...
In the field of vision-based robot grasping, effectively leveraging RGB and depth information to accurately determine the position and pose of a target is a critical issue. To address this challenge, we proposed a tri-stream cross-modal fusion archit...
Leveraging data from various modalities to enhance multimodal segmentation tasks is a well-regarded approach. Recently, efforts have been made to incorporate an array of modalities, including depth and thermal imaging. Nevertheless, the effective ama...
RNA has emerged as a critical drug target, and accurate prediction of its binding affinity with small molecules is essential for the design and screening of RNA-targeted therapeutics. Although current deep learning methods have achieved progress in p...
The adolescence period is characterized by a considerable risk to weight gain due to the high consumption of food rich in sugar. A promising strategy to reduce sugar consumption may lie in exploiting the ability of our senses to interact to each othe...
Background/Objective: Sleep is significant for human mental and physical health. Sleep disorders represent a crucial risk to human health, and a large portion of the world population suffers from them. The efficient identification of sleep disorders...
of 37