As a non-contact method, vision-based measurement for vibration extraction and modal parameter identification has attracted much attention. In most cases, artificial textures are crucial elements for visual tracking, and this feature limits the appli...
As a promising alternative to conventional contact sensors, vision-based technologies for a structural dynamic response measurement and health monitoring have attracted much attention from the research community. Among these technologies, Eulerian vi...
Recently, the combination of Fringe Projection (FP) and 2D Digital Image Correlation (2D-DIC) has become a low-cost alternative for measuring deformations even in dynamic events such as vibration testing. FP and DIC are displacement measurement techn...
Modal analysis provides the dynamic behavior of an object or structure, and is often undertaken using the Finite Element Method (FEM) due to its ability to deal with arbitrary geometries. This article investigates the use of Augmented Reality (AR) to...
This study aimed to reveal the influence of emotional valence and sensory modality on neural activity in response to multimodal emotional stimuli using scalp EEG. In this study, 20 healthy participants completed the emotional multimodal stimulation e...
Concrete sleepers used in railway engineering are subject to damage, such as cracks and breakage. Damaged concrete sleepers undergo changes to their material and structural properties, including response, mode shape, and natural frequency. Therefore,...
Emotion perception frequently involves the integration of visual and auditory information. During multisensory emotion perception, the attention devoted to each modality can be measured by calculating the difference between trials in which the facial...
Background/Objectives: Working memory (WM) performance relies on the coordination of updating and inhibition functions within the central executive system. However, their interaction under varying cognitive loads, particularly across sensory modaliti...
Exhibition design in museum environments serves as a vital mechanism for enhancing cultural engagement, enriching visitor experience, and promoting heritage preservation. Despite the growing number of museums, improvements in exhibition quality remai...
Deep learning (DL) methods are increasingly being applied for developing reliable computer-aided detection (CADe), diagnosis (CADx), and information retrieval algorithms. However, challenges in interpreting and explaining the learned behavior of the...
Can experience change perception? Here, we examine whether language experience shapes the way individuals process auditory and visual information. We used the McGurk effect—the discovery that when people hear a speech sound (e.g., “ba”) and see a con...
Background: Emotion recognition is a fundamental aspect of social communication, yet most research has focused on visual emotion expressions, leaving it less understood how auditory and audiovisual cues shape perceptual organization. The present stud...
This study presents a three-dimensional collective motion model that integrates auditory and visual sensing modalities, inspired by organisms like bats that rely on these senses for navigation. Most existing models of collective motion consider visio...
Vision and touch are fundamental sensory modalities that enable humans to perceive and interact with objects in their environment. Vision facilitates the perception of attributes such as shape, color, and texture from a distance, while touch provides...
In this paper, the mode shapes of an empty and oil-filled transformer experimental model tank are obtained using 3D finite element method (FEM) modal analysis. For verification of the FEM analysis results, experimental modal analysis (EMA) is carried...
The low-frequency performance of exciter-driven flat-panel loudspeakers is technically challenging. The lower modal density results in high deviations in the frequency response, and dips of more than 20 dB are possible. This paper presents an alterna...
This survey provides a comprehensive guide to Multimodal Large Language Models (MLLMs) with a focus on vision–language tasks, including image captioning, visual question answering, cross-modal retrieval, visual grounding, multi-image reasoning,...
This paper presents a study on the idle vibration reduction of a diesel sport utility vehicle (SUV). To reduce idle vibration, the transmission paths of vibration from the engine to the driver seat floor were investigated with the vehicle components...
Multi-modal ocular biometrics has recently garnered significant attention due to its potential in enhancing the security and reliability of biometric identification systems in non-constrained scenarios. However, accurately and efficiently segmenting...
Cross-modal correspondence, a cross-sensory cognitive phenomenon, reveals the link between visual forms and taste experiences. Although research on Western alphabetic typography is extensive, the Chinese character system has received less attention....
This article investigates how cognitive and grammatical mechanisms shape variable singular–plural agreement in Spanish perception–verb constructions, a domain where speakers alternate between agreement with the postverbal NP2 and agreemen...
Neural networks have an extensive ability to change in response to environmental stimuli. This flexibility peaks during restricted windows of time early in life called critical periods. The ubiquitous occurrence of this form of plasticity across sens...
Biological swarms communicate through decentralized, adaptive behaviors shaped by local interactions, selective attention, and symbolic signaling. These principles of animal communication enable robust coordination without centralized control or pers...
Foveal (central) and peripheral vision are strongly interconnected to provide an integrated experience of the world around us. Recently, it has been suggested that there is a feedback mechanism that links foveal and peripheral vision. This peripheral...
In this article, we present an approach that uses both two force sensitive handles (FSH) and a flexible capacitive touch sensor (FCTS) to drive a haptic-based immersive system. The immersive system has been developed as part of a multimodal interface...
Continual Generalized Category Discovery (C-GCD) is an emerging research direction in Open-World Learning. The model aims to incrementally discover novel classes from unlabeled data while maintaining recognition of previously learned classes, without...
Automated optical tweezers-based robotic manipulation of microscale objects requires real-time visual perception for estimating the states, i.e., positions and orientations, of the objects. Such visual perception is particularly challenging in hetero...
The integration of multisensory inputs plays a crucial role in shaping perception and behavior, particularly in the visual system. The collicular pathway, encompassing the optic tectum in non-mammalian vertebrates and the superior colliculus (SC) in...
People with visual impairments (VIPs) can participate in orientation and mobility (O&M) training to learn how to navigate to their desired goal locations. During O&M training, personal wayfinding preferences with regard to cue use and wayfind...
Building information extraction utilizing remote sensing technology has vital applications in many domains, such as urban planning, cadastral mapping, geographic information censuses, and land-cover change analysis. In recent years, deep learning alg...
My talk consists of three parts. First, I present the urges and antecedents that are present in the current development of the concept of visuality and can affect education as a considerable development potential. Almost half a century ago something...
Image-guided surgical procedures are challenged by mono image modality, two-dimensional anatomical guidance and non-intuitive human-machine interaction. The introduction of Tablet-based augmented reality (AR) into surgical robots may assist surgeons...
Visual content is central to online health communication, yet little is known about how multimodal relationships are associated with audiences’ click-through choices. Drawing on processing fluency and risk communication perspectives, this study...
One of the most applied imaging methods in medicine is endoscopy. A highly specialized image modality has been developed since the first modern endoscope, the “Lichtleiter” of Bozzini was introduced in the early 19th century. Multiple med...
Most artistic expressions are conveyed through images (e.g., painting) and audio (e.g., music), and deep learning has been successfully applied to neural style transfer within each of these modalities. However, there is still a lack of deep models th...
With the continuous progress in drone and materials technology, numerous bionic drones have been developed and employed in various fields. These bionic drones are designed to mimic the shape of birds, seamlessly blending into the natural environment...
Underwater vision is one of the dominant senses and has shown great prospects in ocean investigations. In this paper, a hierarchical Independent Component Analysis (ICA) framework has been established to explore and understand the functional roles of...
Free-standing archaeological walls are significantly exposed to horizontal actions (e.g., earthquakes) as they lack connections provided by floors or roofs. In such cases, the dynamic response governs the activation of local mechanisms of collapse, d...
Museums serve as experimental spaces for smart cities. The hypothesis suggests that museums can offer insights into transitioning smart cities from a mainly data-centric model to one that emphasises sensory experiences. This qualitative study investi...
Visual and olfactory floral signals play key roles in plant-pollinator interactions. In recent decades, studies investigating the evolution of either of these signals have increased considerably. However, there are large gaps in our understanding of...
This study examines individual-centric multimodal sensory experiences in the museum context, where multimodality is defined as the interplay among sensory modalities. Focusing on visual and haptic experiences, the research aims to investigate the rol...
This paper presents a new methodology for analyzing lip articulation during fingerspelling aimed at extracting robust visual patterns that can overcome the inherent ambiguity and variability of lip shape. The proposed approach is based on unsupervise...
This paper proposes a novel Large Language Model (LLM)-based visual target navigation framework for quadrotors in unknown environments. Leveraging the semantic knowledge of LLMs, our method enables autonomous exploration based on natural language ins...
Existing e-commerce recommender systems, like graph-based retrieval and user behavior-driven Collaborative Filtering, usually take either textual or visual features for item recommendations to users. Traditional hierarchical large language models (HL...
Background: This paper presents a structured narrative review of recent advances in AI-driven image generation across four complementary perspectives: generative models and architectures, quality assessment and performance metrics, application domain...
This paper proposes a novel point cloud multi-scale completion algorithm guided by image rotation attention mechanisms to address the challenges of severe information loss and suboptimal fusion effects in multi-modal feature extraction and integratio...
Background/Objectives: People with visual impairments can participate in orientation and mobility (O&M) training to learn how to navigate to their desired destinations. Instructors adapt their approach to each individual client. However, assessme...
Primary breast osteosarcoma (PBO) is very rare. This report presents a case of POB that was evaluated by multiple modalities. A woman in her 70s presented with a mass of increasing size in her right breast. A mammogram and an ultrasound visualized a...
The human visual system can rapidly focus on prominent objects in complex scenes, significantly enhancing information processing efficiency. Salient object detection (SOD) mimics this biological ability, aiming to identify and segment the most promin...
Cotton fiber quality is shaped during boll development, boll opening, fluffing, and harvesting, but current assessment still relies largely on manual field inspection and postharvest laboratory testing. This limits timely harvest scheduling and plot-...
of 2