Search Results (662)

Multisensory integration is crucial for effective cognitive functioning, especially in complex tasks such as those requiring rapid audiovisual information processing. High-level martial arts routine athletes, trained in integrating visual and auditory cues for performance, may exhibit superior abilities in cross-audiovisual integration. This study aimed to explore whether these athletes demonstrate an expert advantage effect in audiovisual integration, particularly focusing on whether this advantage is due to enhanced automatic auditory processing. A total of 165 participants (81 male, 84 female) were included in three experiments. Experiment 1 (n = 63) used a cross-audiovisual Rapid Serial Visual Presentation (RSVP) paradigm to compare the martial arts routine athlete group (n = 31) with a control group (n = 33) in tasks requiring target stimulus identification under audiovisual congruent and incongruent conditions. Experiment 2 (n = 52) manipulated the synchronicity of auditory stimuli to differentiate between audiovisual integration and auditory alerting effects. Experiment 3 (n = 50) combined surprise and post-surprise tests to investigate the role of automatic auditory processing in this expert advantage. Experiment 1 revealed that martial arts routine athletes outperformed the control group, especially in semantically incongruent conditions, with significantly higher accuracy at both lag3 (p < 0.001, 95% CI = [0.165, 0.275]) and lag8 (p < 0.001, 95% CI = [0.242, 0.435]). Experiment 2 found no significant difference between groups in response to the manipulation of auditory stimulus synchronicity, ruling out an alerting effect. In Experiment 3, martial arts routine athletes demonstrated better performance in reporting unexpected auditory stimuli during the surprise test, indicating enhanced automatic processing capacity. Additionally, a significant improvement in working memory re-selection was observed in the martial arts routine group. The expert advantage effect observed in martial arts routine athletes is attributable to enhanced cross-audiovisual integration, independent of an auditory alerting mechanism. Long-term training improves the efficiency of working memory re-selection and the ability to inhibit conflicting information, suggesting that the expanded capacity for automatic auditory processing underpins their multisensory integration advantage. Full article

As autonomous driving technologies advance, the need for human-in-the-loop systems becomes increasingly critical to ensure safety, adaptability, and public confidence. This paper presents the design and evaluation of a context-aware immersive teleoperation interface that integrates real-time simulation, virtual reality, and multimodal feedback to support remote interventions in emergency scenarios. Built on a modular ROS2 architecture, the system allows seamless transition between simulated and physical platforms, enabling safe and reproducible testing. The experimental results show a high task success rate and user satisfaction, highlighting the importance of intuitive controls, gesture recognition accuracy, and low-latency feedback. Our findings contribute to the understanding of human-robot interaction (HRI) in immersive teleoperation contexts and provide insights into the role of multisensory feedback and control modalities in building trust and situational awareness for remote operators. Ultimately, this approach is intended to support the broader acceptability of autonomous driving technologies by enhancing human supervision, control, and confidence. Full article

Immersive technologies such as augmented reality (AR) and virtual reality (VR) have emerged as powerful tools in cultural heritage education and preservation. Building on prior work that demonstrated the effectiveness of gamified XR applications in engaging users with heritage content and drawing on existing studies in neuroscience and cognitive psychology, this study explores how immersive experiences support multisensory integration, emotional engagement, and spatial presence—all of which contribute to the deeper encoding and recall of heritage narratives. Through a theoretical lens supported by the empirical literature, we argue that the interactive and embodied nature of AR/VR aligns with principles of cognitive load theory, dual coding theory, and affective neuroscience, supporting enhanced learning and memory consolidation. This paper aims to bridge the gap between technological innovation and cognitive understanding in cultural heritage dissemination, identifying concrete design principles for memory-driven digital heritage experiences. While promising, these approaches also raise important ethical considerations, including accessibility, cultural representation, and inclusivity—factors essential for equitable digital heritage dissemination. Full article

Although measurements of urban shrinkage in China have received much attention, most have relied on statistical yearbook data based on political–administrative city boundaries, and remote-sensing-based quantification is mainly one-dimensional. This has caused problems in incorporating rural areas and spatiotemporal inconsistencies, as well as an inadequate understanding, which has subsequently resulted in an inaccurate shrinkage identification. This study merely utilized the latest multisensory and time-series remote sensing data, including nighttime light, land use, and population grids, to quantify the spatiotemporal patterns of multidimensional shrinkage based on the county-level urban entity mapping of Yangtze River Delta urban agglomerations (YRD-UAs) from 2003 to 2023. County-level urban entities were acquired from a pioneering mapping effort that utilized city-specific commuting distance and land use maps. The results demonstrated that urban entities in 215 counties grew at a generally slowing pace. The degree of economic, population, and space shrinkage was mainly slight, and the shrinking trajectory was dominated by temporary shrinkage. Most counties experienced population shrinkage in their coastal-oriented distribution, whereas economic shrinkage affected the fewest counties, with the lowest spatial clustering occurring northward. Population shrinkage also displayed the highest spatial autocorrelation, but its agglomeration weakened against space shrinkage clustering. This study concluded that the exclusive utilization of remote sensing products to measure urban-entity-based multidimensional shrinkage reduced the uncertainty associated with rural area inclusion and resulted in satisfactory assessment accuracy. The spatiotemporal patterns of multidimensional shrinkage suggested strengthening ecological land allocation within urban entities across the entire region, implementing polycentric development strategies in the north, as well as enhancing county-level economic governance in the northwest. This study presents a spatiotemporally comparable methodology for quantifying the multidimensional shrinking of county-level urban entities at a large scale and contributes to further optimizing the developments of YRD-UAs. Full article

Urban green spaces (UGSs) and forests play a vital role in shaping sustainable and livable cities, offering not only ecological benefits but also spaces that are essential for human well-being, social interactions, and everyday life. Understanding the landscape features that resonate most with public preferences is essential for enhancing the appeal, accessibility, and functionality of these environments. However, traditional approaches—such as surveys or single-data analyses—often lack the nuance needed to capture the complex and multisensory nature of human responses to green spaces. This study explores a cross-modal methodology that integrates natural language processing (NLP) and deep learning techniques to analyze text and image data collected from public reviews of 19 urban parks in Nanjing. By capturing both subjective emotional expressions and objective visual impressions, this study reveals a consistent public preference for natural landscapes, particularly those featuring evergreen trees, shrubs, and floral elements. Text-based data reflect users’ lived experiences and nuanced perceptions, while image data offers insights into visual appeal and spatial composition. By bridging human-centered insights with data-driven analysis, this research provides a robust framework for evaluating landscape preferences. It also underscores the importance of designing green spaces that are not only ecologically sound but also emotionally resonant and socially inclusive. The findings offer valuable guidance for the planning, design, and adaptive management of urban green infrastructure in ways that support healthier, more responsive, and smarter urban environments. Full article

This study introduces an educational framework that merges 3D modeling with AI-assisted narrative interaction to apply digital technology in cultural heritage education, exemplified by an ancient carriage culture. Through immersive tasks and contextual narratives, the course notably improved learners’ professional skills and cultural awareness. Experimental results revealed significant knowledge acquisition among participants post-engagement. Additionally, the user experience improved, with increased satisfaction in the narrative interaction design course. These enhancements led to heightened interest in cultural heritage and deeper knowledge acquisition. Utilizing Norman’s three-layer interaction model, Ryan’s contextual narrative theory, and Falk and Dierking’s museum learning experience model, the study developed a systematic course for multi-sensory design and contextual interaction, confirming the positive impact of multimodal interaction on learning outcomes. This research provides theoretical support for the digital transformation of cultural education and practical examples for educational practitioners and cultural institutions to implement in virtual presentations and online learning. Full article

Emotion recognition is an essential social ability that continues to develop across adolescence, a period of critical socio-emotional changes. In the present study, we examine how signals from different sensory modalities, specifically touch and facial expressions, are integrated into a holistic understanding of another’s feelings. Adolescents (n = 30) and young adults (n = 30) were presented with dynamic faces displaying either a positive (happy) or a negative (sad) expression. Crucially, facial expressions were anticipated by a tactile stimulation, either positive or negative. Across two experiments, we use different tactile primes, both in first-person experience (experiment 1) and in the vicarious experience of touch (experiment 2). We measured accuracy and reaction times to investigate whether tactile stimuli affect facial emotional processing. In both experiments, results indicate that adolescents were more sensitive than adults to the influence of tactile primes, suggesting that sensory cues modulate adolescents’ accuracy and velocity in evaluating emotion facial expression. The present findings offer valuable insights into how tactile experiences might shape and support emotional development and interpersonal social interactions. Full article

Ubiquitous blended learning, leveraging mobile devices, has democratized education by enabling autonomous and readily accessible knowledge acquisition. However, its reliance on traditional interfaces often limits learner immersion and meaningful interaction. The emergence of the wearable metaverse offers a compelling solution, promising enhanced multisensory experiences and adaptable learning environments that transcend the constraints of conventional ubiquitous learning. This research proposes a novel framework for ubiquitous blended learning in the wearable metaverse, aiming to address critical challenges, such as multi-source data fusion, effective human–computer collaboration, and efficient rendering on resource-constrained wearable devices, through the integration of embodied interaction and multi-agent collaboration. This framework leverages a real-time multi-modal data analysis architecture, powered by the MobileNetV4 and xLSTM neural networks, to facilitate the dynamic understanding of the learner’s context and environment. Furthermore, we introduced a multi-agent interaction model, utilizing CrewAI and spatio-temporal graph neural networks, to orchestrate collaborative learning experiences and provide personalized guidance. Finally, we incorporated lightweight SLAM algorithms, augmented using visual perception techniques, to enable accurate spatial awareness and seamless navigation within the metaverse environment. This innovative framework aims to create immersive, scalable, and cost-effective learning spaces within the wearable metaverse. Full article

With the widespread adoption of mobile reading across diverse scenarios, understanding environmental impacts on attention has become crucial for reading performance optimization. Building upon this premise, the study examined the impacts of different reading environments on attention during mobile reading, utilizing a mixed-methods approach that combined eye-tracking experiments with semi-structured interviews. Thirty-two college students participated in the study. Quantitative attention metrics, including total fixation duration and fixation count, were collected through eye-tracking, while qualitative data regarding perceived environmental influences were obtained through interviews. The results indicated that the impact of different environments on mobile reading attention varies significantly, as this variation is primarily attributable to environmental complexity and individual interest. Environments characterized by multisensory inputs or dynamic disturbances, such as fluctuating noise and visual motion, were found to induce greater attentional dispersion compared to monotonous, low-variation environments. Notably, more complex potential task-like disturbances (e.g., answering calls, conversations) were found to cause the greatest distraction. Moreover, stimuli aligned with an individual’s interests were more likely to divert attention compared to those that did not. These findings contribute methodological insights for optimizing mobile reading experiences across diverse environmental contexts. Full article

This paper explores the potential and implications arising from the convergence of virtual reality, the metaverse, and digital twins in translating a real-world commemorative event into a virtual environment. It emphasizes how such integration influences digital transformation processes, particularly in reshaping models of social interaction. Virtual reality is conceptualized as an immersive technology, enabling advanced multisensory experiences within persistent virtual spaces, such as the metaverse. Furthermore, this study delves into the concept of digital twins—high-fidelity virtual representations of physical systems, processes, and objects—highlighting their application in simulation, analysis, forecasting, prevention, and operational enhancement. In the context of virtual events, the convergence of these technologies is examined as a means to create interactive, adaptable, and scalable environments capable of accommodating diverse social groups and facilitating global accessibility. As a practical application, a digital twin of the Ferrándiz and Carbonell buildings—the most iconic architectural ensemble on the Alcoi campus—was developed to host a virtual event commemorating the 50th anniversary of the integration of the Alcoi School of Industrial Technical Engineering into the Universitat Politècnica de València in 1972. The virtual environment was subsequently evaluated by a sample of users, including students and faculty, to assess usability and functionality, and to identify areas for improvement. The digital twin achieved a score of 88.39 out of 100 on the System Usability Scale (SUS). The findings underscore the key opportunities and challenges associated with the adoption of these emerging technologies, particularly regarding their adaptability in reconfiguring digital environments for work, social interaction, and education. Using this case study as a foundation, this paper offers insights into the strategic role of the metaverse in extending environmental perception and its transformative potential for the future digital ecosystem through the implementation of digital twins. Full article

While poetry has long relied on musical and visual elements for its communicative power, numerous contemporary poets are drawing so dramatically on the resources of the visual arts and on elements of musical scoring that their poems become inter-arts hybrids. The interdisciplinary character of environmental writing and its attachment to material conditions of planetary life particularly invite the use of visual and/or audio technologies as documentation or as prompts toward multisensory attention that may shift readers’ perceptions of the more-than-human world. This essay examines four recent works of ecopoetry from the US to explore some of the diverse ways in which, by integrating into volumes of poetry their own visual and musical art, poets are expanding the environmental imagination and enhancing their environmental messaging. The visual and musical elements, I argue, offer fresh perceptual lenses that help break down cognitive habits bolstering separations of Western humans from more-than-human realms or dampening awareness of social and cultural norms that foster environmental degradation and violations of environmental justice. The multi-modal works discussed are Jennifer Scappettone’s The Republic of Exit 43, JJJJJerome Ellis’s Aster of Ceremonies, Danielle Vogel’s Edges & Fray, and Jonathan Skinner’s “Blackbird Stanzas.” Full article

Vinegar functions not only as a sensory enhancer but also as a culturally embedded culinary element across global food systems. In Taiwanese cuisine, black vinegar represents a traditional staple, particularly associated with dumpling consumption, whereas Italian balsamic vinegar is renowned for its aromatic complexity and nuanced sweetness, highly esteemed in Western gastronomy. Despite their culinary significance, limited empirical research has examined how these culturally distinct condiments are perceived when applied beyond their traditional contexts, especially in iconic national dishes. This study investigates Taiwanese consumers’ cross-cultural sensory responses to dumplings paired with either local black vinegar or imported balsamic vinegar. Through a structured sensory evaluation encompassing appearance, aroma, taste, and overall impression, this research explores how sensory cues and cultural expectations interact to shape flavor preferences. The results indicate that although visual attributes were rated similarly, balsamic vinegar’s distinctive aroma and taste elicited significantly greater sensory engagement, suggesting a latent openness to reinterpretation and hybridization within established food practices. These findings were supported by one-way ANOVA results, which revealed significant differences among the three groups for aroma (F = 6.30, p < 0.01), taste (F = 7.21, p < 0.01), and overall evaluation (F = 15.15, p < 0.001). By integrating sensory analysis with cultural food studies, this research advances the understanding of how multisensory cues influence consumer acceptance across cultural contexts. It further highlights the dynamic interplay between cultural familiarity and sensory novelty in flavor perception. These insights yield practical implications for culinary innovation, global flavor localization, and the development of culturally responsive food products. Full article

This article presents research and a discussion on the proper use of filtration in optical measurements. Measurements were taken using a Werth multisensory machine using a Werth Zoom optical sensor. During optical measurements, the filtration option can be used. The manufacturer defines filters as “Dust”. They allow the machine operator to define the appropriate size depending on the type of inclusions or artifacts created in the production process. They can occur in processes such as punching on presses or production in the injection molding process of plastics. The presented research results and statistical analyses confirm the assumptions regarding the validity of using filters and their values. The use of filters with a higher value significantly affects the obtained results and forces the machine user to make a reasonable choice. Full article

The perceived quality of extra virgin olive oil (EVOO) arises from the multisensory integration of multimodal stimuli, primarily driven by non-volatile and volatile organic compounds (VOCs). Given that EVOO is frequently consumed in combination with other foods, cross-modal interactions, encompassing both internal and external elements, play a crucial role in shaping its sensory perception. A more realistic representation of EVOO perception can be achieved by considering these cross-modal effects and their temporal dynamics. This study employed dynamic sensory and instrumental techniques to investigate the product-related mechanisms that influence EVOO flavor perception. Ten trained panelists (mean age = 41.5 years; 50% female) evaluated two EVOO samples under two consumption conditions: alone and accompanied by a solid carrier (bread or chickpeas). Temporal Check-All-That-Apply (TCATA) and nose-space analysis using Proton-Transfer-Reaction Time-of-Flight Mass Spectrometry (PTR-ToF-MS) were conducted simultaneously. Sensory descriptors and mass spectral peaks were analyzed through temporal curve indices (Area Under the Curve, Maximum Citation/Concentration, Time to Maximum), which were then used to construct multi-dimensional sensory and VOC release maps. Findings revealed that the composition and texture of the food carriers had a greater influence on temporal flavor perception than the variability in VOCs released by the different EVOO samples. These results underscore the importance of considering cross-modal sensory interactions when predicting EVOO flavor perception. The carriers modulated both the perception and VOC release, with effects dependent on their specific composition and texture. This methodological approach enabled a deeper understanding of the dynamic relationship between VOC release and EVOO sensory experience. Full article

Accessible tools for post-stroke motor rehabilitation are critically needed to promote recovery beyond clinical settings. This pilot study evaluated the impact of a posture correction intervention using the Postural SmartVest, a wearable device that delivers multisensory feedback via a smartphone app. Forty individuals with post-stroke hemiparesis participated in a single supervised session, during which each patient completed the same four-phase functional protocol: multidirectional walking, free walking toward a refrigerator, an upper-limb reaching and object-handling task, and walking back to the starting point. Under the supervision of their therapists, each patient performed the full protocol twice—first without feedback and then with feedback—which allowed within-subject comparisons across multiple metrics, including upright posture duration, number and frequency of posture-related events, and temporal distribution. Additional analyses explored associations with demographic and clinical variables and identified predictors through regression models. Wilcoxon signed-rank and Mann–Whitney U tests showed significant improvements with feedback, including an increase in upright posture time ($p<0.001$), an increase in the frequency of upright posture events ($p<0.001$), and a decrease in the total task time ($p=0.038$). No significant subgroup differences were found for age, sex, lateralization, or stroke chronicity. Regression models did not identify significant predictors of improvement. Full article