Search Results (37)

As autonomous driving technologies advance, the need for human-in-the-loop systems becomes increasingly critical to ensure safety, adaptability, and public confidence. This paper presents the design and evaluation of a context-aware immersive teleoperation interface that integrates real-time simulation, virtual reality, and multimodal feedback to support remote interventions in emergency scenarios. Built on a modular ROS2 architecture, the system allows seamless transition between simulated and physical platforms, enabling safe and reproducible testing. The experimental results show a high task success rate and user satisfaction, highlighting the importance of intuitive controls, gesture recognition accuracy, and low-latency feedback. Our findings contribute to the understanding of human-robot interaction (HRI) in immersive teleoperation contexts and provide insights into the role of multisensory feedback and control modalities in building trust and situational awareness for remote operators. Ultimately, this approach is intended to support the broader acceptability of autonomous driving technologies by enhancing human supervision, control, and confidence. Full article

Sustainable and technology-enhanced learning (TEL) plays a crucial role in supporting learners with dyslexia by providing accessible, personalized, and inclusive educational experiences. The case study discusses learning challenges of students with dyslexia due to both pedagogical and technological factors. Traditional teaching methods that rely heavily on text-based instruction can make it difficult for them to process and retain information. Many digital tools and learning platforms are not designed with accessibility features like text-to-speech or dyslexia-friendly fonts, making it harder for dyslexic students to engage with content. A lack of individualized instructional approaches, such as multisensory learning or adaptive learning technologies, can hinder their progress. Additionally, inadequate teacher training on dyslexia-friendly strategies can result in ineffective support in the classroom. The aim of this paper is to identify the most appropriate pedagogical and technological aspects and their applicability to the development of tools for dyslexic learners and to elucidate the most effective way of learning according to needs. This paper presents a case study on the learning object design to overcome dyslexia barriers and improve the quality of students’ learning. Full article

The exploitation of immersive simulation platforms to improve traditional training techniques in the agricultural industry sector would enable year-round accessibility, flexibility, safety, and consistent high-quality training for agricultural operators. An innovative workflow in virtual simulations for training and educational purposes includes an immersive environment in which the operator can interact with plants through haptic interfaces, following instructions imparted by a non-playing character (NPC) instructor. This study allows simulating the pruning of a complex case study, a hazelnut tree, reproduced in very high detail to offer agricultural operators a more realistic and immersive training environment than those currently existing. The process of creating a multisensorial environment starts with the integrated survey of the plant with a laser scanner and photogrammetry and then generates a controllable parametric model from roots to leaves with the exact positioning of the original branches. The model is finally inserted into a simulation, where haptic gloves with tactile resistance responsive to model collisions are tested. The results of the experimentation demonstrate the correct execution of this innovative design simulation, in which branches and leaves can be cut using a shear, with immediate sensory feedback. The project therefore aims to finalize this product as a realistic training platform for pruning, but not limited to it, paving the way for high-fidelity simulation for many other types of operations and specializations. Full article

Objective: Mental fatigue (MF) induced by prolonged cognitive tasks poses significant risks to postural stability, yet its effects on multi-sensory integration remain poorly understood. Method: This study investigated how MF alters sensory reweighting and postural control in 27 healthy young males. A 45 min incongruent Stroop task was employed to induce MF, validated via subjective Visual Analog Scale (VAS) scores and psychomotor vigilance tests. Postural stability was assessed under four sensory perturbation conditions (O-H: no interference; C-H: visual occlusion; O-S: proprioceptive perturbation; C-S: combined perturbations) using a Kistler force platform. Center of pressure (COP) signals were analyzed through time-domain metrics, sample entropy (SampEn), and Discrete Wavelet Transform (DWT) to quantify energy distributions across sensory-related frequency bands (visual: 0–0.1 Hz; vestibular: 0.1–0.39 Hz; cerebellar: 0.39–1.56 Hz; proprioceptive: 1.56–6.25 Hz). Results: MF significantly reduced proprioceptive energy contributions (p < 0.05) while increasing vestibular reliance under O-S conditions (p < 0.05). Time-domain metrics showed no significant changes in COP velocity or displacement, but SampEn decreased under closed-eye conditions (p < 0.001), indicating reduced postural adaptability. DWT analysis highlighted MF’s interaction with visual occlusion, altering cerebellar and proprioceptive energy dynamics (p < 0.01). Conclusion: These findings demonstrate that MF disrupts proprioceptive integration, prompting compensatory shifts toward vestibular and cerebellar inputs. The integration of nonlinear entropy and frequency-domain analyses advances methodological frameworks for fatigue research, offering insights into real-time sensor-based fatigue monitoring and balance rehabilitation strategies. This study underscores the hierarchical interplay of sensory systems under cognitive load and provides empirical evidence for optimizing interventions in high-risk occupational and clinical settings. Full article

A high prevalence of chronic diseases exposes diverse healthcare pain points due to the limited effectiveness of pharmaceutical drugs and biologics, sedentary lifestyles, insufficient health literacy, chronic stress, unsatisfactory patient experience, environmental pollution and competition with commercial determinants of health. To improve patient care and long-term outcomes, the impact of the home environment is overlooked and underutilized by healthcare. This cross-disciplinary work describes perspectives on (1) the home environment as a therapeutic target for the prevention and treatment of chronic diseases and (2) transforming health-centric household goods e-commerce platforms into digital health interventions. We provide a rationale for creating therapeutic home environments grounded in biophilic design (multisensory, environmental enrichment) and supporting physical activities, quality sleep, nutrition, music, stress reduction, self-efficacy, social support and health education, hence providing clinical benefits through the modulation of the autonomic nervous system, neuroplasticity and behavior change. These pleiotropic “active non-pharmacological ingredients” can be personalized for people living with depression, anxiety, migraine, chronic pain, cancer, cardiovascular and other conditions. We discuss prospects for integrating e-commerce with digital health platforms to create “therapeutic home environment” interventions delivered through digital therapeutics and their combinations with prescription drugs. This multimodal approach can enhance patient engagement while bridging consumer spending with healthcare outcomes. Full article

Embodiment lies at the core of music cognition, prompting recent pedagogical shifts towards a multi-sensory, whole-body approach. However, the education of oral music genres that rely exclusively on direct teacher–disciple transmission through live demonstration and imitation is now undergoing a transformation by rapidly adapting to technology-mediated platforms. This paper examines challenges in embodied facets of video-mediated synchronous distance Hindustani music pedagogy. For this, it takes an ethnomusicological stance and showcases a thematic analysis of interviews featuring Dhrupad music practitioners. The analysis is driven and organized by the 4E Cognition principles, which stress the intimate relationship between body, mind, and environment. Findings indicate that while this adaptation aims to make music content more widely accessible, it comes at the cost of reducing opportunities for multi-modal engagement and interaction among participants. Results reveal limitations in transmitting non-verbal, embodied, multi-sensory cues, along with visual and acoustic disruptions of a sense of shared spatial and physical context, that hinder effective interaction and a sense of immersion, elements that are deemed vital in music education. They prompt concerns about the suitability of conventional videoconferencing platforms and offer key insights for the development of alternative technologies that can better assist embodied demands of the pedagogical practices involved. Full article

The advent of Industry 4.0 necessitates substantial interaction between humans and machines, presenting new challenges when it comes to evaluating the stress levels of workers who operate in increasingly intricate work environments. Undoubtedly, work-related stress exerts a significant influence on individuals’ overall stress levels, leading to enduring health issues and adverse impacts on their quality of life. Although psychological questionnaires have traditionally been employed to assess stress, they lack the capability to monitor stress levels in real-time or on an ongoing basis, thus making it arduous to identify the causes and demanding aspects of work. To surmount this limitation, an effective solution lies in the analysis of physiological signals that can be continuously measured through wearable or ambient sensors. Previous studies in this field have mainly focused on stress assessment through intrusive wearable systems susceptible to noise and artifacts that degrade performance. One of our recently published papers presented a wearable and ambient hardware-software platform that is minimally intrusive, able to detect human stress without hindering normal work activities, and slightly susceptible to artifacts due to movements. A limitation of this system is its not very high performance in terms of the accuracy of detecting multiple stress levels; therefore, in this work, the focus was on improving the software performance of the platform, using a deep learning approach. To this purpose, three neural networks were implemented, and the best performance was achieved by the 1D-convolutional neural network with an accuracy of 95.38% for the identification of two levels of stress, which is a significant improvement over those obtained previously. Full article

In 2022, the National Museum of Australia launched an immersive virtual exhibition of Australian Aboriginal art: Connection: Songlines from Australia’s First Peoples, which was created and produced by Grande Experiences, the same team that produced the multisensory experience Van Gogh Alive. The exhibition employs large-scale projections and cutting-edge light and sound technology to offer a mesmerizing glimpse into the intricate network of Australian Aboriginal art, which is an ancient pathway of knowledge that traverses the continent. Serving as the gateway to the Songlines universe, the exhibition invites visitors to delve into the profound spiritual connections with the earth, water, and sky, immersing them in a compellingly rich and thoroughly captivating narrative with a vivid symphony of sound, light, and color. This article examines Connection as a digital storytelling platform by exploring the Grande Experiences company’s approach to the digital replication of Australian Aboriginal art, with a focus on the connection between humans and nature in immersive exhibition spaces. Full article

Despite the known benefits of social-emotional learning (SEL) for children, evidence-based, culturally sensitive, and multisensory SEL programs are limited. To address existing challenges in SEL for underprivileged youth, we developed the multicomponent B.E. M.Y. F.R.I.E.N.D. (BMF) framework that capitalizes on (1) cultural tailoring to foster acceptability, (2) tools and strategies to build healthy habits, (3) parental engagement using the Child-Mediated Health Communication Model, (4) social engagement of teachers via peer interaction during learning experiences, and (5) multisensory learning. Each letter (component) of the BMF stands for a unique SEL skill. To test the BMF framework, we developed a proof of concept (POC) focused on one component of the BMF—mindfulness and gratitude SEL (M-letter). The POC includes a description of immersive and interactive multimedia modules with tailor-made music, digital games, cartoons, and booster activities. The outcomes from the POC will inform the development of fully powered randomized studies of each component of BMF and, ultimately, the implementation and dissemination of the entire BMF program. The Multisensory Multilevel Health Education Model (MMHEM) guided the design of the program. In the POC, we used a learning management system (LMS) platform to facilitate program scalability. The modules encompassed culturally and age-relevant real-world examples and were digitized and integrated with traditional learning approaches. This article presents qualitative and quantitative data evaluating feasibility, preliminary acceptability, and preliminary outcomes from the mindfulness and gratitude modules (letter “M” of the BMF). The studies were conducted with 4th and 5th-grade students (Studies 2–4) attending a New York City public school-affiliated after-school program in the Bronx and Queens and their teachers (Study 1). Study #1 presents the focus group data on teachers and principals; Study #2 shows the focus group data on minoritized students; Study #3 presents data from the pilot testing of study-specific outcome measures; and Study #4 presents data on the preliminary efficacy of the BMF mindfulness and gratitude modules using a within-subjects repeated measures pre-posttest study design. Results suggest that the “M” component (mindfulness and gratitude) of the BMF framework is feasible and highly engaging among minoritized children, with high acceptability among teachers and students. We also found a positive impact of the intervention on measures of gratitude and life satisfaction (preliminary efficacy). Full article

Background: Falls and related injuries are critical issues in several disease states, as well as aging, especially when interactions between vestibular and visual sensory inputs are involved. Slow support surface tilt (0.6 deg/s) followed by subjective postural horizontal (SPH) assessments have been proposed as a viable method for assessing otolith contributions to balance control. Previous assessments of perceived body alignment to vertical, including subjective visual vertical, have suggested that visual inputs are weighted more when vestibular information is near the threshold and less reliable during slow body tilt. To date, no studies have examined the influence of visual stimuli on slow roll-tilt postural responses and the SPH. Therefore, this study investigated how dynamic visual cues, in the form of circular vection (CV), influence postural responses and the perception of the horizontal during and after support surface tilt. Methods: Ten healthy young adults (6 female, mean age 23) wore a head-mounted display while standing on a tilting platform. Participants were asked to remain upright for 30 s, during which (1) the visual scene rotated, inducing roll CV clockwise (CW) or counter-clockwise (CCW) at 60°/s; (2) the platform only (PO) rotated in roll to test SPH (0.6°/s, 2°, CW or CCW); (3) a combination of both; or (4) neither occurred. During SPH trials, participants used a hand-held device to reset the position of the platform to 0.8°/s to their perceived SPH. The angular motion of body segments was measured using pairs of light-emitting diodes mounted on the head, trunk and pelvis. Segment motion, prior to platform motion, was compared to that at peak body motion induced by platform motion and when SPH had been set. Results: When the support surface was tilted 2°, peak upper body tilt significantly increased for congruent CV and platform tilt and decreased at the pelvis for incongruent CV when compared to PO, leading to significant differences across body segments for congruent and incongruent conditions (p ≤ 0.008). During PO, participants’ mean SPH deviated from horizontal by 0.2°. The pelvis deviated 0.2°, the trunk 0.3°, and the head 0.5° in the direction of initial platform rotation. When platform tilt and CV directions were congruent or incongruent, only head tilt at SPH reset under congruent conditions was significantly different from the PO condition (1.7° vs. 0.5°). Conclusions: Roll CV has a significant effect on phasic body responses and a less significant effect on tonic body responses to lateral tilt. The SPH of the support surface was not altered by CV. Responses during tilt demonstrated enhanced reactions for congruent and reduced reactions for incongruent CV, both different from responses to CV alone. Tonic body displacements associated with SPH were changed less than those during tilt and were only slightly larger than displacements for CV alone. This study supports the hypothesis of weighted multisensory integration during dynamic postural tasks being highly dependent on the direction of visual cues during tilt and less dependent on tonic SPH offsets. These techniques could be used to examine vestibular and visual interactions within clinical populations, particularly those with visual vertigo and dizziness. Full article

Over the past twenty years, the use of electronic mobile sensors by children and youngsters has played a significant role in environmental education projects in Portugal. This paper describes a research synthesis of a set of case studies (environmental education projects) on the use of sensors as epistemic mediators, evidencing the technological, environmental, social, and didactical dimensions of environmental education projects over the last two decades in Portugal. The triggers of the identified changes include: (i) the evolution of sensors, information and communication platforms, and mobile devices; (ii) the increasing relevance of environmental citizenship and participation; (iii) the recognition of the role of multisensory situated information and quantitative information in environmental citizenship; (iv) the cause–effect relation between didactical strategies and environmental education goals; (v) the potential of sensory and epistemic learners’ practices in the environment to produce learning outcomes and new knowledge. To support the use of senses and sensors in environmental education projects, the SEAM model was created based on the developed research synthesis. Full article

Challenges associated with plastic waste management range from littering to high collection costs to low recycling rates. Effective collection of plastics is obviously an important step in the management of plastic waste and has an impact on recycling rates. For this reason, several countries have transformed their collection systems in recent decades. Collecting more plastic packaging comes at a cost, as the feedstock for the sorting process becomes more complex and leads to cross-contamination within the sorted fractions. Therefore, a balance must be obtained between some elements, such as the design of packaging, collection and recycling rates, and finally, the quality of fractions that have been sorted. Further investment to improve pretreatment, sorting, and recycling technologies and simpler recyclable packaging designs are, therefore, key to further increasing plastic recycling rates. It is essential to possess more data, especially on the type of containers and plastics, and examine how often unsorted waste is collected. The automated waste collection monitoring system is a step forward in automating manual waste collection and sorting. Multi-sensory artificial intelligence (AI) for sorting plastic waste and the blockchain sorting platform for the circular economy of plastic waste are forward-looking activities that will increase the efficiency of recycling plastic waste. This review focuses on the development of collection systems and sorting processes for post-consumer plastic recycling. The focus is on best practices and the best available technology. Separate collection systems for recyclable plastics are presented and discussed along with their respective technical collection and sorting solutions, taking into consideration that progress in separation and sorting systems are implicitly linked to approaches to waste collection. Full article

Creativity plays a significant role in competitive product ideation. With the increasing emergence of Virtual Reality (VR) and Artificial Intelligence (AI) technologies, the link between such technologies and product ideation is explored in this research to assist and augment creative scenarios in the engineering field. A bibliographic analysis is performed to review relevant fields and their relationships. This is followed by a review of current challenges in group ideation and state-of-the-art technologies with the aim of addressing them in this study. This knowledge is applied to the transformation of current ideation scenarios into a virtual environment using AI. The aim is to augment designers’ creative experiences, a core value of Industry 5.0 that focuses on human-centricity, social and ecological benefits. For the first time, this research reclaims brainstorming as a challenging and inspiring activity where participants are fully engaged through a combination of AI and VR technologies. This activity is enhanced through three key areas: facilitation, stimulation, and immersion. These areas are integrated through intelligent team moderation, enhanced communication techniques, and access to multi-sensory stimuli during the collaborative creative process, therefore providing a platform for future research into Industry 5.0 and smart product development. Full article

Virtual events have become more popular recently, and while these events have the potential to be inclusive to a broader range of attendees, there is limited information available on how to plan and deliver a virtual, accessible, and bilingual event. The objective of this paper is to share how our team planned and delivered a virtual conference that was fully bilingual and accessible to individuals with disabilities by incorporating closed captions, sign language interpretation, language interpretation (audio), regularly scheduled breaks, and a multi-sensory experience. We describe our approaches to planning the conference, such as including individuals with disabilities in decision-making, selecting virtual conference platforms, captioners, and interpreters, and how we incorporated a multi-sensory experience. The paper also summarizes feedback we received from our attendees using a post-conference evaluation survey and our team’s reflections on positive aspects of the conference and opportunities for improvement. We conclude by providing a set of practical recommendations that we feel may be helpful to others planning virtual accessible bilingual conferences in the future. Full article

The aim of this study is to extract impervious surfaces and show their spatial distribution, using different machine learning algorithms. For this purpose, geoprocessing and remote sensing techniques were used and three classification methods for digital images were compared, namely Support Vector Machines (SVM), Maximum Likelihood (ML) and Random Trees (RT) classifiers. The study area is one of the most prestigious and the largest housing estates in Warsaw (Poland), the Fort Bema housing complex, which is also an exemplary model for hydrological solutions. The study was prepared on the Geographic Information System platform (GIS) using aerial optical images, orthorectified and thus provided with a suitable coordinate system. The use of these data is therefore supported by the accuracy of the resulting infrared channel product with a pixel size of 0.25 m, making the results much more accurate compared to satellite imagery. The results of the SVM, ML and RT classifiers were compared using the confusion matrix, accuracy (Root Mean Square Error /RMSE/) and kappa index. This showed that the three algorithms were able to successfully discriminate between targets. Overall, the three classifiers had errors, but specifically for impervious surfaces, the highest accuracy was achieved with the SVM classifier (the highest percentage of overall accuracy), followed by ML and RT with 91.51%, 91.35% and 84.52% of the results, respectively. A comparison of the visual results and the confusion matrix shows that although visually the RT method appears to be the most detailed classification into pervious and impervious surfaces, the results were not always correct, e.g., water/shadow was detected as an impervious surface. The NDVI index was also mapped for the same spatial study area and its application in the evaluation of pervious surfaces was explained. The results obtained with the GIS platform, presented in this paper, provide a better understanding of how these advanced classifiers work, which in turn can provide insightful guidance for their selection and combination in real-world applications. The paper also provides an overview of the main works/studies dealing with impervious surface mapping, with different methods for their assessment (including the use of conventional remote sensing, NDVI, multisensory and cross-source data, ‘social sensing’ and classification methods such as SVM, ML and RT), as well as an overview of the research results. Full article