In contrast to sighted students who acquire mathematical expressions (MEs) from their visual sources, blind students must keep MEs in their memory using the Tactile or Auditory Modality. In this work, we rigorously investigate the ability to temporar...
Background: This study examined condition-dependent electroencephalography (EEG) changes under progressive degradation of visual and tactile information. Methods: Using a controlled visual–tactile paradigm, we systematically manipulated visual...
With the increasing complexity of robotic missions and the development towards long-term autonomous systems, the need for multi-modal sensing of the environment increases. Until now, the use of tactile sensor systems has been mostly based on sensing...
Understanding surface textures through visual cues is crucial for applications in haptic rendering and virtual reality. However, accurately translating visual information into tactile feedback remains a challenging problem. To address this challenge,...
Surface material recognition is a key component in robotic perception and physical interaction, particularly when leveraging both tactile and visual sensory inputs. In this work, we propose Surformer v1, a transformer-based architecture designed for...
Modern robots fall behind humans in terms of the ability to discriminate between textures of objects. This is due to the fact that robots lack the ability to detect the various tactile modalities that are required to discriminate between textures of...
Information obtained from multiple sensory modalities, such as vision and touch, is integrated to yield a holistic percept. As a haptic approach usually involves cross-modal sensory experiences, it is necessary to develop an apparatus that can chara...
A human can infer the magnitude of interaction force solely based on visual information because of prior knowledge in human–robot interaction (HRI). A method of reconstructing tactile information through cross-modal signal processing is propose...
In the early 2020s, the coronavirus pandemic brought the notion of remotely connected care to the general population across the globe. Oftentimes, the timely provisioning of access to and the implementation of affordable care are drivers behind tele-...
Background: When engaging with the environment, multisensory cues interact and are integrated to create a coherent representation of the world around us, a process that has been suggested to be affected by the lack of visual feedback in blind individ...
To explore whether temporal electroencephalography (EEG) traits can dissociate the physical properties of touching objects and the congruence effects of cross-modal stimuli, we applied a machine learning approach to two major temporal domain EEG trai...
This study aims to investigate the effects of a synchronous rhythmic–auditory stimulation (RAS) and vibrotactile wristband system on walking performance and subjective responses of older adults in a public transportation context. In the experim...
There has been a great deal of research investigating intrinsic/extrinsic cues and their influences on consumer perception and purchasing decisions at points of sale, product usage, and consumption. Consumers create expectations toward a food product...
Cochlear implants (CIs) recover hearing in severely to profoundly hearing-impaired people by electrically stimulating the cochlea. While they are extremely effective, spatial hearing is typically severely limited. Recent studies have shown that hapti...
Numerous technological solutions have been proposed to promote piano learning and teaching, but very few with market success. We are convinced that users’ needs should be the starting point for an effective and transdisciplinary development process o...
Background: During the last trimester of pregnancy, about 80% of the infant’s calcium is incorporated, and for this reason, preterm infants have less bone mineralization compared to those born at term. The aim of the present systematic review was to...
A commonly cited reason for the high abandonment rate of myoelectric prostheses is a lack of grip force sensory feedback. Researchers have attempted to restore grip force sensory feedback by stimulating the residual limb’s skin surface in respo...
Research exploring the impact of development and aging on working memory (WM) has primarily concentrated on visual and verbal domains, with limited attention paid to the tactile modality. The current study sought to evaluate WM encompassing storage a...
Several studies have found in the sense of touch a good sensory modality by which to study body representation. Here, we address the “metric component of body representation”, a specific function developed to process the discrimination of tactile dis...
Reusing the tactile knowledge of some previously-explored objects (prior objects) helps us to easily recognize the tactual properties of new objects. In this paper, we enable a robotic arm equipped with multi-modal artificial skin, like humans, to ac...
During the last decades, smart tactile sensing systems based on different sensing techniques have been developed due to their high potential in industry and biomedical engineering. However, smart tactile sensing technologies and systems are still in...
Background: Working memory (WM) involves temporarily storing and manipulating information. Research on the impact of aging on WM has shown inconsistent results regarding the decline in visual and verbal WM, with a lack of studies on tactile WM. This...
Tactile sensing helps robots interact with humans and objects effectively in real environments. Piezoelectric polymer sensors provide the functional building blocks of the robotic electronic skin, mainly thanks to their flexibility and suitability fo...
13 March 2023
Objective: To evaluate and compare the effects of conventional proprioceptive training and games with motion monitoring on plantar tactile sensitivity in older women. Methods: A randomized controlled clinical trial, with 50 older women randomized int...
Vision and touch are fundamental sensory modalities that enable humans to perceive and interact with objects in their environment. Vision facilitates the perception of attributes such as shape, color, and texture from a distance, while touch provides...
4 March 2026
With the rapid growth of e-commerce platforms, consumers increasingly make purchase decisions without direct physical interaction, particularly for tactile-dependent categories such as furniture and home décor. Drawing on embodied cognition, t...
Traditional tactile brain–computer interfaces (BCIs), particularly those based on steady-state somatosensory–evoked potentials, face challenges such as lower accuracy, reduced bit rates, and the need for spatially distant stimulation poin...
15 July 2025
Emotion recognition is an essential social ability that continues to develop across adolescence, a period of critical socio-emotional changes. In the present study, we examine how signals from different sensory modalities, specifically touch and faci...
We investigate crosstalk effects in a dual-modality tactile–proximity sensing system based on Time-of-Flight (ToF) technology integrated within a flat poly(methyl methacrylate) (PMMA) light guide. Building on the OptoSkin framework, we employ t...
Tactile sensing is an important perceptual modality that enables robots to understand human contact behaviors. Estimating the fingertip contact angle based on tactile pressure distribution provides a simplified representation of the finger’s co...
Enabling touch-sensing capability would help appliances understand interaction behaviors with their surroundings. Many recent studies are focusing on the development of electronic skin because of its necessity in various application domains, namely a...
Background and Clinical Significance: Understanding early brain development in infants is essential as identifying an abnormal pattern could accelerate the start of early interventions. There is still limited evidence on how external stimuli (such as...
Background: Working memory (WM) impairment is a potential consequence of motor aphasia resulting from left-hemisphere ischemic stroke. While verbal WM has been studied extensively in this disorder, research regarding non-verbal modalities remains lim...
Altered somatosensory function is common among stroke survivors, yet is often poorly characterized. Methods of profiling somatosensation that illustrate the variability in impairment within and across different modalities remain limited. We aimed to...
Assistive technology uses multi-modal feedback devices, focusing on the visual, auditory, and haptic modalities. Tactile devices provide additional information via touch sense. Perception accuracy of vibrations depends on the spectral and temporal at...
Accurate grasping state detection is critical to the dexterous operation of robots. Robots must use multiple modalities to perceive external information, similar to humans. The direct fusion method of visual and tactile sensing may not provide effect...
External cognitive burden has long been considered an important factor causing pedestrian navigation safety problems, as pedestrians in navigation inevitably acquire external information through their senses. Therefore, the influences of different ty...
Emotion recognition has increased the potential of affective computing by getting an instant feedback from users and thereby, have a better understanding of their behavior. Physiological sensors have been used to recognize human emotions in response...
Despite the use of tactile graphics and audio guides, blind and visually impaired people still face challenges to experience and understand visual artworks independently at art exhibitions. Art museums and other art places are increasingly exploring...
Tactile sensors are needed for effectively controlling the interaction between a robotic hand and the environment, e.g., during manipulation of objects, or for the tactile exploration of unstructured environments, especially when other sensing modali...
Reliable tactile object shape recognition on robotic hands is often achieved using dense sensor arrays or vision-based tactile skins, which increase fabrication complexity and computational cost. This work demonstrates that high-recognition performan...
The development of assistive technologies is improving the independent access of blind and visually impaired people to visual artworks through non-visual channels. Current single modality tactile and auditory approaches to communicate color contents...
Background: When exploring audio-tactile nautical charts without vision, users could trigger vocal announcements of a seamark’s name thanks to video tracking. In a first condition they could simply use a green sticker fastened at the tip of a f...
Proper feedback is essential in gaze based interfaces, where the same modality is used for both perception and control. We measured how vibrotactile feedback, a form of haptic feedback, compares with the commonly used visual and auditory feedback in...
We present an integrated sensing glove that combines two of the most visionary wearable sensing technologies to provide both hand posture sensing and tactile pressure sensing in a unique, lightweight, and stretchable device. Namely, hand posture reco...
The SensaSea System is a responsive multisensory environment, specifically, a room-sized interactive installation that incorporates wearable devices, interactive visual floor projections and auditory and tactile modalities. SensaSea is designed as a...
Flexible piezoresistive sensors are often vulnerable to modal ambiguity and bending-induced drift, both of which can obscure true pressure and strain signals under practical operation. Here, we address these limitations by suppressing bending sensiti...
Numerous studies have previously explored the perception of horizontal movements. This includes research on Redirected Walking (RDW). However, the challenge of replicating the sensation of vertical movement has remained a recurring theme. Many conven...
Parkinson’s Disease (PD) has historically been considered a disorder of motor dysfunction. However, a growing number of studies have demonstrated sensory abnormalities in PD across the modalities of proprioceptive, tactile, visual, auditory and...
This paper focuses on the development and validation of an automatic learning system for the classification of tactile data in form of vibro-tactile (accelerometer) and audio (microphone) data for texture recognition. A novel combination of features...
of 3