Search Results (6)

This paper presents the development and evaluation of a smartphone application designed to improve accessibility for blind users. It uses the lightweight EfficientDet-lite2 model and the comprehensive COCO dataset in order to provide real-time object detection. The novelty of the application is in the integration of haptic feedback, which is activated when users touch objects that are detected on the screen, combined with audio notifications that announce the name of the detected object in multiple languages. This multimodal feedback mechanism helps blind users to recognize, explore, and move within their environment more effectively and safely. Extensive usability and user experience evaluation was conducted with blind and blindfolded users. The evaluation assessed the usability, effectiveness, accessibility, and user satisfaction and experience of the application. Additionally, a comparative analysis was performed between the use of haptic feedback and scenarios where haptic feedback was disabled. The results show a higher level of user satisfaction, greater ease of use, and significant potential for improving the independence of blind people when the haptic feedback is enabled. The findings also suggest that the inclusion of haptic feedback significantly enhances the user experience. This study underlines the importance of multimodal feedback systems in assistive technologies and the potential of mobile applications to provide accessible solutions for blind users. Full article

Recently, remote meetings and work-from-home have become more common, reducing the opportunities for face-to-face communication. To facilitate communication among remote workers, researchers have focused on virtual space technology and spatial augmented reality technology. Although these technologies can enhance immersiveness in collaborative work, they face the challenge of fostering a sense of physical contact. In this work, we aimed to foster a sense of presence through haptic stimulation using pneumatic actuators. Specifically, we developed a choker-type wearable device that presents various pressure patterns around the neck; the pattern presented depends on the message the device must convey. Various combinations of haptic presentation are achieved by pumping air to the multiple pneumatic actuators attached to the choker. In addition, we conducted experiments involving actuators of different shapes to optimize the haptic presentation. When linked with a smartphone, the proposed device can present pressure patterns to indicate incoming calls and notifications, to give warning about an obstacle that one who is texting might miss while walking, and to provide direction to a pedestrian. Furthermore, the device can be used in a wide range of applications, from those necessary in daily living to those that enhance one’s experience in the realm of entertainment. For example, haptic feedback that synchronizes with the presence of a singer or with the rhythm of a song one listens to or with a performer’s movements during a stage performance will immerse users in an enjoyable experience. Full article

Haptic feedback is appealing for achieving the realistic perception of environmental changes for human bodies in human–computer interaction fields. However, existing haptic actuators have some hurdles such as single mode, poor compatibility, or incomplete tactile information. In this study, we proposed a novel way to generate haptic feedback by designing a soft electro-hydraulic pneumatic actuator (SEHPA) with dual drive modes. The SEHPA was structured with silicone films, a silicone air chamber, flexible electrodes, and an insulating liquid dielectric for good human–machine compatibility. The SEHPA had the advantages of high output force (1.5 N at 10 kPa) and displacement (4.5 mm at 5 kPa), as well as various haptic notifications (0~400 Hz vibration). The electro-hydraulic drive method realized smooth output force changes at the millinewton level (0~40 mN) and output displacement changes at the micron level (0~800 μm), which further enriched the details of the tactile experience. In addition, the self-sensing capability of the SEHPA can be dedicated to monitoring and ensuring precise output. The SEHPAs can be potentially mounted on the fingertips to provide accurate tactile sensation once the manipulator touches an object through teleoperation. More invisible information can also be obtained by customizing various haptic notifications. The excellent response behavior and accurate tactile haptic feedback demonstrate the candidate for teleoperation fields. Full article

In this work, we extend the previously proposed approach of improving mutual perception during human–robot collaboration by communicating the robot’s motion intentions and status to a human worker using hand-worn haptic feedback devices. The improvement is presented by introducing spatial tactile feedback, which provides the human worker with more intuitive information about the currently planned robot’s trajectory, given its spatial configuration. The enhanced feedback devices communicate directional information through activation of six tactors spatially organised to represent an orthogonal coordinate frame: the vibration activates on the side of the feedback device that is closest to the future path of the robot. To test the effectiveness of the improved human–machine interface, two user studies were prepared and conducted. The first study aimed to quantitatively evaluate the ease of differentiating activation of individual tactors of the notification devices. The second user study aimed to assess the overall usability of the enhanced notification mode for improving human awareness about the planned trajectory of a robot. The results of the first experiment allowed to identify the tactors for which vibration intensity was most often confused by users. The results of the second experiment showed that the enhanced notification system allowed the participants to complete the task faster and, in general, improved user awareness of the robot’s movement plan, according to both objective and subjective data. Moreover, the majority of participants (82%) favoured the improved notification system over its previous non-directional version and vision-based inspection. Full article

In a collaborative scenario, the communication between humans and robots is a fundamental aspect to achieve good efficiency and ergonomics in the task execution. A lot of research has been made related to enabling a robot system to understand and predict human behaviour, allowing the robot to adapt its motion to avoid collisions with human workers. Assuming the production task has a high degree of variability, the robot’s movements can be difficult to predict, leading to a feeling of anxiety in the worker when the robot changes its trajectory and approaches since the worker has no information about the planned movement of the robot. Additionally, without information about the robot’s movement, the human worker cannot effectively plan own activity without forcing the robot to constantly replan its movement. We propose a novel approach to communicating the robot’s intentions to a human worker. The improvement to the collaboration is presented by introducing haptic feedback devices, whose task is to notify the human worker about the currently planned robot’s trajectory and changes in its status. In order to verify the effectiveness of the developed human-machine interface in the conditions of a shared collaborative workspace, a user study was designed and conducted among 16 participants, whose objective was to accurately recognise the goal position of the robot during its movement. Data collected during the experiment included both objective and subjective parameters. Statistically significant results of the experiment indicated that all the participants could improve their task completion time by over 45% and generally were more subjectively satisfied when completing the task with equipped haptic feedback devices. The results also suggest the usefulness of the developed notification system since it improved users’ awareness about the motion plan of the robot. Full article

This study developed a wearable hearing-assist system that can identify the direction of a sound source while using short-term interaural time differences (ITDs) of sound pressure and convey the sound source direction to a hearing-impaired person via vibrators that are attached to his or her shoulders. This system, which is equipped with two microphones, could dynamically detect and convey the direction of front, side, and even rear sound sources. A male subject was able to turn his head toward continuous or intermittent sound sources within approximately 2.8 s when wearing the developed system. The sound source direction is probably overestimated when the interval between the two ears is smaller. When the subject can utilize vision, this may help in tracking the location of the target sound source, especially if the target comes into view, and it may shorten the tracking period. Full article