Vision-based Pose Estimation (VPE) represents a non-invasive solution to allow a smooth and natural interaction between a human user and a robotic system, without requiring complex calibration procedures. Moreover, VPE interfaces are gaining momentum as they are highly intuitive, such that they can be used from untrained personnel (e.g., a generic caregiver) even in delicate tasks as rehabilitation exercises. In this paper, we present a novel master–slave setup for hand telerehabilitation with an intuitive and simple interface for remote control of a wearable hand exoskeleton, named HX. While performing rehabilitative exercises, the master unit evaluates the 3D position of a human operator’s hand joints in real-time using only a RGB-D camera, and commands remotely the slave exoskeleton. Within the slave unit, the exoskeleton replicates hand movements and an external grip sensor records interaction forces, that are fed back to the operator-therapist, allowing a direct real-time assessment of the rehabilitative task. Experimental data collected with an operator and six volunteers are provided to show the feasibility of the proposed system and its performances. The results demonstrate that, leveraging on our system, the operator was able to directly control volunteers’ hands movements. Full article

This paper presents a gait phase detection algorithm for providing feedback in walking with a robotic prosthesis. The algorithm utilizes the output signals of a wearable wireless sensory system incorporating sensorized shoe insoles and inertial measurement units attached to body segments. The principle of detecting transitions between gait phases is based on heuristic threshold rules, dividing a steady-state walking stride into four phases. For the evaluation of the algorithm, experiments with three amputees, walking with the robotic prosthesis and wearable sensors, were performed. Results show a high rate of successful detection for all four phases (the average success rate across all subjects >90%). A comparison of the proposed method to an off-line trained algorithm using hidden Markov models reveals a similar performance achieved without the need for learning dataset acquisition and previous model training. Full article

This paper introduces the design and development of a novel pressure-sensitive foot insole for real-time monitoring of plantar pressure distribution during walking. The device consists of a flexible insole with 64 pressure-sensitive elements and an integrated electronic board for high-frequency data acquisition, pre-filtering, and wireless transmission to a remote data computing/storing unit. The pressure-sensitive technology is based on an optoelectronic technology developed at Scuola Superiore Sant’Anna. The insole is a low-cost and low-power battery-powered device. The design and development of the device is presented along with its experimental characterization and validation with healthy subjects performing a task of walking at different speeds, and benchmarked against an instrumented force platform. Full article

We present a novel sensorized mat for monitoring infant’s posture through the measure of pressure maps. The pressure-sensitive mat is based on an optoelectronic technology developed in the last few years at Scuola Superiore Sant’Anna: a soft silicone skin cover, which constitutes the mat, participates in the transduction principle and provides the mat with compliance. The device has a modular structure (with a minimum of one and a maximum of six sub-modules, and a total surface area of about 1 m²) that enables dimensional adaptation of the pressure-sensitive area to different specific applications. The system consists of on-board electronics for data collection, pre-elaboration, and transmission to a remote computing unit for analysis and posture classification. In this work we present a complete description of the sensing apparatus along with its experimental characterization and validation with five healthy infants. Full article

This paper reviews the state of the art of artificial tactile sensing, with a particular focus on bio-hybrid and fully-biological approaches. To this aim, the study of physiology of the human sense of touch and of the coding mechanisms of tactile information is a significant starting point, which is briefly explored in this review. Then, the progress towards the development of an artificial sense of touch are investigated. Artificial tactile sensing is analysed with respect to the possible approaches to fabricate the outer interface layer: synthetic skin versus bio-artificial skin. With particular respect to the synthetic skin approach, a brief overview is provided on various technologies and transduction principles that can be integrated beneath the skin layer. Then, the main focus moves to approaches characterized by the use of bio-artificial skin as an outer layer of the artificial sensory system. Within this design solution for the skin, bio-hybrid and fully-biological tactile sensing systems are thoroughly presented: while significant results have been reported for the development of tissue engineered skins, the development of mechanotransduction units and their integration is a recent trend that is still lagging behind, therefore requiring research efforts and investments. In the last part of the paper, application domains and perspectives of the reviewed tactile sensing technologies are discussed. Full article

We present a sensor technology for the measure of the physical human-robot interaction pressure developed in the last years at Scuola Superiore Sant’Anna. The system is composed of flexible matrices of opto-electronic sensors covered by a soft silicone cover. This sensory system is completely modular and scalable, allowing one to cover areas of any sizes and shapes, and to measure different pressure ranges. In this work we present the main application areas for this technology. A first generation of the system was used to monitor human-robot interaction in upper- (NEUROExos; Scuola Superiore Sant’Anna) and lower-limb (LOPES; University of Twente) exoskeletons for rehabilitation. A second generation, with increased resolution and wireless connection, was used to develop a pressure-sensitive foot insole and an improved human-robot interaction measurement systems. The experimental characterization of the latter system along with its validation on three healthy subjects is presented here for the first time. A perspective on future uses and development of the technology is finally drafted. Full article

A sensory apparatus to monitor pressure distribution on the physical human-robot interface of lower-limb exoskeletons is presented. We propose a distributed measure of the interaction pressure over the whole contact area between the user and the machine as an alternative measurement method of human-robot interaction. To obtain this measure, an array of newly-developed soft silicone pressure sensors is inserted between the limb and the mechanical interface that connects the robot to the user, in direct contact with the wearer’s skin. Compared to state-of-the-art measures, the advantage of this approach is that it allows for a distributed measure of the interaction pressure, which could be useful for the assessment of safety and comfort of human-robot interaction. This paper presents the new sensor and its characterization, and the development of an interaction measurement apparatus, which is applied to a lower-limb rehabilitation robot. The system is calibrated, and an example its use during a prototypical gait training task is presented. Full article