Next Article in Journal
Headgear Accessories Classification Using an Overhead Depth Sensor
Next Article in Special Issue
A Tactile Sensor Network System Using a Multiple Sensor Platform with a Dedicated CMOS-LSI for Robot Applications
Previous Article in Journal
Inhomogeneous Oxygen Vacancy Distribution in Semiconductor Gas Sensors: Formation, Migration and Determination on Gas Sensing Characteristics
Previous Article in Special Issue
Human Thalamic Somatosensory Nucleus (Ventral Caudal, Vc) as a Locus for Stimulation by INPUTS from Tactile, Noxious and Thermal Sensors on an Active Prosthesis
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Slippage Detection with Piezoresistive Tactile Sensors

by
Rocco A. Romeo
1,*,
Calogero M. Oddo
2,
Maria Chiara Carrozza
2,
Eugenio Guglielmelli
1 and
Loredana Zollo
1
1
Research Unit of Biomedical Robotics and Biomicrosystems, Università Campus Bio-Medico di Roma, Rome 00128, Italy
2
The BioRobotics Institute, Scuola Superiore Sant’Anna, Pisa 56127, Italy
*
Author to whom correspondence should be addressed.
Sensors 2017, 17(8), 1844; https://doi.org/10.3390/s17081844
Submission received: 21 June 2017 / Revised: 1 August 2017 / Accepted: 7 August 2017 / Published: 10 August 2017
(This article belongs to the Special Issue Tactile Sensors and Sensing)

Abstract

:
One of the crucial actions to be performed during a grasping task is to avoid slippage. The human hand can rapidly correct applied forces and prevent a grasped object from falling, thanks to its advanced tactile sensing. The same capability is hard to reproduce in artificial systems, such as robotic or prosthetic hands, where sensory motor coordination for force and slippage control is very limited. In this paper, a novel algorithm for slippage detection is presented. Based on fast, easy-to-perform processing, the proposed algorithm generates an ON/OFF signal relating to the presence/absence of slippage. The method can be applied either on the raw output of a force sensor or to its calibrated force signal, and yields comparable results if applied to both normal or tangential components. A biomimetic fingertip that integrates piezoresistive MEMS sensors was employed for evaluating the method performance. Each sensor had four units, thus providing 16 mono-axial signals for the analysis. A mechatronic platform was used to produce relative movement between the finger and the test surfaces (tactile stimuli). Three surfaces with submillimetric periods were adopted for the method evaluation, and 10 experimental trials were performed per each surface. Results are illustrated in terms of slippage events detection and of latency between the slippage itself and its onset.

1. Introduction

Tactile sensing is fundamental for enhancing performance of robotic systems in unstructured environments. Moreover, in the last years the interaction of robots with the surrounding environment is increasingly moving more and more towards the inclusion of human beings, in addition to inanimate objects [1]. This implies the need of advanced sensing capabilities to effectively interact with people and successfully grasp and manipulate objects. In particular, tactile sensing plays a paramount role to: (a) gather information about the object properties, e.g., shape and hardness, and about the interaction forces, and (b) properly detect slippage phenomena that may occur during manipulation and grasping tasks. Robotic end effectors are the devices at the end of robot kinematic chains. They can be grippers or also robotic hands. They should be able to control slip events in a dexterous manner, and to avoid grasp instability or else damages to the objects. While the robotic end effector performs an action or handles an object, unpredictable events might occur, which hinder the success of the action; the availability of control strategies relying on tactile sensory feedback could greatly increase robot performance when facing such a situation.
To date, the number of applications using tactile information is limited [1]. Depending on the technology, tactile sensors still suffer from certain drawbacks, such as hysteresis, non-linearity and sensitivity to environment (e.g., temperature). The resulting lack of reliability leads robotic end effectors to mainly act within structured environments, without relying on tactile information. Even when they are endowed with tactile sensory system, the dexterity of the human hand is highly difficult to mimic. Indeed, tactile sensory systems are not capable of measuring all the tactile properties (contact forces, slippage, temperature, roughness, texture, hardness, etc.) as human tactile sensing can do simultaneously. Further, most tactile sensors can only be used either for static or dynamic sensing, but not both. Much research was performed in the last decades, yet the biological tactile system is not satisfactorily reproduced. For this reason, improving tactile information can predispose the robots towards a more natural behavior, including e.g., their reactions to unexpected events and situations. Sensory feedback from tactile sensors would be of great help in many robotic domains, such as robotic manipulation and prosthetics. Nonetheless, the current state of the art regarding commercial prosthetic hands reports only one case of a device provided with feedback, from tactile or force sensors and employed for slip control [2]; this confirms that tactile sensing technologies, including slip detection, are not easily applicable to prosthetic systems yet, despite the considerable efforts of the last years [3]. Moreover, it is worth noticing that the number of research groups and activities focused on tactile sensing has traditionally been lower than on other sensing principles (e.g., artificial vision), thus leading to a slower development of the tactile technology [4].
The literature proposes plenty of tactile sensors and procedures for slippage detection. In tactile sensing applications, a critical issue is the integration of static (force/pressure measurement) and dynamic (slip detection) information. The main approach used until the end of last century relied on the calculation of the static friction coefficient from normal and tangential force measurements [5,6]. This requires a multiaxial force sensor in order to measure forces at least along two axes (including the normal one); as an alternative, tangential forces can be analyzed in the frequency domain [7,8] by resorting to Fast Fourier Transform (FFT), Discrete Fourier Transform (DFT) and Power Spectrum Density (PSD), or else estimated by means of Kalman filters [9].
Other methods take into account the variations of the center of pressure [10,11]. A tri-axial force sensor featuring a Carbon Micro-Coil (CMC) for slippage detection was fabricated in [12]. A widespread solution is to combine more sensing units for static and dynamic information. To this purpose, force sensors can be jointly used with piezoelectric (such as Polyvinylidene fluoride (PVDF) or lead zirconate titanate (PZT)) sensors for slip management [13,14,15]. Moreover, the employment of accelerometers as slippage sensors was also demonstrated in various scenarios [16,17,18].
In [19] a slippage sensor based on conductive rubber was proposed, which was able to detect slippage phenomena through the application of the Continuous Wavelet Transform. However, the aforementioned sensor was not able to measure forces. Further methods exploit the derivative function of the normal component of the estimated force [20], or else, the vibrations in a fluid sealed into the core of a biomimetic sensor [21,22]. This is the case of the commercial sensor BioTac (by SynTouch, Montrose, CA, USA), which is able to provide slippage information by means of a band-pass filtered signal of a fluid pressure measurement in the 10–1040 Hz range.
All the reported works present sensors and/or techniques for the detection of slippage often resorting to force measurement on more axes. In this paper, a new method [23] for the detection of slippage events is proposed; it provides an ON/OFF slip information thanks to online processing of a force sensor output. Simple operations such as digital filtering, rectification and envelope of the input signal are cascaded in order to generate the ON/OFF slip signal. The method can be applied to every type of piezoresistive sensors, regardless the number of force axes: i.e., each available axial component might be processed in the same way, though one is sufficient for the generation of the ON/OFF slip signal. Indeed, the difficulty of measuring slippage events starting only from normal force signal is well known [24]; by applying the proposed method to the voltage output of a simple, low cost mono-axial sensor (i.e., normal axis), it is possible to obtain information about slippage along with the force information itself. An application of the method to mono-axial force sensors for force and slippage control of a prosthetic hand is presented in [25].
Here, the proposed method will be explained in detail and its experimental validation on a tactile array including microelectromechanical system (MEMS) piezoresistive force sensors will be illustrated. Each sensor in the array is composed of four sensitive units; hence, 16 “channels” are taken into account for detecting slippage, considered as mono-axial components. The raw voltage from all the channels is employed as input for the algorithm. It is possible to convert such an input into a force signal by using calibration matrices [26]; nonetheless, the voltage signal contains all the necessary information for applying the proposed slippage detection algorithm. This approach is highly convenient for online applications, e.g., a robotic hand control system. Indeed, force computation and slip detection from the voltage output can be performed in parallel rather than subsequently, thus speeding up the process.
During the validation trials, slippage was induced by controlling the sliding velocity of the surface in contact with the sensors, which were embedded into a prosthetic finger (see Section 3). A mechatronic platform operated the surface movement, reproducing in this way the slippage event. The slippage detection method was tested on three surfaces with sub-millimetric periods (ranging from 400 µm to 480 µm), using a set of experiments composed of 10 trials for each surface. Such surfaces were chosen for a first rigorous validation as the one shown in the present paper. However, the method was also tested with flat surfaces having roughness values up to 0.2 µm [23], using different piezoresistive sensors. These tests, along with the experiments carried out with common objects in [25], indicated a scarce influence of the material properties towards the algorithm output.
Even though periodic surfaces were adopted, this paper does not aim at providing a technique for surface pattern discrimination. To this end, literature offers solutions like the one in [27]; nevertheless, slippage identification is not concerned, as greater attention is paid to the roughness encoding by means of MEMS tactile sensors. A biomimetic tactile sensor is used in [28] to understand how human mechanoreceptors code textural information during exploratory tasks. Very limited speeds (0.2 mm/s) were set, thus not investigating slippage conditions. Advanced hardware for composite tactile imaging was developed in [29], allowing to reconstruct spatial profile of applied pressure. Although the considerable technological advance, the study neglected the analysis of slippage phenomena.
The paper is structured as follows: in Section 2 the slippage detection procedure is presented in detail, describing the different blocks with the main characteristics. Section 3 illustrates the experimental setup that was employed for the evaluation of the method, together with the sensors. In Section 4 experimental data elaboration and results are discussed. Finally, Section 5 points out the conclusions and the future work.

2. Slippage Detection Procedure

2.1. Theoretical Description of the Method

The proposed method consists of three main blocks in cascade between the input signal, which is the raw voltage output of the employed force sensor, and the ON/OFF output, which is the final slippage signal. Figure 1 shows the blocks. Although the calibrated force information is not used as input, it should be noticed that the algorithm output somehow depends from the applied pressure level, i.e., the higher the exerted pressure on the sensor is, the higher the amplitude of the signal available for the ON/OFF signal generation is. However, the applied pressure is directly proportional to the raw voltage, allowing to exploit the latter without loss of information.
The variation of the voltage signal with respect to the baseline (which ranges between 4.3 V and 4.35 V, Figure 2), due to an applied force, is characterized by high amplitude and low frequencies in absence of slippage. When the sensor is slid over a surface (active touch), or vice-versa when the surface is slid on the sensor (passive touch), the voltage signal carries a higher frequency content and has a smaller amplitude. Such a content can be extracted by means of filtering operations: adequate cut-off frequencies and bandwidth are defined depending on the type of sensor and on its specific structure. Thus, the low frequencies of the original voltage signal are filtered out, by privileging the faster variations produced by slip. At this point, a low amplitude, high frequency signal is generated; the presence of dense fluctuations indicates that the relative movement between the object and the sensor is occurring. The filtering operation is computed together with an opportune amplification (block 1) and is followed by the rectification and exponentiation of the signal (block 2), which is in turn followed by an enveloping phase (block 3). An ON/OFF signal relative to the onset of a slippage event is then generated. The algorithm blocks are described in detail below.

2.1.1. Filter Network

The filtering operations are responsible for the high frequency extraction from the force (voltage) signals. Thus, it is crucial to accurately design the filter parameters in order to obtain proper performance. A band-pass configuration was chosen for controlling the whole bandwidth, though a high-pass filter can also be adopted. The most general configuration of the method requires one to fix the low cut-off frequency fcol around 7–10 Hz, in order to avoid the signal slow variations due to the applied force. By filtering the signal content up to a high cut-off frequency fcoh equal to 50 Hz, the vibrations generated by the slippage can be adequately isolated, and relayed to the next elaboration stages. Nonetheless, the solution implemented in this work is general; the bandwidth can also be varied, depending on the sensor structure and output.
For the filters network, Infinite Impulse Response (IIR) causal filters were designed. IIR filters are computationally more efficient than the Finite Impulse Response (FIR) type, while the causality is fundamental for a real-time implementation. A 4th-order Butterworth filter was employed. It can be expressed by means of its transfer function Hb(z) as:
H b ( z ) =   G b n = 0 N b n z n n = 0 M a n z n ,
and:
Y ( z ) = H b ( z ) X ( z )
is the filtered output in the z-domain, with the possibility to control the filtered signal amplitude through a gain Gb. In Equation (1) N = M is the filter order while in Equation (2) X(z) is the input piezoresistive signal. Equation (1) also gives an idea of how the filter order influences the transfer function. The polynomials complexity augments with the order; this adds delay to the system, even though the filter performance is improved.
Additional digital 4th-order stop-band filters, can be cascaded to the Butterworth one. A flat response in the pass-band region was searched, as well as a quick roll-off transition to the stop-band region. In Figure 2a, a general example of filtered signal is illustrated together with the original unfiltered piezoresistive signal. The choice of high order filters, higher than three, is due to the necessity of achieving fast roll-off. In this way, frequency components outside the range of interest might be easily discarded, including frequencies near the bandwidth limits. Nevertheless, the filter order must be carefully chosen considering Equation (1), avoiding too much elevate values.

2.1.2. Rectification

The filtering stage provides a high frequency signal, yet characterized by a bipolar nature. The rectification can improve the subsequent thresholding. In Figure 2b an example of rectification is provided. By inverting the polarity of the negative spikes, the time window where the signal is ON (i.e., above threshold) can be longer than in the case of a bipolar signal.
A full-wave rectification, or at least a half-wave rectification needs to be performed. Moreover, to privilege the slip signal content with respect to the peaks due to contact and release phases, the exponentiation of the signal amplitude was computed. Indeed, these peaks may sometimes be present although the stop-band filters have a great impact on the signal. The amplitude of such peaks is commonly smaller than the true positives; exponentiation helps to increase the amplitude difference between false positives and true ones. To this end, the filtered and rectified signal can be raised to the third power, and whole process is described by the following mathematical function Hf+r(z):
H f + r ( z ) =   H f ( z ) H f * ( z * ) 3 / 2
where:
H f ( z ) =   H b ( z ) H e 1 ( z ) H e 2 ( z )
i.e., Hf(z) represents the transfer function of the overall filters network, comprised of the filters described in Section 2.1.1. The network includes two stop-band filters He1(z) and He2(z), briefly described in Section 3. The filtered and rectified signal Y(z) becomes:
Y f + r ( z ) =   | H f | 3 X ( z ) 3 =   X ( z ) 2 H f ( z ) H f * ( z * ) 3 2

2.1.3. Envelope

Finally, the envelope of the signal is calculated by means of Root Mean Square (RMS). The RMS value ENVrms is obtained as follows:
E N V r m s = 1 W r = w 1 w 2 x r 2
where W = W2W1 corresponds to the temporal width of the selected window, and xr is a single sample included within W. The rectified signal Yr+f(z) was divided into windows with an equal width h; every window Wi almost totally overlaps the adjacent one Wi+1, since they are computed as:
W i = [ Y r + f ( i ) ,   Y r + f ( i + 1 ) Y r + f ( i + h ) ]
W i + 1 = [ Y r + f ( i + 1 ) ,   Y r + f ( i + 2 ) Y r + f ( i + h + 1 ) ]
i.e., the overlap is shifted by one sample from a window to the next one.
The envelope acts as a low pass filter; it generates a continuous curve starting from the peaks of the rectified signal. Figure 2c gives an example of enveloped signal. At this point, the ON/OFF slip signal can be obtained with a threshold mechanism (see Section 4). More details about the chosen time window will be provided in Section 4.

3. Experimental Setup, Protocol and Algorithm Implementation

The described algorithm was applied to the raw voltage outputs of a 2 × 2 array of piezoresistive MEMS sensors that were integrated in a biomimetic fingertip [27]. Each sensor had four piezoresistors implanted at the roots of a cross-shape structure that transduced the forces acting on a mesa. The sensors were covered by a polymeric packaging material (DragonSkin, Smooth-On, Macumgie, PA, USA), with 10 shore A hardness and about 0.8 mm thickness. The area of mechanical contact sensorized by the 16 channels was about 22 mm2. The experiments were carried out under a passive touch protocol: the fingertip was static and a plastic plate was put into contact and then slid by means of a 2 degrees of freedom tactile stimulation platform [30]. It allowed implementing trials with versatile reconfiguration of stimulation conditions. Briefly, the platform had horizontal and vertical translational degrees of freedom. The horizontal axis was operated by means of a linear guide (LTP 60.180.0804-02, SKF Multitec, Göteborg, Sweden), actuated with a DC motor (RE35, Maxon Motors, Sachseln, Switzerland), with position tracking error lower than 30 µm up to 25 mm/s sliding velocity. The vertical axis was operated by means of a voice coil (NCC05-18-060-2X, H2W Tech., Santa Clarita, CA, USA), with force tracking error lower than 20 mN [28]. The platform was previously shown not to introduce spurious vibrations that could be perceived by humans. This was confirmed by a set of experiments involving the recording of neural activity of rapidly adapting (Meissner) mechanoreceptors [30].
The purpose of the protocol was to evaluate the effectiveness of the proposed algorithm to: (1) identify the onset of the sliding phase; (2) separate the slippage from the loading and unloading phases that were included in the experimental procedure. During the contact phases the interaction force was kept at 400 mN, and the plastic plate was moved at 6.7 mm/s for 1.5 s and subsequently at 10 mm/s for 1 s. The trial time T was set at 6.5 s, as the slippage lasted 2.5 s while 2 s elapsed between the finger contact on the platform and the start of the movement; the same time interval occurred between the end of the slippage and the finger release. Three plates were tested, with 10 experimental repetitions per plate, for the sake of evaluating the generalization abilities of the proposed algorithm with different surfaces. The plates differed for the spatial period Δp (400, 440 and 480 µm) of the pattern of ridges and grooves that alternated along its surface. The height of the ridges of the stimuli was as little as 100 µm to test the capability of the system to identify slippage with a surface having a fine patterning. In this work, all experimental data were acquired at a sample rate of 380 Hz. More details about the experimental setup (Figure 3b,c) can be found in [27]. Additional tests with different piezoresistive sensors and flat surfaces characterized by roughness up to 0.2 µm can be retrieved in [23].
The algorithm was applied to each channel of the biomimetic fingertip, thus generating 16 ON/OFF signals to identify the occurrence of local slippage events. The 16 ON/OFF signals were then grouped taking into account the channels physical orientation; a single global ON/OFF slippage alerting signal was finally generated. Four groups of four channels each were created: (1) transversal proximal (TP) orientation; (2) transversal distal (TD) orientation; (3) longitudinal ulnar (LU) orientation; (4) longitudinal radial (LR) orientation. Figure 3a shows the allocation of the sensing units on the biomimetic fingertip, while Table 1 groups them with respect to their orientation.
For all the four groups, the ON/OFF signal obtained from every channel was put into an AND operator, resulting in four ON/OFF signals. Subsequently, the logical OR operator was applied to the four ON/OFF signals for the determination of the final ON/OFF signal. The basic concept is the following:
  • the presence of local slip phenomena is investigated on every possible direction, both transversal and longitudinal;
  • the AND operator allows reducing the detection of false positives, which mainly occur during the contact and release phases, thus having a robust local slip identification;
  • the OR operator allows detecting the slippage as soon as it is detected on at least one direction, thus converting any identified local slip into a global alert.
The high cut off frequency fcoh of the band-pass filter was set to twice the highest expected fundamental frequency (i.e., 25 Hz) based on the experimented spatial periods of the plates Δp and their sliding velocity v. However, fcoh might be differently chosen without deterioration of the algorithm efficacy, as it will be shown in Section 4. The gain Gb was set to 100 in order to amplify the small vibrations due to slip. Two additional digital 4th-order stop-band filters, i.e., elliptic filters, were cascaded to the Butterworth one. Their transfer functions He1(z) (low filter) and He2(z) (high filter) were set with unitary gain, while the pass-band ripple (peak to peak) and the stop-band attenuation were set to 0.01 dB and 40 dB respectively. They were conceived to inhibit the frequency content below the low limit of the bandpass filter (low filter) and above its high limit (high filter). Rectification (full-wave), exponentiation and enveloping operations were performed as described in Section 2.
As regards the ON/OFF computation, it is important to focus on the width of the temporal window employed. The computational operations described in Section 2, including the final ON/OFF decision, were accomplished by setting the time window width to 40 ms. This value resulted from a trade-off between: (1) the necessity to achieve a computational time below the physiological time needed to respond to slip events (i.e., >70 ms [31,32]); (2) the correct detection of the slippage, reducing the detection of false positives. Figure 4 illustrates the output from one of the tactile units during a trial, and the result of the algorithm (ON/OFF signal) calculated with different time windows. The enveloped signal is considered to be ON if its average value within the time window overcomes an empirically established threshold. The threshold can be adjusted according to the employed sensor technology; it may vary from a kind of sensor to the other. In this case, it was set to 0.5 V.

4. Experimental Results

First, it is crucial to evaluate the delay D between the beginning of the platform movement with respect to the biomimetic finger, and the OFF to ON transition of the slip signal. The time instant tst at which the platform starts moving was computed as follows:
t s t = { t 1 T   |   d x p l ( t ) d t   0 }
i.e., the time instant t1 at which the platform position value xpl is different from the previous one, is considered as the start of the relative movement during the trial time interval T. In other words, the minimum measurable displacement (according to the sampling frequency) has been regarded as the commencement of the slippage. In this way, a rigorous evaluation was carried out, with movements lower than 5 µm considered as the start of the slippage phase.
As already explained in Section 3, the time window for the algorithm execution was regulated accounting for the physiological response time as well. Similarly, the delay D has to be lower than 70 ms, possibly not greater than 50 ms as D does not include the efferent response (i.e., the reaction to the identified slip), but only the afferent one. This means that slippage detection has to be followed by an opportune reaction (either of the robot or the human) in terms of force adjustment. Table 2 summarizes the mean values mDi for all the trials carried out for the three Δps. These values were obtained based on the position measured by an optical encoder embedded in the mechatronic platform. They were computed with respect to tst as described by Equation (9).
All the values in Table 2 were calculated as:
m D i , Δ pj =   k = 1 16 c h k 16
where i is the trial number, Δpj is the corresponding Δp and k is the channel number. Such values resulted to be acceptable (<50 ms) in most cases. These data can be further synthetized by observing the mean values mDΔp for every Δp, i.e., the sum of the mDi,Δpj in every column of Table 2 divided by the number of trials performed per every Δp (i.e., 10). They are:
  • mD400 = 36.02 ± 3.91 ms;
  • mD440 = 41.78 ± 10.78 ms;
  • mD480 = 48.90 ± 9.91 ms.
These results confirm the capability of the proposed slip detection algorithm, in terms of promptness. The mDΔp value seems to increase proportionally to the stimulus spacing Δp, coherently with the fact that the output of the sensors shifts towards lower frequencies (thus requiring higher latencies for being observed).
Another crucial feature that should characterize an algorithm for the prevention of slippage events regards the correct avoidance of false positives. While grasping an object, false positives might principally occur during the contact and/or release phases. In Figure 5 some examples of the algorithm performance are shown, extracted from one of the trials relating to the 440 µm stimulus. A channel from each of the four groups mentioned previously is displayed in Figure 5a,b; Figure 5c shows the result of the AND mechanism for all the four groups, whereas Figure 5d depicts the final ON/OFF slip signal generated by means of the OR operation applied onto the four ANDs. In every plot, a black asterisk indicates the start of the mechatronic platform movement tst (start of slip), calculated according to Equation (9).
Figure 5c shows how three of the four ANDs result in an OFF signal for the entire duration of the trial. This condition highlights the capability of the algorithm to detect the occurrence of local slip events, without requiring the activation of the whole set of channels. This resembles the biological condition, in which the human finger tactile areas might be involved differently even when performing the same task. The robustness of the algorithm always allowed detecting the true positive, as it is sufficient to achieve the ON at least on one of the four ANDs. In fact, Figure 5d illustrates the ON signal, which covers the whole duration of the slip event. No false positives were detected in the example shown in Figure 5. The same considerations can be extended to Figure 6, which relates to a trial carried out onto the 480 µm stimulus.
In Figure 6, the MEMS signals were taken from different channels with respect to Figure 5. Different shape can be noticed as well: this is due to the various contact conditions that every tactile array unit faces, as already referred. Most notably, channel 16 is characterized by huge peaks in correspondence of the contact and release instants, with no useful content during the slip event.
The overall success rate of the algorithm in identifying slippage events was equal to 100%, as it correctly recognized the slippage event in all 30 trials. False positives were rarely detected by the algorithm; for evaluating their detection, the time lapse tfp when false positives can occur has been considered, which is the trial time T (i.e., 6.5 s) decreased by the actual slippage event duration (i.e., 2.5 s). The mean percentage of false positives, computed with respect to tfp, resulted to be: 1.01% (Δp = 400 µm), 0.11% (Δp = 440 µm), and 0.88% (Δp = 480 µm).
In order to assess relevance of the proposed method, additional tests were performed with different configurations of the filter network. The bandwidth of the bandpass filter has been extended up to 150 Hz, close to the Nyquist limit (i.e., 190 Hz). The reduction of the filters quantity has been tried as well. In this way, rising the slippage speed does not compromise the functioning of the algorithm. Moreover, the possibility to modify the design choices described in Section 2 and Section 3 can be demonstrated. In Figure 7, the algorithm output is shown for a further trial (440 µm). Results depicted in Figure 7a,b were obtained with a bandwidth [10–100] Hz for the bandpass filter, while Figure 7c,d offer the same graphs but relating to a bandwidth [10–150] Hz. In both configurations, the stopband filter He2(z) was removed from the filter network.
It is easy to observe that data illustrated in Figure 7 do not significantly differ from the ones of Figure 5 and Figure 6. Causal filters introduce an amount of delay in the system: therefore, removing one of them has the advantage of reducing the delay D between the slippage onset (tst) and the ON signal. E.g., a D of 15.31 ms was achieved for the trial of Figure 7. Nevertheless, the absence of a stopband filter unavoidably results into a greater probability to detect false positives. Finally, the effectiveness of the algorithm at higher slippage velocities than the ones used in this work was proved in [23] (up to 8 cm/s) and [25] (up to 4 cm/s).

5. Conclusions and Future Work

In this paper, a novel method for detection of slippage events was proposed. Said method was presented through a detailed description of its sub-blocks, which include simple operations such as digital filtering, rectification and envelope of the input signal. Such sub-blocks are cascaded to generate the ON/OFF slippage identification signals. The method was accurately validated on piezoresistive MEMS sensors; an ad hoc automated setup was experimented for this purpose. A total of four sensors, integrated into a biomimetic fingertip, were employed; each sensor featured four channels, leading thus to sixteen channels for the slippage detection analysis.
Relative movements lower than 5 μm between the sensor and the contact surface were detectable through the developed algorithm. True positives were detected in 100% of the cases and minimum average delays resulted lower than 50 ms. False positives have been detected in no more than 1.01% of the cases. Remarkably, it is not necessary to employ the force value to apply the method: the raw voltages of sensor outputs (relating to the force) can be used as input. In this manner the force estimation and the ON/OFF slip signal generation can be performed as parallel operations rather than consecutive.
Future works will focus on the use of additional sensors for the algorithm validation, with the aim of extending the algorithm validity beyond the piezoresistive domain. Surfaces with more naturalistic texture, in place of regular gratings, will be employed to hopefully confirm the possibility to apply the algorithm regardless the surface characteristics. The method was already tested in a prosthetic control with common objects [25] and with surfaces whose roughness was a priori known [23]; yet further verifications are needed in order to show the general extendibility of the algorithm.

Acknowledgments

This work was partly supported by the national projects PPR2 (‘Control of hand prosthesis by invasive neural interfaces’, CUP: E58C13000990001), PCR 1/2 (‘New methods in the treatment of limb amputation, finalized to the application of bionic prostheses’, CUP: E57B16000160005) and RehabRobo@work (CUP: C82F17000040001), funded by the National Institute for Insurance against Industrial Injuries (INAIL), by the national project PRIN/HandBot (‘Biomechatronic hand prostheses endowed with bio-inspired tactile perception, bi-directional neural interfaces and distributed sensori-motor control’, CUP: B81J12002680008), funded by the Italian Minister of Instruction, University and Research, and by the EU Grant FP7-NMP 228844 NANOBIOTOUCH project (‘Nanoresolved multi-scan investigations of human tactile sensations and tissue engineered nanobiosensors’).

Author Contributions

R.A.R. performed experiments, designed the slippage detection algorithm, analyzed data, discussed the results and wrote the paper; C.M.O. developed the biomimetic fingertip, performed experiments, contributed to the design of the slippage detection algorithm, discussed the results, wrote the paper and co-supervised the study; M.C.C. provided bioengineering background, developed the biomimetic fingertip and contributed to the discussion; E.G. provided bioengineering background and discussed the results; L.Z. performed experiments, contributed to the design of the slippage detection algorithm, discussed the results, wrote the paper and supervised the study; all authors revised and approved the manuscript.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Kappassov, Z.; Corrales, J.; Perdereau, V. Tactile sensing in dexterous robot hands—Review. Robot. Auton. Syst. 2015, 74, 195–220. [Google Scholar] [CrossRef]
  2. Ciancio, A.L.; Cordella, F.; Barone, R.; Romeo, R.A.; Bellingegni-Dellacasa, A.; Sacchetti, R.; Davalli, A.; Di Pino, G.; Ranieri, F.; Di Lazzaro, V.; et al. Control of prosthetic hands via the peripheral nervous system. Front. Neurosci. 2016, 10, 1–17. [Google Scholar] [CrossRef] [PubMed]
  3. Francomano, M.T.; Accoto, D.; Guglielmelli, E. Artificial sense of slip—A review. IEEE Sens. J. 2013, 13, 2489–2498. [Google Scholar] [CrossRef]
  4. Dahiya, R.S.; Valle, M. Tactile sensing technologies. In Robotic Tactile Sensing; Springer Science & Business Media: Dordrecht, The Netherlands, 2012; pp. 79–136. [Google Scholar]
  5. Mingrino, A; Bucci, A.; Magni, R.; Dario, P. Slippage Control in Hand Prostheses by Sensing Grasping Forces and Sliding Motion. In Proceedings of the IEEE/RSJ/GI International Conference on Intelligent Robots and Systems, Munich, Germany, 12–16 September 1994. [Google Scholar]
  6. De Maria, G.; Natale, C.; Pirozzi, S. Tactile Sensor for Human-like Manipulation. In Proceedings of the International Conference on Biomedical Robotics and Biomechatronics, Rome, Italy, 24–27 June 2012. [Google Scholar]
  7. Fernandez, R.; Payo, I.; Vazquez, A.S.; Becedas, J. Micro-Vibration-Based Slip Detection in Tactile Force Sensors. Sensors 2014, 14, 709–730. [Google Scholar] [CrossRef] [PubMed]
  8. Engeberg, E.D.; Meek, S.G. Adaptive Sliding Mode Control for Prosthetic Hands to Simultaneously Prevent Slip and Minimize Deformation of Grasped Objects. IEEE/ASME Trans. Mechatron. 2013, 18, 376–385. [Google Scholar] [CrossRef]
  9. Wettels, N.; Parnandi, A.R.; Moon, J.H.; Loeb, G.E.; Sukhatme, G.S. Grip Control Using Biomimetic Tactile Sensing Systems. IEEE/ASME Trans. Mechatron. 2009, 14, 718–723. [Google Scholar] [CrossRef]
  10. Wolweg, E.G.M.; Hoeve, H.; Jongkind, W.; Marconi, L.; Melchiorri, C.; Bonivento, C. Slip Detection by Tactile Sensors: Algorithms and Experimental Results. In Proceedings of the International Conference on Robotics and Automation, Minneapolis, MN, USA, 22–28 April 1996. [Google Scholar]
  11. Gunji, D.; Mizoguchi, Y.; Teshigawara, S.; Ming, A.; Namiki, A.; Ishikawaand, M.; Shimojo, M. Grasping Force Control of Multi-fingered Robot Hand based on Slip Detection Using Tactile Sensor. In Proceedings of the International Conference on Robotics and Automation, Pasadena, CA, USA, 19–23 May 2008. [Google Scholar]
  12. Kawamura, T.; Inaguma, N.; Nejigane, K.; Tani, K.; Yamada, H. Measurement of Slip, Force and Deformation Using Hybrid Tactile Sensor System for Robot Hand Gripping an Object. Int. J. Adv. Robot. Syst. 2012, 10, 1–8. [Google Scholar] [CrossRef]
  13. Yamada, Y.; Cutkosky, M.R. Tactile Sensor with 3-Axis Force and Vibration Sensing Functions and Its Application to Detect Rotational Slip. In Proceedings of the International Conference on Robotics and Automation, San Diego, CA, USA, 8–13 May 1994. [Google Scholar]
  14. Choi, B.; Kang, S.; Choi, H. Development of Fingertip Tactile Sensor for Detecting Normal Force and Slip. In Proceedings of the International Conference on Control, Automation and Systems, Seoul, Korea, 2–5 June 2005. [Google Scholar]
  15. Cotton, D.P.J.; Chappell, P.H.; Cranny, A.; White, N.M.; Beeby, S.P. Novel Thick-Film Piezoelectric Slip Sensor for a Prosthetic Hand. IEEE Sens. J. 2007, 7, 752–761. [Google Scholar] [CrossRef]
  16. Howe, R.D.; Cutkosky, M.R. Sensing Skin Acceleration for Slip and Texture Perception. In Proceedings of the International Conference on Robotics and Automation, Scottsdale, AZ, USA, 14–19 May 1989. [Google Scholar]
  17. Romeo, R.A.; Cordella, F.; Zollo, L.; Formica, D.; Saccomandi, P.; Schena, E.; Carpino, G.; Davalli, A.; Sacchetti, R.; Guglielmelli, E. Development and Preliminary Testing of an Instrumented Object for Force Analysis During Grasping. In Proceedings of the 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Milano, Italy, 25–29 August 2015. [Google Scholar]
  18. Abhinav, V.; Vivekanandan, S. Real-Time Intelligent Gripping System for Dexterous Manipulation of Industrial Robots. In Proceedings of the World Congress on Engineering, London, UK, 1–3 July 2009. [Google Scholar]
  19. Teshigawara, S.; Tadakuma, K.; Ming, A.; Ishikawa, M.; Shimojo, M. High Sensitivity Initial Slip Sensor for Dexterous Grasp. In Proceedings of the International Conference on Robotics and Automation, Anchorage, AK, USA, 3–8 May 2010. [Google Scholar]
  20. Pasluosta, C.F.; Chiu, A.W. Evaluation of a Neural Network-Based Control Strategy for a Cost-Effective Externally-Powered Prosthesis. Assist. Technol. 2012, 24, 196–208. [Google Scholar] [CrossRef] [PubMed]
  21. Fishel, J.A.; Loeb, G.E. Sensing Tactile Microvibrations with the BioTac—Comparison with Human Sensitivity. In Proceedings of the International Conference on Biomedical Robotics and Biomechatronics, Rome, Italy, 24–27 June 2012. [Google Scholar]
  22. Su, Z.; Hausman, K.; Chebotar, Y.; Molchanov, A.; Loeb, G.E.; Sukhatme, G.S.; Schaal, S. Force Estimation and Slip Detection for Grip Control using a Biomimetic Tactile Sensor. In Proceedings of the International Conference on Humanoid Robots, Seoul, Korea, 3–5 November 2015. [Google Scholar]
  23. Romeo, R.A.; Zollo, L.; Guglielmelli, E. Method for Detection of Slippage with Force Sensors and Apparatus. Thereof. Patent No. 102016000105302, 19 October 2016. [Google Scholar]
  24. Ho, A.V.; Hirai, S. Mechanics of Localized Slippage in Tactile Sensing—And Application to Soft Sensing Systems; Springer: Berlin, Germany, 2013. [Google Scholar]
  25. Barone, R.; Ciancio, A.L.; Romeo, R.A.; Davalli, A.; Sacchetti, R.; Guglielmelli, E.; Zollo, L. Multilevel control of an anthropomorphic prosthetic hand for grasp and slip prevention. Adv. Mech. Eng. 2016, 8, 1–13. [Google Scholar] [CrossRef]
  26. Oddo, C.M.; Valdastri, P.; Beccai, L.; Roccella, S.; Carrozza, M.C.; Dario, P. Investigation on calibration methods for multi-axis, linear and redundant force sensors. Meas. Sci. Technol. 2007, 18, 623–631. [Google Scholar] [CrossRef]
  27. Oddo, C.M.; Controzzi, M.; Beccai, L.; Cipriani, C.; Carrozza, M.C. Roughness encoding for discrimination of surfaces in artificial active-touch. IEEE Trans. Robot. 2011, 27, 522–533. [Google Scholar] [CrossRef]
  28. Scheibert, J.; Leurent, S.; Prevost, A.; Debrégeas, G. The role of fingerprints in the coding of tactile information probed with a biomimetic sensor. Science 2009, 323, 1503–1506. [Google Scholar] [CrossRef] [PubMed]
  29. Wu, W.; Wen, X.; Wang, Z.L. Taxel-addressable matrix of vertical-nanowire piezotronic transistors for active and adaptive tactile imaging. Science 2013, 340, 952–957. [Google Scholar] [CrossRef] [PubMed]
  30. Oddo, C.M.; Beccai, L.; Vitiello, N.; Wasling, H.B.; Wessberg, J.; Carrozza, M.C. A mechatronic platform for human touch studies. Mechatronics 2011, 21, 604–613. [Google Scholar] [CrossRef]
  31. Johansson, R.S.; Westling, G. Roles of glabrous skin receptors and sensorimotor memory in automatic control of precision grip when lifting rougher or more slippery objects. Exp. Brain Res. 1984, 56, 550–564. [Google Scholar] [CrossRef] [PubMed]
  32. Macefield, V.G.; Johansson, R.S. Control of grip force during restraint of an object held between finger and thumb: Responses of muscle and joint afferents from the digits. Exp. Brain Res. 1996, 108, 172–184. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Block scheme of the slippage detection method.
Figure 1. Block scheme of the slippage detection method.
Sensors 17 01844 g001
Figure 2. Operations of the algorithm blocks: (a) example of voltage signal from a force sensor (top) with the corresponding filtered signal (bottom); (b) same signal as in (a) (top) with the filtered and rectified signal (bottom); (c) original voltage signal (top) and enveloped one (bottom). The signal on top in (ac) was obtained by pressing and rubbing the sensor onto an unknown roughness surface. The filters were dimensioned as reported in this section.
Figure 2. Operations of the algorithm blocks: (a) example of voltage signal from a force sensor (top) with the corresponding filtered signal (bottom); (b) same signal as in (a) (top) with the filtered and rectified signal (bottom); (c) original voltage signal (top) and enveloped one (bottom). The signal on top in (ac) was obtained by pressing and rubbing the sensor onto an unknown roughness surface. The filters were dimensioned as reported in this section.
Sensors 17 01844 g002
Figure 3. (a) Positioning of the 16 tactile units in the fingertip; (b) CAD image of the experimental setup. Fingertip embedding the sensing units (1), plastic plate (stimulus) (2), voice coil actuator providing interaction force (3) and support (4) moved on a linear guide (5) by a DC motor; (c) real picture of the experimental setup.
Figure 3. (a) Positioning of the 16 tactile units in the fingertip; (b) CAD image of the experimental setup. Fingertip embedding the sensing units (1), plastic plate (stimulus) (2), voice coil actuator providing interaction force (3) and support (4) moved on a linear guide (5) by a DC motor; (c) real picture of the experimental setup.
Sensors 17 01844 g003
Figure 4. (a) Voltage output from one of the 16 tactile units; (b) result of the algorithm application using a 40 ms window for the ON/OFF signal computation; (c) result of the algorithm application using a 30 ms window for the ON/OFF signal computation; (d) result of the algorithm application using a 20 ms window for the ON/OFF signal computation. The enveloped signal was computed using a 40 ms time window in all subfigures. It is clearly noticeable, from the event detected between 9 and 10 s in the last 2 subplots, that the narrowest the window, the highest is the possibility to detect false positives.
Figure 4. (a) Voltage output from one of the 16 tactile units; (b) result of the algorithm application using a 40 ms window for the ON/OFF signal computation; (c) result of the algorithm application using a 30 ms window for the ON/OFF signal computation; (d) result of the algorithm application using a 20 ms window for the ON/OFF signal computation. The enveloped signal was computed using a 40 ms time window in all subfigures. It is clearly noticeable, from the event detected between 9 and 10 s in the last 2 subplots, that the narrowest the window, the highest is the possibility to detect false positives.
Sensors 17 01844 g004
Figure 5. Algorithm performance plots. Panels (a,b) show the MEMS sensors output from some of the channels, one for each of the four groups mentioned in Section 3; panel (c) contains the AND mechanism results for every group; panel (d) represents the final slip signal (OR of all the ANDs).
Figure 5. Algorithm performance plots. Panels (a,b) show the MEMS sensors output from some of the channels, one for each of the four groups mentioned in Section 3; panel (c) contains the AND mechanism results for every group; panel (d) represents the final slip signal (OR of all the ANDs).
Sensors 17 01844 g005
Figure 6. Algorithm performance plots. Again, Panels (a,b) show the MEMS sensors output from some channels (one per group) while Panel (c,d) depict respectively the AND mechanism results for every group and their OR, i.e., the final slip signal.
Figure 6. Algorithm performance plots. Again, Panels (a,b) show the MEMS sensors output from some channels (one per group) while Panel (c,d) depict respectively the AND mechanism results for every group and their OR, i.e., the final slip signal.
Sensors 17 01844 g006
Figure 7. Algorithm performance for different design choices. Panels (a,c) plot respectively the AND results of the four channel groups. Panels (b,d) plot the final slip signal generated through the OR operator.
Figure 7. Algorithm performance for different design choices. Panels (a,c) plot respectively the AND results of the four channel groups. Panels (b,d) plot the final slip signal generated through the OR operator.
Sensors 17 01844 g007
Table 1. The four channel groups.
Table 1. The four channel groups.
ChannelsNameAcronym
14, 16, 11, 9Transversal ProximalTP
1, 3, 8, 6Transversal DistalTD
5, 7, 12, 10Longitudinal RadialLR
2, 4, 15, 13Longitudinal UlnarLU
Table 2. This table contains the mean delays mDi of every trial, obtained upon all the 16 channels for every Δp.
Table 2. This table contains the mean delays mDi of every trial, obtained upon all the 16 channels for every Δp.
TrialmDp = 400 µm) (ms)mDp = 440 µm) (ms)mDp = 480 µm) (ms)
143.37 ± 32.9866.66 ± 15.8973.48 ± 30.95
233.19 ± 22.0155.44 ± 13.0644.01 ± 11.73
333.19 ± 22.9942.57 ± 15.9855.98 ± 12.40
439.60 ± 22.0137.29 ± 13.1640.92 ± 10.79
534.32 ± 20.6636.30 ± 14.3247.96 ± 8.74
633.19 ± 19.5439.27 ± 15.7650.16 ± 6.99
735.83 ± 23.1034.98 ± 11.4443.56 ± 10.57
837.33 ± 25.1133.99 ± 13.5539.16 ± 17.35
930.55 ± 11.7436.30 ± 12.7144.88 ± 16.59
1039.60 ± 25.1734.98 ± 14.9148.84 ± 16.34

Share and Cite

MDPI and ACS Style

Romeo, R.A.; Oddo, C.M.; Carrozza, M.C.; Guglielmelli, E.; Zollo, L. Slippage Detection with Piezoresistive Tactile Sensors. Sensors 2017, 17, 1844. https://doi.org/10.3390/s17081844

AMA Style

Romeo RA, Oddo CM, Carrozza MC, Guglielmelli E, Zollo L. Slippage Detection with Piezoresistive Tactile Sensors. Sensors. 2017; 17(8):1844. https://doi.org/10.3390/s17081844

Chicago/Turabian Style

Romeo, Rocco A., Calogero M. Oddo, Maria Chiara Carrozza, Eugenio Guglielmelli, and Loredana Zollo. 2017. "Slippage Detection with Piezoresistive Tactile Sensors" Sensors 17, no. 8: 1844. https://doi.org/10.3390/s17081844

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop