Next Article in Journal
Investigation of a HAP-UAV Collaboration Scheme for Throughput Maximization via Joint User Association and 3D UAV Placement
Previous Article in Journal
Crack Detecting Method Based on Grid-Type Sensing Networks Using Electrical Signals
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Advanced Stiffness Sensing through the Pincer Grasping of Soft Pneumatic Grippers

by
Chaiwuth Sithiwichankit
and
Ratchatin Chancharoen
*
Department of Mechanical Engineering, Faculty of Engineering, Chulalongkorn University, Bangkok 10330, Thailand
*
Author to whom correspondence should be addressed.
Sensors 2023, 23(13), 6094; https://doi.org/10.3390/s23136094
Submission received: 29 May 2023 / Revised: 19 June 2023 / Accepted: 29 June 2023 / Published: 2 July 2023
(This article belongs to the Section Physical Sensors)

Abstract

:
In this study, a comprehensive approach for sensing object stiffness through the pincer grasping of soft pneumatic grippers (SPGs) is presented. This study was inspired by the haptic sensing of human hands that allows us to perceive object properties through grasping. Many researchers have tried to imitate this capability in robotic grippers. The association between gripper performance and object reaction must be determined for this purpose. However, soft pneumatic actuators (SPA), the main components of SPGs, are extremely compliant. SPA compliance makes the determination of the association challenging. Methodologically, the connection between the behaviors of grasped objects and those of SPAs was clarified. A new concept of SPA modeling was then introduced. A method for stiffness sensing through SPG pincer grasping was developed based on this connection, and demonstrated on four samples. This method was validated through compression testing on the same samples. The results indicate that the proposed method yielded similar stiffness trends with slight deviations in compression testing. A main limitation in this study was the occlusion effect, which leads to dramatic deviations when grasped objects greatly deform. This is the first study to enable stiffness sensing and SPG grasping to be carried out in the same attempt. This study makes a major contribution to research on soft robotics by progressing the role of sensing for SPG grasping and object classification by offering an efficient method for acquiring another effective class of classification input. Ultimately, the proposed framework shows promise for future applications in inspecting and classifying visually indistinguishable objects.

1. Introduction

One of the most important components of robotic systems is the gripper, performing as system hand to conduct grasping [1,2,3,4]. With grasping, the systems can have physical interaction with their environment and mechanically manipulate objects [5,6,7]. There are a variety of gripper types [8]. Different gripper types offer dissimilar grasping performances. Based on the principles of grasping, there are four generic types, including impactive, ingressive, astrictive, and contigutive [9]. The same source shows that impactive and astrictive grippers are the majority of grippers.
The human hand is always an extraordinary inspiration for impactive grippers in various aspects [10,11,12,13]. One of its motivating features is haptic sensing, allowing us to observe object properties and perform grasping adaptively [14]. Due to the rise of the complexity of robotic tasks, this feature has received considerable attention [15,16]. The sources moreover reveal that impactive grippers, the working principle of which is similar to the human hand, have been expected to make robotic systems capable of perceiving the mechanical properties of objects without any auxiliary probe. The systems with this capability are empirically more effective, in the aspects of working cost, space, and time, for object classification and identification [17,18,19,20,21], which are essential in an extensive scale of applications. This capability further facilitates adaptive grasping based on object properties [22,23].
Evidence shows that many researchers have studied the sensing of object properties through impactive grasping. However, available techniques for this function are for conventional impactive grippers with rigid links, broadly known as mechanical grippers. A variety of sensors were integrated into mechanical grippers to determine their internal states, external inputs, and loads [24,25,26,27]. For variables that cannot be directly perceived, kinematic and kinetic models of the grippers were developed. The association of variables on the grippers to those equivalents on grasped objects was solved, so object properties can be observed through gripper variables. Integrated sensors were mostly visual, force, and tactile types [28,29]. The following works are instances of the related studies. Kim [30] performed weight estimation using a force-sensor-integrated mechanical gripper. Romano et al. [31] implemented human-inspired adaptive grasping using a mechanical gripper with tactile sensors. Spiers et al. [32,33] studied feature extraction, shape recognition, and object classification using various mechanical grippers.
During the recent decades, a new gripper type, widely called a soft gripper, has increasingly obtained considerable interest [34,35,36]. Some soft grippers are of the impactive type. Their bodies are structurally compliant. The major outperforming feature of the grippers is mechanical intelligence, offering the possibility of grasping dissimilar objects using simple control architectures [37,38,39]. The soft pneumatic gripper (SPG), the working principle of which relies on anisotropic inflation according to pressurized air, is a popular type of soft gripper [40,41]. An SPG consists of two or more soft pneumatic actuators (SPAs). The main remarkable attribute of SPAs is that their intrinsically flexible structures can provide admirable compliance [42,43,44]. Nevertheless, the fantastic compliance of SPAs comes with a considerable concern regarding their nonlinear infinite degree-of-freedom (DOF) structures [45,46,47]. Accordingly, the modelling and sensor installation on SPAs are fundamentally challenging [48,49,50,51]. These challenges make the sensing of object properties through SPG grasping a complex problem. Specifically, the internal states and external loads of SPAs are difficult to perceive, and the connection of the variables on SPAs to those equivalents on grasped objects is mysterious.
Only a few relevant works were found. Homberg et al. [52] examined the data-driven haptic identification of objects using an SPG. Chen et al. [53] demonstrated size recognition and adaptive grasping using SPGs. Sankar et al. [54] investigated texture discrimination with an SPG. These works focus on the sensing of the sizes, geometries, and surface properties of grasped objects. Such attributes can be described with morphological variables, while mechanical properties require the consideration of both morphology and force. Supplementary studies are then necessary to make SPG grasping viable for the sensing of mechanical properties. At this early stage, a study relating to the sensing of any mechanical property through SPG grasping is a significant advancement.
A comprehensive framework for stiffness sensing through SPG pincer grasping is presented in this study. The presented framework includes the association of the deformation and force on the grasped object and their equivalents on SPAs, a new concept of SPA modeling, and a method for sensing object stiffness through SPG pincer grasping. The importance and originality of this study are that it explicates the combination of stiffness sensing and SPG grasping in a single action. The findings make an important contribution to the field of soft robotics, specifically extending the role of sensing for SPG grasping and object classification for complementing a new domain of classification data with an efficient framework of data acquisition. Future applications of the proposed framework could involve object inspection and classification for objects that cannot be discriminated based solely on their visual appearance.

2. Materials and Methods

2.1. Fundamentals of Stiffness Measurement

When an object is subjected to external force in the direction normal to its surface, it deforms in the same direction according to the force (Figure 1). Stiffness is a mechanical property of an object, indicating its ability to withstand deformation under external force. Let δ O and F O , respectively, represent the magnitude of the deformation and force on an object. Stiffness, denoted by k O , governs the correlation between δ O and F O as follows:
F O = k O δ O δ O .
Basically, k O is a function of δ O , and tends to be constant at low δ O . The conventional approaches for investigating k O are tensile [55] and compression [56] testing. An object is tensioned or compressed using a specific machine or probe, then a series of δ O and F O during the test is collected. From the collected series of δ O and F O , k O can be determined following Equation (1). Likewise, objects are compressed by grippers throughout grasping. The mechanical interaction between the grippers and objects also causes δ O and F O . Accordingly, δ O and F O throughout grasping can be utilized to estimate k O . Thus, k O is alternatively realizable through grasping.

2.2. SPG Pincer Grasping

Impactive grasping can be basically categorized, based on morphology, into two main types, including pincer [57] and envelope [58] grasping. Objects are squeezed by the fingertips of grippers in pincer grasping. The contact between the grippers and the grasped objects certainly occurs around the fingertips, although the contact locations can be slightly deviated. In contrast, gripper fingers perform as cages confining objects in envelope grasping. The contact locations are unpredictable, and tactile sensors are required to determine where the contact takes place. Once the contact locations are determined, the analysis of the correlation between variables on the gripper fingers and their equivalents on the grasped objects can proceed. With these kind of correlations, δ O and F O are solvable through the variables on the grippers, and then k O can be recognized.
This work focuses only on SPG pincer grasping (Figure 1). In SPG grasping, two or more SPAs perform as gripper fingers. SPAs make contact with the grasped objects at their tips. The interaction at the SPA tips depends on several factors, such as SPA performance, manipulator motion, object weight, and geometrical compatibility. To accomplish the sensing of k O , grasping conditions must be properly set up to make other effects besides the interaction due to SPA performance negligible. In this work, manipulators were expected to be static, and object weight was presumed to be insignificant or compensated with supports. For geometrical compatibility, this factor is supposed to have no effect on the interaction according to SPA compliance. Our observation and analysis on the pincer grasping of two-finger impactive SPGs reveals that F O equals the magnitude of the withstanding force on the SPAs, denoted by F S (Figure 1), as follows:
F S t = F O t .
The deformation of the SPAs, denoted by δ S (Figure 1), is equivalent to the combination of δ O and the space between them, denoted by G (Figure 1), as follows:
δ S t = δ O t + G .

2.3. SPA Modeling

The infinite-DOF structures of SPAs not only complicate the connection of δ S and F S to δ O and F O , but also make SPA modeling difficult. The modeling of SPAs is still an area of mainstream research on soft robotics. The most extensive technique for managing SPA infinite-DOF structures has been utilizing the combined effect of individual local joints to depict SPA configurations. In published SPA models, SPA curvature was assumed to be consistent along SPA length. SPA configuration was then represented by the SPA angle of curvature [50,59]. Nonetheless, SPA curvature is practically variable along the length in SPG pincer grasping. We suggest that SPA configuration should be portrayed by δ S . According to the equation of motion, an SPA model can be initiated as follows:
δ ¨ S t = f ( δ S t , δ ˙ S t , F S t , P S t ) ,
where P S denotes SPA input pressure. The variables δ ˙ S and δ ¨ S are time derivatives of δ S , while f represents a nonlinear function due to SPA characteristics. Equation (4) indicates that the change in δ ¨ S is governed by δ S , δ ˙ S , F S , and P S . However, SPA conditions are mostly static throughout grasping. Both δ ˙ S and δ ¨ S are then typically negligible. Equation (4) can be revised as follows:
0 = f δ S t , F S t , P S t .
This equation shows that δ S can be repeated under the identical steady-state conditions of F S and P S .
According to published works on SPA modeling, solving Equation (5) is demanding. There is no straightforward analytical method for it, and available simulation solvers are not suitable because of the large deformation and nonlinear characteristics of SPAs. An empirical investigation on an SPA was consequently conducted to obtain its performance curves, serving as an SPA model for comprehensive demonstration. Note that the SPA is an industrial bending type, and its operating P S condition ranges from −100 to 100 kPa. The experimental setup used for the investigation includes a motorized linear stage, load cell, and air supply, as demonstrated in Figure 2. The SPA was hung vertically. The load cell was equipped to the linear stage, and then horizontally moved to constrain δ S . The air supply was later employed to generate P S . After the SPA became steady, the signal from the load cell was interpreted to measure F S . We subsequently iterated these steps for different combinations of δ S and P S until F S at all designated δ S and P S conditions was collected and recorded. Note that the designated conditions of δ S ranged from 0 to 8 mm with 200 µm intervals, and those of P S ranged from 10 to 100 kPa with 10 kPa intervals. Linear fitting using QR factorization [60] was then applied to the resulting relationship between δ S and F S at each P S condition. Finally, the fitting results were plotted as F S δ S straight lines.

2.4. Stiffness Sensing through SPG Pincer Grasping

The proposed method of sensing k O is basically based on object compression due to SPA performance throughout SPG pincer grasping. Equations (2) and (3) illustrate that δ O and F O can be algebraically transformed into δ S and F S . Equation (1) is then revisable in accordance with the association of δ S and F S to δ O and F O as follows:
F S = k O δ S G δ S .
From this perspective, k O can be alternatively determined from some simultaneous sets of δ S and F S , producible by varying P S . The sensing of δ S and F S is still demanding. Most of the established works on SPA sensing in the aspect of SPA configuration only consider the SPA angle of curvature, which cannot be uniquely transformed into δ S in SPG pincer grasping. Despite sensing accuracy, we found that visual inspection is the only available approach for the direct observation of δ S . Furthermore, the sensing of F S can proceed only when using cutting-edge tactile sensing [26,61]. Currently, the most straightforward method for determining both δ S and F S is through exploiting computer vision to visually inspect δ S . Once δ S is successfully perceived, and P S is identified using some extensive pressure sensors, F S can be approximated using SPA kinetic models. The method of solving of Equation (5) mentioned in the previous subsection is presented for this purpose.
Stiffness sensing through SPG pincer grasping on four testing samples, subsequently called thin, slim, medium, and thick sample, was carried out. The testing samples were elastic elastomer hollow tubes (Figure 3), 3D-printed from the same material using a fused deposition modeling 3D printer with an extrusion nozzle of 0.4 mm. Each of them weighs around 2 g and are thus negligible. Their outer diameter was designed to be 20 mm. The main difference among them is their wall thickness. The wall thickness of the thin sample was 0.8 mm, that of the slim sample was 1.2 mm, that of the medium sample was 1.6 mm, and that of the thick sample was 2 mm. The SPG utilized in this experiment consisted of two SPAs, identical to the one investigated in the previous subsection, with a space of 20 mm between them. One of the samples was instantly grasped in a vertical gesture (Figure 4) under 11 different conditions of P S ranging from 0 to 100 kPa with 10 kPa intervals. At each P S condition, a stereo photograph of grasping was captured when the steady state was reached using a binocular digital camera, the resolution of which was FHD. The loaded P S was then released to make the SPG and sample return to their neutral shapes, before the SPG was executed with another of the P S conditions. After all of the stereo photographs were collected, each of them was individually processed to estimate G and δ S using image processing [62,63] and stereo computer vision [64,65]. From the estimated δ S and realized P S , the corresponding F S was identified. The correlation between δ S and F S at every designated P S condition was obtained accordingly. The next steps were eliminating the data points at which δ S was below G or beyond 10 mm, and then adding the x-axis intersection point at ( G ,0). Linear interpolation was utilized to make the discrete points into a continuous line. Hence, k O could be determined as the slope of the F S δ S curve following Equation (6). The resulting F S δ S curve was alternatively converted into an F O δ O curve using Equations (2) and (3), and k O was computed following Equation (1). The same process was repeated with the other samples.
In particular, the workflow of image processing and stereo computer vision began with the image undistortion [66] on a pair of the stereo photographs using pre-calibrated intrinsic camera parameters. The SPA tips were manually extracted from the undistorted images, and then the point triangulation [67] on the extracted pixels was completed. From the point triangulation, the 3D positions, with respect to the camera, of the SPA tips were determined. The vector from one SPA tip to the other was formulated in 3D based on their determined positions, and the distance between the SPA tips was calculated as the magnitude of this vector. These procedures were repeated for every pair of photographs. At this point, the distance between the SPA tips at every predefined P S condition was estimated. The distance at the rest state was set as a reference, and other estimated distances were compared to it. The resulting margin was considered twice δ S . For the value of G , we manually extracted the edges of the sample from one of the photograph pairs. Next, the extracted pixels were processed through the same procedures to determine the outer diameter of the sample. The approximated diameter was subtracted from the distance between the SPA tips at the rest state, and the subtraction result was considered twice G . The process toward the distance was tested on the exterior size of the samples, and it caused errors of up to 200 µm.

2.5. Validation

To validate the proposed method of stiffness sensing, a compression-testing experiment was conducted on the testing samples. Each sample was compressed individually using a load cell driven with a motorized linear stage (Figure 5). Specifically, the capacity of the load cell was 1 kgf, and its accuracy was 0.2% of the capacity. We adjusted δ O by moving the load cell, and compressed the sample until it reached a steady state. Later, F O was measured with the load cell. These steps were repeated for F O at the δ O conditions ranging from 0 to 6 mm with 100 µm intervals. From the acquired pairs of δ O and F O , a curve of F O over δ O was plotted. This curve was then transformed into k O over δ O using Equation (1). Afterwards, the resulting k O over δ O was compared to its counterpart obtained via the proposed method. Specifically, the comparison was focused on the deviation of k O , denoted by k O , along δ O . The definition of k O was determined as follows:
k O δ O = k O , S δ O k O , C δ O ,
where k O , S and k O , C , respectively, represent k O gathered from SPG pincer grasping and compression testing. These procedures were iterated for all other samples. In addition, the results of the proposed method were verified, and they were viable for object classification by utilizing them in manual template-matching classifications. The template used in this process is k O over δ O obtained through compression testing.

3. Results and Discussion

3.1. SPA Modeling

The empirically-investigated model of an SPA was first obtained. It contains 10 performance curves (Figure 6), describing SPA behaviors at 10 P S conditions ranging from 10 to 100 kPa with 10 kPa intervals. Each curve addresses the inverse relationship between δ S and F S at a specified P S condition. Furthermore, both δ S and F S were raised when P S increased. The resolution of δ S intervals in the investigation had only a minor effect on the resulting curves. The decrease rate of F S with respect to δ S varied from around 261 to 415 N/m. We tried the δ S intervals of 100 and 400 µm for the same process, and there was a tiny change in the results. The processing effort and time required for the investigation can be considerably reduced by using a rougher δ S interval. Another observation of this examination was that SPA curvature was practically inconsistent along SPA length (Figure 7) when F S was plentiful. The need for a new concept of SPA modeling is hence remarked upon by this investigation.

3.2. Stiffness Sensing through SPG Pincer Grasping

The experiment of stiffness sensing through SPG pincer grasping was completed. Eleven stereo photographs of SPG pincer grasping (Figure 7), captured at P S conditions ranging from 0 to 100 kPa with 10 kPa intervals, were acquired for each tested sample. The expressed workflow of image processing and stereo computer vision utilized these photographs and provided the distance between SPA tips at every P S condition. A set of δ S with respect to P S was determined from the provided distances. The corresponding F S was realized from the obtained pairs of δ S and P S using the SPA model acquired in the previous subsection. The resulting correlation between δ S and F S was made continuous using piecewise linear interpolation (Figure 6). Through the same workflow of image processing and stereo computer vision, the value of G was found to be 1.44 mm for the thin sample, 1.38 mm for the slim sample, 1.27 mm for the medium sample, and 1.4 mm for the thick sample. The equivalent values of δ O and F O were calculated using Equations (2) and (3). Four F O δ O curves (Figure 8) were plotted following the calculated collection of δ O and F O . The stiffness k O of all samples was plotted (Figure 8), and therefore successfully perceived through SPG pincer grasping. We found that k O was flat between 56 and 147 N/m for the thin sample. For the slim sample, k O was plane between 188 and 263 N/m when δ O was below 4 mm and continuously increased to 973 N/m when δ O became greater. Furthermore, k O increased from 308 to 562 N/m when δ O was smaller than 1.4 mm, and was fairly horizontal between 442 and 626 N/m when δ O was greater for the medium sample. Lastly, k O was found to be consistent at around 1.1 N/mm when δ O was under 500 µm, and then oscillated between 1.1 and 2.1 N/mm when δ O was higher than 500 µm for the thick sample.

3.3. Validation

Compression testing on the testing samples was successful, and four F O δ O curves were collected (Figure 8). The value of k O was subsequently computed and plotted (Figure 8). The resulting k O from the both methods had similar trends with small deviations for all samples. The deviation k O with respect to δ O was computed (Figure 8). The comparison results show that k O was oscillating over δ O around 40 N/m for the thin sample when δ O was under 5 mm, and continuously rose to 200 N/m when δ O was higher for the thin sample. Meanwhile, k O was oscillating around 100 N/m when δ O was below 4 mm, and suddenly shifted to vibrate around 25 to 30 N/m when δ O went over 4 mm for the slim sample. For the medium sample, k O was roughly flat around 150 N/m when δ O was between 1.38 and 2.9 mm, while fluctuating around 300 N/m when δ O was out of this range. Moreover, k O was oscillating around 400 N/m for the thick sample. The viability of k O acquired through SPG pincer grasping for object classification was also tested by employing the results of k O for manual template-matching classification on the samples. All of the samples were promptly classified because the classifying data obviously fit the template. The consideration was mainly based on the maximum value and moving average of k O . The classification results are demonstrated in Figure 9. Although the classification was not programmatically processed, it illustrates that k O obtained with the proposed method can be employed for object classification.
In the cases of the thin and slim samples, k O dramatically increased when δ O was greater than 4 mm. This phenomenon could be attributed to the occlusion effect [68], which occurred during manual feature extraction in the process of stereo computer vision. The phenomenon obstructed the visibility of the SPA tips when δ O yielded 4 mm. Once the SPA tips were unreliably extracted, the estimated values of δ S could deviate from the real values, and the resulting k O from the proposed method could have considerable errors. The necessity of further research on direct δ S sensing for more accurate results of k O is hence remarked. With more accurate δ S , the proposed method could offer more rigorous results of k O , and be credibly applied to some higher level tasks, such as object identification based on k O .

4. Conclusions

The sensing of stiffness through the pincer grasping of SPGs is presented in this study. The main objective of this study was to clarify the sensing of object stiffness via SPG grasping. The challenge of the study was that the deformation and force on the grasped objects must be associated with their equivalents on SPAs, but SPA structure basically has infinite DOF with nonlinear characteristics. According to SPA compliance, the modeling and sensor installation on SPAs are also sophisticated and novel. We first clarified how object stiffness is conventionally measured, and then presented the connection between stiffness measurement and SPG grasping. The analysis on SPG grasping was completed. Next, the association of the deformation and force on grasped objects to those on SPAs during SPG pincer grasping was formulated. Because SPA curvature is practically inconsistent along SPA length in SPG pincer grasping, available methods of SPA modeling are unfunctional in this case. A new concept of SPA modeling was consequently introduced. Afterwards, a method for stiffness sensing through SPG pincer grasping was proposed and demonstrated on four testing samples. An experiment of compression testing was later implemented to validate the results of the proposed method. The results show that the stiffness of all of the samples perceived with this proposed method slightly deviated from that obtained from compression testing; however, it was still functional for classifying the samples. The contribution and novelty of this study are combining stiffness sensing and SPG grasping into a single action. This study contributes to the fields of soft robotics by leading to the role extension of SPG grasping for sensing applications and object classification by offering an efficient framework for acquiring a new class of classification inputs. The proposed framework has potential for future applications in object inspection and classification, especially for visually indistinguishable objects. A limitation of this study is that the resulting deviation dramatically increased when the deformation of a sample yielded a large value. This phenomenon could be explained by the occlusion effect during the process of visual inspection for SPA deformation. Further studies regarding the direct sensing of SPA deformation should be carried out to overcome the occlusion effect and substantially improve the resulting accuracy of the proposed method. The accuracy improvement is expected to make the outputs of the proposed method viable for higher level tasks, such as identifying grasped objects.

Author Contributions

Conceptualization, C.S.; methodology, C.S.; software, C.S.; validation, C.S.; formal analysis, C.S.; investigation, C.S.; resources, C.S. and R.C.; data curation, C.S.; writing—original draft preparation, C.S.; writing—review and editing, C.S.; visualization, C.S.; supervision, R.C.; project administration, C.S. and R.C.; funding acquisition, R.C. All authors have read and agreed to the published version of the manuscript.

Funding

This project was funded by the National Research Council of Thailand (NRCT).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

C.S. is supported by a scholarship from “The 100th Anniversary Chulalongkorn University Fund for Doctoral Scholarship”.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Tsai, R.Y. A New Technique for Fully Autonomous and Efficient 3D Robotics Hand/Eye Calibration. IEEE Trans. Robot. Autom. 1989, 5, 345–358. [Google Scholar] [CrossRef]
  2. Levine, S.; Pastor, P.; Krizhevsky, A.; Ibarz, J.; Quillen, D. Learning hand-eye coordination for robotic grasping with deep learning and large-scale data collection. Int. J. Robot. Res. 2018, 37, 421–436. [Google Scholar] [CrossRef]
  3. Piazza, C.; Grioli, G.; Catalano, M.G.; Bicchi, A. A Century of Robotic Hands. Annu. Rev. Control Robot. Auton. Syst. 2019, 2, 1–32. [Google Scholar] [CrossRef]
  4. Marwan, Q.M.; Chua, S.C.; Kwek, L.C. Comprehensive Review on Reaching and Grasping of Objects in Robotics. Robotica 2021, 39, 1849–1882. [Google Scholar] [CrossRef]
  5. Han, L.; Trinkle, J.C.; Li, Z.X. Grasp analysis as linear matrix inequality problems. IEEE Trans. Robot. Autom. 2000, 16, 663–674. [Google Scholar] [CrossRef]
  6. Miller, A.T.; Allen, P.K. Graspit: A versatile simulator for robotic grasping. IEEE Robot. Autom. Mag. 2004, 11, 110–122. [Google Scholar] [CrossRef]
  7. Bohg, J.; Morales, A.; Asfour, T.; Kragic, D. Data-driven grasp synthesis-A survey. IEEE Trans. Robot. 2014, 30, 289–309. [Google Scholar] [CrossRef]
  8. Zhang, B.; Xie, Y.; Zhou, J.; Wang, K.; Zhang, Z. State-of-the-art robotic grippers, grasping and control strategies, as well as their applications in agricultural robots: A review. Comput. Electron. Agric. 2020, 177, 105694. [Google Scholar] [CrossRef]
  9. Monkman, G.J.; Hesse, S.; Steinmann, R.; Schunk, H. Robot Grippers; Wiley-VCH: Weinheim, Germany, 2006. [Google Scholar]
  10. Yang, Y.; Chen, Y.; Li, Y.; Chen, M.Z.Q.; Wei, Y. Bioinspired robotic fingers based on pneumatic actuator and 3D printing of smart material. Soft Robot. 2017, 4, 147–162. [Google Scholar] [CrossRef]
  11. Santina, C.D.; Arapi, V.; Averta, G.; Damiani, F.; Fiore, G.; Settimi, A.; Catalano, M.G.; Bacciu, D.; Bicchi, A.; Bianchi, M. Learning from humans how to grasp: A data-driven architecture for autonomous grasping with anthropomorphic soft hands. IEEE Robot. Autom. Lett. 2019, 4, 1533–1540. [Google Scholar] [CrossRef]
  12. Wang, H.; Abu-Dakka, F.J.; Le Nguyen, T.; Kyrki, V.; Xu, H. A Novel Soft Robotic Hand Design with Human-Inspired Soft Palm: Achieving a Great Diversity of Grasps. IEEE Robot. Autom. Mag. 2021, 28, 37–49. [Google Scholar] [CrossRef]
  13. Yoon, D.; Kim, K. Fully Passive Robotic Finger for Human-Inspired Adaptive Grasping in Environmental Constraints. IEEE/ASME Trans. Mechatron. 2022, 27, 3841–3852. [Google Scholar] [CrossRef]
  14. Johansson, R.S.; Flanagan, J.R. Coding and use of tactile signals from the fingertips in object manipulation tasks. Nat. Rev. Neurosci. 2009, 10, 345–359. [Google Scholar] [CrossRef] [PubMed]
  15. Feix, T.; Bullock, I.M.; Dollar, A.M. Analysis of human grasping behavior: Object characteristics and grasp type. IEEE Trans. Haptics 2014, 7, 311–323. [Google Scholar] [CrossRef]
  16. Lederman, S.J.; Klatzky, R.L. Haptic classification of common objects: Knowledge-driven exploration. Cogn. Psychol. 1990, 22, 421–459. [Google Scholar] [CrossRef]
  17. De-An, Z.; Jidong, L.; Wei, J.; Ying, Z.; Yu, C. Design and control of an apple harvesting robot. Biosyst. Eng. 2011, 110, 112–122. [Google Scholar] [CrossRef]
  18. Shaukat, A.; Gao, Y.; Kuo, J.A.; Bowen, B.A.; Mort, P.E. Visual classification of waste material for nuclear decommissioning. Robot. Auton. Syst. 2016, 75, 365–378. [Google Scholar] [CrossRef]
  19. Zhou, X.; Xu, X.; Liang, W.; Zeng, Z.; Shimizu, S.; Yang, L.T.; Jin, Q. Intelligent Small Object Detection for Digital Twin in Smart Manufacturing with Industrial Cyber-Physical Systems. IEEE Trans. Ind. Inform. 2022, 18, 1377–1386. [Google Scholar] [CrossRef]
  20. Li, Y.; Zhang, D.; Lee, D.J. Automatic fabric defect detection with a wide-and-compact network. Neurocomputing 2019, 329, 329–338. [Google Scholar] [CrossRef]
  21. Czerniawski, T.; Nahangi, M.; Haas, C.; Walbridge, S. Pipe spool recognition in cluttered point clouds using a curvature-based shape descriptor. Autom. Constr. 2016, 71, 346–358. [Google Scholar] [CrossRef]
  22. Phanomchoeng, G.; Rajamani, R. Real-time estimation of rollover index for tripped rollovers with a novel unknown inputs nonlinear observer. In Proceedings of the American Control Conference, Montreal, QC, Canada, 27–29 June 2012; pp. 2090–2095. [Google Scholar]
  23. Phanomchoeng, G.; Chantranuwathana, S.; Charunyakorn, P. On-line Ladle Lining Temperature Estimation by Using Bounded Jacobian Nonlinear Observer. J. Iron Steel Res. Int. 2016, 23, 792–799. [Google Scholar] [CrossRef]
  24. Park, J.; Moon, W. A hybrid-type micro-gripper with an integrated force sensor. Microsyst. Technol. 2003, 9, 511–519. [Google Scholar] [CrossRef]
  25. Almassri, A.M.; Wan Hasan, W.Z.; Ahmad, S.A.; Ishak, A.J.; Ghazali, A.M.; Talib, D.N.; Wada, C. Pressure sensor: State of the art, design, and application for robotic hand. J. Sens. 2015, 2015, 846487. [Google Scholar] [CrossRef]
  26. Kappassov, Z.; Corrales, J.A.; Perdereau, V. Tactile sensing in dexterous robot hands—Review. Robot. Auton. Syst. 2015, 74, 195–220. [Google Scholar] [CrossRef]
  27. Kim, D.E.; Li, A.; Dau, M.N.; Kim, H.H.; Chung, W.Y. Deep learning-based smith predictor design for a remote grasping control system. J. Mech. Sci. Technol. 2022, 36, 2533–2545. [Google Scholar] [CrossRef]
  28. Calandra, R.; Owens, A.; Jayaraman, D.; Lin, J.; Yuan, W.; Malik, J.; Adelson, E.H.; Levine, S. More than a feeling: Learning to grasp and regrasp using vision and touch. IEEE Robot. Autom. Lett. 2018, 3, 3300–3307. [Google Scholar] [CrossRef]
  29. Girão, P.S.; Ramos, P.M.P.; Postolache, O.; Miguel Dias Pereira, J. Tactile sensors for robotic applications. Meas. J. Int. Meas. Confed. 2013, 46, 1257–1271. [Google Scholar] [CrossRef]
  30. Kim, G.S. Development of a three-axis gripper force sensor and the intelligent gripper using it. Sens. Actuators A Phys. 2007, 137, 213–222. [Google Scholar] [CrossRef]
  31. Romano, J.M.; Hsiao, K.; Niemeyer, G.; Chitta, S.; Kuchenbecker, K.J. Human-inspired robotic grasp control with tactile sensing. IEEE Trans. Robot. 2011, 27, 1067–1079. [Google Scholar] [CrossRef]
  32. Spiers, A.J.; Liarokapis, M.V.; Calli, B.; Dollar, A.M. Single-Grasp Object Classification and Feature Extraction with Simple Robot Hands and Tactile Sensors. IEEE Trans. Haptics 2016, 9, 207–220. [Google Scholar] [CrossRef]
  33. Spiers, A.J.; Morgan, A.S.; Srinivasan, K.; Calli, B.; Dollar, A.M. Using a Variable-Friction Robot Hand to Determine Proprioceptive Features for Object Classification during Within-Hand-Manipulation. IEEE Trans. Haptics 2020, 13, 600–610. [Google Scholar] [CrossRef] [PubMed]
  34. Ilievski, F.; Mazzeo, A.D.; Shepherd, R.F.; Chen, X.; Whitesides, G.M. Soft robotics for chemists. Angew. Chem. Int. Ed. 2011, 50, 1890–1895. [Google Scholar] [CrossRef] [PubMed]
  35. Bao, G.; Fang, H.; Chen, L.; Wan, Y.; Xu, F.; Yang, Q.; Zhang, L. Soft robotics: Academic insights and perspectives through bibliometric analysis. Soft Robot. 2018, 5, 229–241. [Google Scholar] [CrossRef] [PubMed]
  36. Boyraz, P.; Runge, G.; Raatz, A. An overview of novel actuators for soft robotics. Actuators 2018, 7, 48. [Google Scholar] [CrossRef]
  37. Bone, G.M.; Lambert, A.; Edwards, M. Automated modeling and robotic grasping of unknown three-dimensional objects. In Proceedings of the IEEE International Conference on Robotics and Automation, Pasadena, CA, USA, 19–23 May 2008; pp. 292–298. [Google Scholar]
  38. Rus, D.; Tolley, M.T. Design, fabrication and control of soft robots. Nature 2015, 521, 467–475. [Google Scholar] [CrossRef] [PubMed]
  39. Thuruthel, T.G.; Ansari, Y.; Falotico, E.; Laschi, C. Control Strategies for Soft Robotic Manipulators: A Survey. Soft Robot. 2018, 5, 149–163. [Google Scholar] [CrossRef]
  40. Gorissen, B.; Reynaerts, D.; Konishi, S.; Yoshida, K.; Kim, J.W.; De Volder, M. Elastic Inflatable Actuators for Soft Robotic Applications. Adv. Mater. 2017, 29, 1604977. [Google Scholar] [CrossRef]
  41. Shintake, J.; Cacucciolo, V.; Floreano, D.; Shea, H. Soft Robotic Grippers. Adv. Mater. 2018, 30, 1707035. [Google Scholar] [CrossRef]
  42. Hughes, J.; Culha, U.; Giardina, F.; Guenther, F.; Rosendo, A.; Iida, F. Soft manipulators and grippers: A review. Front. Robot. AI 2016, 3, 69. [Google Scholar] [CrossRef]
  43. Hines, L.; Petersen, K.; Lum, G.Z.; Sitti, M. Soft Actuators for Small-Scale Robotics. Adv. Mater. 2017, 29, 1603483. [Google Scholar] [CrossRef]
  44. Polygerinos, P.; Correll, N.; Morin, S.A.; Mosadegh, B.; Onal, C.D.; Petersen, K.; Cianchetti, M.; Tolley, M.T.; Shepherd, R.F. Soft Robotics: Review of Fluid-Driven Intrinsically Soft Devices; Manufacturing, Sensing, Control, and Applications in Human-Robot Interaction. Adv. Eng. Mater. 2017, 19, 1700016. [Google Scholar] [CrossRef]
  45. Lipson, H. Challenges and Opportunities for Design, Simulation, and Fabrication of Soft Robots. Soft Robot. 2014, 1, 21–27. [Google Scholar] [CrossRef]
  46. Chen, X.; Zhang, X.; Huang, Y.; Cao, L.; Liu, J. A review of soft manipulator research, applications, and opportunities. J. Field Robot. 2022, 39, 281–311. [Google Scholar] [CrossRef]
  47. Su, H.; Hou, X.; Zhang, X.; Qi, W.; Cai, S.; Xiong, X.; Guo, J. Pneumatic Soft Robots: Challenges and Benefits. Actuators 2022, 11, 92. [Google Scholar] [CrossRef]
  48. Udupa, G.; Sreedharan, P.; Dinesh, P.S.; Kim, D. Asymmetric bellow flexible pneumatic actuator for miniature robotic soft gripper. J. Robot. 2014, 2014, 902625. [Google Scholar] [CrossRef]
  49. Yang, H.; Chen, Y.; Sun, Y.; Hao, L. A novel pneumatic soft sensor for measuring contact force and curvature of a soft gripper. Sens. Actuators A Phys. 2017, 266, 318–327. [Google Scholar] [CrossRef]
  50. Lotfiani, A.; Yi, X.; Shao, Z.; Zhao, H.; Parkestani, A.N. Analytical modeling and optimization of a corrugated soft pneumatic finger considering the performance of pinch and power grasps. Extrem. Mech. Lett. 2021, 44, 101215. [Google Scholar] [CrossRef]
  51. Alici, G.; Canty, T.; Mutlu, R.; Hu, W.; Sencadas, V. Modeling and Experimental Evaluation of Bending Behavior of Soft Pneumatic Actuators Made of Discrete Actuation Chambers. Soft Robot. 2018, 5, 24–35. [Google Scholar] [CrossRef]
  52. Homberg, B.S.; Katzschmann, R.K.; Dogar, M.R.; Rus, D. Haptic identification of objects using a modular soft robotic gripper. In Proceedings of the IEEE International Conference on Intelligent Robots and Systems, Hamburg, Germany, 28 September–2 October 2015; pp. 1698–1705. [Google Scholar]
  53. Chen, Y.; Guo, S.; Li, C.; Yang, H.; Hao, L. Size recognition and adaptive grasping using an integration of actuating and sensing soft pneumatic gripper. Robot. Auton. Syst. 2018, 104, 14–24. [Google Scholar] [CrossRef]
  54. Sankar, S.; Balamurugan, D.; Brown, A.; Ding, K.; Xu, X.; Low, J.H.; Yeow, C.H.; Thakor, N. Texture Discrimination with a Soft Biomimetic Finger Using a Flexible Neuromorphic Tactile Sensor Array That Provides Sensory Feedback. Soft Robot. 2021, 8, 577–587. [Google Scholar] [CrossRef]
  55. Smerd, R.; Winkler, S.; Salisbury, C.; Worswick, M.; Lloyd, D.; Finn, M. High strain rate tensile testing of automotive aluminum alloy sheet. Int. J. Impact Eng. 2005, 32, 541–560. [Google Scholar] [CrossRef]
  56. Kallio, M.; Lindroos, T.; Aalto, S.; Järvinen, E.; Kärnä, T.; Meinander, T. Dynamic compression testing of a tunable spring element consisting of a magnetorheological elastomer. Smart Mater. Struct. 2007, 16, 506–514. [Google Scholar] [CrossRef]
  57. Shi, J.; Woodruff, J.Z.; Umbanhowar, P.B.; Lynch, K.M. Dynamic In-Hand Sliding Manipulation. IEEE Trans. Robot. 2017, 33, 778–795. [Google Scholar] [CrossRef]
  58. Tamamoto, T.; Takeuchi, K.; Koganezawa, K. Development of gripper to achieve envelope grasping with underactuated mechanism using differential gear. J. Robot. Mechatron. 2018, 30, 855–862. [Google Scholar] [CrossRef]
  59. Tian, Y.; Zhang, Q.; Cai, D.; Chen, C.; Zhang, J.; Duan, W. Theoretical modelling of soft robotic gripper with bioinspired fibrillar adhesives. Mech. Adv. Mater. Struct. 2020, 29, 2250–2266. [Google Scholar] [CrossRef]
  60. Subhedar, M.S.; Mankar, V.H. Image steganography using redundant discrete wavelet transform and QR factorization. Comput. Electr. Eng. 2016, 54, 406–422. [Google Scholar] [CrossRef]
  61. Park, S.; Hwang, D. Softness-Adaptive Pinch-Grasp Strategy Using Fingertip Tactile Information of Robot Hand. IEEE Robot. Autom. Lett. 2021, 6, 6370–6377. [Google Scholar] [CrossRef]
  62. Kruachottikul, P.; Cooharojananone, N.; Phanomchoeng, G.; Chavarnakul, T.; Kovitanggoon, K.; Trakulwaranont, D.; Atchariyachanvanich, K. Bridge Sub Structure Defect Inspection Assistance by using Deep Learning. In Proceedings of the 2019 IEEE 10th International Conference on Awareness Science and Technology, iCAST 2019, Morioka, Japan, 25 October 2019. [Google Scholar]
  63. Kruachottikul, P.; Cooharojananone, N.; Phanomchoeng, G.; Chavarnakul, T.; Kovitanggoon, K.; Trakulwaranont, D. Deep learning-based visual defect-inspection system for reinforced concrete bridge substructure: A case of Thailand’s department of highways. J. Civ. Struct. Health Monit. 2021, 11, 949–965. [Google Scholar] [CrossRef]
  64. Dadashzadeh, M.; Abbaspour-Gilandeh, Y.; Mesri-Gundoshmian, T.; Sabzi, S.; Hernández-Hernández, J.L.; Hernández-Hernández, M.; Ignacio Arribas, J. Weed classification for site-specific weed management using an automated stereo computer-vision machine-learning system in rice fields. Plants 2020, 9, 559. [Google Scholar] [CrossRef]
  65. Ermilov, A.A.; Baranya, S.; Török, G.T. Image-based bed material mapping of a large river. Water 2020, 12, 916. [Google Scholar] [CrossRef]
  66. Zhang, M.; Hu, X.; Yao, J.; Zhao, L.; Li, J.; Gong, J. Line-based geometric consensus rectification and calibration from single distorted manhattan image. IEEE Access 2019, 7, 156400–156412. [Google Scholar] [CrossRef]
  67. Li, J.; Bennett, B.L.; Karam, L.J.; Pettinato, J.S. Stereo Vision Based Automated Solder Ball Height and Substrate Coplanarity Inspection. IEEE Trans. Autom. Sci. Eng. 2016, 13, 757–771. [Google Scholar] [CrossRef]
  68. Choi, I.O.; Park, S.H.; Kang, K.B.; Lee, S.H.; Kim, K.T. Efficient parameter estimation for cone-shaped target based on distributed radar networks. IEEE Sens. J. 2019, 19, 9736–9747. [Google Scholar] [CrossRef]
Figure 1. SPG grasping an object with deformation and force annotations on the SPA and object.
Figure 1. SPG grasping an object with deformation and force annotations on the SPA and object.
Sensors 23 06094 g001
Figure 2. An experimental setup for acquiring SPA performance curves.
Figure 2. An experimental setup for acquiring SPA performance curves.
Sensors 23 06094 g002
Figure 3. Elastic elastomer 3D-printed hollow tubes used as testing samples for stiffness recognition.
Figure 3. Elastic elastomer 3D-printed hollow tubes used as testing samples for stiffness recognition.
Sensors 23 06094 g003
Figure 4. Experimental setup for stiffness sensing through SPG pincer grasping.
Figure 4. Experimental setup for stiffness sensing through SPG pincer grasping.
Sensors 23 06094 g004
Figure 5. Experimental setup for stiffness measurement through compression testing.
Figure 5. Experimental setup for stiffness measurement through compression testing.
Sensors 23 06094 g005
Figure 6. An empirical kinetic model of an SPA and the primary results of stiffness sensing through SPG pincer grasping on four samples.
Figure 6. An empirical kinetic model of an SPA and the primary results of stiffness sensing through SPG pincer grasping on four samples.
Sensors 23 06094 g006
Figure 7. A stereo photograph of SPG grasping captured with a binocular camera.
Figure 7. A stereo photograph of SPG grasping captured with a binocular camera.
Sensors 23 06094 g007
Figure 8. Resulting force, stiffness, and stiffness deviations over object deformation from stiffness sensing through SPG pincer grasping and compression testing methods on four samples: (a) thin sample; (b) slim sample; (c) medium sample; (d) thick sample.
Figure 8. Resulting force, stiffness, and stiffness deviations over object deformation from stiffness sensing through SPG pincer grasping and compression testing methods on four samples: (a) thin sample; (b) slim sample; (c) medium sample; (d) thick sample.
Sensors 23 06094 g008
Figure 9. Manual template-matching classification on four samples based on their stiffness collected through SPG pincer grasping.
Figure 9. Manual template-matching classification on four samples based on their stiffness collected through SPG pincer grasping.
Sensors 23 06094 g009
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Sithiwichankit, C.; Chancharoen, R. Advanced Stiffness Sensing through the Pincer Grasping of Soft Pneumatic Grippers. Sensors 2023, 23, 6094. https://doi.org/10.3390/s23136094

AMA Style

Sithiwichankit C, Chancharoen R. Advanced Stiffness Sensing through the Pincer Grasping of Soft Pneumatic Grippers. Sensors. 2023; 23(13):6094. https://doi.org/10.3390/s23136094

Chicago/Turabian Style

Sithiwichankit, Chaiwuth, and Ratchatin Chancharoen. 2023. "Advanced Stiffness Sensing through the Pincer Grasping of Soft Pneumatic Grippers" Sensors 23, no. 13: 6094. https://doi.org/10.3390/s23136094

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop