1. Introduction
Effective force interaction is crucial for the human–machine interface during teleoperation. It is difficult to make accurate decisions if the operator lacks a sense of the working environment [
1]. As an intuitive and effective force interaction mechanism, the force feedback glove allows users to touch and manipulate virtual objects in an intuitive and direct way via the dexterous manipulation and sensitive perception capabilities of the hands [
2], which significantly enhances their ability to understand the remote scene [
3].
Over the past decade, force feedback devices with various mechanisms have been proposed and widely adopted in virtual reality [
4], human–machine teleoperation [
5,
6,
7], micromanipulation [
8], medical training, and rehabilitation [
9,
10]. Based on their working principle and working space, force feedback devices can be classified into grounded and ungrounded devices [
11]. Grounded force feedback devices are fixed in place and apply force from the ground (or from a desk) [
12]; many products of this type have been put forward, and various end effectors such as pens [
13,
14], scissors [
15,
16], and soft balls have been used depending on the purpose of the system. However, the restricted workspace makes it difficult for the user to move freely, thus leading to a lack of flexibility. This is effectively addressed by ungrounded feedback devices, in which the interaction force derived from the operator is applied to other parts of the user’s body, allowing for a significant improvement in flexibility and enabling the user to feel the virtual object more naturally.
Ungrounded feedback devices, also known as wearable force feedback devices, can be divided into active feedback force and passive feedback force according to working principle. Compared with gloves providing active feedback force, gloves with passive feedback force are promising in terms of safety and low weight, but simulating the variable stiffness of virtual objects is more challenging. Therefore, Wang D X et al. [
17] proposed a variable stiffness passive force feedback, in which the stiffness of the glove is tuned by changing the structural stiffness; the switch between free and constrained space is realized in real time by locking/unlocking the revolute joints of the glove using a servo motor, but the structure is complex. Wang D M et al. [
18] developed a force feedback glove using a magnetorheological (MR) damper to provide viable feedback force, while it has the shortcoming of a slow response time.
Compared with the passive force feedback gloves, the active force feedback can provide flexible stiffness and variable feedback force, which has been adopted in various commercial force feedback devices. The CyberGrasp [
19] is one of the most successful haptic gloves available on the market. The actuation tendons pull the glove mechanism to provide force feedback up to 12 N to each finger in the direction opposite the fingers closing (only one direction force feedback). The glove mounted on the back of the hand weighs 350 g, but the separate control and actuator unit has a weight of 20 kg, which makes the device’s portability difficult. Due to lack of position sensors, the CyberGrasp needs an extra data glove (CyberGlove) to provide sensing. To solve this problem, Zhou M et al. [
20] proposed a sensing and force-feedback exoskeleton (SAFE) glove. The glove is a wireless and self-contained mechatronic system that mounts over the dorsum of a bare hand and provides haptic force feedback to each finger. A force sensor is installed at the end of the glove to sense fingertip force, but due to the complex structure, the glove only achieved two fingers, and the weight was 275 g.
To reduce the weight of gloves, Zheng et al. [
21] and Wang et al. [
22] designed a force feedback glove using a cylinder as power source to achieve flexible force feedback by varying the pressure inside the cylinder. The glove can achieve a feedback force up to 16 N and weighs 245 g; however, the glove lacks the closed-loop control of force, and the compressibility of the gas leads to inaccurate feedback forces and a slow response. To enhance the inaccuracy of the feedback force, in 2016, Sarakoglou et al. [
23] designed a motor-driven exoskeleton force feedback glove, which enables the measurement of motor torque through a torque sensor at the end of the motor and the measurement of finger position using a position encoder. Moreover, Nguyen et al. [
24] developed a glove that measures driving force, they used a series elastic actuator (SEA) mechanism in their actuation system. This mechanism consists of a linear motor, a spring, and a linear potentiometer to generate the desired force. This glove measures the driving force by measuring the deformation of the spring mounted at the end of the actuator and achieving dynamic force response with the PID algorithm. To achieve a smooth transition from free workspace to constrained workspace, Park et al. [
11] designed a smooth transition control strategy to switch between two controllers without any sudden movement of the motor at the boundaries of different control strategies.
The parameters of the relevant studies discussed above are listed in
Table 1. From the above analysis, a well-designed glove should possess the following characteristics:
- (1)
A lightweight and simple structure;
- (2)
The capability of realizing the measurement of driving force and position;
- (3)
The capability of realizing soft and precise force feedback;
- (4)
A large workspace and without causing harm to the operator.
As shown in
Table 1, while many studies have attempted to achieve the aforementioned goals, some gloves possess one or more of the desired characteristics; however, designing gloves that encompass all of these characteristics remains a challenge [
25]. In order to meet all these requirements, in this study, a lightweight, wearable exoskeleton glove that enables driving force and driving position measurement is designed, integrated, and tested. The glove uses a triple-link structure to achieve force transfer and covers most of the finger’s movement space with good wearability and safety. The designed data glove enables indirect measurement of finger driving force through a force sensor at the end of the actuator. A prototype of a five-degrees-of-freedom force feedback exoskeleton was built. Then, an isomorphic teleoperation control framework is designed to achieve motion control of the remote actuator and feedback sensing of the contact force. In addition, a closed-loop control algorithm based on impedance theory was developed, which can generate the required driving force and achieve a smooth transition between the two motion phases of the free and constrained space.
The sections of this paper are organized as follows: In
Section 1, we explain the purpose of this study. In
Section 2, we describe the structure design, including the drive system design, mechanical analysis, and workspace analysis. In
Section 3, we describe the details of the proposed control algorithm based on impedance control theory. The performance verification is presented in
Section 4, including the dynamic response characteristics in the free and constrained motion states. The glove is discussed in
Section 5, and the conclusions are given in
Section 6.
2. Mechanical System
In this study, a novel EFFG was designed to meet the specified requirements discussed in introduction. As shown in
Figure 1, the designed glove mainly consists of a sensory-enabled motor, a three-link force transfer mechanism, and a finger connector. The glove provides both motion control and force feedback. The total weight of the EFFG was 278 g, which includes a 7.4-volt rechargeable battery (38 g), a control unit (25 g), five actuators (per 30 g), and five drive links (per 13 g).
2.1. Transmission Structure
Each finger, excluding the thumb, is composed of three bones (proximal phalanx (PP), middle phalanx (MP), and distal phalanx (DP)) and three joints. Inspired by the mechanism of human fingers, this study designed a three-linkage transmission structure. As shown in
Figure 2, the three-link transmission unit comprises three curved links connected to each other via hinges, and the ends of the linkages are connected to the actuator and the fingertip, respectively, ensuring smooth force transmission. During working, the first connecting Link1 rotates around point A, causing the motor to move relative to the base plate; thus, the force-sensing side of the linear actuator is connected to the base plate by a spherical joint, and the base plate is attached to the back of the hand with Velcro.
According to the research by Kapandji et al. [
25], the axes of human fingers are non-standard orthogonal to the sagittal plane, and the surface of the human finger bending motion is a curved surface since the relative directions of the finger joint axes are not perfectly parallel. A simple rigid connection is unsuitable because the joint-axis misalignment between the finger and the glove mechanism can generate an uncomfortable tangential force on the user’s fingertip. As a result, the five transmission structure units are connected with bandages instead of rigid connections, allowing the finger to bend in the direction of abduction/adduction freely while minimizing uncomfortable forces.
The length of the links is optimized based on anthropomorphic data [
26] and simulation analysis, adhering to the following optimization criteria: the linear actuator motion range is 16 mm, and the length of the links should ensure that (1) the working space of the exoskeleton glove matches the finger’s movement space; (2) to prevent collisions, the links should not interfere with the movement of the finger; and (3) the limit state of the motor is close to the limit state of the finger extension.
Table 2 lists the optimized dimensions of each finger link.
Three-dimensional printing technology was employed to fabricate the components, and a robust tough resin with a bending strength of 38–56 Mpa was selected as the material to achieve high structural stiffness and reduced mass. Furthermore, the optimized dimensions also ensure the safety of the force feedback gloves. Since the linear actuator has a limited range, the limit state of the motor should be close to the limit state of finger extension but not exceed it, thus preventing potential damage to the hand during the transition of the motor stretch. Even if an accidental failure of the linear motor occurs, it would not cause serious mechanical injury to the finger. The physical view of the glove in extreme bending/extension shown in
Figure 3 verifies its safety.
2.2. Kinematic and Workspace Analysis
For each force feedback unit, the exoskeleton and the human finger can be modeled as a six-bar linkage mechanism. As shown in
Figure 4, the base plate is solidly connected to the hand, representing the ground. Each human finger consists of three links, as does the exoskeleton. Both the end link of the mechanism and the fingertip are attached with Velcro, so there are six links in total (one ground link, three finger links, and two exoskeleton links) and six revolute pairs.
According to Grubler’s formula, the degrees of freedom (
DOF) of this unit can be calculated using (1).
where
n is the number of connecting links;
is the number of lower pairs; and
is the number of higher pairs. Because the number of DOF of the mechanism is two, the mechanism allows any arbitrary movement of the fingertip in the flexion–extension plane.
When the motor moves along the red axis in
Figure 4, it drives the end of the force feedback glove in the red direction. The relationships between the fingertip position
P, the finger joint angle, and the exoskeleton joint angle are:
where
are the finger joint angles;
are the exoskeleton joint angles, respectively;
is the length of the exoskeleton linkage; and
is the length of the fingertip.
The relationship between the exoskeleton joint angle
and the motor length
is
where
represents the length of the linear motor; and
are the designed parameters that represent the length of the base plate, the length between the pivot point and the force transmission point, and the inherent angle between the force transmission link and connecting link 1, respectively.
The relationship between the exoskeleton joint angle and the finger joint angle is as follows:
where:
Therefore, if the joint angle of the human finger is known, the joint angle of the exoskeleton and the length of the linear motor can be calculated with (5)–(6). Conversely, if the length of the linear motor and the joint angle of the exoskeleton are known, the current joint angle of the human finger can be determined.
Additionally, this study analyzed the workspace performance through simulation. The MATLAB Robotics Toolbox [
27] was used to simulate the movement of both the human hand and the haptic glove. Each finger is modeled as a serial kinematically rigid robot using the standard Denavit–Hartenberg (DH) notation. According to references [
28,
29,
30], the anthropometric data, including the average length of the index finger knuckle and the minimum and maximum joint angles, are presented in
Table 3.
With this information, the 2D motion space of the single finger and the exoskeleton structure is obtained. As depicted in
Figure 5, the orange point clouds represent the exoskeleton motion points, and the motion space of the human finger is depicted with blue points. The simulation result demonstrates that the designed mechanism is capable of covering a substantial portion of the operational workspace of the finger. This conclusion is verified by the physical picture of the wearer in different bending states (
Figure 6). Moreover, the limitation in achieving the tight grip position helps prevent potential harm to the wearer’s finger joints in case of motor malfunction. The motion spaces of the other fingers are consistent with this pattern.
2.3. Force Sensing and Transmission
Real-time measurement of the feedback force is necessary for closed-loop force control. Nevertheless, traditional fingertip force sensors might not be well suited for exoskeleton systems. The limitations of this approach include: (1) The fingertip force sensor requires bulky fixtures to attach to the fingers. Moreover, one fingertip force sensor requires at least three communication wires, resulting in a confusing structure and lack of stability; (2) The force sensor needs to be in close contact with the fingertips; excessive mounting preload can produce severe uncomfortable compression and even cause insufficient blood supply to the fingers. A small mounting preload can cause the force sensor to slip or even to make poor contact with the force sensor, resulting in serious dynamic measurement errors. In addition, the mounting preload is not fixed for each wear, which further reduces the measurement accuracy and stability of the force sensor and leads to oscillation in the response of the force closed-loop control algorithm. For these reasons, mounting the force sensor directly on the fingertip dose not facilitate precise force measurement. In this design, an indirect force measurement method was utilized. As
Figure 7 shows, a compact force sensor, enabling force detection within a range of [−50 N, 50 N] with a resolution of 1 N (Inspire robot Inc., Beijing, China.), was connected to the motor’s end to measure the drive force, The rendering of the gripping force is achieved through the designed three-link structure, which transfers the actuator-generated driving force to the finger.
Below, we analyze the relationship between the driving force and the fingertip force, which focuses on the device’s ability to transmit the desired force to the fingertips, and to determine whether there is a fixed positive correlation.
Since the weight of the links is relatively small compared to the transmitted force, the weight factor of the exoskeleton can be neglected. Furthermore, the gradual rate of change in the user’s finger movements implies that the acceleration of each link during finger motion can be set aside. For the reasons listed above, the force transmission can be simplified as a quasi-static force analysis.
As shown in
Figure 8,
is the pulling force generated by the actuator and
is the normal force applied to the fingertip. According to the static equilibrium equations, the relationship between the driving force and the effective orthogonal decomposition force
of link 2 on link 1 is as follows:
where:
The static force analysis of link 2 is a s follows:
The relationship between the force perceived at the fingertip and the driving force of the motor can be obtained with (10) the following:
Therefore, the driving force and finger force are positively correlated.
2.4. Electrical Design
In terms of electrical design, the focus was on designing compact interface circuit boards to ensure portability and durability. As depicted in
Figure 9, the electrical system comprises a microcontroller, a wireless communication module, five channels of A/D acquisition (for fingertip pressure sensors), five linear servo motor communication channels, and a rechargeable battery.
The controller communicates with the actuator by means of a bus with a maximum frequency of 921,600 bps. Actuators were distinguished by assigning different ID codes, enabling the controller to manage up to 254 motors on one communication channel.
The Arduino microcontroller (Nano), a miniaturized high-performance microprocessor, was applied as the control module. The processor performs the following functions: (1) measuring the driving force and the drive position of the actuator; (2) sending commands to the actuator to control the force applied to the fingertips; (3) communicating with the teleoperated master unit to control the movement of the remote bionic mechanical hand; (4) communicating with the teleoperation master unit to obtain the desired feedback force back for the operator.
The microcontroller operates at a frequency of 16 MHz. Communication between the glove and the master is realized through a wireless Bluetooth module, which transmits data at an update rate of 9600 Hz and communicates with the linear actuator at a frequency of 128,000 Hz.
3. Control System
Limited by the drawbacks of fingertip force sensors discussed in
Section 2.3, currently, EFFGs have difficulty in achieving the measurement of feedback forces. In this study, an exoskeleton structure was designed with a driving force sensor installed at the end of the motor. The structure enables indirect acquisition of the actual feedback force exerted on the finger through the force transfer mechanism. In other words, the feedback force of the fingertip can be analytically calculated by (7)–(10). However, the results of the analysis and related research indicate that the parameters related to the force transfer function such as the lengths of each finger phalange (
p1,
p2, and
p3) vary for each individual, making theoretical calculations unsuitable for direct application. As stated in (7)–(10), the transfer relationship between the driving force and the fingertip sensing force is non-linear, but positively correlated at a specified location. In this study, an indirect closed-loop force feedback method is proposed for haptic interaction in isomorphic systems.
3.1. Architecture of Isomorphic Teleoperation Systems
As depicted in
Figure 10, the designed isomorphic teleoperation systems comprise a force feedback glove and a humanoid hand. The humanoid hand is a commercially available manipulator, with a similar mechanism to the exoskeleton glove, featuring five driving DOFs. The driving force can be measured indirectly through the driving current. When the user wears the glove, assisted by vision, the user controls the extension or bending of the fingers by driving the movement of the exoskeleton glove; therefore, the movement of the slave robot is controlled based on the measured length of the glove’s motor actuator. When the slave manipulator makes contact with an object, the gripping force exerted by the remote actuator is transmitted to the operator through the exoskeleton glove.
Figure 11 presents the control diagram for the isomorphic teleoperation system. In the free workspace, the desired force of the impedance controller
is set to 0. The exoskeleton glove extends or flexes under the traction of human fingers, and the motion of the slave hand is controlled by the bending position of the exoskeleton glove (the code value of the motor). When the slave manipulator is in contact with an object, the desired force and desired position (Fd, Xd) of the controller are set to the driving force and driving position (Fs, Xs) applied by the remote actuator. In other words, the driving force applied to the fingers by the exoskeleton glove is equivalent to the driving force applied to the object by the slave actuator. This provides the operator with an immersive gripping sensation and enables more intuitive and secure control of the robot.
3.2. Modeling of Impedance Controller
The core of the control system is achieving a smooth control method for the required driving force. According to the previous related studies [
23,
24], the response characteristics of the PID can cause sudden rotation of the motor at the moment of contact with an object, causing a shock sensation for the operator’s hand. Therefore, Y. Park designed a transition balance strategy based on scaling factors to achieve smooth transitions from free mode to interactive mode, but with a decreased response speed [
11]. As a compliant control algorithm, in this study, the impedance control method is employed for the control of the exoskeleton force feedback as it offers both flexibility and accurate tracking of the desired forces [
31].
Impedance control can be classified into two types: force-based and position-based impedance control. The former relies on an accurate dynamics model, while the latter functions by inputting a desired contact force and mapping it to the desired position of the target. In this study, position-based impedance control was selected, as the linear motor employed is capable of achieving precise position control.
The impedance controller model is a second-order model [
32], mathematically represented as follows:
where
are the actual driving position, driving velocity, and acceleration of the EFFG;
denote the desired driving position, driving velocity, and acceleration; and
indicates the difference between the desired driving force of the exoskeleton and the real driving force measured by the force sensor.
In the control process of exoskeleton gloves, the desired driving force and stiffness in the free workspace are set to zero, enabling the human finger to move freely. The position of the slave actuator tracks the driving position of the exoskeleton, which is controlled by the operator. In the interaction mode, the desired driving force of EFFG is set to match the driving force applied by the slave actuator, while the desired position is set to the driving position when the slave actuator is in contact. This enables the operator to feel the gripping force applied by the slave actuator.
5. Discussion and Future Work
This paper presents the design and experimental evaluation of a new haptic glove. Based on the performance requirements outlined in
Section 1, the main contributions and novelty of this glove are summarized as follows:
- (1)
Size and weight—The entire system, including the glove skeleton, battery, and actuator unit, weighs only 278 g. In addition to being lightweight, it is also portable, wireless, and self-contained, with no need for additional external devices or complex transmission lines. This improves the sense of wearing and flexibility of gloves;
- (2)
Safety and large workspace—The three joints of each link are driven by a single actuator unit through a push–pull cable mechanism. The designed transfer mechanism is capable of covering a huge workspace of the fingers. Moreover, the limit state of the motor is close to the limit state of finger extension, which helps prevent potential harm to the wearer’s finger joints in the event of motor malfunction, even if there is an accidental failure of the linear motor;
- (3)
Flexible and fast dynamic force response—A compact miniature force sensor is mounted at the end of the motor to measure driving force. Based on the measurement of driving force, a closed-loop force control based on the impedance algorithm is designed. Compared to the PID control algorithm, the designed impedance control algorithm exhibits more flexible dynamic force response and avoids sudden motor movement at the boundaries of different work strategies.
Compared to commercial and other force feedback gloves [
17,
18,
19,
20,
21,
22,
23,
24,
25], the proposed glove mechanism has the following disadvantages: (1) Lack of soft wearability—The glove is mounted on the finger through Velcro, and each finger needs to be fixed separately, resulting in a complicated wearing process. Furthermore, the finger is connected to the rigid linkage structure directly, resulting in an uncomfortable feeling; (2) Slow response speed—While the response speed under constrained workspace has increased by more than 50% compared to that reported in the literature [
11], the response speed remains relatively low, especially in the free workspace. The adopted motor’s movement speed is 50 mm/s, which enables the finger to fully extend/contract 180 times in one minute, meeting the requirement of fast hand movements. However, the control algorithm requires further optimization to enhance movement speed and the feedback force resolution; (3) Limited maximum feedback force—A simple three-link structure was designed, and when the force is larger, the link will produce bending deformation, limiting the maximum feedback force.
In future research, the control algorithm will be further refined to focus on enhancing the response speed and reducing the obstruction force in the free workspace; for example, by further optimizing the impedance parameters or using adaptive impedance control. Additional investigation into the mapping relationship between the glove’s driving force and the driving force of the slave actuator is warranted. Moreover, the proposed device will be integrated with the haptic feedback device [
34] developed in our lab to further augment immersion. Furthermore, performance evaluations will be conducted on our wearable locator-based teleoperation system with various operators.