1. Introduction
In contrast to a single robot manipulator [
1,
2,
3], multiple robot manipulators [
4,
5,
6] can handle more complex tasks efficiently. Among the multiple robot manipulators, dual-arm robots [
7,
8,
9] can be applied to various complex operations due to their coordinated performance and human-like characteristics. Therefore, dual-arm robots have wide application prospects.
For cooperative operations of dual-arm robots, there are kinematic constraints and dynamic constraints between two arms [
10]. However, traditional dynamic constraints are just to maintain the force and torque balance of the workpiece. They cannot guarantee that the workpiece will not slip or even fall off during operations. Therefore, it is necessary to add the friction cone constraints to realize the force-closure grasps [
11,
12,
13,
14] for more stable operations. Carabis et al. [
15] adjusted the contact force dynamically to maintain the stability of grasp according to the friction cone constraints when the contact force would exceed the slippage threshold. Peng et al. [
16] calculated the maximum normal contact force based on the maximum load and the friction cone constraints. The desired normal contact force was selected without exceeding the maximum normal force. Zhou et al. [
17] converted the friction cone constraints into a positive definite Hermitian matrix and then designed a cost function accordingly. The minimum normal contact force was obtained by minimizing the cost function. Nevertheless, the above methods can only guarantee that the contact force satisfies the force-closure dynamic constraints or is minimal under this condition. They cannot guarantee the optimal distribution of joint torques. Hence, for the continuous operation requirements of dual-arm robots, such as long-term transportation tasks, the issue of energy consumption needs to be given priority consideration. The minimum energy consumption of dual arm robots can be guaranteed through the optimal distribution of joint torques. Therefore, this paper adopts the minimum energy consumption principle to distribute the contact force and joint torques for the dual-arm robot under the condition of satisfying the force-closure dynamic constraints.
To guarantee the accuracy of cooperative operations, it is necessary to achieve the coordination control of dual-arm robots. Common coordination control methods are to integrate kinematic constraints and dynamic constraints into the hybrid force/position control or the impedance control [
18,
19]. However, impedance control requires the establishment of an accurate impedance model [
20,
21]. In the case that the operation task is complex, the establishment process is cumbersome. An inaccurate impedance model will affect the real-time control performance. In contrast, hybrid force/position control requires switching between the position and force control in real time according to the actual environment. Chattering easily occurs in the switching process [
22,
23]. Moreover, the position accuracy can only be guaranteed in the position constraint space, and the force accuracy can only be guaranteed in the force constraint space. Therefore, for the limitations of traditional force control methods, we proposed a weighted hybrid force/position control (WHFPC) method in our previous research [
24]. It summed the force and position control laws in a weighted way. The precise control of force and position in any constraint direction is realized. However, WHFPC is only applicable to a single robot manipulator. Therefore, for improving the operational ability and applicability, the constraints of dual-arm robots are introduced into WHFPC to realize the coordination control.
To further improve the coordination performance of dual-arm robots, it is essential to guarantee the synchronization between the two arms. Zhang et al. [
25] added the synchronization error to the finite-time sliding mode controller to ensure the convergence of the synchronization and tracking errors. Mohammed et al. [
26] designed an observer-based synchronous output feedback tracking control strategy for multi-manipulator synchronization. Duong et al. [
27] designed a synchronous control strategy with the time delay estimation to handle the uncertainty of the closed-loop kinematic chain for reducing the synchronization error. Zhang et al. [
28] proposed a supertwisting sliding mode synchronization control method to enhance the parallel robot coordination. However, the above synchronization control methods are only suitable for the position control but not the traditional force control. In contrast, WHFPC sums the force and position control laws in a weighted way. Therefore, the synchronization error can be introduced into its position control law to realize position control, force control, and synchronization control simultaneously. Accordingly, a weighted hybrid force/position coordination control (WHFPCC) method is designed for improving the coordination and overall performance of dual-arm robots.
To enhance the adaptability of WHFPCC, it is necessary to dynamically tune the gains of the controller in accordance with the actual operation situations. The fuzzy self-tuning technology [
29,
30] can tune the control gains adaptively according to the variation in errors; thus, the system has strong adaptability and better control effect. The traditional fuzzy self-tuning technology can only be applied individually to position control or force control. However, the gains of position control, force control, and synchronization control of WHFPCC affect each other. Hence, all the gains must be tuned simultaneously. On the basis of the characteristics of WHFPCC, the fuzzy self-tuning technology is improved and applied to WHFPCC. Therefore, a weighted hybrid force/position fuzzy coordination control (WHFPFCC) method is proposed to simultaneously tune the position, force, and synchronization control gains to improve the control precision of dual-arm robots.
The main contributions are listed below:
- (1)
To guarantee the stable grasp of the workpiece, the force-closure dynamic constraints of dual-arm robots are established by combining the force and torque balance constraints of the workpiece with the friction cone constraints. Moreover, to reduce the energy consumption, the minimum energy consumption principle is adopted to optimize the distribution of the contact force and joint torques of dual-arm robots under the force-closure dynamic constraints.
- (2)
WHFPCC is proposed to realize position control, force control, and synchronization control simultaneously. The synchronization error between two arms is introduced into WHFPC in the form of a weighted sum. The Lyapunov method is adopted to prove the stability of WHFPCC. It can effectively enhance the cooperation performance of dual-arm robots.
- (3)
WHFPFCC is proposed to tune the position, force, and synchronization control gains simultaneously. According to the characteristics of WHFPCC, a fuzzy controller is developed by adopting the principles of dominant variable and input unsaturation. It can adaptively tune the control gains according to different operating conditions and effectively improve the control accuracy.
The following organization of this paper is arranged below. In
Section 2, force-closure dynamic constraints are analyzed for dual-arm robot coordination. In
Section 3, WHFPCC is proposed for dual-arm robots, and the proof of its stability is described. In
Section 4, WHFPFCC is proposed for dual-arm robots. In
Section 5, numerical simulations are carried out. In
Section 6, physical experiments are carried out. In
Section 7, conclusions are summarized.
2. Force-Closure Dynamic Constraints of Dual-Arm Robot Coordination
Compared with the single robot manipulator, dual-arm robot coordination is more complex. Two arms interact with each other in actual operations. There are certain constraints between each other. Hence, dual-arm robot coordination is coupled. Dual-arm robot coordination includes loose coordination and tight coordination, among which the tight coordination has stronger coupling. For tight coordination of dual-arm robots, not only the kinematic constraint [
31,
32] but also the dynamic constraint [
19,
32] should be satisfied. As shown in
Figure 1, the dynamic constraint can be derived from force analysis of the workpiece.
The force and the torque balance constraints can be derived from the force and torque analysis of the workpiece, as shown in Equations (1) and (2), respectively.
The force balance constraint [
19,
32] in the world frame can be described below:
where
.
and
are the contact force vectors of the left-arm robot and the right-arm robot, respectively, and their dimensions are both 3.
is the gravity vector of the workpiece,
is the component of
in the
z axis, and
is the mass of the workpiece.
is the linear acceleration vector of the workpiece centroid in the world frame, and its dimension is 3.
The torque balance constraint [
19,
32] in the world frame can be described below:
where
is the contact torque vector between the workpiece and the left-arm robot, and its dimension is 3;
is the contact torque vector between the workpiece and the right-arm robot, and its dimension is 3;
is the distance vector between the workpiece centroid and the force action point of the left-arm robot, and its dimension is 3;
is the distance vector between the workpiece centroid and the force action point of the right-arm robot, and its dimension is 3;
is the inertia tensor matrix, and its dimension is 3 × 3;
is the angular velocity vector of the workpiece centroid in the world frame, and its dimension is 3; and
is the angular acceleration vector of the workpiece centroid in the world frame, and its dimension is 3.
The vector cross product can be converted into the dot product between a matrix and a vector by Equation (3). Therefore, the force balance constraint and the torque balance constraint can be combined into the generalized force balance constraint by Equation (3), as described in Equation (4).
where
;
;
and
are the geometric parametric matrices related to
and
, respectively;
are the components of
in the x, y, and z directions, respectively; and
are the components of
in the x, y, and z directions, respectively.
where
,
,
,
,
, and
.
To guarantee that the workpiece would not slip or even fall off during operations, the generalized contact force between the workpiece and the dual-arm robot should meet not only the above constraints but also the friction cone constraint for force-closure grasps. In this paper, the end effector of the dual-arm robot is a two-finger gripper, and the contact mode between the workpiece and this end effector is hard-finger contact (namely, point contact with friction) [
13]. Therefore, the point contact with friction is taken as the contact mode to analyze the friction cone constraint.
The generalized contact force vector of the dual-arm robot is described in Equation (5).
,
can be decomposed into the tangential force
,
and
,
along the workpiece surface direction and into the normal force
,
, whose directions are perpendicular to the workpiece surface. Then the friction cone constraint of force-closure is described in Equation (6).
where
is the generalized contact force vector of the left-arm robot in its contact frame;
is the generalized contact force vector of the right-arm robot in its contact frame;
,
, and
are the components of
in the x, y, and z directions of the contact frame of the left-arm robot, respectively; and
,
, and
are the components of
in the x, y, and z directions of the contact frame of the right-arm robot, respectively.
where
is the frictional coefficient of the workpiece surface.
The generalized force balance constraint (4) is established in the world frame, but the friction cone constraint (6) is established in the contact frame. They can be translated to each other by Equation (7).
where
,
,
, and
.
is the generalized contact force vector of the left-arm robot in the world frame;
is the generalized contact force vector of the right-arm robot in the world frame;
,
, and
are the components of
in the x, y, and z directions of the world frame, respectively;
,
, and
are the components of
in the x, y, and z directions of the world frame, respectively;
is the coordinate transformation matrix between
and
;
is the coordinate transformation matrix between
and
;
is the transformation matrix between the world frame and the contact frame of the left-arm robot, and its dimension is 3 × 3; and
is the transformation matrix between the world frame and the contact frame of the right-arm robot, and its dimension is 3 × 3.
The contact mode of the dual-arm robot is the point contact with friction. Hence, there is no contact torque. Equation (4) can be rewritten as Equation (8). Then, Equations (5)–(8) constitute the force-closure dynamic constraint of dual-arm robot coordination.
where
.
For the convenience of the subsequent solution, Equations (5)–(7) are uniformly rewritten in the form whose independent variable is
, as described in Equations (9)–(12). Equation (9) corresponds to Equation (5). This means that the generalized contact force
does not include the contact torque in the case that the contact mode of the dual-arm robot is the point contact with friction. Equations (10)–(12) corresponds to Equations (6) and (7). For the convenience of subsequent calculation, both sides of Equation (6) are squared simultaneously. Due to the normal contact force
, the squared operation would not change the constraint.
where
, and
, that is,
is a diagonal matrix with
as the main diagonal elements.
where
is a 1 × 12 matrix. Its
ith element is 1, and its other elements are 0.
is a 1 × 12 matrix. Its (
i + 6)th element is 1, and its other elements are 0.
To minimize the energy consumption of coordination operations, the minimization of joint driving torque is regarded as the optimization objective, and then the generalized contact force of the dual-arm robot is distributed according to this optimization objective. The objective function is designed to get the minimum value of the square sum of the driving torque for each joint, and it can be converted into a function whose independent variable is the generalized contact force
according to the dynamic model of the dual-arm robot. The dynamic model is described in Equation (13). Therefore, the generalized contact force distribution can be described as a constrained optimization problem with the objective function and the constraints (8)–(12), as described in Equation (14).
where
,
,
,
,
,
,
,
,
,
,
,
, and
. The three elements in each vector/matrix set below correspond to left-arm robot, right-arm robot, and dual-arm robot, respectively.
,
, and
are the joint torque vectors, and their dimensions are
n,
n, and 2
n, respectively;
,
, and
are the joint angular acceleration vectors, and their dimensions are
n,
n, and 2
n, respectively;
,
, and
are the joint angular velocity vectors, and their dimensions are
n,
n, and 2
n, respectively;
,
, and
are the inertial matrixes, and their dimensions are
n ×
n,
n ×
n, and 2
n × 2
n, respectively;
,
, and
are the centrifugal force and Coriolis force matrixes, and their dimensions are
n ×
n,
n ×
n, and 2
n × 2
n, respectively;
,
, and
are the gravity matrixes, and their dimensions are
n × 1,
n × 1, and 2
n × 1, respectively;
,
, and
are the joint friction vectors, and their dimensions are
n,
n, and 2
n, respectively;
,
, and
are the Coulomb friction vectors, and their dimensions are
n,
n, and 2
n, respectively;
is the diagonal matrix with
as the main diagonal elements, and its dimension is 2
n × 2
n;
,
, and
are the viscous friction coefficient matrixes, and their dimensions are
n ×
n,
n ×
n, and 2
n × 2
n, respectively;
,
, and
are the external disturbance vectors, and their dimensions are
n,
n, and 2
n, respectively;
,
, and
are the Jacobian matrixes, and their dimensions are 6 ×
n, 6 ×
n, and 12 × 2
n, respectively; and
is the number of degrees of freedom of the left-arm robot or the right-arm robot.
where
;
is the weighting coefficient matrix, and its dimension is
n ×
n;
is the equality constraint, corresponding to Equations (8) and (9); and
is the inequality constraint, corresponding to Equations (10)–(12).
There are many mature numerical solutions for nonlinear constrained optimization problems in mathematics. The interior-exterior point method [
33,
34,
35] can convert a constrained optimization problem into an unconstrained one, and it can effectively reduce the difficulty of the solution. Therefore, this method is adopted to address the aforementioned problem to obtain the optimal generalized contact force.
4. Weighted Hybrid Force/Position Fuzzy Coordination Controller for Dual-Arm Robots
To automatically select the optimal control gains, WHFPFCC is proposed by adding a fuzzy controller to WHFPCC. It can automatically tune the control gains to achieve optimal control performance.
According to the structural characteristics of WHFPCC, input variables of the fuzzy controller are the absolute values of the generalized contact force errors , the absolute values of the position and posture errors , and the absolute values of the synchronization errors . Here, . Output variables are the variations , , , and of the control gains , , , and .
4.1. Fuzzification
The fuzzy sets of input variables are specified as {Very Small (VS), Small (S), Medium (M), Big (B), Very Big (VB)}. Their fuzzy domains are designed as {0,4} accordingly. That is, .
The continuous triangular membership function is adopted since the input variables change continuously, as shown in
Figure 3. On the basis of the designed fuzzy domain, VS, S, M, B, and VB can be represented as Equations (27)–(31).
where
is the input variable after fuzzification, and
is its membership function.
The fuzzy sets of output variables are specified as {Negative Big (NB), Negative Medium (NM), Negative Small (NS), Zero (ZO), Positive Small (PS), Positive Medium (PM), Positive Big (PB)}. Their fuzzy domains are designed as {−3,3} accordingly. That is, .
The continuous triangular membership function is adopted since the output variables change continuously, as shown in
Figure 4. On the basis of the designed fuzzy domain, NB, NM, NS, ZO, PS, PM, and PB can be represented as Equations (32)–(38).
where
is the output variable after fuzzification, and
is its membership function.
4.2. Fuzzy Inference
According to the influence of control gains on the generalized contact force errors, the position and posture errors, and the synchronization errors, the following fuzzy rule is designed:
If is Ah, is Bi and is Cj, then is Dk, is El, is Fm, and is Gn, where Ah, Bi, Cj, Dk, El, Fm, and Gn are the fuzzy sets of , , , , , , and , respectively.
The design basis of the fuzzy rules is the dominant variable principle. Among the three input variables of the fuzzy controller, the largest one will be dominant. The control gain corresponding to the dominant input variable will be increased first. In addition, considering that the input of the designed controller is the weighted sum of the inputs of the position, force, and synchronization control, the control gain corresponding to the non-dominant input variable will be appropriately reduced to prevent input saturation. The fuzzy rule base is designed by combining the above principles with practical experience, as shown in
Table 1,
Table 2,
Table 3,
Table 4 and
Table 5. According to these fuzzy rules, the fuzzy values of output variables can be obtained by a standard Mamdani inference engine [
37].
4.3. Defuzzification
To transform the fuzzy values of output variables into clear control signals, the center of gravity defuzzifier is utilized to defuzzify them, as shown in Equation (39).
where
is the output variable after defuzzification.
The control gains
,
,
, and
can be tuned by adding the output variables
,
,
, and
, as show in Equation (40). Therefore, the control gains can be adaptively tuned for the best effect.
where
,
,
, and
are the control gains before adjustment;
,
,
, and
are the control gains after adjustment; and
,
,
, and
are the variations of control gains.
In addition, to guarantee the stability of the designed controller, the tuned control gains must meet the stability conditions described in
Section 3.2. If the tuned control gains do not meet the stability conditions, the controller should still use the original control gains.
6. Physical Experiments
To verify the practical performance of WHFPFCC, the Baxter dual-arm robot built by Rethink Robotics (Hebron, KY, USA) is chosen as the experimental subject. The actual experimental environment is constructed according to the simulation environment in
Section 5.1, as show in
Figure 19. The desired terminal trajectory and the desired generalized force of the dual-arm robot are the same as the ones in
Section 5.1.
The workpiece is a slender rod. Its weight is within the bearing range of a single-arm robot. However, only in the case that the grasping position of the gripper is at the workpiece centroid, the workpiece centroid will remain horizontal in the contact frame (that is, the axis of the workpiece is parallel to the fingers of the gripper). And if the workpiece is affected by external disturbance, the horizontal state is difficult to maintain. In the case that the grasping position of the gripper deviates from the workpiece centroid, the workpiece will have a certain inclination. And the farther the grasping position of the gripper deviates from the workpiece centroid, the greater the inclination angle of the workpiece. If subsequent assembly operations are required, such as placing the workpiece in the corresponding groove, the workpiece may not fit with the groove when the workpiece is in the inclined state. The above problems can be effectively solved by the cooperative gripping of the dual-arm robot. In this situation, the workpiece always maintains a horizontal state in the contact frame, and it is not easily affected by external disturbances.
Table 7 indicates that maximum and average position errors of THFPC are both greater than 10
−3 m in the Y and Z direction. It means that if THFPC is adopted for coordination control of the dual-arm robot, the closed-chain structure of tight coordination operation would be destroyed. Therefore, THFPC should not be adopted for the physical experiment. Only PCC and WHFPFCC are adopted for the comparative experiment. The absolute values of their terminal position, force and synchronization errors are shown in
Figure 20,
Figure 21,
Figure 22,
Figure 23 and
Figure 24. The maximum and average values of the position error
, force error
and synchronization error
are shown in
Table 14,
Table 15 and
Table 16.
Table 14 and
Table 15 indicate that maximum and average position errors of the two control methods are both less than 10
−3 m. Maximum and average force errors of WHFPFCC are less than 1 N. However, the maximum force error of PCC is greater than 1 N in the Z direction.
Table 16 and
Figure 24 indicate that the maximum and average synchronization errors of the two control methods are both less than 10
−3 m and not much different. Hence, PCC can only ensure the position accuracy but cannot ensure the force accuracy. In contrast, WHFPFCC can ensure both the position accuracy and the force accuracy and has good coordination ability.
Figure 20,
Figure 21,
Figure 22 and
Figure 23 indicate that, for the two control methods, the variation trend of the actual control errors is basically the same as the variation trend of the simulation control errors, and the actual steady-state errors are close to the simulation steady-state errors. Hence, WHFPFCC can effectively realize the coordination control of the dual-arm robot and enhance control precision.
7. Conclusions
To enhance the stability and coordination property of dual-arm robot cooperative operations, a force-closure-based weighted hybrid force/position fuzzy coordination control method is proposed for dual-arm robots. Force-closure dynamic constraints are established to improve the stability of grasping for preventing the workpiece from slipping. To reduce the energy consumption of cooperative operation, the minimum energy consumption principle is adopted to distribute the contact force and joint torques of the dual-arm robot. To simultaneously ensure positional accuracy, force accuracy, and coordination performance, the weighted hybrid force/position control is combined with synchronous control. To enhance the adaptability, a fuzzy controller is designed to simultaneously tune the gains of position control, force control, and synchronization control. Simulation and experimental results demonstrate that, compared with the position coordination control method and the traditional hybrid force/position control, the weighted hybrid force/position fuzzy coordination control method can effectively ensure the position accuracy, force accuracy, and synchronization performance. Moreover, it can reduce the position and force control errors. For different trajectories, different loads, and external disturbances, it has strong robustness. Hence, the proposed method can effectively enhance the overall performance and operational ability of dual-arm robots.
To ensure real-time performance, the optimal force distribution is preprocessed offline. It generates the desired contact force before the control begins. In the future, to further improve the robustness, the optimal force distribution will be processed online. Additionally, it will be combined with model linearization, parallel computing, or other methods to enhance the real-time performance of online processing.