Estimated Reaction Force-Based Bilateral Control between 3 DOF Master and Hydraulic Slave Manipulators for Dismantlement

This paper proposes a novel bilateral control design based on an estimated reaction force without a force sensor for a three-degree of freedom hydraulic servo system with master–slave manipulators. The proposed method is based upon sliding mode control with sliding perturbation observer (SMCSPO) using a bilateral control environment. The sliding perturbation observer (SPO) estimates the reaction force at the end effector and second link without using any sensors. The sliding mode control (SMC) is used as a bilateral controller for the robust position tracking and control of the slave device. A bilateral control strategy in a hydraulic servo system provides robust position and force tracking between master and slave. The difference between the reaction force of the slave produced by the effect of the remote environment and the operating force applied to the master by the operator is expressed in the target impedance model. The impedance model is applied to the master and allows the operator to feel the reaction force from the environment. This research experimentally verifies that the slave device can follow the trajectory of the master device using the proposed bilateral control strategy based on the estimated reaction force. This technique will be convenient for three or more degree of freedom (DOF) hydraulic servo systems used in dismantling nuclear power plants. It is worthy to mention that a camera is used for visual feedback on the safety of the environment and workspace.


Introduction
This is an era for computer science and technology; thus, automation and remote operation requires time.The automated/remote system must consider, in detail, the manual operation to come up with an alternative solution that provides better control for the operator with instrumental feedback.Several conditions need to be considered when designing and implementing remote activities.These conditions include a clear workspace for designed equipment, the environmental conditions of the area of operation, handling of different types of materials, tool setup and change out among others.The crux of the story is to replace manual tools with a suitable remote system.A simple example is to modify grip operation by utilizing the end effector and implementing remote alignment and pinning methods and using self-standing bails.A successful remote design always inherits a defined workspace for equipment with minimum mechanical limitations to accomplish a task.Remote technology is a broader area that could be subdivided into different fields such as dismantling equipment, cutting tools, segmenting, sampling and workspace to handle the designed equipment.This field has some systems was a virtual 6DOF robot and another real industrial robot.A visual user interface was created to show the position and velocity profile for tele-operated control.They implemented Lyapunov stability methodology to analyze stability and position localization.Shafiqul et al. [26] investigated a bilateral control tele-operated scheme for a robotic system with unsymmetrical time-varying delays.The authors implemented an adaptive algorithm to determine relating factors between human and master manipulator and between slave and remote setup.Later, delayed estimated factors are fed back to the master and slave systems.The authors estimated and analyzed the impedance properties of the interaction between the human-based system and the remote environment.Further application of bilateral control are electro-pneumatic actuators and mobile robot [27,28].
Xiao et al. [29] presented the model mediated tele-operated approach.This proposed scheme has been designed to achieve stability and transparency while considering the random communication delays.Da Sun et al. [30], proposed a novel approach for tele-operated systems utilizing an extended prescribed performance control and a wave-based time domain passivity scheme.This scheme ensures synchronization of velocity, force, and localization.The stability and performance of the system are analyzed by the standard Lyapunov scheme.This methodology also ensures high tracking results of localization, velocity, and force.Similarly Azimifar et al. [31] presented a strategy to estimate the external force acting on master and slave systems.This scheme is advantageous with low-cost features and ease of implementation as the force sensors requirement is eliminated.They proposed a novel control for a nonlinear bilateral tele-operated system with time delays that estimates the force accordingly.The stability of the system is analyzed through the famous Lyapunov stability methodology.The tele-operation of remote system falls under the umbrella of bilateral control.It includes a master robot system that is operated by human operators and controlled through electric actuators whereas a slave robot system that is placed or installed at a remote location and is controlled through hydraulic actuators.Thus, to achieve an efficient bilateral control, three key features are necessary.The first is the coordinated control that is responsible for decoupling of position and force controllers.Second, is the linearization of hydraulic actuators.Third, is the agreement of system order of electric and hydraulic actuators by using a pseudo differentiator.Sho et al. [32] proposed a novel method with an efficient and accurate tracking performance and is the most stable in a contact control scenario among all three controllers.Minou et al. [33] proposed a hybrid control algorithm for trajectory tracking with constant force.A non-linear model is implemented for the position controller to achieve predictive tracking, satisfying the input constraints.The authors analyzed the performance of the proposed controller and concluded that position tracking has a proof-mean-square-error (RMSE) of 0.89 mm whereas the catheter regulated the force with RMSE of 4.9 mN.Yaoyao et al. [34] presented a novel idea of trajectory control of an underwater vehicle-manipulator system by implementing a discrete time delay estimating methodology.Xia et al. [35] proposed a non-linear adaptive control algorithm for a non-linear manipulator system with uncertainties in its dynamics.Their algorithm guarantees accurate and efficient tracking.The proposed algorithm not only estimates the manipulator's dynamics but also determines the best fit dead-zone parameter in adaptation law.The estimated values are later used in proposed control law.The authors claimed and showed results suggesting that tracking is accurate and efficient even when both dynamics and dead-zone uncertainties appear at the same time.There are several studies in the literature which have presented the idea of utilizing force sensors to detect the outer forces in conventional bilateral control schemes, but such addition of force sensors has certain problems.A simple explanation to it is that a manipulator system with a force sensor acts as a two-mass resonant system.Thus, it is a bottleneck in realizing high-frequency force sensing [36,37].The master and slave configuration of a manipulator system is highly applicable and suitable for nuclear power plants, because of restricted human access.In addition to this, it also requires exact control and dismantling/handling of a material/object with excessive load.Hydraulic systems are best suitable for such an application as they offer high power actuators.
In keeping a view of the above studies, in this study, we implemented the sliding mode control with sliding perturbation observer (SMCSPO).It is an efficient and robust control algorithm that not only estimates the reaction force of master and slave but also determines the bilateral control of the hydraulic servo system of a 3DOF master-slave robot.The reason for using a hydraulic servo system is that its power-to-weight ratio is better than any other type of actuated robot at the expense of positional accuracy.In this study, the sliding perturbation observer (SPO) is implemented to estimate the reaction force of the slave without using any sensor.The bilateral control scheme is implemented for efficient and accurate position and force tracking b/w master-slave configuration with visual feedback.In the bilateral controller, the difference of reaction force of the slave manipulator and operating force applied to the master manipulator is designed to target the impedance model.The reaction force of the slave is resultant of effects in the remote environment while operator force is applied by the operator (Human) at the master manipulator.The experimental results of studies endorse that the slave efficiently follows the position trajectory of the master system.
The manuscript is organized as follows: Section 2 of this paper presents the mechanical structure and dynamics of a 3DOF hydraulic servo system that could be utilized in the dismantling of nuclear power plants.Section 3 describes the sliding mode control with sliding perturbation observer (SMCSPO), and the reaction force estimation method is also presented in the same section.Section 4 is reserved for the description of mathematical details regarding bilateral control of master-slave 3DOF hydraulic servo system, and Section 5 presents its experimental setup.Section 6 presents the results of the performance of bilateral control through different experiments, and finally, Section 7 entails the concluding remarks to this study.

Mechanical Design and Dynamics of Hydraulic Servo System
It is a well-known fact that hydraulic servo systems have a favorable position in applications involving the machine tool industry.Some popular examples include handling hazardous material, remote equipment, steel factories, mining of materials, the exploration of oil, and the testing of automotive equipment, etc.A servo system is responsible, according to design, to control dynamical properties, such as; force, pressure, acceleration, electrical properties, etc.The attractive features of hydraulic servo systems include efficient response time, high torque and very few stroke characteristics.The hydraulic system has several advantages, but most prominent are accurate tracking of localization and acceleration, better stiffness features, null backlash, efficient response to sudden change, and less wear rate, among others.The hydraulic system has a better position among robotic systems to dismantle nuclear plants or hazardous plants.The hydraulic system, while used in nuclear plants, could be divided into two major parts, the first consists of a couple of hydraulic cylinders which formulate the vertical movement and the second consists of an AC servo motor responsible for horizontal changes.Two cylinders with a hydraulic mechanism is provided in the first part as much higher torque is required in the vertical direction.The mechanical design of shape and different sizes of a hydraulic servo system utilized in nuclear power plants is shown in Figures 1 and 2. The modelling of hydraulic actuator has been presented in Appendix A.
in nuclear plants, could be divided into two major parts, the first consists of a couple of hydraulic cylinders which formulate the vertical movement and the second consists of an AC servo motor responsible for horizontal changes.Two cylinders with a hydraulic mechanism is provided in the first part as much higher torque is required in the vertical direction.The mechanical design of shape and different sizes of a hydraulic servo system utilized in nuclear power plants is shown in Figures 1 and 2. The modelling of hydraulic actuator has been presented in Appendix A.   The schematic design of an end effector is displayed in Figure 3 and the schematic diagram of a hydraulic servo system's base and secondary link is shown in Figure 4.The schematic design of an end effector is displayed in Figure 3 and the schematic diagram of a hydraulic servo system's base and secondary link is shown in Figure 4.The schematic design of an end effector is displayed in Figure 3 and the schematic diagram of a hydraulic servo system's base and secondary link is shown in Figure 4.It is a well-known fact that a robotic system dynamic is a cross-relation between different forces, acceleration properties, and localization.Thus, the dynamical equation of a robotic manipulator in free space could be represented mathematically as, where θ, A(θ), B θ, .θ , g(θ) and T are the vectors representing joints of angles, the matrix representing mass or inertia, the centrifugal/Coriolis torque, the gravity torque in joint space, and the vector of joint torques, respectively.Similarly, the equation repressing dynamical properties of different links in a hydraulic servo system could be represented as (J s2 + ∆J s2 ) ..
where J s1 , J s2 and J s3 represent the inertia of the base, second link, and end effector respectively, similarly D s1 , D s2 and D s3 represents the damping characteristics of the base, second link, and end effector respectively.The uncertainty is represented by ∆, β 1 , and β 2 shows the viscosity of each cylinder in the first part.M s1 , M s2 and M s3 represent the masses of the base, second link and end effector, L 1 and L 3 are lengths of base and end effector, L 2 represents the length from joint to the centre of mass (COM) of the second link.τ e1 , τ e2 and τ e3 represent the reaction torque generated by contact with the environment and joints 1, 2 and 3 respectively, λ represents the dynamical properties regarding the base, .θ 1 is the velocity of the first cylinder and .
x is the velocity of the second cylinder, and T 1 , T 2 and T 3 represent joint torques of the base, second link and end effector respectively.

Sliding Mode Control
Several previous studies have shown that the implementation of a sliding perturbation observer (SPO) and a sliding mode control (SMC) at the same time provides certain attractive features which include efficient performance against perturbation by utilizing partial state feedback.The combination of these two with such attractive properties is known as sliding mode control with sliding perturbation observer [37].In our previous work [38], we only estimated the reaction force of the slave at the end effector.In this study, three-link robotic manipulator actuators are controlled by implementing SMC, and the reaction force is determined by applying SPO.A generic mathematical representation of n-degrees of freedom system inheriting second order dynamics is as follow, .. where T represents the state vector with X j ∆ = [x j , .
x j ] T , the non-linear driving force is represented by f j (x) with uncertainties ∆ f j (x), the elements of the control gain matrix is represented by b ji with corresponding uncertainties ∆b ji , the external disturbance and control input is represented by d j and u j ; respectively, and f j , b ji are well known continuous functions of state in literature [39].All of the uncertainties could be summed up, to represent perturbation as follow, The objective of control is to force state x to a desired state T in the presence of perturbation.The upper bound for perturbation is defined by a known continuous function of state as follows where F j > ∆ f j , Φ ji > ∆b ji and D j > d j represent the expected upper bounds of the uncertainties.
Let us suppose f j (x), defined in Equation ( 5), except perturbation of Equation ( 6) is represented as where α 3j is an arbitrary positive number, and u j is the new control variable.The equations of SPO are derived as [39]. .
where k 1j , k 2j , α 3j are positive numbers and x = x − x is the estimation error of the measurable state.ψj is defined as the estimated perturbation of the robot manipulator.The " " and "ˆ" represent the error in estimation and quantity estimated in result of the estimation respectively.
Electronics 2018, 7, 256 8 of 26 The anti-chatter properties are formulated by a saturation function defined by Slotine et al. [40] where the boundary layer of SMC control is represented by ε 0j .Finally, the error dynamics of SPO are mathematically defined as [39], . . .
After the observer sliding mode begins, x 2j dynamics become .
The frequency domain relation between Ψ j and Ψ j is derived as and this is equivalent to a high-pass filter.The sliding function is defined as where e j = x 1j − x 1dj is the actual position tracking error, c 1j > 0. As the sliding surface is reached, we define .s j = 0 and sliding control is defined as .
where robust gain is represented by K j and is supposed to be positive.The control input u j is mathematically defined as follows, Similarly, the estimated sliding function is represented mathematically as ŝj = . êj + c j1 êj (22) where, the estimation error of localizing tracking is êj = x1j − x 1dj and jth degree of freedom motion [x 1dj .
x 1dj ] T and c j1 > 0. Similarly, the estimation error in sliding function is mathematically represented by s j = ŝj − s j .The estimation error in sliding function can be calculated by using Equations ( 19) and ( 22) as s j = .
The new control input u j is designed such that it forces .ŝ ŝ < 0 outside of the prescribed manifold.The desired ŝj -dynamics is defined as Thus .ŝj can be calculated as follows The control law to apply Equation ( 23) with x 2j = 0 is defined as where u j represents the control input of SMCSPO.Thus, the resulting ŝj -dynamics including the effects of x 2j could be mathematically represented as To ensure the outer part of the manifold ŝj ≤ ε 0j satisfies the inequality .ŝ ŝ < 0, the robust control gain must be constrained to the following inequality Finally, the actual s j -dynamics within the boundary layer of ŝj ≤ ε 0j can be mathematically expressed as .
The estimation errors in state estimation and perturbation are the driving force for s j -dynamics.The target of the designed SMCSPO is to minimize mismatch b/w the actual and desired trajectory.The sliding perturbation observer is responsible for reducing the estimation error x j in the observer part.Therefore, the sliding mode control is designed for error êj reduction b/w desired and actual values of the trajectory.Thus, implementation of SMC and SPO simultaneously guarantee the accurate results of trajectory tracking with a reduction of error.
The mechanical hardware limitations restrict the design procedure as described in Jairo et al. [39].The instant when ŝj ≤ ε 0j , the observer design and s j -dynamics, can be represented in mathematical form as below, (30) where a square matrix of order 4 in Equation ( 30) represents the state matrix.Further suppose, λ represents the eigen values of state matrix A, then its characteristic equation det |λI − A| = 0, can be expressed as, By implementing the pole-placement method, let us introduce a desired characteristic polynomial p(λ d ) = (λ + λ d ) 4 which leads to a design solution It is obvious that a reduction in error and an increase in the accuracy of observations could be achieved with a large value of gain λ d .But Jairo et al. [41] has categorically shown the limitation of breakpoints of sliding function dynamics encircled in a manifold.They showed that it could not go beyond 1/5τ hw , where h is a positive number, and frequency is represented by w.Another study by Slotine et al. [42] also showed the same results.Thus, the optimal gain value could be selected as 3.2.Reaction Force Estimation Based upon Sliding Perturbation Observer (SPO) The algorithm using SPO could be utilized to set an estimate of perturbation that leads to the determination of reaction force.The perturbation's estimation includes two factors, the first disturbance that is regarded as an external force and another is the dynamic error that inherits non-linear terms and viscous friction.The 3DOF robotic-manipulator defined in Equations ( 2) and ( 3) can be used to define a perturbation estimate that would be used to determine the reaction force.The perturbation estimate of the end-effector and second link are mathematically represented by an expression defined below, .
The Equations ( 34) and ( 35) further used to calculate the reaction force as follows x + λ (37) where τe1 , τe2 are the estimates of reaction torques generated as a result of contact with the environment of the end-effector and second link respectively, ∆ represents the uncertainty parameter.It is worthy to mention that if the parameter is well estimated than the parameter of uncertainty could be considered as well.

Bilateral Control
The design purpose of bilateral control refers to a relation b/w the master and slave system helping the system operator in a way that is as close as the actual environment.There are two important factors that need to be considered while designing bilateral control.The first is that the slave accurately follows the trajectory of the master system and the second that the system's operator gets a realistic feel of a reaction force.In this study, the master and slave system are 3DOF hydraulic servo systems.The dynamical equations for these two systems are shown in Equations ( 38) and (39). .
where J m , J s , u m and u s are inertia, position, and control input of master and slave of hydraulic servo system respectively.τ h represents the real/action force generated by the operator at the master device, τ e defines the reaction force of the slave system in a remote environment.A detailed workflow of the control algorithm for bilateral control is presented in Figure 5.
where m J , s J , m u and s u are inertia, position, and control input of master and slave of hydraulic servo system respectively.h τ represents the real/action force generated by the operator at the master device, e τ defines the reaction force of the slave system in a remote environment.A detailed workflow of the control algorithm for bilateral control is presented in Figure 5.A simple fact is that as the master device is operated by a human operator, the slave system follows the trajectory of the master system.The slave system of hydraulic servos follows the master's trajectory using a sliding mode control.The impedance control is implemented to transfer reaction force during trajectory tracking.Therefore, no reaction force is observed by the operator while there are no contact between the slave and environment.

Master Controller and Device
The design of the master system has been considered under two constraints.The first one is that the reaction force is felt by the operator during the slave system and environment contact.The second constraint is that the operator uses the master system with the minimal force possible.The design of the impedance control is defined as, where d J , d B and d K are the inertia, damping, and stiffness of the impedance control model respectively, f k represents the scale factor of the reaction force.The scale factor f k scales the force ratio that is converted from the master system to the slave system.For simplicity, in this study f k is considered to be unity.The control input signal to the master system can be determined by replacing the estimated/observed state variable to the original ones.Thus, the control input for a dynamical system of Equation (38) and impedance control of Equation ( 40) can be mathematically presented as follows, A simple fact is that as the master device is operated by a human operator, the slave system follows the trajectory of the master system.The slave system of hydraulic servos follows the master's trajectory using a sliding mode control.The impedance control is implemented to transfer reaction force during trajectory tracking.Therefore, no reaction force is observed by the operator while there are no contact between the slave and environment.

Master Controller and Device
The design of the master system has been considered under two constraints.The first one is that the reaction force is felt by the operator during the slave system and environment contact.The second constraint is that the operator uses the master system with the minimal force possible.The design of the impedance control is defined as, where J d , B d and K d are the inertia, damping, and stiffness of the impedance control model respectively, k f represents the scale factor of the reaction force.The scale factor k f scales the force ratio that is converted from the master system to the slave system.For simplicity, in this study k f is considered to be unity.The control input signal to the master system can be determined by replacing the estimated/observed state variable to the original ones.Thus, the control input for a dynamical system of Equation (38) and impedance control of Equation ( 40) can be mathematically presented as follows, where u m , .θm , .
θm are the control input, estimated speed and estimated position of the master system by utilizing SPO, τh represents the torque estimate that is produced by the operator while operating the master device.The master device used in this research is presented in Figure 6.
where m u , m θ  ˆ, m θ  ˆ are the control input, estimated speed and estimated position of the master system by utilizing SPO, h τˆ represents the torque estimate that is produced by the operator while operating the master device.The master device used in this research is presented in Figure 6.

Slave Controller and Device
The slave controller is designed to track the trajectory of the master system.The slave controller is designed by utilizing SMCSPO for this study.The logic behind the SMCSPO design is to compensate sliding mode control for the perturbation estimate.It is an additive quantity consisting of uncertainty, disturbance, and non-linearity [39].Thus, SMCSPO design efficiently removes the external disturbance and uncertainty of parameters.The sliding function that is estimated can be expressed as is the tracking error between the master and slave device, c is a positive constant.By substituting the observed/estimated state in the sliding function defined above in Equation ( 42) and the sliding perturbation observer of Equation ( 12), the differential of the estimated sliding surface s ˆcan be mathematically represented as It is found that when the phase is converged to the sliding surface and error estimate 1 ~s θ remains inside boundary layer.The impedance model Equations ( 40) and ( 43) are utilized to obtain s  ˆ.

Slave Controller and Device
The slave controller is designed to track the trajectory of the master system.The slave controller is designed by utilizing SMCSPO for this study.The logic behind the SMCSPO design is to compensate sliding mode control for the perturbation estimate.It is an additive quantity consisting of uncertainty, disturbance, and non-linearity [39].Thus, SMCSPO design efficiently removes the external disturbance and uncertainty of parameters.The sliding function that is estimated can be expressed as where ê = θs1 − θm1 is the tracking error between the master and slave device, c is a positive constant.By substituting the observed/estimated state in the sliding function defined above in Equation ( 42) and the sliding perturbation observer of Equation ( 12), the differential of the estimated sliding surface ŝ can be mathematically represented as It is found that α s1 .θ s1 , α s2 θ s1 ≈ 0 when the phase is converged to the sliding surface and error estimate θ s1 remains inside boundary layer.The impedance model Equations ( 40) and ( 43) are utilized to obtain The new control variable u s is chosen under the constraint i.e., .ŝ ŝ < 0. Similarly, .ŝ dynamics is chosen to satisfy the sliding mode condition The new control input presented in Equation ( 8) can be found from Equations ( 44) and ( 45) Final control input for the slave system is mathematically defined as u s = J s u s + B s .θs (47)

Experimental Environment
The slave device for the experiment is shown in Figure 7.The hydraulic servo system consists of two hydraulic cylinders and one AC servo motor.The first base axis is actuated by the AC servo motor.The 2nd link and end effector are actuated by the hydraulic cylinder.
The new control input presented in Equation ( 8) can be found from Equations ( 44) and ( 45) Final control input for the slave system is mathematically defined as

Experimental Environment
The slave device for the experiment is shown in Figure 7.The hydraulic servo system consists of two hydraulic cylinders and one AC servo motor.The first base axis is actuated by the AC servo motor.The 2nd link and end effector are actuated by the hydraulic cylinder.The experiments were performed on a 3DOF hydraulic servo system.Table 1, shows the specifications of a hydraulic servo system.

S. No
Items Specification The experiments were performed on a 3DOF hydraulic servo system.Table 1, shows the specifications of a hydraulic servo system.In [43,44], the identification and robust control of a hydraulic servo system have been discussed.The unknown parameters such as the inertia and damping coefficients of the system are obtained by the signal compression method which can estimate the dynamics by obtaining an equivalent impulse response [45].The model dynamic is given by ..
where J i , D i are the equivalent moments of inertia and damper respectively.Table 2, shows the values of the dynamics.The experimental setup includes a master device, a slave device and a control system as shown in Figure 8.
, 1, 2, 3 where i J , i D are the equivalent moments of inertia and damper respectively.Table 2, shows the values of the dynamics.The experimental setup includes a master device, a slave device and a control system as shown in Figure 8.The master and slave device consist of three links each, in which the third link is connected with the base.We can find the reaction force at end effector and the 2nd link.SMCSPO is used to estimate the reaction force.Since the operator moves the master device to make the slave come in contact with a hard object, a visual sensor is installed with the slave device.It is not relevant to the control algorithm but provides visual feedback to the operator to avoid any inconvenience or uncertain situations.Figure 9 provides a pictorial view of visual feedback which helps enhance the safety during work.The master and slave device consist of three links each, in which the third link is connected the base.We can find the reaction force at end effector and the 2nd link.SMCSPO is used to estimate the reaction force.Since the operator moves the master device to make the slave come in contact with a hard object, a visual sensor is installed with the slave device.It is not relevant to the control algorithm but provides visual feedback to the operator to avoid any inconvenience or uncertain situations.Figure 9

Experimental Results
In our study, our system is non-linear, and therefore, a robust control scheme (i.e., SMCSPO) was pursued.Since PID/PD controllers are not robust, comparatively to SMCSPO, to nonlinearities.

Experimental Results
In our study, our system is non-linear, and therefore, a robust control scheme (i.e., SMCSPO) was pursued.Since PID/PD controllers are not robust, comparatively to SMCSPO, to nonlinearities.Therefore, their performance is not as good as that of the proposed SMCSPO.Figure 10 shows the comparison between PID and SMCSPO.

Experimental Results
In our study, our system is non-linear, and therefore, a robust control scheme (i.e., SMCSPO) was pursued.Since PID/PD controllers are not robust, comparatively to SMCSPO, to nonlinearities.Therefore, their performance is not as good as that of the proposed SMCSPO.Figure 10 shows the comparison between PID and SMCSPO.Table 3 shows the values of the parameters used in the experiment by using SMCSPO.The parameters used in the experiment are determined by using the Equations ( 32) and (33).Extensive simulations were performed to find the best value of boundary layer width ( o ε ) resulting in convergence of the sliding surface to zero.Table 3 shows the values of the parameters used in the experiment by using SMCSPO.The parameters used in the experiment are determined by using the Equations ( 32) and (33).Extensive simulations were performed to find the best value of boundary layer width (ε o ) resulting in convergence of the sliding surface to zero.Six different experiments are done by using SMCSPO: (i) Bilateral (Master-Slave manipulation) control of the end effector (ii), estimated perturbation measured at the end effector of master and slave (iii), bilateral (Master-Slave manipulation) control of the 2nd link (iv), estimated perturbation measured at the 2nd link of master and slave (v), bilateral (Master-Slave manipulation) control of the base (vi), and bilateral (Master-Slave manipulation) control of the end effector, 2nd link and base at the same time.
The scenario of the experiment is set up such that the operator (human) moves the master device and the slave device follows the trajectory of the master device using SMCSPO.Figure 11 shows the experimental result of the master-slave trajectories for the end effector.The blue line shows the experimental result of the master device whereas, the red line shows the experimental result of the slave device by using SMCSPO.It can be observed that the slave device can follow the master device.The maximum value of the trajectory is 81 degree at 14 s.The end effector of the slave device can move between 0 and 90 degrees.
slave (iii), bilateral (Master-Slave manipulation) control of the 2nd link (iv), estimated perturbation measured at the 2nd link of master and slave (v), bilateral (Master-Slave manipulation) control of the base (vi), and bilateral (Master-Slave manipulation) control of the end effector, 2nd link and base at the same time.
The scenario of the experiment is set up such that the operator (human) moves the master device and the slave device follows the trajectory of the master device using SMCSPO.Figure 11 shows the experimental result of the master-slave trajectories for the end effector.The blue line shows the experimental result of the master device whereas, the red line shows the experimental result of the slave device by using SMCSPO.It can be observed that the slave device can follow the master device.The maximum value of the trajectory is 81 degree at 14 s.The end effector of the slave device can move between 0 and 90 degrees.The error between the master-slave trajectories for the end effector is shown in Figure 12.The maximum error between the master and slave trajectories is 0.62 degrees at 15.5 s.It can be seen that the errors between the master and slave trajectories are very small.The error between the master-slave trajectories for the end effector is shown in Figure 12.The maximum error between the master and slave trajectories is 0.62 degrees at 15.5 s.It can be seen that the errors between the master and slave trajectories are very small.The value of the estimated perturbation for the slave is very high as compared to the master.This is because of the hydraulic system for the slave.The dynamic value of the slave (i.e., 303.26) is much bigger than the master (i.e., 1.35135).The pattern of the estimated perturbation of master and slave is the same but in an opposite direction.To compare these two results, we normalized the estimated perturbation of master and slave.The normalized estimated perturbation of master is between 0 and 1 while the slave is between −1 and 0 using Equations ( 49) and (50).The value of the estimated perturbation for the slave is very high as compared to the master.This is because of the hydraulic system for the slave.The dynamic value of the slave (i.e., 303.26) is much bigger than the master (i.e., 1.35135).The pattern of the estimated perturbation of master and slave is the same but in an opposite direction.To compare these two results, we normalized the estimated perturbation of master and slave.The normalized estimated perturbation of master is between 0 and 1 while the slave is between −1 and 0 using Equations ( 49) and (50).In the above equations, a i is the current value.Figure 15 shows the normalized estimated perturbation for the master and slave of the end effector.The red line shows the normalized estimated perturbation of the master device, whereas the blue line shows the normalized estimated perturbation of the slave device.The error between master-slave trajectories for the 2nd Link is shown in Figure 17.The maximum error between master and slave trajectories are 0.41 degree at 49 s.The error between master-slave trajectories for the 2nd Link is shown in Figure 17.The maximum error between master and slave trajectories are 0.41 degree at 49 s.The error between master-slave trajectories for the 2nd Link is shown in Figure 17.The maximum error between master and slave trajectories are 0.41 degree at 49 s.     Figure 20 shows the normalized estimated perturbation for master and slave of the 2nd link.The red line shows the normalized estimated perturbation of the master device, whereas the blue line shows the normalized estimated perturbation of the slave device.Figure 21 shows the experimental result of master-slave trajectories for the base axis.The blue line shows the experimental result of the master device whereas, the red line shows the experimental result of the slave device by using SMCSPO.It can be seen that the slave device can follow the master device.The maximum value of the trajectory is 100 degrees at 13 s.The base of the slave device can move between 0 and 360 degrees.The error between master-slave trajectories for the base is shown in Figure 22.The maximum error between master and slave trajectories is 1.3 degrees at 26.5 s.The error between master-slave trajectories for the base is shown in Figure 22.The maximum error between master and slave trajectories is 1.3 degrees at 26.5 s.The error between master-slave trajectories for the base is shown in Figure 22.The maximum error between master and slave trajectories is 1.3 degrees at 26.5 s.  Figure 23 shows the experimental result of the master-slave trajectories for the end effector, 2nd link and base by using SMCSPO.The blue line shows the experimental result of the master device whereas the red line shows the experimental result of the slave device of the end effector.The grey line shows the experimental result of the master device whereas the pink dotted line indicates the experimental result of the slave device of the 2nd link.The blue-dotted line shows the experimental result of the master device whereas the red dotted line shows the experimental result of the slave device of the base.At the beginning only, the end effector can move until 49 s.Then, the end effector and 2nd link moved simultaneously by 12 s (i.e., from 50 to 62 s).After that, the 2nd link moved separately by 18 s (i.e., from 62 to 80 s).Then, the base can move by 32 s (i.e., from 81 to 113 s).In the end, the end effector and 2nd link moved again simultaneously by 16 s (i.e., from 115 to 131 s).The slave device followed the trajectory of the master device accurately.The maximum trajectories of the end effector, 2nd link and base are 88, 27 and 52 degrees, respectively.

Conclusions
In this paper, we have estimated the reaction force of the end effector and 2nd link for a threedegree of freedom hydraulic servo system with master-slave manipulators using SMCSPO without using any sensors.By using an SMC-based bilateral control strategy and visual feedback, the slave device followed the trajectory of the master device (human operator) with minimum error.Also,

Conclusions
In this paper, we have estimated the reaction force of the end effector and 2nd link for a three-degree of freedom hydraulic servo system with master-slave manipulators using SMCSPO without using any sensors.By using an SMC-based bilateral control strategy and visual feedback, the slave device followed the trajectory of the master device (human operator) with minimum error.Also, bilateral control is used to estimate the reaction force of the master device which is fed back to the operator to handle the master device.
From Figures 11,16,21 and 23, it is confirmed that the slave can follow the master trajectories and an operator can easily handle the slave device by feeling the estimated reaction force using the applied SPO when the slave touches an object even if a force sensor is not used.
The maximum error between master and slave for the end effector, 2nd link and base are summarized in Table 4.This research is applied for dismantling nuclear power plants, and there are many situations where a human cannot access due to the high degree of radiation and the very long half-lives of the radioactive materials involved.Therefore, the slave device is used for such hazardous locations.It is useful for activities such as transportation of active uranium in nuclear power plants, disposal of an explosive, remote cutting for nuclear power plant dismantling, grinding, etc.
where M p is the total mass elements, B p is the total damper elements between rod and cylinder, F p is the total friction elements and x p is the displacement of rod.To calculate the linearized load flow dynamic equation, Equation (A5) can be linearized as follow where k q is load flow coefficient, k p is load flow pressure coefficient and defined as follow x v * and P L * in Equations (A10), (A11) are x v and P L near the operating point.Using Equation (A7), linearized load flow dynamic equation can be rewritten as Equation (A12).The effective bulk modulus of the fluid is much larger value than other constant parameters.There the pressure variation terms of Equation (A7) is negligible.A e .
x p = k q x v − k p P L (A12) Combing Equations (A7) and (A12), 2nd order dynamic equation can be obtained as follow M p ..
x p + (B p + A 2 e k p ) .
x p + F e = A e k q k p x v (A13) After separating the non-linear term and parameter error from Equation (A13), the equation of motion is derived as M HT ..
x p + B TH .
x p + ψ = KK sv V e (A14) where M HT and B TH is the equivalent value of mass element and damper element respectively, ψ is the summation of non-linear term, parameter error, friction and disturbance and K is the linear coefficient of A e k q k p .The perturbation ψ, is defined as follow ψ = M −1 HT [∆K∆K sv u H − ∆M HT ..
x p + ∆B TH .

Figure 1 .
Figure 1.Structure of the 3DOF hydraulic servo system.Figure 1. Structure of the 3DOF hydraulic servo system.Electronics 2018, 7, x FOR PEER REVIEW 5 of 26

Figure 1 .
Figure 1.Structure of the 3DOF hydraulic servo system.Figure 1. Structure of the 3DOF hydraulic servo system.Electronics 2018, 7, x FOR PEER REVIEW 5 of 26

Figure 4 .
Figure 4. Schematic diagram of base and second link.Figure 4. Schematic diagram of base and second link.

Figure 4 .
Figure 4. Schematic diagram of base and second link.Figure 4. Schematic diagram of base and second link.

Figure 5 .
Figure 5.The work flow of control algorithm.

Figure 5 .
Figure 5.The work flow of control algorithm.

Figure 9 .
Figure 9. Pictorial view of visual feedback.

Figure 9 .
Figure 9. Pictorial view of visual feedback.

Figure 12 .
Figure 12.Error between master-slave trajectories for end effector.

Figures 13 and 14
Figures 13 and 14 show the estimated perturbation of master and slave for the end effector.The maximum estimated perturbation of the master is 67.56162N*m at 14 s.While the maximum estimated perturbation of the slave is 1516.7 N*m at 14 s.

Figure 12 .
Figure 12.Error between master-slave trajectories for end effector.

Figures 13 and 14
Figures 13 and 14 show the estimated perturbation of master and slave for the end effector.The maximum estimated perturbation of the master is 67.56162N*m at 14 s.While the maximum estimated perturbation of the slave is 1516.7 N*m at 14 s.

Figure 12 .
Figure 12.Error between master-slave trajectories for end effector.

Figures 13 and 14
Figures 13 and 14  show the estimated perturbation of master and slave for the end effector.The maximum estimated perturbation of the master is 67.56162N*m at 14 s.While the maximum estimated perturbation of the slave is 1516.7 N*m at 14 s.

Figure 13 .
Figure 13.Estimated perturbation of master for end effector.

Figure 13 .
Figure 13.Estimated perturbation of master for end effector.

Electronics 2018, 7 ,
x FOR PEER REVIEW 18 of 26 perturbation of the master device, whereas the blue line shows the normalized estimated perturbation of the slave device.

Figure 14 .
Figure 14.Estimated perturbation of slave for end effector.Figure 14.Estimated perturbation of slave for end effector.

Figure 14 .
Figure 14.Estimated perturbation of slave for end effector.Figure 14.Estimated perturbation of slave for end effector.

Figure 14 .
Figure 14.Estimated perturbation of slave for end effector.

Figure 15 .
Figure 15.Normalized estimated perturbation of master and slave for end effector.

Figure 16
Figure16shows the experimental result of the master-slave trajectories for the 2nd link.The blue line shows the experimental result of the master device, whereas the red line shows the experimental result of the slave device by using SMCSPO.The slave device can also follow the master device.The maximum value of the trajectory is 60 degrees at 13.5 s.The 2nd link of the slave device can move between 0 and 90 degrees.

Figure 15 .
Figure 15.Normalized estimated perturbation of master and slave for end effector.

Figure 16
Figure 16 shows the experimental result of the master-slave trajectories for the 2nd link.The blue line shows the experimental result of the master device, whereas the red line shows the experimental result of the slave device by using SMCSPO.The slave device can also follow the master device.The maximum value of the trajectory is 60 degrees at 13.5 s.The 2nd link of the slave device can move between 0 and 90 degrees.Electronics 2018, 7, x FOR PEER REVIEW 19 of 26

Figures 18
Figures 18 and 19 show the estimated perturbation of master and slave for the 2nd link.The maximum estimated perturbation of the master is 326.6367N*m at 38.5 s.While the maximum estimated perturbation of the slave is 1296.9N*m at 38.5 s.The pattern of master and slave estimated perturbation is the same but in opposite direction.

Figures 18 26 Figure 18 .
Figures 18 and 19 show the estimated perturbation of master and slave for the 2nd link.The maximum estimated perturbation of the master is 326.6367N*m at 38.5 s.While the maximum estimated perturbation of the slave is 1296.9N*m at 38.5 s.The pattern of master and slave estimated perturbation is the same but in opposite direction.Electronics 2018, 7, x FOR PEER REVIEW 20 of 26

Figure 19 .
Figure 19.Estimated perturbation of slave for 2nd link.

Figure 19 .
Figure 19.Estimated perturbation of slave for 2nd link.

Figure 20
Figure20shows the normalized estimated perturbation for master and slave of the 2nd link.The red line shows the normalized estimated perturbation of the master device, whereas the blue line shows the normalized estimated perturbation of the slave device.

Figure 19 .
Figure 19.Estimated perturbation of slave for 2nd link.

Figure 20
Figure20shows the normalized estimated perturbation for master and slave of the 2nd link.The red line shows the normalized estimated perturbation of the master device, whereas the blue line shows the normalized estimated perturbation of the slave device.

Figure 19 .
Figure 19.Estimated perturbation of slave for 2nd link.

Figure 20
Figure20shows the normalized estimated perturbation for master and slave of the 2nd link.The red line shows the normalized estimated perturbation of the master device, whereas the blue line shows the normalized estimated perturbation of the slave device.

Figure 20 .
Figure 20.Normalized estimated perturbation of master and slave for 2nd link.

Figure 20 .
Figure 20.Normalized estimated perturbation of master and slave for 2nd link.

Figure 21
Figure21shows the experimental result of master-slave trajectories for the base axis.The blue line shows the experimental result of the master device whereas, the red line shows the experimental result of the slave device by using SMCSPO.It can be seen that the slave device can follow the master device.The maximum value of the trajectory is 100 degrees at 13 s.The base of the slave device can move between 0 and 360 degrees.

Figure 22 .
Figure 22.Error between master-slave trajectories for base.

Figure 23
Figure23shows the experimental result of the master-slave trajectories for the end effector, 2nd link and base by using SMCSPO.The blue line shows the experimental result of the master device whereas the red line shows the experimental result of the slave device of the end effector.The grey line shows the experimental result of the master device whereas the pink dotted line indicates the experimental result of the slave device of the 2nd link.The blue-dotted line shows the experimental result of the master device whereas the red dotted line shows the experimental result of the slave device of the base.At the beginning only, the end effector can move until 49 s.Then, the end effector and 2nd link moved simultaneously by 12 s (i.e., from 50 to 62 s).After that, the 2nd link moved

Electronics 2018, 7 ,
x FOR PEER REVIEW 22 of 26 separately by 18 s (i.e., from 62 to 80 s).Then, the base can move by 32 s (i.e., from 81 to 113 s).In the end, the end effector and 2nd link moved again simultaneously by 16 s (i.e., from 115 to 131 s).The slave device followed the trajectory of the master device accurately.The maximum trajectories of the end effector, 2nd link and base are 88, 27 and 52 degrees, respectively.

Table 2 .
Hydraulic servo system dynamics parameters. S.

Table 2 .
Hydraulic servo system dynamics parameters.