Open Access
This article is

- freely available
- re-usable

*Micromachines*
**2016**,
*7*(9),
168;
doi:10.3390/mi7090168

Article

PSO-Based Algorithm Applied to Quadcopter Micro Air Vehicle Controller Design

^{1}

Department for Management of Science and Technology Development, Ton Duc Thang University, Ho Chi Minh City, Vietnam

^{2}

Faculty of Electrical & Electronic Engineering, Ton Duc Thang University, Ho Chi Minh City, Vietnam

^{3}

Department of Electrical Engineering, Southern Taiwan University of Science and Technology, Tainan 71005, Taiwan

*

Correspondence: Tel.: +886-6-253-3131

Received: 1 July 2016 / Accepted: 1 September 2016 / Published: 15 September 2016

## Abstract

**:**

Due to the rapid development of science and technology in recent times, many effective controllers are designed and applied successfully to complicated systems. The significant task of controller design is to determine optimized control gains in a short period of time. With this purpose in mind, a combination of the particle swarm optimization (PSO)-based algorithm and the evolutionary programming (EP) algorithm is introduced in this article. The benefit of this integration algorithm is the creation of new best-parameters for control design schemes. The proposed controller designs are then demonstrated to have the best performance for nonlinear micro air vehicle models.

Keywords:

particle swarm optimization (PSO)-based; evolutionary programming (EP); integral of the squared error (ISE); micro air vehicle (MAV)## 1. Introduction

The state of the art design first developed by Kennedy and Eberhart [1] in 1995 is particle swarm optimization (PSO)-based on inspiration from the social behavior of groups of birds and fish. The PSO-based algorithm is effortless and simply requires the adjustment of a few parameters [2]. Additionally, when compared with other methods, such as neural networks, machine learning, and genetic computation, it achieves better performances in computing speed, accuracy, and small memory size. The advantages of the PSO-based algorithm are very impressive, and as a result, many scientists have used it to solve their problems, ranging from shop-scheduling to optimized control gains. Some others have even upgraded this algorithm by combining PSO with another methodology. Hence, different types of hybrid PSOs have been proposed due to multi-objective functioning. For example, Liu et al. [3] used a PSO-based memetic algorithm (PSOMA) to solve a flow shops scheduling issue. Later, Solihin et al., using a PSO-based algorithm, optimized the state feedback for a flexible link manipulator tracking control [4]. The combination of PSO and gravitational search algorithm (GSA) was introduced by Mirjalili et al. [5] in 2010. A novel hybrid binary particle swarm optimization algorithm (HBPSO) that combined the PSO’s concept and a Genetic Algorithm (GA) was presented by Menhas et al. [6]. Ghodrati and Lotfi combined cuckoo search (CS) and particle swarm optimization (PSO) [7] in 2012. A hybrid particle swarm optimization algorithm (HPSOM) used to integrate the PSO algorithm with the genetic algorithm mutation method was introduced by Esmin and Matwin [8]. A PSO-based algorithm was also used by Koyuncua and Erolb [9] to cope with scheduling new product development projects in 2015. All of these methods stated above can increase the convergence speed and improve the chosen system. Following this trend, this research paper focuses on the PSO-based algorithm and upgrades this algorithm by using evolutionary programming [10]. Its benefit is that it creates new best-parameters in a short time, improving the multi-object optimization process.

Conventional proportional-integral-derivative (PID) controllers that have a simple control structure are applied in many industrial fields. Moreover, due to regulated control gains, a new hybrid control approach fuzzy-PID [11,12] is applied for an autonomous mini-helicopter. In this paper, a fuzzy-PID controller [11,12,13] that has various advantages is chosen for the controller design task. The parameter gains are then evaluated by using the fitness functions. The Integral of the Squared Error (ISE) [14] that is associated with the system’s performance indices is selected for this assignment. The attitude-based models of the quadcopter micro air vehicle are exploited to illustrate the augmenting benefits.

## 2. PSO-Based Algorithm Applied Controller Design

Evolutionary algorithms are a group of algorithms that include genetic algorithm (GA) and evolutionary programming (EP). Although similar to genetic programming (GP), the EP method allows for the evolution of the optimized parameters and having a fixed structure. The EP process neglects the crossover operator while keeping the main operator mutation and the selection strategy. The populations’ members are observed as a part of a specific species rather than similar species members; thus, a new offspring is generated by each parent [10].

The mutation stage occurs at every x
where x

_{i}(t) and generates X_{j}(t) = [x_{j}_{1}(t), x_{j}_{2}(t), … , x_{j}_{D}(t)] by using Equation (1):
$${x}_{j\mathrm{D}}(t+1)={x}_{j\mathrm{D}}(t)+N\left(0,1\right)$$

_{j}_{D}is the jth individual error data, and N(0,1) is a random normal distribution of x. The mutation rate is noted as mr.The next step is the selection operator wherein the new individual of every particle j is selected by using the roulette wheel technique. It picks x

_{j}_{D}from the set of all X_{j}, then updates v_{i}and x_{i}by the major equation of the PSO-based algorithm. In this article, the proposed algorithm creates an elite PSO-based algorithm by the combination of PSO and EP. These effects usually attain a better result than either the PSO or the existing algorithms alone.The fundamental PSO algorithm is a great number of particles moving around in a multi-dimensional space, such as the schooling of fish, the flocking of birds, and the swarm theory [1,2]. The major PSO algorithm can be verified by Equation (2):

$$\{\begin{array}{l}{v}_{i\mathrm{D}}(t+1)=\mathsf{\omega}\times {v}_{i\mathrm{D}}(t)+{l}_{1}\times {\mathrm{rand}}_{1}(\cdot )\times \left({p}_{i\mathrm{D}}(t)-{x}_{i\mathrm{D}}(t)\right)+{l}_{2}\times {\mathrm{rand}}_{2}(\cdot )\times \left({p}_{g\mathrm{D}}(t)-{x}_{i\mathrm{D}}(t)\right)\\ {x}_{i\mathrm{D}}(t+1)={x}_{i\mathrm{D}}(t)+{v}_{i\mathrm{D}}(t+1)\end{array}$$

The velocity and the position of particle i are noted by v

_{i}_{D}and x_{i}_{D}, respectively. The best particle historical position is p_{i}_{D}, and the global best position is p_{g}_{D}. In order to go along with learning rates l_{1}and l_{2}, the inertia weight ω is a user-defined parameter. It manages the relationship of the previous values of particle velocities to the current value. The rand_{1}(·), rand_{2}(·) items are uniformly distributed random numbers [0,1]. The l_{1}× rand_{1}(·) × (p_{i}_{D}(t) − x_{i}_{D}(t)) term refers to the cognitive component. It reflects the distance at which the best solution P_{i}(t) of a particle is located. The combination of the PSO-based algorithm and EP will generate and update the parameters of the control system performance index. Some specific performance indicators are usually designed to evaluate and determine the minimum error criterion [14]. Due to system advantages, the ISE performance index is chosen as shown in Equation (3):
$$\mathrm{ISE}={\displaystyle \underset{0}{\overset{\mathsf{\tau}}{\int}}e{(t)}^{2}}dt$$

The performance index f(ISE) is the minima for all swarm particles, meaning that the optimization issue determines a group of five fuzzy-PID control parameters k

_{P}, k_{I}, k_{D}, k_{e}, and k_{de}. After that, each new particle is said to represent a group of solutions. The four items rising time, settling time, peak time, and maximum overshoot are of significant focus on each control system. They are exploited to find out the minimum ISE fitness function, as shown in Equation (4).
$$f(\mathrm{ISE})={\mathsf{\alpha}}_{1}\times \mathrm{RiseTime}+{\mathsf{\alpha}}_{2}\times \mathrm{SettlingTime}+{\mathsf{\alpha}}_{3}\times \mathrm{PeakTime}+{\mathsf{\alpha}}_{4}\times (|r-\mathrm{Overshoot}|)$$

The weighting factors of each control factor are noted as α

_{i}. The rising time, settling time, peak time, and maximum overshoot are estimated via the output performance, and then its values are recorded. Afterward, the particle groups which contain a large error can be eliminated. Thus, the convergence speed of the system is also accelerated. The fitness function settles in the range:
$$f\left(\mathrm{ISE}\right)\in [0,100]$$

The whole progression can be assigned as illustrated in Figure 1:

The main functions of PID controllers are improving the dynamic response and reducing or eliminating the steady state errors. The improvement of the fuzzy-PID controller by incorporating a fast learning PID controller gains with fuzzy control parameters, yielding a high-quality solution [15], is chosen in this article. As shown in Figure 2, the tracking error e(t) and the differential tracking error de(t) after modifying the triangle membership function in segments (0, 0.3, 0.6, and 1) are the inputs of the fuzzy inference system. The two inputs e(t) and de(t), and the output CI are formal triangular membership functions.

Based on expert knowledge, the dynamic behavior of the fuzzy logic controller (FLC) is described by a set of linguistic rules [16]. In this paper, we employed Mandani’s Min–Max inference engine type and center of area method (COA) defuzzification. Seven partitions are decomposed and implemented to fuzzy control parameters: negative big (NB), negative medium (NM), negative small (NS), zero (ZE), positive small (PS), positive medium (PM) and positive big (PB). The application of fuzzy control rules that have only three NB and three PB are then designated in Table 1. The structure of the fuzzy-PID input is presented by Equation (5).

$$u(t)={u}_{\mathrm{Fuzzy}}+{u}_{\mathrm{PID}}={u}_{\mathrm{Fuzzy}}+{k}_{\mathrm{P}}\times e+{k}_{\mathrm{I}}{\displaystyle \int e+}{k}_{\mathrm{D}}\times \frac{de}{dt}$$

## 3. Quadcopter as a Micro Air Vehicle

The quadcopter as a micro air vehicle (MAV) [17,18] in Figure 3 has six degrees of freedom (DOF) and is depicted using a right hand generalized Earth coordinate system of axes and a right hand body frame. It has a special form with two pairs of contra-rotating rotors to provide lift and directional control. Unlike conventional helicopters, it typically has fixed-pitch blades and varies their thrust by changing rotor speeds. The quadcopter has two major motivating benefits, which are its reliability and compactness. The Quadcopter configuration can be described as having four propellers, with two pairs of propellers (1 and 3) and (2 and 4) that turn in opposite directions in a cross configuration. By varying the rotor speed, the lift force and the motion-creation are changed. Hence, vertical motion is generated by increasing or decreasing the four propeller’s speeds simultaneously. Changing the speed of propellers 2 and 4 conversely produces roll rotation that goes together with lateral motion. Pitch rotation and the corresponding lateral motion is the result of the speed of propellers 1 and 3 being conversely modified. As it results from the difference in the counter-torque between each pair of propellers, yaw rotation is more subtle.

## 4. Simulation Results

The previously mentioned parameters are established for the numerical simulation test in this section. The PSO-based algorithm for attitude pilot angle: Roll, Pitch, and Yaw are set on 30, 50, and 20 generations, respectively. The fitness weighting factors that occurred in Equation (4) are set as [α

_{1}, α_{2}, α_{3}, α_{4}] = [40, 25, 10, 5], and PID gains are set in the range [0, 20]. The mutation rate is mr = 0.105. The attitude control performances are displayed in each channel: Roll angle is set 1 rad (~60°), Pitch angle is set 0.5 rad (~30°) and Yaw angle is set 1 rad (~60°). The sampling time in this simulation is 0.01 s.Roll channel (Lateral control):

$$f(s)=\frac{0.522}{0.004{s}^{4}+0.039{s}^{3}+0.009{s}^{2}}$$

Pitch channel (Longitudinal control):

$$\mathsf{\theta}(s)=\frac{0.522}{0.004{s}^{4}+0.039{s}^{3}+0.009{s}^{2}}$$

Yaw channel (Pedal control):

$$\mathsf{\psi}(s)=\frac{21.78}{0.008{s}^{4}+0.077{s}^{3}+0.18{s}^{2}}$$

The results of the PSO-based controller strategy that are shown in Figure 4, Figure 5 and Figure 6 are examined. After using the proposed controller methodology, the Bode diagrams have shown on each channel Roll, Pitch, and Yaw results that are within the stability margin of the system. The convergence speed of the PSO-based algorithm is rapid with success after just 15 iterations for the overall process. In addition, the impressive results of the attitude pilot responses are achieved after 0.2 s.

## 5. Conclusions

In this article, the proposed PSO-based algorithm—which optimized fuzzy-PID controller gains and achieved minimization by the ISE fitness criterion—has been successfully implemented to attitude control Roll, Pitch, and Yaw of the quadcopter micro air vehicle models. The best performances are successfully accomplished by implementing the proposed controller. The algorithm saves the settling time and improves the reliability, as well as the stability of the system models. Due to demonstration of the augmented benefits of PSO algorithm, real time flight control is to be future research work.

## Acknowledgments

The authors would like to express sincere thanks to the reviewers for their invaluable comments and suggestions. This work is supported by the Ministry of Science and Technology, Taiwan, under Grant Nos. MOST 104-2221-E-218-039.

## Author Contributions

H.-K.T. developed the methodology and drafted the manuscript. Moreover, J.-S.C. derived the formulas and completed the simulations. The authors approved the final manuscript.

## Conflicts of Interest

The authors declare no conflict of interest.

## References

- Kennedy, J.; Eberhart, R. Particle swarm optimization. In Proceedings of the Fourth IEEE International Conference on Neural Networks, Perth, Australia, 27 November–1 December 1995; pp. 1942–1948.
- Eberhart, R.C.; Shi, Y. Comparing inertia weights and constriction factors in particle swarm optimization. In Proceedings of the IEEE Congress on Evolutionary Computation, San Diego, CA, USA, 16–19 July 2000; pp. 84–88.
- Liu, B.; Wang, L.; Lin, Y.H. An effective PSO-based memetic algorithm for flow shop scheduling. IEEE Trans. Syst. Man. Cybern.
**2007**, 37, 18–27. [Google Scholar] [CrossRef] - Solihin, M.I.; Akmeliawati, R. PSO-based optimization of state feedback tracking controller for a flexible link manipulator. In Proceedings of the International Conference of Soft Computing and Pattern Recognition (SoCPaR 2009), Malacca, Malaysia, 4–7 December 2009; pp. 72–76.
- Mirjalili, S.; Hashim, S.Z.M. A new hybrid PSOGSA algorithm for function optimization. In Proceedings of the International Conference on Computer and Information Application (ICCIA), Tianjin, China, 3–5 December 2010; pp. 374–377.
- Menhas, M.I.; Fei, M.R.; Wang, L.; Fu, X. A novel hybrid binary PSO algorithm. In Advances in Swarm Intelligence; Springer: Berlin, Germany, 2011; Volume 6728, pp. 93–100. [Google Scholar]
- Ghodrati, A.; Lotfi, S. A hybrid CS/PSO algorithm for global optimization. In Intelligent Information and Database Systems; Springer: Berlin, Germany, 2012; Volume 7198, pp. 89–98. [Google Scholar]
- Esmin, A.A.A.; Matwin, S. HPSOM: A hybrid particle swarm optimization algorithm with genetic mutation. Int. J. Innov. Comput. Inf. Control
**2013**, 9, 1919–1934. [Google Scholar] - Koyuncua, E.; Erolb, R. PSO based approach for scheduling NPD projects including overlapping process. Comput. Ind. Eng.
**2015**, 85, 316–327. [Google Scholar] [CrossRef] - Eiben, A.E.; Smith, J.E. Introduction to Evolutionary Computing; Springer: Berlin, Germany, 2003. [Google Scholar]
- Zhao, Z.Y.; Tomizuka, M.; Isaka, S. Fuzzy gain scheduling of PID controllers. In Proceedings of the First IEEE Conference on Control Applications, Dayton, OH, USA, 13 September 1992; pp. 698–703.
- Sanchez, E.N.; Becerra, H.M.; Velez, C.M. Combining fuzzy, PID and regulation control for an autonomous mini-helicopter. Inf. Sci.
**2007**, 177, 1999–2022. [Google Scholar] [CrossRef] - Juang, Y.T.; Chang, Y.T.; Huang, C.P. Design of fuzzy PID controllers using modified triangular membership functions. Inf. Sci.
**2008**, 178, 1325–1333. [Google Scholar] [CrossRef] - Tan, W.; Liu, J.; Chen, T.; Marquez, H.J. Comparison of some well-known PID tuning formulas. Comput. Chem. Eng.
**2006**, 30, 1416–1423. [Google Scholar] [CrossRef] - Passino, K.M.; Yurkovich, S. Fuzzy Control; Addison-Wesley: Reading, MA, USA, 1998. [Google Scholar]
- Precup, R.E.; David, R.C.; Petriu, E.M.; Preitl, S.; Radac, M.B. Fuzzy logic-based adaptive gravitational search algorithm for optimal tuning of fuzzy controlled servo systems. IET Control Theory Appl.
**2013**, 7, 99–107. [Google Scholar] [CrossRef] - Bouabdallah, S.; Noth, A.; Siegwart, R. PID vs LQ control techniques applied to an indoor micro quadrotor. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, Sendal, Japan, 28 September–2 October 2004; pp. 2451–2456.
- Bouabdallah, S. Design and Control of Quadrotors with Application to Autonomous Flying. Ph.D. Thesis, Ecole Polytechnique Federale de Lausanne, Lausanne, Switzerland, December 2006. [Google Scholar]

**Figure 1.**Particle swarm optimization based (PSO)-based algorithm applies to the micro air vehicle controller design.

**Figure 4.**Roll channel control with the PSO-based algorithm. (

**a**) Roll angle response; (

**b**) The ISE fitness function; (

**c**) Bode diagram.

**Figure 5.**Pitch channel control with the PSO-based algorithm. (

**a**) Pitch angle response; (

**b**) The ISE fitness function; (

**c**) Bode diagram.

**Figure 6.**Yaw channel control with the PSO-based algorithm. (

**a**)Yaw angle response; (

**b**) The ISE fitness function; (

**c**) Bode diagram.

CI(t) | e(t) | |||||||
---|---|---|---|---|---|---|---|---|

NB | NM | NS | ZE | PS | PM | PB | ||

de(t) | NB | ZE | NS | NS | NM | NM | NB | NB |

NM | PS | ZE | NS | NS | NM | NM | NB | |

NS | PS | PS | ZE | NS | NS | NM | NM | |

ZE | PS | NM | PS | ZE | NS | NS | NM | |

PS | PM | PM | PS | PS | ZE | NS | NS | |

PM | PB | PM | PM | PS | PS | ZE | NS | |

PB | PB | PB | PM | PM | PS | PS | ZE |

NB: negative big; NM: negative medium; NS: negative small; ZE: zero; PS: positive small; PM: positive medium; and PB: positive big.

© 2016 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC-BY) license ( http://creativecommons.org/licenses/by/4.0/).