1. Introduction
Multivariable or multi-input multi-output (MIMO) control systems are ubiquitous in modern industry and technology, including such fields as chemical and power industries, electrical and aerospace engineering, and, especially, robotics, automation, and mechatronics [
1,
2,
3,
4]. This article addresses an important issue in multivariable feedback control, which has always attracted the interest of scientists and researchers. In a broader context, the matter concerns the analysis of sensitivity of feedback control systems to small variations of parameters, an issue which is closely related to conventional robustness analysis.
Various aspects of sensitivity analysis of control systems are presented in numerous articles, textbooks, and monographs [
5,
6,
7,
8,
9,
10,
11,
12,
13]. Thus, the bibliography in the monograph “Theory of Sensitivity in Dynamic Systems” by Prof. M. Eslami [
7], published in 1994, contained more than 2500 titles on sensitivity theory and related topics. One of the first publications devoted to sensitivity analysis of multivariable feedback systems was the article by J. Cruz and W. Perkins [
9], in which some frequency-domain criteria involving the sensitivity matrix were derived.
At present, the theory and methods of multivariable feedback control are mostly inherited from general feedback control [
1,
2,
3,
4,
14], where optimal, adaptive, robust, and some other methods are predominant [
15,
16,
17,
18,
19,
20,
21,
22,
23,
24,
25]. For the most part, these methods are based on the state-space representation of control systems, which, being quite effective from the computational perspective and possessing many other substantial features, often lacks the physical clarity inherent in common frequency-domain and root-domain methods of classical feedback control [
14]. The point is that many important structural features of multivariable control systems that can be easily seen from the input–output (matrix) description of MIMO systems are often significantly “disguised” in the corresponding state-space equations.
In this respect, in the 1970s, the prominent British theorist A.G. Macfarlane and his colleagues proposed the characteristic transfer functions (CTFs) method (also called characteristic locus or characteristic gain loci method), which was based on the transfer matrix representation of MIMO control systems [
26,
27,
28,
29].
Formally, the CTFs method allows one to associate with an
N-dimensional (that is having
N inputs and
N outputs) MIMO system a set of
N independent single-input single-output (SISO) characteristic systems, and, as a consequence, to reduce the stability analysis and design of an interconnected MIMO system to stability analysis and design of
N SISO systems [
1,
2,
3].
In fact, the ideas of the CTFs method created exceptional opportunities to extend classical feedback control to multivariable systems. However, no effective design procedures for MIMO systems were proposed in [
26,
27,
28,
29]. Moreover, the CTFs method was claimed in [
24,
25] as unreliable and not robust.
In monograph [
3], the main classical methods of feedback control were extended to MIMO case based on the CTFs method. The central feature of the methods presented in [
3] is that the design of any
N-dimensional MIMO system can be reduced to design of a certain SISO system using standard classical methods and techniques.
The concept of characteristic gain loci sensitivity was first introduced by I. Postlethwaite [
30]. The sensitivity indices introduced in [
30] characterize the sensitivity of the gain loci to small perturbations of the return-ratio matrix of the MIMO system. The sensitivity indices are calculated using the left and right eigenvectors of the return-ratio matrix and provide information about stability with respect to small perturbations of that matrix. The issue of robustness of MIMO systems, where the plant is described using the CTFs method, is addressed in [
31]. In that paper, a sophisticated two-stage design procedure to improve system robustness is proposed based on the notion of commutative controller [
29]. At the first stage, a dynamic pre-compensator is designed which transforms, at least at some predefined frequencies, the plant transfer matrix into a normal matrix. Then, at the second stage, a commutative controller is designed for the pre-compensated (normalized) plant. If the design is correct, then the corresponding CTFs of the pre-compensated plant and the commutative controller are simply multiplied together. However, in general, it is impossible to find a realizable matrix compensator that transforms the transfer matrix of the plant into a normal matrix. For that reason, there are no effective design procedures based on the notion of commutative controllers.
A broadened discussion of modern sensitivity-analysis methodology can be found, for example, in [
32,
33,
34].
At the same time, many important aspects of sensitivity of MIMO systems, such as the sensitivity of canonical basis axes and relation between the sensitivities of the CTFs of open-loop and closed-loop systems, have not been discussed in [
30,
31] or in any other publications.
In this paper, the issue of sensitivity of general type MIMO systems to small variations of parameters is systematically addressed within the framework of the CTFs method.
The paper is organized as follows. A short presentation of the main ideas of the CTFs method is given in
Section 2.
Section 3 is the central and is devoted to derivation of formulas determining the sensitivity of the CTFs and the canonical basis axes to small variations (perturbations) of parameters.
Section 4 presents two illustrative examples of applying the results of the previous section to specific MIMO control systems. The first of them describes the notorious two-dimensional system that was used in [
24,
25] as an example, illustrating that the CTFs method is not robust. In that section, a detailed explanation is given as to why the conclusions made in [
24,
25] are erroneous. The second example concerns the sensitivity analysis of the hexacopter’s control system to small degradations of motors efficiency.
2. Canonical Representation of MIMO Control Systems
Consider an
N-dimensional MIMO feedback control system in
Figure 1. Here,
denote the Laplace transforms of the
N-dimensional input, output, and error vector signals
, respectively (we shall regard them as elements of some
N-dimensional complex space
);
is a square transfer function matrix of the open-loop system of order
with entries
(
) which are scalar proper rational functions in complex variable
[
3].
The output
and error
vectors, where
are related to the input vector
by the following operator equations:
where
are the transfer function matrices of the closed-loop MIMO system with respect to output and error signals, and
is the unit matrix. The transfer matrices
and
are usually called the sensitivity function matrix and complementary sensitivity function matrix [
3].
Based on the method of characteristic transfer functions (CTF), the transfer matrix of the open-loop MIMO system
can be represented, using dyadic notation and similarity transformation, in the following canonical forms [
3]:
where the complex scalar function
(
) (“eigenvalues” of
) are called the CTFs of the open-loop system (further, for simplicity, all
are assumed distinct);
are linearly-independent normalized eigenvectors of
which constitute the canonical basis of the open-loop MIMO system;
are vectors dual to
(vectors of the dual basis), and the modal matrix
is composed of vector-columns
.
Substitution the canonical representations of
(4) into the complementary sensitivity function matrix
and the sensitivity function matrix
(3) yields
Examination of (4)–(6) shows that the canonical basis of the closed-loop MIMO system coincides with the canonical basis of the open-loop system [
3]. Moreover, the CTFs of the closed-loop MIMO system with respect to the output and error are related to
by the very same relationships as common transfer functions of open-loop and closed-loop SISO feedback systems. Geometrically, all this is illustrated in
Figure 2 and
Figure 3.
The stability of the multivariable system in
Figure 1 is determined by the roots of the characteristic equation [
1,
2,
3].
As can be seen from (7), the multivariable system in
Figure 1 is stable if all
N SISO characteristic systems are stable. Note that the stability of characteristic systems can be analyzed using conventional methods of classical feedback control, in particular, the Nyquist criterion [
1,
3,
14].
It should also be noted that the generally accepted assumption of no repeated CTFs is well justified and not restrictive in practical calculations [
3].
Rigorously speaking, the CTFs of general-type transfer matrices belong to the class of multi-valued algebraic functions and constitute one mathematical entity. The branches of the characteristic gain loci are situated on different sheets of a Riemann surface. Transition from one sheet to another is accomplished through the “cuts” connecting the point at infinity with the branch points of the algebraic function, at which two or more CTFs are equal.
When solving practical engineering tasks, the behavior of CTFs in the neighborhood of branch points is neglected, and for any fixed complex or real value , not coinciding with the branch points, the transfer matrix may be viewed as a usual numerical matrix with complex entries. Then, the problem of finding the CTFs for that value of s is simply reduced to computing the eigenvalues of the numerical matrix .
On the other hand, the transfer matrices of MIMO systems are composed of scalar transfer functions which are linear approximations of some dynamic SISO objects. The parameters of these transfer functions are always specified with a certain accuracy, and it is always possible to change the parameters of any individual SISO transfer function, within the given specification accuracy, in a way that excludes the presence of multiple CTFs for any value .
3. Sensitivity of Characteristic Transfer Functions and Canonical Basis Axes
In this section, we discuss, from the standpoint of the CTFs method, the influence of small perturbations (variations) of parameters on the structural and geometrical features of linear MIMO systems. The main attention is paid to the sensitivity functions of SISO characteristic systems and canonical basis axes in the case of small variations of the MIMO system parameters.
Consider the linear MIMO system in
Figure 1 and assume that the open-loop transfer matrix
depends continuously on
varying parameters
, forming the vector
. Furthermore, to emphasize the dependence of
on
, we shall write
. Denote by
the vector of nominal values of
, and by
, the vector of variations, i.e., assume
. Let the CTFs and canonical basis of the MIMO system with the nominal values
be known. A question arises: How are the CTFs and canonical basis axes changed in the case of small variations of the parameters
, i.e., for
? We solve this task as a first approximation, based on the perturbation theory of linear operators in finite-dimensional Hilbert spaces [
35,
36].
Because of parameters perturbations, let the transfer matrix
be expressed as
where
is the variation of
caused by the perturbations
. As we assume continuous dependence of
on
, the variation
in (8) can be represented, for small
, with the help of the Taylor series:
where
are the first-order sensitivity matrices of the transfer matrix
with respect to variations
, evaluated for the nominal vector
. The dots in (9), and in what follows, mean that the terms of the higher order of smallness, as compared with
, are omitted.
As
is assumed differentiable with respect to
, the following expansions for the CTFs
and the canonical basis axes
are valid:
and
where
are the unknown first-order sensitivity functions of
and sensitivity vectors of
.
Since (11) and (12) are the eigenvalues and eigenvectors of the varied matrix
(8), and allowing for (9), we can write
Carrying out the multiplication and comparing the first-order terms with respect to the corresponding perturbations
on both sides of (14), we obtain the following system of
equations:
Multiply, in the form of a scalar product, both sides of (15) by the vector
, which is dual to the eigenvector
of the initial (unperturbed) MIMO system. Recalling that the first vector in the scalar product should be taken as the complex conjugate, we obtain
Note that if the matrix
has the canonical representation
then the conjugate matrix
is
From here, it is clear that the eigenvector
, which is dual to the eigenvector
of
, corresponds to the CTF
of
. Therefore,
Substituting (19) into (16) and conjugating both sides in (16) yields the final expression for the sensitivity function
:
It is important to note that, for any fixed , the right sides in (20) represent (for ) the diagonal elements of the matrix (10), where the latter is evaluated in the basis composed of the vectors . Hence, the open-loop MIMO system sensitivity functions with respect to small perturbations of the th parameter are equal to the diagonal elements of the sensitivity matrix evaluated in the canonical basis of the unperturbed MIMO system. Multiplying both sides in (16) by , we come to the conclusion that a similar relationship takes place, as a first approximation, between the finite variations and the diagonal elements of the matrix of finite variations .
Proceed now to the sensitivity vectors
(13) of the open-loop MIMO system’s canonical basis axes. Toward this end, multiply both sides of (15) by the dual vectors
. After some simple transformations, this yields
where
are the elements of the
th column (except for
) of the matrix
(10), represented in the canonical basis of the unperturbed MIMO system. Notice that the scalar products on the left side of (21) are the coordinates of the vector
along the
th axis
of the initial canonical basis. It is easy to show, using the normalizing condition for the varied eigenvector
(12) [
35], that the coordinate of
along the
th axis
is equal to zero. Therefore, we can write
Thus, Expressions (20)–(22) determine the sensitivity functions
of the CTFs
of the open-loop MIMO system and the sensitivity vectors
of the canonical basis axes
with respect to small perturbations of the parameters
. These expressions show that for evaluating
and
it is enough to find the representation
of the matrices
(10) in the canonical basis of the unperturbed MIMO system. The diagonal elements
of the matrix
(23) are equal to
, and the non-diagonal elements
, after dividing by the differences
, give the coordinates of
in the aforementioned basis.
Consider now the sensitivity of the closed-loop MIMO system, restricting ourselves, for brevity, to the sensitivity transfer matrix
(3). Assume that because of the parameter’s perturbations
, the initial transfer matrix
becomes
where
is the variation of
caused by the perturbations
. Let us find the expression for
, assuming that the corresponding variation
of the open-loop MIMO system is known. In that case, the matrix
(24) can be represented in the form
From (3) and (12), it is easy to see that the variation
is equal to the difference of the inverse transfer matrices
and
, i.e.,
Multiplying this relation from the left by
and from the right by
yields
from which, taking into account (24), and after simple algebraic transformations, we obtain the following expression for the variation
of the transfer matrix
caused by the variation
:
In principle, this expression is valid for any, not necessarily small, variations
. Recalling that the task above was solved as a first approximation, preserving only the terms linear with respect to
, let us determine this approximation for
To this end, expand the inverse matrix on the right side of (27) into the infinite Neumann series [
36]:
This series converges for
, which always takes place in practice for small
. Substituting (28) in (27), and neglecting the terms of the higher order of smallness, gives a first approximation for the variation
Owing to the continuous dependence of the transfer matrix
on parameters
, the variation
can be written in the form
where
are the first-order sensitivity matrices of the transfer matrix
with respect to the variations of the
th parameter
. Then, based on (29), (30), and (9), we find the following formulae establishing relationships between the sensitivity matrices (10) and (31) of the open-loop and closed-loop MIMO system transfer matrices:
The CTFs
of the closed-loop MIMO system have the following form:
These functions are expanded into the Taylor series:
where
are the first-order sensitivity functions of the CTFs
with respect to the variations of the
th parameter
.
Since the canonical bases of the open-loop and closed-loop MIMO system coincide, Expansion (12) is also valid for the axes
of the closed-loop system, where, instead of
, the designations
should be introduced. Proceeding in the same manner as in the analysis of the open-loop MIMO system, it is easy to show that, for evaluating
and
, it is necessary to find the representation of the matrices
(31) in the canonical basis of the unperturbed MIMO system. That representation has the form
The diagonal elements of the matrix are equal to the sensitivity functions (34), and the non-diagonal elements , divided by the differences , yield the coordinates of the sensitivity vectors of the th canonical axis of the closed-loop MIMO system.
Expressions (32) and (35) enable us to determine the relationship between sensitivity functions of the open-loop and closed-loop MIMO system, i.e., to determine the effect caused on the MIMO system sensitivity by the introduction of feedback. Substituting (32) into (35), using the canonical representation of the transfer matrix
(47) and accounting for (23), gives
from which, finding the diagonal elements on the right side, we obtain
Expressions (37) relate the sensitivity functions of the closed-loop and open-loop SISO characteristic systems and are completely analogous to those well known in the classical control theory [
5,
14]. If we let
, then from (37) it is clear that, for those frequencies
for which
(usually it is the low-frequency region), the introduction of feedback decreases the sensitivity of the CTFs to parameters variations. In the high-frequency region, where
, the sensitivity of the closed- loop and open-loop CTFs is approximately the same. Finally, in the region of the resonance frequencies, where
, the feedback deteriorates the sensitivity of the CTFs.
The non-diagonal elements
of the matrix
(36) have the form
Dividing both sides of (38) by the differences
, we obtain the following equalities:
But, according to the above statement, the left-hand terms in (39) are equal (for some ) to the coordinates of the sensitivity vectors of the th canonical axis of the closed-loop MIMO system, and the right-hand terms are equal to the coordinates of the sensitivity vectors of the corresponding (in fact, the same) axis of the open-loop system. Additionally, all these coordinates are determined with respect to the same canonical basis of the unperturbed MIMO system.
Consequently, the vectors and are equal to each other, i.e., the introduction of feedback does not affect the sensitivity of the MIMO system canonical basis to small variations of parameters.
5. Discussion and Conclusions
In this paper, the problem of sensitivity of multivariable control systems is analyzed within the framework of the CTFs method. The formulas determining the sensitivity functions of the CTFs and sensitivity vectors of the canonical basis axes to small variations of parameters of general type MIMO control systems are derived. The relations between the sensitivity functions of open-loop and closed-loop MIMO systems are established. It is shown that the sensitivity functions of the CTFs of the open-loop and the closed-loop MIMO systems are related to each other by the same expressions as the standard sensitivity functions of the open-loop and closed- loop SISO systems. Furthermore, the sensitivity vectors of the canonical basis axes are not affected by the introduction of feedback loop.
In future research, it is intended to extend the results of the paper to special structural classes of MIMO control systems, such as uniform system, symmetric systems, anti-symmetric systems, etc.
It should be noted that the CTFs method was successfully used in aerospace engineering, particularly in the design of high-precision guidance systems of two astronomical telescopes mounted on the space station “MIR”. Nevertheless, in the technical literature on multivariable feedback control, that method is often claimed to be not robust and, therefore, unreliable in practical design. That erroneous conclusion has become quite common because of two main reasons.
First, it is due to the notorious example usually attributed to J. Doyle and G. Stein [
24], where it is shown that a two-dimensional system having, at first glance, infinite gain margins calculated through the CTFs becomes unstable in the case of small additive perturbations of the controller’s gains. In this paper, a detailed analysis of the sensitivity and robustness of the system in [
24] is given, and it is shown that the incorrect conclusion about robustness was made because of improper application of the CTFs method (improper treatment of the results). In short, the example in [
24] can be considered as an equally good illustrative example of a non-robust control system but not evidence of unreliability of the CTFs method. The point is that the robustness of MIMO control systems essentially depends not only on stability margins of the SISO characteristic systems but also on the skewness of the canonical basis axes (or condition number of the modal matrix), which, in this case, is quite close to critical.
The second reason is more significant. The design of MIMO control systems is computationally intensive and cannot be performed without specialized computer-aided control system design (CACSD) tools [
40,
41,
42,
43,
44,
45]. Unfortunately, at present, there are no acknowledged CACSD tools based on the CTFs method. It is worth mentioning that in the 1990s, the Multivariable Frequency-Domain Toolbox (MFD Toolbox) was developed by J.M. Maciejowski, M.P. Ford, and J.B. Boyle at Cambridge Control Ltd. [
46]. The MATLAB-based MFD Toolbox was designed for the analysis and design of linear MIMO systems. Among some other design techniques, the MFD Toolbox supported also the CTFs method for both continuous-time and discrete-time systems. However, no information can be found about the current situation with that toolbox.
In this respect, a new software package, called MIMO Control Toolbox, is being developed at the Aerial Robotics Center of the National Polytechnic University of Armenia [
47]. The toolbox works in the MATLAB environment and is designed for analysis and design of control systems in robotics, mechatronics, and many other fields. The principal feature of the MIMO Control Toolbox is that the design of any
N-dimensional MIMO control system is reduced to the design of a certain fictitious SISO control system. Another key feature of the toolbox is that it includes about 250 new MATLAB classes (objects) describing all the main structural types of MIMO control systems known from the scientific and technical literature.
The frequency and time-response characteristics of the hexacopter’s control system in
Figure 12,
Figure 13,
Figure 14,
Figure 15,
Figure 16 and
Figure 17 were obtained with the help of a special interactive graphical user interface (GUI) which is a part of the MIMO Control Toolbox package and which can be viewed as an extension to the multivariable case of the well-known GUI Control Systems Designer in MATLAB [
40]. The MIMO Control Toolbox can be used both as a computer-aided control systems design tool in industry and various engineering applications and for teaching the fundamentals of classical and modern feedback control at educational institutions.