Analytic Matrix Method for Frequency Response Techniques Applied to Nonlinear Dynamical Systems II: Large Amplitude Oscillations

Abstract

This work is the second in a series of articles that deal with analytical solutions of nonlinear dynamical systems under oscillatory input that may exhibit harmonic frequencies. Frequency response techniques of nonlinear dynamical systems are usually analyzed with numerical methods, because in most cases analytical solutions such as the harmonic balance series solution turn out to be difficult, if not impossible, as they are based on an infinite series of trigonometric functions with harmonic frequencies. The key contribution of the analytic matrix methods reported in the present series of articles is to work with the invariant submanifold of the problem and to propose the solution as infinite power series of the oscillatory input; this procedure is a direct one that speeds up the computations compared to traditional series solution methods. The method reported in the first contribution of this series allows for the computation of the analytical solution only for small and medium amplitudes of the oscillatory input, because these series may diverge when large amplitudes are applied. Therefore, the analytic matrix method reported here, which is a reconfiguration of the method proposed in the first contribution in this series, allows the solving of problems in the regime of large-amplitude oscillations where the contributions of the high order harmonics affect the amplitudes of the low order harmonics, leading to amplitude- and frequency-dependent coefficients for the infinite series of trigonometric function expansion.

1. Introduction

When dealing with nonlinear dynamical systems under oscillatory input that may exhibit harmonic and non-harmonic frequencies, frequency response techniques (FRT) are commonly used to predict the output of the system correctly [1,2]. The problem is usually analyzed with numerical methods due to the complex nature of the output [1,2,3,4]. For instance, Azarboni and Heidari [5] worked with the Galerkin approach accompanied by trigonometric shape functions to analyze the effects of nonlinear sources for the study case of a harmonically excited nanoscale Bernoulli–Euler beam. In Pai [1], the authors approachedthe time-frequency analysis of several nonlinear discrete and continuous systems by developing a methodology to improve adaptive time-frequency analysis by combining empirical mode decomposition and conjugate–pair decomposition for noise filtering in the time domain. Pai’s so-called conjugate-pair decomposition (CPD) method requires only a few recent data points sampled at a low frequency for sliding-window point-by-point adaptive time-frequency analysis. This method can be used for online frequency tracking. With the CPD method, Pai was able to reduce the end effect and dissolve other mathematical and numerical problems in time-frequency analysis. Zhu and Lang [2] developed a new concept known as the Associated Output Frequency Response Function. This function was used along with their nonlinear autoregressive with exogenous input method to analyze the effects of both linear and nonlinear characteristic parameters on the output frequency responses of the Duffing equation with nonlinear damping. In Živković et al. [3], the authors worked with the Nonlinear Frequency Response method to optimize the forced periodic operations of processes that are classically operated in a steady-state regime. Similarly, Zhu et al. [4] upgraded the Nonlinear Frequency Response method to the Nonlinear Output Frequency Response Functions (NOFRF) method to solve a general class of nonlinear systems. To do this, they had to introduce the generalized associated linear equations to develop a novel approach to systematically evaluating the NOFRFs. Furthermore, the lack of analytical methods to solve nonlinear FRT problems is noticeable. The large amplitude oscillatory (LAO) mode of data acquisition used in certain FRT applications implies that both frequency and amplitude directly influence the output of a dynamical system. LAO data reveal higher-order harmonics and multiple subharmonics not considered in small amplitude oscillatory (SAO) or medium amplitude oscillatory (MAO) methods [6]. In LAOs, the output waveform behavior exhibits distortions from the input waveform that may reveal an offset from the input and a contorted shape [7]. Dynamical systems may display a variety of outputs. For instance, one specific dynamical system may display a boxy output wave. In contrast, a different system may display distorted waves with the presence of multiple peaks corresponding to the harmonics and subharmonics [8]. In the first paper in this series [9], we presented an analytical method that simplifies traditional approaches to obtaining the solution using the harmonic balance series method. Such an analytical method can be applied to nonlinear dynamic systems under oscillatory input to find the analog of a typical Bode plot. In the first method, we worked with the invariant submanifold of the problem. We obtained a recursive relation for the coefficients of a series solution that converges for SAO and MAO input regions. However, for the case of LAOs, we found it necessary to reconsider the definition of the coefficients to include both the frequency and the amplitude. This reconsideration proved useful in obtaining information on highly nonlinear systems subjected to periodic inputs in cases where the output is stable but exhibits multiple subharmonics. In this paper, we present an analytic method for FRT with applications to nonlinear dynamical systems that adapts the analytic matrix method for FRT we previously reported [9]. With this, we then provide a complementary structured procedure to obtain information on nonlinear systems subjected to periodic inputs in LAOs. In the method reported here, we work with an invariant submanifold of the problem equivalent to the harmonic balance series solution. The recursive relation obtained for coefficients in this analytical method is dependent on both the amplitude and the frequency. This method simplifies traditional approaches to obtain the solution with the harmonic balance series method for dynamical systems that exhibit strong nonlinearities.

2. Frequency Response Analysis

Consider the input-state stable dynamical system

$$\dot{x}\left(t\right)=f\left(x\left(t\right),z\left(t\right)\right),$$

(1)

where $x\in X\subset {\mathbb{R}}^n$ is the state vector, $z\in {\mathbb{R}}^2$ is the input vector, and $f:X\times {\mathbb{R}}^2\to {\mathbb{R}}^n$ is a local Lipschitz continuous function [10]. It should be considered that this system is input-state stable [11], i.e., for $z=0$, the unforced system $\dot{x}\left(t\right)=f\left(x\left(t\right),0\right)$ is asymptotically stable.

In traditional frequency response techniques [12,13], z shows linear oscillatory behavior with the following dynamics:

$$\begin{array}{ccc}\hfill {\dot{z}}_1& =& \omega z_2,\hfill \end{array}$$

(2)

$$\begin{array}{ccc}\hfill {\dot{z}}_2& =& -\omega z_1,\hfill \end{array}$$

(3)

where $\omega$ is the frequency of oscillation. The behavior of $z_1$ and $z_2$ depends on the initial conditions and has the general form $z_1\left(t\right)=Asin\left(\omega t+\varphi \right)$ and $z_2\left(t\right)=Acos\left(\omega t+\varphi \right)$, where A and $\varphi$ are the amplitude and phase of the oscillation, respectively.

The oscillator (2)–(3) is Poisson stable, i.e., its dynamical behavior has persistent oscillations with maximum amplitude A [14], while system (1) is assumed to be input-state stable; thus, past a transient time $x\left(t\right)$, it reaches an invariant submanifold, $x\left(t\right)=\xi \left(z\left(t\right)\right)$, that depends exclusively on the behavior of $z\left(t\right)$; any trajectory $x\left(t\right)$ of system (1) is the image through the mapping $\xi \left(·\right)$ of a trajectory of the driving system, satisfying the following partial differential equation

$$\dot{\xi }\left(z\right)=f\left(\xi \left(z\right),z\right),$$

(4)

with

$$\dot{\xi }\left(z\right)=\omega \left(\frac{\partial \xi }{\partial z_1}{z}_2-\frac{\partial \xi }{\partial z_2}{z}_1\right),$$

(5)

where t has been replaced with the oscillator state vector, z, as the independent variable.

3. Analytical Matrix Method

3.1. Motivation

In our previous work [9], it was assumed that the invariant submanifold, $\xi \left(z\right)$, can be described by the following series:

$${\xi }_k\left(z\right)=\sum _{i=0}^{\infty }\sum _{j=0}^{\infty }{c}_{k,i,j}{z}_1^i{z}_2^j,k=1,2,\dots ,n,$$

(6)

where $c_{k,i,j}$ are the undetermined coefficients. Then, the problem reduces to finding the correct value of these coefficients, which can be found using the quadrature method. The proposed solution (6) can be substituted in Equation (4) to simplify the calculations of the correct values of coefficients $c_{k,i,j}$. This solution can be rewritten in matrix form as

$${\xi }_k=Z_1^T{C}_k{Z}_2,$$

(7)

where

$$Z_i=\left(\begin{array}{c}1\\ z_i\\ z_i^2\\ ⋮\end{array}\right),\mathrm{for}i=1,2,$$

(8)

and

$$C_k=\left(\begin{array}{cccc}{c}_{k,0,0}& c_{k,0,1}& c_{k,0,2}& \cdots \\ c_{k,1,0}& c_{k,1,1}& c_{k,1,2}& \cdots \\ c_{k,2,0}& c_{k,2,1}& c_{k,2,2}& \cdots \\ ⋮& ⋮& ⋮& \ddots \end{array}\right).$$

(9)

Two issues must be considered here. First, in certain cases series (6) might diverge, depending on the frequency and amplitude selected. This situation usually happens in LAOs. Notice that series (6) is equivalent to

$${\xi }_k\left(z\right)=\sum _{n=0}^{\infty }\sum _{i=0}^n{A}^n{c}_{k,n-i,i}{sin}^{n-i}\left(\omega t+\varphi \right){cos}^i\left(\omega t+\varphi \right),$$

where $\left|{sin}^{n-i}\left(\omega t+\varphi \right){cos}^i\left(\omega t+\varphi \right)\right|<1$; therefore, although the series coefficients are convergent, i.e., ${\sum }_i\left|c_{k,n-i,i}\right|<{\sum }_i\left|c_{k,n-1-i,i}\right|$, the overall series coefficients for high order powers, i.e., $A^n{c}_{k,n-i,i}$ for $n\gg 1$ and $i=0,1,2,\dots ,n$, might not converge for high amplitudes, i.e., $A{\sum }_i\left|c_{k,n-i,i}\right|\nless {\sum }_i\left|c_{k,n-1-i,i}\right|$. Second, where the series does not diverge, the higher order coefficients have the same order of magnitude as those with lowerr order power, i.e., ${\sum }_i\left|A^n{c}_{k,n-i,i}\right|\sim {\sum }_i\left|A^{n-K}{c}_{k,n-K-i,i}\right|$. Hence, the truncated series is useless for computation.

For instance, in [9], the following dynamical system was analyzed:

$$\dot{x}=-x^3+u,$$

(10)

where $x\in \mathbb{R}$ is the state variable and $u\in \mathbb{R}$ is the input variable. When system (10) is subjected to an oscillatory input $u\left(t\right)=z_1\left(t\right)$, where $z_1$ is the first element of the state vector of the oscillator (2)–(3) past a transient behavior that depends on the initial conditions, the system will approach an invariant submanifold $x\left(t\right)=\xi \left(z\left(t\right)\right)$ that satisfies the following nonlinear partial differential equation:

$$\dot{\xi }=\omega \left(\frac{\partial \xi }{\partial z_1}{z}_2-\frac{\partial \xi }{\partial z_2}{z}_1\right)=-{\xi }^3+z_1.$$

(11)

Then, applying the method proposed in [9], the following series solution with the form in (6) can be obtained:

$$\begin{array}{ccc}\hfill \xi \left(t\right)& =& -\frac{1}{\omega }{z}_2\left(t\right)+\frac{2z_1^3\left(t\right)+3z_1\left(t\right)z_2^2\left(t\right)}{3{\omega }^4}+\frac{13z_2^5\left(t\right)+10z_1^2\left(t\right)z_2^3\left(t\right)}{15{\omega }^7}\hfill \\ & & -\frac{52z_1^7\left(t\right)+232z_1^5\left(t\right)z_2^2\left(t\right)+219z_1^3\left(t\right)z_2^4\left(t\right)+195z_1\left(t\right)z_2^6\left(t\right)}{75{\omega }^{10}}+\cdots \hfill \end{array}$$

(12)

The terms of order $n=2k-1$ of this series for $k=1,2,3,\dots$, are proportional to $A^{2k-1}/{\omega }^{3k-2}$; as such, in [9] it was shown that an approximated limit to guarantee the convergence of series (12) is that the frequency–amplitude relation must satisfy ${\omega }^3>A^2$. When this limit is not fulfilled, the solution (12) is no longer suitable to describe the dynamical behavior and the series may diverge, as the series coefficients for high order powers are not convergent and may have the same order of magnitude as the terms with low order power. For instance, when the system is in LAO mode, by comparing the first and the last term of series (12), $-\frac{A}{\omega }\left(\frac{z_2}{A}\right)$ and $-\frac{13A^7}{5{\omega }^{10}}\left(\frac{z_1\left(t\right)}{A}\right){\left(\frac{z_2\left(t\right)}{A}\right)}^6$, respectively, it is clear that, for ${\omega }^3<{\left(13/5\right)}^{1/3}{A}^2$, the 7-th order term of $z_1{z}_2^6$ has a larger amplitude than the first order term of $z_2$. In this context, the system is in LAO mode. For this reason, the present work proposes a modification of series (6) to avoid this inconvenience.

3.2. Proposed Series Solution

Due to the trigonometric identity

$$z_1^2+z_2^2=A^2$$

(13)

certain terms with high order power can be represented as a combination of smaller order powers. For instance, vector $Z_2$ is equivalent to

$$Z_2=\left(\begin{array}{c}1\\ z_2\\ z_2^2\\ z_2^3\\ z_2^4\\ z_2^5\\ ⋮\end{array}\right)=\left(\begin{array}{c}1\\ z_2\\ A^2-z_1^2\\ z_2\left(A^2-z_1^2\right)\\ {\left(A^2-z_1^2\right)}^2\\ z_2{\left(A^2-z_1^2\right)}^2\\ ⋮\end{array}\right)=\left(\begin{array}{c}1\\ 0\\ A^2-z_1^2\\ 0\\ A^4-2A^2{z}_1^2+z_1^4\\ 0\\ ⋮\end{array}\right)+\left(\begin{array}{c}0\\ 1\\ 0\\ A^2-z_1^2\\ 0\\ A^4-2A^2{z}_1^2+z_1^4\\ ⋮\end{array}\right)z_2.$$

(14)

Therefore, $Z_2$ can be reformulated as a function of $Z_1$ and $z_2$, eliminating the factors of $z_2$ with order powers larger than 1. For instance, the term $c_{k,i,5}{z}_1^i{z}_2^5$ is equal to $c_{k,i,5}\left(A^4-2A^2{z}_1^2+z_1^4\right)z_1^i{z}_2$, and the original coefficient, $c_{k,i,1}$, for $z_1^i{z}_2$, now has an extra contribution in the form $A^4{c}_{k,i,5}$ that can have the same order of magnitude as $c_{k,i,1}$ and depends on the amplitude. For instance, using identity (14), the series solution (12) is equivalent to

$$\begin{array}{ccc}\hfill \xi \left(t\right)& =& \frac{A^2}{{\omega }^4}\left(1-\frac{13A^4}{5{\omega }^6}+\cdots \right)z_1-\frac{1}{{\omega }^4}\left(\frac{1}{3}-\frac{122A^4}{25{\omega }^6}+\cdots \right)z_1^3\hfill \\ & & -\left(\frac{76A^2}{15{\omega }^{10}}+\cdots \right)z_1^5+\left(\frac{52}{25{\omega }^{10}}+\cdots \right)z_1^7+\cdots \hfill \\ & & +\left[-\frac{1}{\omega }\left(1-\frac{13A^4}{15{\omega }^6}+\cdots \right)-\left(\frac{16A^2}{15{\omega }^7}+\cdots \right)z_1^2+\left(\frac{1}{5{\omega }^7}+\cdots \right)z_1^4+\cdots \right]z_2\hfill \end{array}$$

(15)

except now the coefficients of the series are functions of both the frequency and amplitude, and each of these coefficients can be considered as an infinite series.

Following this approach, by replacing vector (14) in Equation (7) it is straightforward to verify that the series (6) is equivalent to

$${\xi }_k\left(z\right)=\sum _{i=0}^{\infty }{g}_{1,k,i}{z}_1^i+\sum _{i=0}^{\infty }{g}_{2,k,i}{z}_1^i{z}_2,$$

(16)

where $g_{1,k,i}$ and $g_{2,k,i}$ are undetermined coefficients that depend on both the frequency and amplitude, in contrast with the coefficients $c_{k,i,j}$ of series (6), which only depend on the frequency. In matrix form, the vector $\xi$ becomes

$$\xi \left(z\right)=G_1{Z}_1+G_2{Z}_1{z}_2,$$

(17)

where

$$G_i=\left(\begin{array}{c}{G}_{i,1}\\ G_{i,2}\\ ⋮\\ G_{i,n}\end{array}\right)=\left(\begin{array}{cccc}{g}_{i,1,0}& g_{i,1,1}& g_{i,1,2}& \cdots \\ g_{i,2,0}& g_{i,2,1}& g_{i,2,2}& \cdots \\ ⋮& ⋮& ⋮& \cdots \\ g_{i,n,0}& g_{i,n,1}& g_{i,n,2}& \cdots \end{array}\right).$$

(18)

The new coefficients $g_{n-i,k,i}$ are now a function of both the frequency and amplitude, and can be considered as an infinite series of the previous coefficients $A^n{c}_{k,n-i,i}$.

Note that instead of replacing $z_2^2=A^2-z_1^2$ in Equation (14) to obtain the series (16) with terms with higher than first-order powers only for $z_1$, a similar analysis can be carried out by replacing $z_1^2=A^2-z_2^2$ in vector $Z_1$ to obtain an equivalent series with higher order than the first order terms, now in $z_2$. This case is briefly described in Appendix A.

The use of the matrix form (17) allows us to simplify both the analysis and solution. The following two operational definitions are instrumental in finding the series (16) that satisfies Equation (4).

Definition 1.

Given vectors ${\Phi }_a$ and ${\Phi }_b$ with the same dimension $1\times N$ (where N can be infinity), the product operator is defined as

$${〈{\Phi }_a,{\Phi }_b〉}_N={\Phi }_b\left(\begin{array}{c}{\Phi }_a\\ {\Phi }_{a}P\\ {\Phi }_a{P}^2\\ ⋮\\ {\Phi }_a{P}^N\end{array}\right),$$

(19)

where the elements of matrix P are

$${\left[P\right]}_{i,j}=\left\{\begin{array}{cc}1\hfill & \mathrm{if}j=i+1\hfill \\ 0\hfill & \mathit{otherwise}\hfill \end{array}\right..$$

(20)

Definition 2.

Given vectors ${\Phi }_1$ and ${\Phi }_2$ with dimension $1\times N$, the differential operator associated with the oscillation $z_2$ with frequency ω and amplitude A is defined as

$$\begin{array}{ccc}\hfill d\left({\Phi }_1,{\Phi }_2,z_2\right)& =& d\left({\Phi }_1+{\Phi }_2{z}_2\right)\hfill \\ & =& d{\Phi }_1+d{\Phi }_2{z}_2,\hfill \end{array}$$

(21)

where

$$d{\Phi }_1={\Phi }_2\left(A^{2}D-D{P}^2-P\right)\mathit{and}d{\Phi }_2={\Phi }_{1}D,$$

and the elements of matrix D are

$${\left[D\right]}_{i,j}=\left\{\begin{array}{cc}j\hfill & \mathrm{if}i=j+1\hfill \\ 0\hfill & \mathit{otherwise}\hfill \end{array}\right.,$$

(22)

while the elements of matrix P are defined in Equation (20).

To substitute the proposed solution (16) in Equation (4), it is necessary to compute the time derivative of $\xi$; considering that $\xi$ is the sum of coefficients of the form $z_1^i$ and $z_1^i{z}_2$, with $i\in \mathbb{N}$, their time derivatives are

$$\begin{array}{ccc}\hfill \frac{d}{dt}\left(z_1^k\right)& =& k{z}_1^{k-1}{\dot{z}}_1,\hfill \end{array}$$

(23)

$$\begin{array}{ccc}\hfill \frac{d}{dt}\left(z_1^k{z}_2\right)& =& k{z}_1^{k-1}{z}_2{\dot{z}}_1+z_1^k{\dot{z}}_2.\hfill \end{array}$$

(24)

Furthermore, considering the dynamics of z, Equations (2) and (3) and the trigonometric identity provided in Equation (13), it holds that

$$\begin{array}{ccc}\hfill \frac{d}{dt}\left(z_1^k\right)& =& \omega k{z}_1^{k-1}{z}_2,\hfill \end{array}$$

(25)

$$\begin{array}{ccc}\hfill \frac{d}{dt}\left(z_1^k{z}_2\right)& =& \omega \left[k{A}^2{z}_1^{k-1}-\left(k+1\right)z_1^{k+1}\right].\hfill \end{array}$$

(26)

Following this structure, the time derivative of the infinite series (16) or its matrix form, (17), is presented in the following Proposition.

Proposition 1.

Consider vectors ${\Phi }_{1a}$ and ${\Phi }_{2a}$ of infinite dimension with constant coefficients and associated with a function of $z_1$ and $z_2$, defined as

$${\varphi }_a\left(z_1\left(t\right),z_2\left(t\right)\right)={\Phi }_{1a}{Z}_1\left(t\right)+{\Phi }_{2a}{Z}_1\left(t\right)z_2\left(t\right),$$

(27)

where vector $Z_1\left(t\right)$ is defined in Equation (8). The time derivative of ${\varphi }_a$ is

$$\frac{d}{dt}\left[{\varphi }_a\left(z_1\left(t\right),z_2\left(t\right)\right)\right]=\omega \left[d\left({\Phi }_1,{\Phi }_2,z_2\right)\right]Z_1\left(t\right),$$

(28)

where $d\left({\Phi }_1,{\Phi }_2,z_2\right)=d{\Phi }_1+d{\Phi }_2{z}_2$ is the operator described in Definition 2.

Proof. 

The time derivative of ${\varphi }_a$ is

$$\frac{d{\varphi }_a}{dt}=\frac{\partial {\varphi }_a}{\partial z_1}{\dot{z}}_1+\frac{\partial {\varphi }_a}{\partial z_2}{\dot{z}}_2=\omega \left(\frac{\partial {\varphi }_a}{\partial z_1}{z}_2-\frac{\partial {\varphi }_a}{\partial z_2}{z}_1\right).$$

(29)

Notice that the derivative of vector $Z_1$ with respect to $z_1$ is

$$d{Z}_1=\left(\begin{array}{c}0\\ 1\\ 2z_1\\ 3z_1^2\\ ⋮\end{array}\right)=D{Z}_1,$$

(30)

where

$$D=\left(\begin{array}{ccccc}0& 0& 0& 0& \cdots \\ 1& 0& 0& 0& \ddots \\ 0& 2& 0& 0& \ddots \\ 0& 0& 3& 0& \ddots \\ ⋮& \ddots & \ddots & \ddots & \ddots \end{array}\right)$$

(31)

is defined in Equation (22). Therefore, the partial derivatives of ${\varphi }_a$ with respect to $z_1$ and $z_2$ are

$$\begin{array}{ccc}\hfill \frac{\partial {\varphi }_a}{\partial z_1}& =& \frac{\partial {\varphi }_a}{\partial Z_1}d{Z}_1=\left({\Phi }_{1a}+{\Phi }_{2a}{z}_2\right)D{Z}_1,\hfill \end{array}$$

(32)

$$\begin{array}{ccc}\hfill \frac{\partial {\varphi }_a}{\partial z_2}& =& {\Phi }_{2a}{Z}_1,\hfill \end{array}$$

(33)

therefore, the time derivative of ${\varphi }_a$ becomes

$$\frac{d{\varphi }_a}{dt}=\omega \left[\left({\Phi }_{1a}{z}_2+{\Phi }_{2a}{z}_2^2\right)D{Z}_1-{\Phi }_{2a}{z}_1{Z}_1\right];$$

due to the trigonometric identity (13) and the fact that

$$Z_1{z}_1^n=P^n{Z}_1,$$

(34)

where

$$P=\left(\begin{array}{ccccc}0& 1& 0& 0& \cdots \\ 0& 0& 1& 0& \cdots \\ 0& 0& 0& 1& \ddots \\ ⋮& ⋮& \ddots & \ddots & \ddots \end{array}\right),$$

(35)

is defined in Equation (20); the time derivative of ${\varphi }_a$ simplifies to

$$\frac{d{\varphi }_a}{dt}=\omega \left[{\Phi }_{2a}\left(A^{2}D-D{P}^2-P\right)Z_1+{\Phi }_{1a}D{z}_2{Z}_1\right].$$

Finally, with Definition 2, it holds that ${\dot{\varphi }}_a=\omega \left[d\left({\Phi }_{1a},{\Phi }_{2a},z_2\right)\right]Z_1$, concluding the proof. □

The time derivative presented in Proposition 1 includes the differential operator $d\left({\Phi }_1,{\Phi }_2,z_2\right)$, defined in Equation (21), and the matrix $A^{2}D-D{P}^2-P$ with a tridiagonal structure, the elements of which are

$${\left[A^{2}D-D{P}^2-P\right]}_{i,j}=\left\{\begin{array}{cc}-i\hfill & \mathrm{if}j=i+1\hfill \\ A^{2}j\hfill & \mathrm{if}i=j+1\hfill \\ 0\hfill & \mathrm{otherwise}\hfill \end{array}\right.,$$

producing a shift in the coefficients of the series. Then, expressing the time derivative of ${\xi }_k$ as ${\dot{\xi }}_k\left(z\right)={\sum }_{i=0}^{\infty }{q}_{1,k,i}{z}_1^i+{\sum }_{i=0}^{\infty }{q}_{2,k,i}{z}_1^i{z}_2$, the coefficients for $z_1^i$ of ${\dot{\xi }}_k$, $q_{1,k,i}$ and $q_{2,k,i}$ contain the coefficients $g_{1,k,i+1}$ and $g_{2,k,i}$ of ${\xi }_k$.

Furthermore, as Equation (1) contains nonlinear terms, it might have products of finite or infinite series of $z_1$ and $z_2$, such as $z_1^a$, where $a\in \mathbb{Z}$ can be expressed in matrix form as

$$z_1^a=B_a{Z}_1,$$

(36)

where

$${\left[B_n\right]}_i=\left\{\begin{array}{cc}1\hfill & i=n-1\hfill \\ 0\hfill & \mathrm{otherwise}\hfill \end{array}\right.,$$

(37)

while the procedure to compute the product of two series is presented in the following proposition.

Proposition 2.

Consider vectors ${\Phi }_{1,a}$, ${\Phi }_{2,a}$, ${\Phi }_{1,b}$, and ${\Phi }_{2,b}$ with dimension $1\times N$ ($N\to \infty$) associated with functions ${\varphi }_a$ and ${\varphi }_b$ of $z_1$ and $z_2$, defined as

$$\begin{array}{ccc}\hfill {\varphi }_a\left(z_1\left(t\right),z_2\left(t\right)\right)& =& \left({\Phi }_{1,a}+{\Phi }_{2,a}{z}_2\left(t\right)\right)Z_1\left(t\right),\hfill \end{array}$$

(38)

$$\begin{array}{ccc}\hfill {\varphi }_b\left(z_1\left(t\right),z_2\left(t\right)\right)& =& \left({\Phi }_{1,b}+{\Phi }_{2,b}{z}_2\left(t\right)\right)Z_1\left(t\right);\hfill \end{array}$$

(39)

the product of these functions is

$${\varphi }_a\left(z_1\left(t\right),z_2\left(t\right)\right){\varphi }_b\left(z_1\left(t\right),z_2\left(t\right)\right)=\left(\left({\Phi }_{1,a}+{\Phi }_{2,a}{z}_2\left(t\right)\right)Z_1\left(t\right)\right)\left(\left({\Phi }_{1,b}+{\Phi }_{2,b}{z}_2\left(t\right)\right)Z_1\left(t\right)\right),$$

(40)

which is equivalent to

$${\varphi }_a\left(z_1\left(t\right),z_2\left(t\right)\right){\varphi }_b\left(z_1\left(t\right),z_2\left(t\right)\right)={\Phi }_{1,ab}{Z}_1\left(t\right)+{\Phi }_{2,ab}{Z}_1\left(t\right)z_2\left(t\right),$$

(41)

where

$$\begin{array}{ccc}\hfill {\Phi }_{1,ab}& =& \left({〈{\Phi }_{1,a},{\Phi }_{1,b}〉}_N+{〈{\Phi }_{2,a},{\Phi }_{2,b}〉}_N\left(A^2{I}_N-P^2\right)\right),\hfill \end{array}$$

(42)

$$\begin{array}{ccc}\hfill {\Phi }_{2,ab}& =& \left({〈{\Phi }_{1,b},{\Phi }_{2,a}〉}_N+{〈{\Phi }_{1,a},{\Phi }_{2,b}〉}_N\right),\hfill \end{array}$$

(43)

while the operator${〈{\Phi }_{1,a},{\Phi }_{2,b}〉}_N$is described in Definition 1, P is defined in Equation (20), and$I_N$is the identity matrix of dimension N.

Proof. 

As ${\varphi }_a\left(z_1,z_2\right)$ is a scalar function, Equation (40) is equivalent to

$$\begin{array}{ccc}\hfill {\varphi }_a\left(z_1,z_2\right){\varphi }_b\left(z_1,z_2\right)& =& \left[{\Phi }_{1,a}{Z}_1\right]\left[{\Phi }_{1,b}{Z}_1\right]+\left[{\Phi }_{2,a}{Z}_1\right]\left[{\Phi }_{2,b}{Z}_1\right]z_2^2\hfill \\ & & +\left(\left[{\Phi }_{1,b}{Z}_1\right]\left[{\Phi }_{2,a}{Z}_1\right]+\left[{\Phi }_{1,a}{Z}_1\right]\left[{\Phi }_{2,b}{Z}_1\right]\right)z_2.\hfill \end{array}$$

(44)

For any pair of vectors ${\Phi }_{i,a}$ and ${\Phi }_{j,b}$ the product $\left[{\Phi }_{i,a}{Z}_1\right]\left[{\Phi }_{j,b}{Z}_1\right]$ is

$$\left[{\Phi }_{i,a}{Z}_1\right]\left[{\Phi }_{j,b}{Z}_1\right]={\Phi }_{i,b}\left[{\Phi }_{j,a}{Z}_1\right]Z_1={\Phi }_{j,b}\left(\begin{array}{c}{\Phi }_{i,a}{Z}_1\\ {\Phi }_{i,a}{Z}_1{z}_1\\ {\Phi }_{i,a}{Z}_1{z}_1^2\\ ⋮\\ {\Phi }_{i,a}{Z}_1{z}_1^N\end{array}\right)$$

and given the property (34), this product is equal to

$$\left[{\Phi }_{i,a}{Z}_1\right]\left[{\Phi }_{j,b}{Z}_1\right]={\Phi }_{j,b}\left(\begin{array}{c}{\Phi }_{i,a}\\ {\Phi }_{i,a}P\\ {\Phi }_{i,a}{P}^2\\ ⋮\\ {\Phi }_{i,a}{P}^N\end{array}\right)Z_1={〈{\Phi }_{i,a},{\Phi }_{j,b}〉}_N{Z}_1,$$

where ${〈{\Phi }_{i,a},{\Phi }_{j,b}〉}_N$ is provided in Definition 1. Using this formula and the trigonometric identity (13), the product (44) becomes

$$\begin{array}{ccc}\hfill {\varphi }_a\left(z_1,z_2\right){\varphi }_b\left(z_1,z_2\right)& =& \left({〈{\Phi }_{1a},{\Phi }_{1b}〉}_N+A^2{〈{\Phi }_{2a},{\Phi }_{2b}〉}_N\right)Z_1-{〈{\Phi }_{2a},{\Phi }_{2b}〉}_N{Z}_1{z}_1^2\hfill \\ & & +\left({〈{\Phi }_{1b},{\Phi }_{2a}〉}_N+{〈{\Phi }_{1a},{\Phi }_{2b}〉}_N\right)Z_1{z}_2.\hfill \end{array}$$

Finally, property (34) is applied again to obtain

$${\varphi }_a{\varphi }_b=\left[{〈{\Phi }_{1a},{\Phi }_{1b}〉}_N+{〈{\Phi }_{2a},{\Phi }_{2b}〉}_N\left(A^{2}I-P^2\right)\right]Z_1+\left({〈{\Phi }_{1b},{\Phi }_{2a}〉}_N+{〈{\Phi }_{1a},{\Phi }_{2b}〉}_N\right)Z_1{z}_2,$$

which is equivalent to Equation (41), concluding the proof. □

It is important to note that the time derivative and the product described in Propositions 1 and 2 have the same structure as series (17). Hence, it is possible to establish the conditions to find the oscillatory invariant submanifold (4) presented in the following theorem.

Theorem 1.

Considering the input-state stable differential Equation (1) with $x\in {\mathbb{R}}^n$ and $z\in {\mathbb{R}}^2$ along with the dynamics defined in Equations (2) and (3), assume that $x\left(t\right)$ reaches an invariant submanifold that satisfies the equations

$$0=\omega \left(\frac{\partial \xi \left(z\right)}{\partial z_1}{z}_2-\frac{\partial \xi \left(z\right)}{\partial z_2}{z}_1\right)-f_k\left(\xi \left(z\right),z\right),k=1,2,\dots ,n.$$

(45)

Then, if functions $f_k\left(x\left(t\right),z\left(t\right)\right)$ can be expressed as series of integer powers of the elements of x and z, the solution of each element of vector ξ can be proposed to be an infinite series of integer powers of $z_1$ and $z_2$, i.e.,

$${\xi }_k\left(z\right)=\sum _{i=0}^{\infty }{g}_{1,k,i}{z}_1^i+\sum _{i=0}^{\infty }{g}_{2,k,i}{z}_1^i{z}_2,k=1,2,\dots ,n,$$

(46)

which in matrix form is

$${\xi }_k\left(t\right)=G_{1,k}{Z}_1\left(t\right)+G_{2,k}{Z}_1\left(t\right)z_2\left(t\right),k=1,2,\dots ,n,$$

(47)

where vectors

$$G_{i,k}=\left(\begin{array}{cccc}{g}_{i,k,0}& g_{i,k,1}& g_{i,k,2}& \cdots \end{array}\right),i=1,2,k=1,2,\dots ,n$$

(48)

are the rows of matrix $G_i$, defined in Equation (18).

Proof. 

The system of differential equations defined in Equation (45) is

$$0=\frac{d{\xi }_k\left(z\right)}{dt}-f_k\left({\xi }_1\left(z\right),\dots ,{\xi }_n\left(z\right),z_1,z_2\right),k=1,2,\dots ,n.$$

Assume that the elements of the invariant submanifold $\xi \left(t\right)$ can be described as in Equation (47); then, according to Proposition 1, their time derivatives are

$$\frac{d{\xi }_k\left(t\right)}{dt}=\omega \left(\frac{\partial {\xi }_k\left(z\right)}{\partial z_1}{z}_2-\frac{\partial {\xi }_k\left(z\right)}{\partial z_2}{z}_1\right)=\omega \left[d\left({\Phi }_{1,k},{\Phi }_{2,k}\right)\right]Z_1,k=1,2,\dots ,n,$$

where $d\left({\Phi }_{1,k},{\Phi }_{2,k}\right)$ is provided in Definition 2. Using this time derivative, the elements of Equation (45) become

$$0=\omega \left[d\left({\Phi }_{1,k},{\Phi }_{2,k},z_2\right)\right]Z_1-f_k\left(\left(G_{1,1}+G_{2,1}{z}_2\right)Z_1,\dots ,\left(G_{1,n}+G_{2,n}{z}_2\right)Z_1,z_1,z_2\right),$$

for $k=1,2,\dots ,n$. If functions $f_k\left(x,z\right)$ can be expressed as series of integer powers of the elements of x and z, then using the identities in Equations (36) and (41) in Proposition 2, the differential equations can be transformed to the form

$$0={\Psi }_{1,k}\left(\omega ,A,G_1,G_2\right)Z_1+{\Psi }_{2,k}\left(\omega ,A,G_1,G_2\right)Z_1{z}_2,k=1,2,\dots ,n,$$

(49)

where ${\Psi }_{1,k}\left(\omega ,A,G_1,G_2\right)$ and ${\Psi }_{2,k}\left(\omega ,A,G_1,G_2\right)$ are vectors that depend on the values of coefficient matrices $G_1$ and $G_2$, defined in Equation (18). Independently of the values of vectors $Z_1$ and $z_2$, Equation (49) holds if

$$\begin{array}{ccc}\hfill {\Psi }_{1,k}\left(\omega ,A,G_1,G_2\right)& =& 0,\hfill \end{array}$$

(50)

$$\begin{array}{ccc}\hfill {\Psi }_{2,k}\left(\omega ,A,G_1,G_2\right)& =& 0,\hfill \end{array}$$

(51)

for $k=1,2,\dots ,n$. Then, the problem reduces to finding the coefficients $g_{k,i,j}$, $k=1,2$, $i=1,2,\dots ,n$, $j\in \mathbb{N}$ by solving Equations (50) and (51) to obtain the solution in Equation (47). □

Equations (50) and (51) imply that there are two set of equations for coefficients with the same order, namely, those associated with $Z_1$ (Equation (50)) and those associated with $Z_1{z}_2$ (Equation (51)); therefore, in order to reduce the degrees of freedom it is necessary to consider the initial conditions ${\xi }_k\left(t_0\right)={\xi }_{k,0}$, where $t_0$ is such that $z_1\left(t_0\right)=Asin\left(\omega t_0+\varphi \right)=0$ and $z_2\left(t_0\right)=Acos\left(\omega t_0+\varphi \right)=A$. Then, at $t=t_0$ it holds that

$$Z_1\left(t_0\right)=\left(\begin{array}{c}1\\ 0\\ 0\\ ⋮\end{array}\right),$$

while the value of ${\xi }_k$ at $t=t_0$ is

$${\left[{\xi }_k\right]}_{t=t_0}=g_{1,k,0}+A{g}_{2,k,0}.$$

Therefore, the first n parameters of both $G_1$ and $G_2$ in series (7) are correlated, and their value depends on the initial conditions

$${\xi }_{k,0}=g_{1,k,0}+A{g}_{2,k,0},k=1,2,\dots ,n.$$

(52)

To illustrate the proposed method, in the following section the same study cases used in our previous contribution [9] are analyzed.

4. Study Cases

4.1. Series Solutions for a Simple Globally Asymptotically Stable Model

Consider the dynamical system (10). As explained in [9], the system is input-state stable and the origin is globally asymptotically stable. If system (10) is subjected to an oscillatory input $u\left(t\right)=z_1\left(t\right)$, where $z_1$ is the first element of the state vector of the oscillator (2)–(3), then past a transient behavior that depends on the initial conditions the system will begin to approach an invariant submanifold $x\left(t\right)=\xi \left(z\left(t\right)\right)$ that satisfies the nonlinear partial differential Equation (11). In order to find the analytical solution, $\xi$ can be expressed as a series with the form of Equation (17), i.e.,

$$\xi =G_1{Z}_1+G_2{Z}_1{z}_2,$$

where

$$\begin{array}{ccc}\hfill G_1& =& \left(\begin{array}{cccccc}{g}_{1,0}& g_{1,1}& g_{1,2}& g_{1,3}& g_{1,4}& \cdots \end{array}\right),\hfill \\ \hfill G_2& =& \left(\begin{array}{cccccc}{g}_{2,0}& g_{2,1}& g_{2,2}& g_{23}& g_{2,4}& \cdots \end{array}\right),\hfill \end{array}$$

and $Z_1$ is described in Equation (8). The nonlinear term in Equation (11) is ${\xi }^3$. Its mathematical structure can be obtained using Proposition 2 twice in the following steps:

1.

The product $\xi ·\xi$ is

$${\xi }^2=Q_1{Z}_1+Q_2{Z}_1{z}_2,$$

where

$$\begin{array}{ccc}\hfill Q_1& =& 〈G_1,G_1〉+〈G_2,G_2〉\left(A^{2}I-P^2\right),\hfill \\ \hfill Q_2& =& 2〈G_1,G_2〉,\hfill \end{array}$$

2.

while the product ${\xi }^2·\xi$ is

$${\xi }^3=Q_3{Z}_1+Q_4{Z}_1{z}_2,$$

where

$$\begin{array}{ccc}\hfill Q_3& =& 〈G_1,Q_1〉+〈G_2,Q_2〉\left(A^{2}I-P^2\right),\hfill \\ \hfill Q_4& =& 〈Q_1,C_2〉+〈G_1,Q_2〉.\hfill \end{array}$$

Equation (11) includes the terms $\dot{\xi }$ and $z_1$, which in matrix form are $\dot{\xi }=\omega G_2$$\left(A^{2}D-D{P}^2-P\right)Z_1+\omega G_{1}D{Z}_1{z}_2$ and $z_1=B_1{Z}_1$, respectively. Therefore, Equation (11) becomes

$$\left[\omega G_2\left(A^{2}D-D{P}^2-P\right)+Q_3-B_1\right]Z_1+\left(\omega G_{1}D+Q_4\right)Z_1{z}_2=0,$$

(53)

which is satisfied for any oscillatory behavior of z if

$$\begin{array}{ccc}\hfill 0& =& \omega G_2\left(A^{2}D-D{P}^2-P\right)+Q_3-B_1,\hfill \end{array}$$

(54)

$$\begin{array}{ccc}\hfill 0& =& \omega G_{1}D+Q_4.\hfill \end{array}$$

(55)

Equations (54) and (55) are a set of two vectorial algebraic equations for coefficients $G_1$ and $G_2$ with solutions that depend on the applied frequency and amplitude. For instance, the first elements of Equations (54) and (55) are

• Coefficient for $z_1^0$ of Equation (54): $0=g_{1,0}\left(3A^2{g}_{2,0}^2+g_{1,0}^2\right)$,
• Coefficient for $z_1^0{z}_2$ of Equation (55): $0=A^2{g}_{2,0}^3+3g_{1,0}^2{g}_{2,0}+g_{1,1}\omega$,
• Coefficient for $z_1^1$ of Equation (54): $1=3A^2{g}_{1,1}{g}_{2,0}^2+2A^2{g}_{2,2}\omega +3g_{1,0}^2{g}_{1,1}-g_{2,0}\omega$,
• Coefficient for $z_1^1{z}_2$ of Equation (55): $0=6g_{1,0}{g}_{1,1}{g}_{2,0}+2g_{1,2}\omega$.

Therefore, the solution can be expressed as a function of $g_{1,0}$ and $g_{2,0}$. From the equation for the $z_1^0$ coefficient, we can infer that the only possible value where $\xi \left(z\right)\ne 0$ is $g_{1,0}=0$. Then, for the equation of the $z_1^0{z}_2$ coefficient, it is possible to compute $g_{1,1}$ as a function of $g_{2,0}$, i.e., $g_{1,1}=-A^2{g}_{2,0}^3/\omega$, while from the equations for the $z_1^1$ and $z_1^1{z}_2$ coefficients we obtain that $g_{2,2}=\frac{3A^4{g}_{2,0}^5+{\omega }^2{g}_{2,0}+\omega }{2A^2{\omega }^2}$ and $g_{1,2}=0$, respectively. By following this procedure, it is always possible to use the equations for the $z_1^k$ and $z_1^k{z}_2$ coefficients to compute the $g_{1,k+1}$ and $g_{2,k+1}$ coefficients, which are always functions of $g_{2,0}$, producing the solution:

$$\begin{array}{ccc}\hfill \xi \left(z\right)& =& -\frac{A^2{g}_{2,0}^3}{\omega }{z}_1-\frac{g_{2,0}^2\left(15A^4{g}_{2,0}^5+g_{2,0}{\omega }^2+3\omega \right)}{6{\omega }^3}{z}_1^3\hfill \\ & & -g_{2,0}\frac{6{\omega }^2+3\left(3+\omega g_{2,0}\right){\omega }^3{g}_{2,0}+A^4\omega \left(99+50\omega g_{2,0}\right)g_{2,0}^5+315A^8{g}_{2,0}^{10}}{40A^2{\omega }^5}{z}_1^5+\cdots \hfill \\ & & +\left(g_{2,0}+\frac{3A^4{g}_{2,0}^5+\omega \left(g_{2,0}\omega +1\right)}{2A^2{\omega }^2}{z}_1^2\right.\hfill \\ & & \left.+\frac{3{\omega }^3\left(1+g_{2,0}\omega \right)+A^4\omega \left(9+10\omega g_{2,0}\right)g_{2,0}^4+35A^8{g}_{2,0}^9}{8A^4{\omega }^4}{z}_1^4+\cdots \right)z_2.\hfill \end{array}$$

(56)

Solution (57) is similar to (16). Note that the general solution (57) for a particular frequency and amplitude is not univocally defined, and depends on an extra parameter, $g_{2,0}$. In comparing both solutions, it is possible to infer that $g_{2,0}=-\frac{1}{\omega }\left(1-\frac{13A^4}{15{\omega }^6}+\cdots \right)$. Therefore, $g_{2,0}$ cannot be analytically evaluated due to its infinite series structure, which depends on high order terms of the previous series solution (12). In order to assign a value to $g_{2,0}$, it may be possible to consider the value ${\xi }_0$, at which $z_1=0$ and $z_2=A$; then, according to Equation (52), it should satisfy

$${\xi }_0=g_{1,0}+A{g}_{2,0},$$

therefore, $g_{2,0}={\xi }_0/A$, producing the equivalent solution:

$$\begin{array}{ccc}\hfill \xi \left(z\right)& =& -\frac{{\xi }_0^3}{\omega }\frac{z_1}{A}-{\xi }_0^2\frac{15{\xi }_0^5+{\xi }_0{\omega }^2+3A\omega }{6{\omega }^3}{\left(\frac{z_1}{A}\right)}^3\hfill \\ & & -{\xi }_0\frac{315{\xi }_0^{10}+50{\xi }_0^6{\omega }^2+3{\xi }_0^2{\omega }^4+\left(99{\xi }_0^4+9{\omega }^2\right){\xi }_{0}A\omega +6A^2{\omega }^2}{40{\omega }^5}{\left(\frac{z_1}{A}\right)}^5+\cdots \hfill \\ & & +\left({\xi }_0+\frac{\left(3{\xi }_0^4+{\omega }^2\right){\xi }_0+A\omega }{2{\omega }^2}{\left(\frac{z_1}{A}\right)}^2\right.\hfill \\ & & \left.+\frac{35{\xi }_0^9+10{\xi }_0^5{\omega }^2+9A\omega {\xi }_0^4+3A{\omega }^3\left(1+\omega {\xi }_0\right)}{8{\omega }^4}{\left(\frac{z_1}{A}\right)}^4+\cdots \right)z_2,\hfill \end{array}$$

although ${\xi }_0$ must be specified as well.

4.2. Series Solutions for a Simple Pendulum

Here, we consider the pendulum model previously analyzed in [9,15]:

$$\begin{array}{ccc}\hfill {\dot{x}}_1& =& x_2,\hfill \end{array}$$

(57)

$$\begin{array}{ccc}\hfill {\dot{x}}_2& =& -sin\left(x_1\right)-\eta x_2+u.\hfill \end{array}$$

(58)

Considering that $sin\left(x_1\right)={\sum }_{i=0}^{\infty }\frac{{\left(-1\right)}^i{x}_1^{2i+1}}{\left(2i+1\right)!}$, it is necessary to apply the product operator described in Proposition 2 an infinite number of times. To avoid this inconvenience, we can define $y_1=sin{x}_1$ and $y_2=cos{x}_1$. Therefore, considering the dynamical behavior of $y_1$ and $y_2$ together with the pendulum dynamics produces an extended system,

$$\begin{array}{ccc}\hfill {\dot{x}}_1& =& x_2,\hfill \\ \hfill {\dot{x}}_2& =& -y_1-\eta x_2+z_1,\hfill \\ \hfill {\dot{y}}_1& =& y_2{x}_2,\hfill \\ \hfill {\dot{y}}_2& =& -y_1{x}_2,\hfill \end{array}$$

where only two nonlinearities appear: $y_2{x}_2$ and $y_1{x}_2$. At the invariant submanifold, these equations become

$$\begin{array}{ccc}\hfill 0& =& \ddot{\xi }+{\zeta }_1+\eta \dot{\xi }-z_1,\hfill \end{array}$$

(59)

$$\begin{array}{ccc}\hfill 0& =& {\dot{\zeta }}_1-{\zeta }_2\dot{\xi },\hfill \end{array}$$

(60)

$$\begin{array}{ccc}\hfill 0& =& {\dot{\zeta }}_2+{\zeta }_1\dot{\xi }.\hfill \end{array}$$

(61)

Now, consider that the solution for $\xi$, ${\zeta }_1$, and ${\zeta }_2$ can be expressed as a series in the form of Equation (16), i.e.,

$$\begin{array}{ccc}\hfill \xi & =& G_1{Z}_1+G_2{Z}_1{z}_2,\hfill \\ \hfill {\zeta }_1& =& Y_{1,1}{Z}_1+Y_{1,2}{Z}_1{z}_2,\hfill \\ \hfill {\zeta }_2& =& Y_{2,1}{Z}_1+Y_{2,2}{Z}_1{z}_2.\hfill \end{array}$$

Proposition 1 allows us to compute the first time derivatives of these variables

$$\dot{\xi }=\left(d{G}_1+d{G}_2{z}_2\right)Z_1\mathrm{and}\dot{\zeta }=\left(d{Y}_{i,1}+d{Y}_{i,2}{z}_2\right)Z_2,i=1,2,$$

with $d{G}_1$, $d{G}_2$, $d{Y}_{i,1}$, and $d{Y}_{i,2}$, $i=1,2$, as proposed in Definition 2, while the second order derivative for $\xi$ can be obtained by iteratively applying the same formula, i.e.,

$$\ddot{\xi }=d\left(d{G}_1,d{G}_2,z_2\right)Z_2=\left(dd{G}_1+dd{G}_2{z}_2\right)Z_1,$$

where $dd{G}_1=G_{1}D\left(A^{2}D-D{P}^2-P\right)$ and $dd{G}_2=G_2\left(A^{2}D-D{P}^2-P\right)D$. Finally, with Proposition 2, the nonlinear terms ${\zeta }_i\dot{\xi }$ for $i=1,2$ can be expressed in series form as

$${\zeta }_i\dot{\xi }=\left(Q_{i,1}+Q_{i,2}{z}_2\right)Z_1,i=1,2,$$

where $Q_{i,1}={〈Y_{i,1},d{G}_1〉}_{\infty }+{〈Y_{i,2},d{G}_2〉}_{\infty }\left(A^2{I}_{\infty }-P^2\right)$ and $Q_{i,2}={〈d{G}_1,Y_{i,2}〉}_{\infty }+{〈Y_{i,1},d{G}_2〉}_{\infty }$. Then, Equations (59)–(61) become

$$\begin{array}{ccc}\hfill 0& =& \left(dd{G}_1+Y_{1,1}+\eta d{G}_1-B_1\right)Z_1+\left(dd{G}_2+Y_{1,2}+\eta d{G}_2\right)Z_1{z}_2,\hfill \\ \hfill 0& =& \left(d{Y}_{1,1}-Q_{2,1}\right)Z_1+\left(d{Y}_{1,2}-Q_{2,2}\right)Z_1{z}_2,\hfill \\ \hfill 0& =& \left(d{Y}_{2,1}+Q_{1,1}\right)Z_1+\left(d{Y}_{2,2}+Q_{1,2}\right)Z_1{z}_2,\hfill \end{array}$$

and are satisfied for any amplitude and frequency of z if the following equations hold:

$$\begin{array}{ccc}\hfill 0& =& dd{G}_1+Y_{1,1}+\eta d{G}_1-B_1,\hfill \end{array}$$

(62)

$$\begin{array}{ccc}\hfill 0& =& dd{G}_2+Y_{1,2}+\eta d{G}_2,\hfill \end{array}$$

(63)

$$\begin{array}{ccc}\hfill 0& =& d{Y}_{1,1}-Q_{2,1},\hfill \end{array}$$

(64)

$$\begin{array}{ccc}\hfill 0& =& d{Y}_{1,2}-Q_{2,2},\hfill \end{array}$$

(65)

$$\begin{array}{ccc}\hfill 0& =& d{Y}_{2,1}+Q_{1,1},\hfill \end{array}$$

(66)

$$\begin{array}{ccc}\hfill 0& =& d{Y}_{2,2}+Q_{1,2}.\hfill \end{array}$$

(67)

Equations (62)–(71) are a set of vectorial algebraic equations for coefficients $G_1$, $G_2$, $Y_{1,1}$, $Y_{1,2}$, $Y_{2,1}$, and $Y_{2,2}$, and their solutions depend on the applied frequency and amplitude. The coefficients of the general solution to these equations is as follows:

• For $\xi =G_1{Z}_1+G_2{Z}_1{z}_2$:

  $$\begin{array}{ccc}\hfill g_{1,n+2}& =& \frac{n^2{\omega }^2{g}_{1,n}-{\left[Y_{1,1}+\eta d{G}_1-B_1\right]}_n}{\left(n+2\right)\left(n+1\right)A^2{\omega }^2},n=0,1,2,\dots \hfill \\ \hfill g_{2,n+2}& =& \frac{{\left(n+1\right)}^2{\omega }^2{g}_{2,n}-{\left[Y_{1,2}+\eta d{G}_2\right]}_n}{\left(n+2\right)\left(n+1\right)A^2{\omega }^2},n=0,1,2,\dots \hfill \end{array}$$
• For ${\zeta }_1=Y_{1,1}{Z}_1+Y_{1,2}{Z}_1{z}_2$:

  $$\begin{array}{ccc}\hfill y_{1,1,n+1}& =& \frac{{\left[Q_{2,2}\right]}_n}{\left(n+1\right)\omega },n=0,1,2,\dots \hfill \\ \hfill y_{1,2,n+1}& =& \left\{\begin{array}{cc}\frac{{\left[Q_{2,1}\right]}_0}{A^2\omega }\hfill & n=0,\hfill \\ \frac{n\omega y_{1,2,n-1}+{\left[Q_{2,1}\right]}_n}{\left(n+1\right)A^2\omega }\hfill & n=1,2,3,\dots \hfill \end{array}\right.\hfill \end{array}$$
• For ${\zeta }_2=Y_{2,1}{Z}_1+Y_{2,2}{Z}_1{z}_2$:

  $$\begin{array}{ccc}\hfill y_{2,1,n+1}& =& -\frac{{\left[Q_{1,2}\right]}_n}{\left(n+1\right)\omega },n=0,1,2,\dots \hfill \\ \hfill y_{2,2,n+1}& =& \left\{\begin{array}{cc}-\frac{{\left[Q_{1,1}\right]}_0}{\omega }\hfill & n=0,\hfill \\ \frac{n\omega y_{2,2,n-1}-{\left[Q_{1,1}\right]}_n}{\left(n+1\right)A^2\omega }\hfill & n=1,2,3,\dots \hfill \end{array}\right.\hfill \end{array}$$

where $y_{1,1,0}=s_1{c}_2$, $y_{1,2,0}=c_1{s}_2/A$, $y_{2,1,0}=c_1{c}_2$, and $y_{2,2,0}=-s_1{s}_2/A$, with $s_1=sin\left(g_{1,0}\right)$, $c_1=cos\left(g_{1,0}\right)$, $s_2=sin\left(A{g}_{2,0}\right)$, and $c_2=cos\left(A{g}_{2,0}\right)$, while $g_{1,0}$, $g_{2,0}$, $g_{1,1}$, and $g_{2,1}$ remain unspecified. Therefore, the general solution has the following form:

$$\begin{array}{ccc}\hfill \xi \left(z\left(t\right)\right)& =& g_{1,0}+g_{1,1}{z}_1-\frac{A^2\eta \omega g_{2,1}+s_1{c}_2}{2A^2{\omega }^2}{z}_1^2\hfill \\ & & +\frac{A\omega +\eta c_1{s}_2+A\omega \left({\eta }^2+{\omega }^2-c_1{c}_2\right)g_{1,1}+A^2\omega s_1{s}_2{g}_{2,1}}{6A^3{\omega }^3}{z}_1^3+\cdots \hfill \\ & & +\left(g_{2,0}+g_{2,1}{z}_1+\frac{A{\omega }^2{g}_{2,0}-A\eta \omega g_{1,1}-c_1{s}_2}{2A^3{\omega }^2}{z}_1^2\right.\hfill \\ & & \left.+\frac{\eta s_1{c}_2+A^2\omega s_1{c}_2{g}_{1,1}+A^2\omega \left(4{\omega }^2+{\eta }^2+A{c}_1{s}_2\right)g_{2,1}}{6A^4{\omega }^3}{z}_1^3+\cdots \right)z_2;\hfill \end{array}$$

(68)

see Appendix B for further details of the solution procedure.

5. Discussion

As discussed in [9], the series solution (6) may diverge for certain conjugated values of the frequency and amplitude in the LAO domain. Therefore, in order to extend the frequency–amplitude region and allow an analytical series to be used, the series solution (16) is proposed, where the smaller order terms may contain “information” about high order harmonics. This approach allows a novel method to proposed using this extension to define a limit of the MAO and LAO regimes, which is one of the important objectives of this work. For instance, in [9] we showed that an approximated limit to guarantee the convergence of series (12) for the dynamical system (8) is that the frequency–amplitude relation must satisfy ${\omega }^3>A^2$. This limit proves to be essential because it separates MAOs and LAOs. When this limit is not fulfilled, the solution (12) is no longer suitable for describing the dynamic behavior of system (8). In particular, a numerical example presented in [9] for $\omega =0.5$ and $A=0.4$ shows that as the number of terms in the truncated series (12) is increased, the prediction progressively diverges from the actual output behavior. In contrast, Figure 1 shows the prediction of the series solution (57) for the same values of the frequency and amplitude, considering up to the first, third, and fifth order terms of the series with $g_{2,0}={\xi }_0/$$A=-1.317$. The maximum percentage or variation of the analytical solution of x with respect to the numerical solution is approximately 15% for $N_{max}=1$, 5% for $N_{max}=3$, and 2% for $N_{max}=5$. Therefore, the fifth order terms of the series (57) are sufficient to reproduce this behavior. However, in this case the value of $g_{2,0}$ must be specified. The error of the analytical vs. the numerical method can be consulted in Figure S1 of the supplementary material.

The solution (69) has four coefficients that cannot be analytically evaluated, namely, $g_{1,0}$, $g_{2,0}$, $g_{1,1}$, and $g_{2,1}$. These parameters contain an infinite number of coefficients from the original series in the form (6). However, the solution can reproduce the system’s response at its invariant submanifold. For instance, Figure 2 shows the comparison of the numerical and analytical solutions provided in Equation (69) for $\eta =0.1428$, $\omega =1$, and $A=0.9$, with $g_{1,0}=-4\pi$, $g_{2,0}=-0.749$, $g_{1,1}=-2.166$, and $g_{2,1}=-0.00268$, considering only the terms up to the third-order, i.e.,

$$\begin{array}{ccc}\hfill \xi \left(z\left(t\right)\right)& \approx & -4\pi -1.9494\frac{z_1\left(t\right)}{A}-1.55\times {10}^{-4}{\left(\frac{z_1\left(t\right)}{A}\right)}^2+0.0575{\left(\frac{z_1\left(t\right)}{A}\right)}^3\hfill \\ & & -\left[0.674+0.00217\frac{z_1\left(t\right)}{A}-0.114{\left(\frac{z_1\left(t\right)}{A}\right)}^2+0.00125{\left(\frac{z_1\left(t\right)}{A}\right)}^3\right]\frac{z_2\left(t\right)}{A}\hfill \end{array}$$

Figure 3 shows the comparison of the numerical and analytical solutions in Equation (69) for $\eta =0.1428$, $\omega =0.05$, and $A=0.9$, with $g_{1,0}=0$, $g_{2,0}=-0.007083$, $g_{1,1}=0.9992$, and $g_{2,1}=0$, considering only the terms up to the third order, i.e.,

$$\xi \left(z\left(t\right)\right)\approx 0.8993\frac{z_1\left(t\right)}{A}+0.2079{\left(\frac{z_1\left(t\right)}{A}\right)}^3-\left[6.375\times {10}^{-3}+0.01243{\left(\frac{z_1\left(t\right)}{A}\right)}^2\right]\frac{z_2\left(t\right)}{A}.$$

In both cases, the set of parameters $\eta$, $\omega$, and A are such that the pendulum is in LAO mode, as Figure 7 of [9] shows. In particular, the behavior shown in Figure 3 requires terms up to the third order, in contrast to the eleventh order, as required to reproduce the same behavior with series (6) (see Figure 4 in [9]). The error of the analytical vs. the numerical method can be consulted in Figures S2 and S3 of the supplementary material.

In Theorem 1, it was considered that $f_k\left(x\left(t\right),z\left(t\right)\right)$ must be expressed as series of integer powers of the elements of x and z. This restriction is necessary in order to represent these terms as a new series with the same form as series (47) using the identities in Equations (36) and (41) in Proposition 2. At first glance, this seems to be a strong restriction; however, in many cases this restriction is fulfilled. For instance, in the pendulum example presented in Section 4.2, it is possible to transform the nonlinear term $sin\left(x_1\right)$ to a nonlinear dynamic with products of the form $y_2{x}_2$ and $y_1{x}_2$. Following a similar procedure, it is possible to transform non-integer power terms to nonlinear dynamics with integer powers. For instance, a more general form of Equation (10) is

$$\dot{x}=-x^{\alpha }+u$$

where $\alpha >0$ can be a real number; then, we can define ${\xi }_1=x$ and ${\xi }_2=x^{\alpha }$ in the invariant submanifold, where the dynamical behavior is

$$\begin{array}{ccc}\hfill {\dot{\xi }}_1& =& -{\xi }_2+z_1\hfill \\ \hfill {\xi }_1{\dot{\xi }}_2& =& -\alpha {\xi }_2^2+\alpha {\xi }_2{z}_1\hfill \end{array}$$

then, applying Theorem 1 with ${\xi }_k\left(t\right)=G_{1,k}{Z}_1\left(t\right)+G_{2,k}{Z}_1\left(t\right)z_2\left(t\right)$ for $k=1,2$, produces the set of equations:

$$\begin{array}{ccc}\hfill 0& =& d{G}_{1,1}+G_{1,2}-B_1\hfill \\ \hfill 0& =& Q_5+\alpha \left(Q_1-Q_3\right)\hfill \\ \hfill 0& =& d{G}_{2,1}+G_{2,2}\hfill \\ \hfill 0& =& Q_6+\alpha \left(Q_2-Q_4\right)\hfill \end{array}$$

where $Q_1=〈G_{1,2},G_{1,2}〉+〈G_{2,2},G_{2,2}〉\left(A^{2}I-P^2\right)$, $Q_2=2〈G_{1,2},G_{2,2}〉$, $Q_3=〈G_{1,2},B_1〉$, $Q_4=〈B_1,G_{2,2}〉$, $Q_5=〈G_{1,1},d{G}_{1,2}〉+〈G_{2,1},d{G}_{2,2}〉\left(A^{2}I-P^2\right)$, and $Q_6=〈d{G}_{1,2},G_{2,1}〉+〈G_{1,1},d{G}_{2,2}〉$, with $d{G}_{1,k}$ and $d{G}_{2,k}$, $k=1,2$, as proposed in Definition 2. In addition, it must hold that ${\left(g_{1,1,0}+g_{2,1,0}A\right)}^{\alpha }=g_{1,2,0}+g_{2,2,0}A$. With this example, we can infer that the restriction of integer powers in Theorem 1 is not as strong as it seems, and that the cost of using this method is the increased number of equations that need to be solved.

6. Conclusions

The key contribution of the analytic matrix methods reported in the present series of articles is to work with the invariant submanifold of the problem (see Equations (4) and (5)) and to propose the solution as infinite power series of the oscillatory input, as opposed to other analytical methods in which infinite series of trigonometric functions with harmonic frequencies are proposed as the solution. Our procedure is direct and allows us to speed up the computations compared to traditional series solution methods. The analytic method for FRT with applications to nonlinear dynamical systems presented here is an alternative to the proposed solution method in [9]. With this novel alternative method, it is possible to expand the analysis to justify the amplitude dependence of the coefficients. First, it is possible to describe the LAO domain with convergent series, where high-order harmonics must be considered. This analytical expansion is feasible if the trigonometric identity (13) is used, which allows for considering the effect of high-order harmonics in the coefficients of low-order harmonics, leading to amplitude- and frequency-dependent coefficients for the infinite series solution. As a second contribution, it is possible to represent the system behavior with fewer terms in the series (16) in comparison with series (6). Finally, the procedure proposed in Theorem 1 together with the tools described in Propositions 1 and 2 allow us to systematize the solution of diverse nonlinear dynamical systems; see the algorithms in the supplementary material.