Abstract
Dynamical systems with entropy operator (DSEO) form a special class of dynamical systems whose nonlinear properties are described by the perturbed mathematical programming problem with entropy objective functions. A subclass of DSEO is the system with positive state coordinates (PDSEO), which are used as mathematical models of the spatiotemporal evolution of demographic and economic processes, dynamic image restoration procedures in computer tomography and machine learning. A mathematical model of the PDSEO with a connectivity parameter characterizing the influence of the entropy operator on the dynamic properties of the system is constructed. PDSEO can have positive stationary states of various classes depending on the number of positive components in the state vector. Classes with p positive components of the state vector (, where n is the order of the system) are considered. The framework of formal power series and the method of successive approximations for the formation of existence conditions of stationary states are developed. The conditions of existence are obtained in the form of relations between the parameters of the system. We used the method of differential Bellman inequalities to study the stability of classes of stationary states in a limited region of phase space. The parametric conditions of instability of the zero stationary state and p positive stationary states depending on the connectivity parameter are obtained. The framework of formal power series and the method of successive approximations for the formation of existence conditions and classification of stationary states are developed. The stability conditions “in large” stationary states are obtained, based on the method of differential Bellman inequalities. The developed methods of existence, classification and stability are illustrated by the analysis of the dynamic properties of the economic model with stochastic investment exchange. Positive stationary states characterize the profitability of economic subsystems. The conditions of profitability and their stability for all subsystems in the system and their various groups are obtained.
1. Introduction
Dynamic systems with an entropy operator are widely used for mathematical modeling of real processes. Apparently, research in this field was pioneered by A.J. Wilson [1], who suggested a thermodynamic approach to the mathematical modeling of transport and regional systems based on the hypothesis about the random nature of exchange processes and the existence of a stationary state that maximizes entropy. This approach turned out to be very fruitful, as is indicated by a large number of publications in which it was applied and further developed for modeling of macro systems [2], entropy restoration of tomographic images [3,4,5], demoeconomic modeling [6], machine learning [7] and others.
Of particular interest are dynamic processes with positive states. For their study, a fundamental principle of statistical thermodynamics—the principle of local equilibria—was developed. In accordance with this principle, a dynamic system is assumed to have “fast” and “slow” processes. A “fast” process is considered a sequence of locally stationary states that correspond to a “slow” process. There are many examples of such processes, but the main difficulties are connected with mathematical modeling of a “fast” process, i.e., with the description of a sequence of locally stationary states. The first idea introduced in [8] was to describe a “fast” process in terms of the local maximum of entropy that depends on the state of a corresponding “slow” process. This approach turned out to be very fruitful as well, and it was successfully applied in many problems, such as population dynamics modeling [9], the spatiotemporal development of settlements [10,11,12] and the dynamic entropy-based procedures of image restoration [13].
The integration of dynamic models of a “slow” process with entropy maximization models describing the locally stationary states of a “fast” process actually formed a new class of dynamic systems with the entropy operator (DSEO) [14]. Generally, the entropy operator in these systems was described by a perturbed mathematical programming problem with entropy objective functions that characterized the mapping of the state space of a “slow” process into the state space of a “fast” process. In most applications of positive dynamic systems with the entropy operator (PDSEO), the models of entropy operators of simpler form were used; namely, the ones described by perturbed problems of constrained entropy maximization. For this class of entropy operators, the conditions of existence, continuity, differentiation, and boundedness were obtained [15]. The Lipschitz constant is an important characteristic of an entropy operator that determines the dynamic properties of PDSEO. In [16,17], a linear majorant method was proposed and some estimates of the Lipschitz constant for the Fermi entropy operator were derived.
This paper is dedicated to the study of positive dynamic systems with the Boltzmann-type entropy operator and constraints on “fast” variables. The properties of a system are analyzed depending on the degree of influence of the entropy operator on them, which is characterized by the connectivity index. A method for calculating stationary positive states is developed and all such states are classified. Parametric conditions for the existence of positive stationary states and their stability in large are established. The proposed methods are used to study stationary states and their stability in an economic system that exchanges investments.
2. Positive Dynamic System with Entropy Operator
Positive dynamic systems are characterized by the state vector with nonnegative components. A subclass of such systems consists of positive dynamic systems with an entropy operator (PDSEO). The structural diagram of a PDSEO can be seen in Figure 1.
Figure 1.
Functional diagram.
It includes three feedback loops with autonomous integrators as follows. One of them is the feedback loop by the state vector with the multiplying block ; the other contains a nonlinear vector function with components ; the third feedback loop incorporates an entropy operator , where is a nonnegative matrix of dimensions The block calculates the so-called -decrement of the matrix , i.e., the difference between its column and row sums. The degree of influence of the entropy operator on the dynamic properties of the system is characterized by the connectivity index .
The PDSEO under study is described by Equation [11]
with the following notations: as the trace of a matrix •; as a matrix of dimensions with elements ; and , as parameters; finally, as a matrix of dimensions with elements .
Let us write system (1) in a more convenient form. Consider an entropy operator described by a perturbed mathematical programming problem: maximize the Boltzmann information entropy [2] on the nonnegative polyhedron . This problem can be simplified, i.e., reduced to an unconstrained maximization problem by passing to the entropy function
The entropy function (2) structurally resembles the Fermi informational entropy [2]. As is easily observed, this function is defined on the above polyhedron, meaning that its absolute maximum belongs to the latter:
In accordance with (2), the elements of the matrix have the form
The vector of the -decrement of the matrix consists of the components
Consider the case in which the functions linearly depend on :
where and are constant coefficients. In this case, the components of the vector have the form
where
Substituting these relations into Equation (1), we derive the PDSEO equation
where the vector function consists of the components
while the elements of the matrix B are .
Consider the PDSEO with
Then Equation (9) takes the form
where the elements of the matrix are given by
while the vector consists of the components
Equations (12) with nonnegative initial conditions have a nonnegative solution, thereby representing an adequate model of the PDSEO.
3. Classification of Stationary States and Existence Conditions
An important problem connected with the study of PDSEOs is the existence of stationary states (equilibria) and their classification. The existence of stationary states depends on the degree of influence of the entropy operator on the dynamic properties of a system, i.e., on the connectivity index . The stationary states of a PDSEO can be divided into three classes as follows.
The first class contains the unique trivial state . From Equation (12) it follows that this state always exists, regardless of the connectivity index.
The second class consists of the states with positive components of the state vector. Such a state will be called n-positive and denoted by .
Finally, the third class includes the states with positive components of the state vector. Such states will be called -positive and denoted by , where the numbers and are different non-coinciding integers from the range .
3.1. n-Positive States
Consider system (11)–(13) with a fixed value of the connectivity index . The matrix is assumed to be nondegenerate, i.e., . Then the existence of a state of this system is determined by the existence of a positive solution to the linear equation
In this case,
In particular, if , then
Hence, for to be positive the parameters and must have different signs:
Consider the case in which . Reverting to Equation (15), we write it in the form
where:
- —
- the vectors and consist of the components and , respectively;
- —
- the matrices – are given byClearly, the matrix is degenerate, i.e., . We will construct the solution to Equation (19) as the formal series [18]In this equality, the initial approximation satisfies the equationthe first approximation the equationThus, in the first approximation the solution to (15) consists of the componentsDirect analysis of the signs of all terms in these formulas allows us to establish the following result.
3.2. -Positive States
For identifying positive components in a state we consider condition (26) with an appropriate modification. More specifically, we construct the matrix by removing the rows and columns with numbers from the matrix We perform the same procedure for the vector and denote the resulting truncated vector by . The existence conditions of a -state are also provided by Theorem 1, which should be formulated for the components of the state vector with numbers
4. Stability of Stationary States
Now, we get back to the nonlinear Equation (12), for which there exists a stationary state from one of the above classes. For analyzing its stability, we introduce the deviation
and study the latter’s behavior as
4.1. Stability of Trivial State
For this stationary state, the deviation is , and the equation takes the form
where
We construct the transition matrix [19]
Since the matrix is diagonal with constant elements, the transition matrix is bounded by norm:
where and
Consider the integral equation that is equivalent to (28):
Differentiating this equality, we easily establish that the nonnegative variable is the solution to the nonlinear differential equation
The convergence holds if the right-hand side of this equation is negative:
Because is a nonnegative variable, . Since is the maximum component of the vector , all its components must satisfy the condition
Hence, the connectivity index is
Theorem 2.
Suppose that for all the values and are simultaneously positive or simultaneously negative. Then there does not exist a value that would satisfy at least one of the inequalities of system (39), and hence the trivial state is unstable.
Corollary 1.
If for all the values and have different signs, then for the connectivity indices the trivial state is stable.
4.2. Stability of Stationary States
The differential equation in the deviation from a stationary state of the class has the form
where the elements of the matrix are given by (13) and
First of all, consider the case in which the connectivity index is . In accordance with (13), (14), (17) and (18), we obtain
As a result, Equation (40) is transformed into
Theorem 3.
Suppose for all the variables and have different signs. Then the state is asymptotically stable in the domain of initial deviations .
The proof is straightforward: under the above hypotheses, the right-hand sides of Equation (43) take negative values in the domain
Consider the case in which . We revert to Equation (40) for and adopt the approximate formula (22) for the stationary state .
Let the matrix in Equation (40) be Hurwitz stable, i.e.,
and also let the matrix have a finite norm .
We introduce the transition matrix
Like before, the transition matrix is bounded by norm:
Using the transition matrix (45), we pass to the integral equation that is equivalent to the differential Equation (40):
The following bound is valid [20]:
Please note that the variables and are nonnegative. Differentiating the expression of yields
Due to (48), we have the differential inequality
In accordance with the theorem on differential inequalities [20], , where satisfies the differential equation
The right-hand side of this equation is negative if (). For any initial deviations from this range, as .
Actually, we have established the following fact:
Theorem 4.
Suppose that the matrix in Equation (40) is Hurwitz stable and is its maximum negative eigenvalue. Then the state is asymptotically stable in the domain of initial deviations
4.3. Stability of Stationary States
Theorem 4 also applies to the states from the class with the only difference that the vector and the matrices R and D are compiled from the rows of the original matrices with numbers .
5. Equilibria and Stability in Investment Dynamics Models
5.1. Model of Economic System with Investment Exchange
Consider an economic system composed of three subsystems exchanging investments. The state of each subsystem is characterized by its investment-conditioned yield (output in value units) and total investments (the sum of investments per unit time). The investment relations between the subsystems are an important economic indicator of their interaction, which is described by the connectivity index .
The investment balance of the economic system has the form
with the following notations: as the investment flow in own manufacture; as the investment flow from other subsystems into subsystem i; finally, as the investment flow from subsystem i into other subsystems. Denote by the investment flows from subsystem i into subsystem j. Then
Consider a random mechanism of investment flows between subsystems. Let the portions of investments be randomly and independently distributed among subsystems with some prior probabilities Please note that with a prior probability the portions of investments stay within subsystem i. In the aggregate, all portions of investments form the investment flow .
For each subsystem, the admissible investment flow is completely exhausted. Therefore, the probabilities satisfy the constraint
We assume that the portions of investments are distributed rather fast, and hence at each time instant t the dynamics of this process can be considered a sequence of locally stationary states with the entropy [2,21]
subject to upper constraints on an admissible investment flow for each subsystem. By definition, the admissible investment flow depends on the yield of subsystem i. This dependence will be characterized by functions . As is well-known, initial investments are required for the operation of an economic system, which are not connected with yield. At initial stages of system operation, there may be no yield at all. Therefore, the functions have a constant term and also a variable term that linearly depends on yield (in first approximation), i.e.,
Using the functions , we write the corresponding system of constraints on the investment activity of all subsystems as
The entropy operator that maps the space of yields into the space of investment flow matrices is described by the perturbed constrained maximization problem of entropy (57) on set (59). In view of relations (56), the solution to this problem has the form
Please note that the own investment flows in (54) are given by
The total investment flow makes up
where
Now, consider the phenomenology of yield dynamics, taking into account that this variable is nonnegative. A change in yield occurs under the influence of two oppositely directed processes: the depreciation of yield due to its consumption (accumulation) and the update of yield through investments. To ensure the nonnegativity of yield, for convenience its variability can be interpreted in terms of the relative rate of change In the first approximation, the relative rate of change is proportional to the difference in the aging rates, due to depreciation and update, through investments. Assuming that each of the listed components of the rate of change is in turn proportional to the yield with a coefficient and also to the total investment flow with a coefficient , we can write the balance relation
Substituting the total investments expression (62) into this relation, we obtain the following system of nonlinear differential equations describing yield dynamics in the economic system composed of three interacting subsystems:
Suppose that the total investments are linearly connected with yield (58). In this case, the above system of nonlinear differential equations takes the form
Here the vector c consists of the components
and the elements of the matrix are given by
System (66) with positive initial conditions (nonzero initial yield) has nonnegative solutions.
5.2. Model Parameters
These parameters are an illustration of the PDSEO analysis. The yields produced in each subsystem are depreciated with specific rates and . All yields are measured in
The random exchange of investments is described by the prior probability matrix
The parameters of the functions are presented in Table 1.
Table 1.
Parameters of functions .
5.3. Analysis of Stationary States: Existence and Stability
Of economic interest are the states in which the yields in all subsystems are positive. In economic literature, such states are called full profitability states. The dependence of full profitability states and their stability on the connectivity index is illustrated in Table 2. Clearly, such states exist and are stable only for the values For they do not exist. The following notations are adopted in this table: as the stability domain (53); as the stability indicator, + for stable and − for unstable; as the maximum eigenvalue.
Table 2.
Full profitability states.
The dependence of the stationary yields of different subsystems on the connectivity index () and also the stability domains () are shown in Figure 2. Please note that these states exist for and are stable up to .
Figure 2.
Full profitability states.
Now, consider -profitability states (). There may exist three states from this class, namely
: ;
: ;
: ;
The dependence of -profitability states on the connectivity index is illustrated in Table 3, Table 4 and Table 5.
Table 3.
The -profitability states.
Table 4.
The -profitability states.
Table 5.
The -profitability states.
From these tables it follows that the -profitability states exist for all values of the connectivity indices, but they are stable only for ; the -profitability states exist for , but are unstable; the -profitability states exist for
The last class of states consists of -profitability states.
The dependence of -profitability states on the connectivity index is illustrated in Table 6.
Table 6.
The -profitability states.
From Table 6 it can be observed that the 1-profitability states exist for the connectivity index but sufficient stability conditions for them are not satisfied.
The dependence of -profitability states on the connectivity index is illustrated in Table 7.
Table 7.
The -profitability states.
From Table 7 it can be observed that the 2-profitability states exist for all values of the connectivity index but sufficient stability conditions for them are not satisfied.
The dependence of -profitability states on the connectivity index is illustrated in Table 8.
Table 8.
The -profitability states.
From Table 8 it can be observed that the 3-profitability states exist for all values of the connectivity index but sufficient stability conditions for them are not satisfied.
Thus, the complete range of the connectivity index can be divided into the following subintervals:
- on which all types of stationary states exist, but only full profitability states are stable;
- on which all types of stationary states exist, except for the -profitability ones; full and -profitability states are stable;
- on which all types of stationary states exist, except for the - and -profitability ones; full and -profitability states are stable;
- on which full-, -, - and -profitability states exist; full and -profitability states are stable.
6. Discussion and Future Work
The proposed method for the analysis of stationary states is based on an approximate solution of the stationary equations, which is constructed using a formal power series with respect to the connectivity parameter . The first order approximation is used. It would be useful to study higher-order approximations, which would clarify the obtained conditions for the existence of positive stationary states.
The PDESO mathematical model contains the simplest Boltzmann entropy operator whose mathematical model taking into account the interval constraints on the variables transforms into the Fermi information entropy maximization problem.
However, in many applied problems in the above areas, mathematical models of PDSEO arise with equalities and inequalities conditions, which have more diverse dynamic properties, namely periodic, non-periodic modes and chaotic attractors.
7. Conclusions
A mathematical model of a positive dynamical system with an entropy operator was formed, focused on studying the influence of the entropy operator on the dynamic properties of the system. A classification of positive stationary states is given and the conditions for their existence are obtained. A theorem on the instability of the zero stationary state is proved. Using the method of differential Bellman inequalities, stability conditions “in large” of positive stationary states are obtained. For the model of the economic system of stochastic investment exchange, the concept of positive profitability conditions is introduced and the conditions for their existence and stability are obtained.
The results obtained can serve as the basis for the study of PDSEO with other classes of entropy operators, for example, the Fermi-entropy operator.
Funding
This research received no external funding.
Conflicts of Interest
The author declares no conflicts of interest.
References
- Wilson, A.G. Entropy in Urban and Regional Modelling; Pion Ltd.: London, UK, 1970. [Google Scholar]
- Popkov, Y.S. Teoriya Makrosistem. Ravnovesnye Modeli; (Theory of Macrosystems. Equilibrium Models); URSS: Moscow, Russia, 1999. [Google Scholar]
- Herman, G.T. Image Reconstruction from Projections: The Fundamentals of Computerized Tomography; Academic Press: New York, NY, USA, 1980. [Google Scholar]
- Censor, Y.; Segmon, J. On Block-Iterative Entropy Optimization. J. Inf. Optim. Sci. 1987, 8, 275–291. [Google Scholar]
- Burne, C.L. Block-iterative Method for Image Reconstruction from Projections. IEEE Trans. Img. Proc. 1996, 5, 792–794. [Google Scholar] [CrossRef] [PubMed]
- Popkov, Y.S. Mathematical Demoeconomy: Integrating Demographic and Economic Approaches; De Gruiter GmbH: Berlin, Germany, 2014. [Google Scholar]
- Popkov, Y.S.; Popkov, A.Y.; Dubnov, Y.A. Randomizirovannoe Mashinnoe Obuchenie; (Randomized Machine Learning); LENAND: Moscow, Russia, 2019. [Google Scholar]
- Popkov, Y.S.; Ryazantsev, A.N. Spatio-Functional Models of Demographic Processes; UN Fund for Population Activity: New York, NY, USA, 1980; Preprint. [Google Scholar]
- Popkov, Y.S.; Shvetsov, V.I. A Principle of Local Equilibrium in the Regional Dynamic Models. Math. Model. 1990, 2, 40–50. [Google Scholar]
- Wilson, A.G. Catastrophe Theory and Bifurcations. Application to Urban and Regional Systems; Croom Helm: London, UK, 1981. [Google Scholar]
- Popkov, Y.S.; Shvetsov, V.I.; Weidlich, W. Settlement Formation Models with Entropy Operator. Ann. Reg. Sci. 1998, 32, 267–294. [Google Scholar] [CrossRef]
- Fan, Y.; Guo, R.; He, Z.; Li, M.; He, B.; Yang, H.; Wen, N. Spatio-temporal Pattern of Urban System Network in the Huaihe River Basin Based on Entropy Theory. Entropy 2019, 21, 20. [Google Scholar] [CrossRef]
- Popkov, Y.S.; Rublev, M.V. Dynamic Procedures of Image Reconstruction from Projections (Computer Tomography). Autom. Remote Control 2006, 67, 233–241. [Google Scholar] [CrossRef]
- Popkov, Y.S. Theory of Dynamic Entropy-operator Systems and Its Applications. Autom. Remote Control 2006, 67, 900–926. [Google Scholar] [CrossRef]
- Popkov, A.Y.; Popkov, Y.S.; Van Wissen, L. Positive Dynamic Systems with Entropy Operator: Application to Labour Market Modelling. EJOR 2005, 164, 811–828. [Google Scholar] [CrossRef]
- Popkov, Y.S. Upper Bound Design for Lipschitz Constant of the F(ν,q)-Entropy Operator. Mathematics 2018, 6, 73. [Google Scholar] [CrossRef]
- Popkov, Y.S. Method of Linear Majorant in the Theory of Monotonic Entropy Operators. Dokl. Math. 2018, 97, 277–278. [Google Scholar] [CrossRef]
- Krasnosel’skii, M.A.; Vainikko, G.M.; Zabreyko, R.P.; Ruticki, Y.B.; Stet’senko, V.Y. Approximate Solution of Operator Equations; Springer: Dordrecht, The Netherlands, 1972; p. 496. [Google Scholar]
- Tikhonov, A.N.; Vasil’eva, A.B.; Sveshnikov, A.G. Differentsial’nye Uravneniya; (Differential Equations); Fizmatlit: Moscow, Russia, 2005. [Google Scholar]
- Beckenbach, E.F.; Bellman, R. Inequalities; Springer: Berlin/Heidelberg, Germany, 1961. [Google Scholar]
- Puu, T. Nonlinear Economic Dynamics; Springer: Berlin/Heidelberg, Germany, 1997. [Google Scholar]
© 2020 by the author. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).