Article Entropy Concept for Paramacrosystems with Complex States

Consideration is given to macrosystems called paramacrosystems with states of finite capacity and distinguishable and undistinguishable elements with stochastic behavior. The paramacrosystems fill a gap between Fermi and Einstein macrosystems. Using the method of the generating functions, we have obtained expressions for probabilistic characteristics (distribution of the macrostate probabilities, physical and information entropies) of the paramacrosystems. The cases with equal and unequal prior probabilities for elements to occupy the states with finite capacities are considered. The unequal prior probabilities influence the morphological properties of the entropy functions and the functions of the macrostate probabilities, transforming them in the multimodal functions. The examples of the paramacrosystems with two-modal functions of the entropy and distribution of the macrostate probabilities are presented. The variation principle does not work for such cases.


Introduction
Entropy maximization as the classical variational principle of the statistical physics is an effective tool for modeling and solving a lot of applied problems.There are many definitions of "entropy" functions [1].Part of them is connected with characterization of the macrosystems [2].They are the systems which consist of a lot of number elements with stochastic behavior but theirs holistic behavior is quasi-deterministic one.
For the first time this approach has been formulated in physics where the terms "microlevel, macrolevel" and "microstate, macrostate" appeared.Then it came into other scientific disciplines.Gradually, it became a tool for theoretic and experimental research.The macrosystems theory is based on this approach.
One of its branches is connected with the study of equilibria in macrosystems with indistinguishable elements, which are distributed in a random way among Fermi-, or Einstein-, or Boltzmann-states.For Fermi-macrosystems, only one element can be in each state, and for Einstein-macrosystems, any number of elements can be in each state.Boltzmann-macrosystems are considered as asymptotics of the first two classes of macrosystems, namely, when the mean number of elements in the the subsets of close states is small.The above phenomenology of states can be interpreted as a statistic by Fermi, Einstein, and Boltzmann, respectively.
However, the question arises as to how the statistics are arranged in macrosystems, the states in which can take 2, 3, . . ., s < ∞ elements, i.e., the states can have capacities s = {s 1 , . . ., s m }, where m is the number of the subsets and s i is the number of elements that can occupy the i-th subset.These statistics occupy the interval between the Fermi-and the Einstein-statistics and they are called parastatistics of the order s [3,4].In the terms of the order, the Fermi-statistics is the parastatistics of the order 1, and the Einstein-statistics is the parastatistics of the order ∞.
We shall identify the macrosystems whose states are characterized by parastatistics of the order s as paramacrosystems of the order s [5].The problems of existing, uniqueness (or non-uniqueness) and identification of the equilibrium macrostates remain burning ones for paramacrosystems.In addition, these problems concern possibility to apply the variation principle of entropy maximization.They are not only cognitive but pragmatic, since a lot of applied systems related to urban and regional planning, demo-economic prediction, routing in computer network, and etc., have "parastatistical" properties.
As microlevel of a paramacrosystem consists of elements with stochastic behavior, the macrostates are also random.Identification of macrostates, selection and study of equilibrium macrostate are based on forming of probabilistic characteristics of paramacrosystems (probability distribution or entropy functions), investigation of their morphological properties, and declaration of the variation principle.
The classical variation principle of statistical physics enunciates the uniqueness of the realized equilibria with entropy maximum.It is true for linear world or not so far from equilibrium state (also in the framework of the linear hypothesis).But the real world is nonlinear.The entropy function can have several maxima.Realization of macrostate depends on a dynamics of the distributed process and domain of attraction of any maximum of the entropy function.
Let us remark that the macrosystem theory is based on the phenomenological scheme in which the elements and the states are indistinguishable.However there are many interesting applied problems when the properties of the elements and the states are more various.
Our contribution to this theory consists of two parts.First, it is the method of forming the probability characteristics of the paramacrosystem with both the equiprobable microstates and the different combination of the distinguishable and indistinguishable elements and states.
The second contribution is connected with accounting of prior information (when the prior probabilities of microstates are not equal) by forming the probability characteristics of the paramacrosystem.
The probability characteristics (probability distribution and entropy functions) give the important information about the realized macrostate, i.e., the information about the number of the function's maxima, and their morphological properties, namely, their "sharpness".If the maximum is unique and "sharp", then we could hope that the macrostate corresponding to such maximum is realized.The Fermi-, Einstein-, Boltzmann-macrosystems have these properties.
However, some types of the paramacrosystems have the entropy function and the probability distribution functions with non-unique maximum.Such situations arise when prior probabilities are not equiprobable.We will demonstrate some examples.

Phenomenology and Classification of Paramacrosystems
Description of the paramacrosystem includes descriptions of the elements, the states and the set of states S. First of all, let us consider elements and states.Assume that there are two functionals, one of which is a generalized characteristics of the element and the other is a generalized characteristics of the state.If this functional takes on similar values for all elements, then the elements are indistinguishable (I E ).If these values are strictly different, then the elements are distinguishable (D E ).Analogical procedure can be applied for selection of the states.We will have the indistinguishable states (I S ) and the distinguishable states (D S ).
Thereby, we obtain four classes of paramacrosystems: • D E D S is a paramacrosystem with distinguishable elements and states; • I E D S is a paramacrosystem with indistinguishable elements and distinguishable states; • D E I S is a paramacrosystem with distinguishable elements and indistinguishable states; • I E I S is a paramacrosystem with indistinguishable elements and states.
The classification above may be illustrated by the following examples with a random behavior of elements.Let us consider a distribution of specialists over vacancies in the labor market.In this case, the elements are the specialists and the states are vacancies.The functional for the elements is the level of qualification.The functional for the states is the salary.If the functionals for elements and states are different, then we have a model of D E D S -paramacrosystem.
Let us imagine that the specialists have the same level of qualification, and the salaries of the vacancies are different.In this case we have a model of I E D S -paramacrosystem.
A reversed situation occurs, when specialists of different level have to be distributed over equal vacancies, which corresponds to a model of D E I S -paramacrosystem.
Finally, there may be a situation, when specialists of equal level are distributed over identical vacancies, i.e., according to a model I E I S -paramacrosystem.Now consider the set S which is a union of disjoin subsets S 1 , . . ., S m with G 1 , . . ., G m states.The states have capacities s 1 , . . ., s m .If all capacities s 1 = • • • = s m = 1, we have a macrosystem with Fermi-states.If all capacities s 1 = • • • = s m = ∞, we have a macrosystem with Einstein-states.
The macrostates are described by vectors N = {N 1 , . . ., N m } ∈ N , where N i is a number of elements occupying the subset S i and N is the set of feasible macrostates.From this definition, it follows that elements and states are faceless in it.On the other hand, its characteristics are made of some union of microstates, which are defined by a complete microscopic description of elements and states.
The microstate is characterized by the tuple X, whose components are indexed elements, occupied a state in the set S i .The set M of microstates contains Z various microstates X, each of which is implemented with a probability w(X).
Let, for each subset S i , there exist a prior probability a i ∈ (0, 1] of the entry into any of the G i s i states belonging to it.All a i are not equal to one another.Because it is assumed that the elements are distributed by states randomly and independently of one another, the probability of the fact that in the subset S i containing the G i s i states the N i states will be occupied and G i s i − N i states will be free, is equal to As the subsets S 1 , . . ., S m do not intersect, the probability of the microstate X is defined by the following equality: This function display the following property: Introduce two functions: We will present the function w(X) (1) in the form In the set M of microsets there exists a subset M N of microstates X with prior probabilities w(X), which generate the macrostate N. Denote the number of this microstates in the subset M N by the Z(N).
In view of the independence of microstates, the probability P (N) of the macrostate N for unequal-probable microstates takes the form: where the normalization constant is Here In this case, the probability P (N) of the macrostate N for equal-probable microstates takes the form: where the normalization constant is We will use also the physical entropy defined with accurate multiplicative constant: This implies that the problems of forming probabilistic characteristics of the paramacrosystems are reduced to defining the number Z(N).

Probability Characteristics of Paramacrosystems of Order "s" with Equal-Probable Microstates
We shall assume the distribution of elements is performed in two stages: first, the elements are distributed over the subsets S 1 , . . ., S m ; and then, over the states within the subsets.
Following this distribution scheme, the number of microstates Z(N) generating the macrostate N is defined by the product of the numbers of elements' allocations at the first Z 1 (N) and second Z 2 (N) stages:

D E D S -Paramacrosystem
We have paramacrosystem with distinguishable elements and states.So, the function Z 1 (N) defines the number of allocations for Y different elements in the subsets S 1 , . . ., S m with occupation numbers N 1 , . . ., N m : The states in each subset S i with occupation number N i are different; their number is G i and capacity is s i .Denote W DD (N i , G i , s i ) as a number of allocations for N i different elements in G i states with capacity s i .As states are independent, then the function Z 2 (N ) takes them form: We shall define the functions W DD (N i , G i , s i ) using the method of generating functions [6,7].Since the elements and states are different, the exponential generating function for permutations is used: This equality determines values of the function W DD (N i , G i , s i ) numerically.Examples of its computation are shown in the first column of Tables 1 and 2.
Table 1.Examples of the allocation functions for   We can obtain analytic expressions for Fermi-and Eistein-states: • the capacity of the states is • the capacity of the states is infinite The last relation corresponds to the number of permutations N i of elements among G i boxes with unbounded returns [2].Thereby, from (10) we obtain that and the distribution of the macrostates probabilities takes the form: According to definition (9) the physical entropy of the D E D S -paramacrosystem is where .
= implies an equality with accurate additive constant.We shall write expressions for the distribution of probabilities and entropies of the macrostates for Fermi-, Einstein-, Boltzmann-states.Let us consider a macrosystem with Fermi-states According to (17) and ( 14) the distribution of macrostates probabilities will have the following form: Physical entropy will be Assuming that the general number of elements in the F-macrosystem is sufficiently great, we can use the Stirling approximation of the factorial function.Then from (20) we obtain the expression for information entropy (Fermi-entropy) [8]: Let us consider the paramacrosystems with Einstein-states ( ).The distribution of macrostates probabilities is defined by the following equality: Physical entropy is The information entropy is constructed by the Sterling-approximation of the factorial function: Let us consider macrosystems with Boltzmann-states.To obtain expressions for the distribution of macrostates probabilities, the limiting process in the corresponding expressions for Fermi-and Einstein-macrosystems is used.
For example, at Then the function distribution of macrostates probabilities for Boltzmann-states takes on the following form: Physical entropy is After application the Sterling-approximation we obtain the generalized information entropy by Boltzmann-Shannon [8]:

I E D S -Paramacrosystem
In this paramacrosystem, a microstate is specified by the numbers of elements N j i that occupy the state j in the subset S i .So, a microstate The vector of macrostate N consists of the components N i = G i j=1 N j i .Hence, Z(N) is a number of microstates, i.e., the vectors x generating the occupation numbers N 1 , . . ., N m .
As the subsets S i are independent: where W ID (N i , G i , s i ) is a number of locations of N i indistinguishable elements in G i distinguishable states with capacities s i .The values of the function W I E D S (N i , G i , s i ) are defined by an ordinary generating function [7] in the following form: This equality allows obtaining the analytical expression for the function W ID (N i , G i , s i ), which takes the form: Tables 1 and 2 contain the values of the function W ID (N i , G i , s i ) for G i = 7, s i = 1 and G i = 7, s i = 3 (second columns of the indicated tables).
As the subsets are independent, the distribution of the macrostates probabilities is equal to; For I E D S -paramacrosystems, the physical entropy has the form Let us consider the special cases of the expressions obtained.At s i = 1, we obtain the distribution of macrostates probabilities (19) and the entropy functions (20) and (21) for Fermi-states.
If s i → ∞, then we obtain the well-known expressions for macrosystem with Einstein-states: -the distribution of the macrostates probabilities -the physical entropy -the information entropy When N i G i , we obtain Boltzmann distribution (26) from (35).The macrosystems of the ID-class with s i = 1 and s i = ∞ are considered in [8].

D E I S -Paramacrosystem
The DI-microstates can be viewed as classes of equivalency in the set of the DD-microstates.Those DD-microstates are equivalent such that one can be transferred into another by means of permutations of states within the subset S i .
By analogy with the D E D S -paramacrosystems, the function Z(N) defining the number of DI-microstates generating the macrostate N is determined by the following expression: Here the function W DI (N i , G i , s i ) defines the number of locations of N i different elements in G i in indistinguishable states with the capacity s i .Using the technique stated in [7], we obtain a generating function for W DI (N i , G i , s i ) from the equality Examples of the functions W DI (N i , G i , s i ) for G i = 7, s i = 2 and G i = 7, s i = 3 are shown in the third column of Tables 1 and 2.
For the DI-paramacrosystem, the distribution of the macrostates probabilities can be represented in the form The physical entropy takes the form Let us consider DI-macrosystem with Fermi-states.Assuming in (39) that s i = 1, we obtain: It should be noted that these expressions do not derive from (14) that defines the functions W DD (N i , G i , s i ) and W ID (N i , G i , s i ) for macrosystems with Fermi-states.The distinction is that the function W DI (N i , G i , s i ) does not depend on N i and G i .Substituting (42) into (40), we obtain the expression for the distribution of the macrostate probabilities of the DI-macrosystems with Fermi-states: It is classical polynomial distribution at equally possible outcomes of independent tests.The physical entropy for this class of macrosystems has the form: Using the Stirling approximation, we obtain the expression for the information entropy: Let us now consider DI-macrosystem with Einstein-states (s i > N i ).In this case we can represent the function W DI (N i , G i , s i ) (39) at analytical form: where are Stirling numbers of the second kind.So, the distribution of the macrostate probabilities for Einstein-macrosystem takes the form: The physical entropy is

I E I S -Paramacrosystem
Both elements and states are indistinguishable in II-paramacrosystems.Therefore, II-microstates can be viewed as classes of equivalency of ID-microstates.We consider the equivalent ID-microstates where one can be transformed into another by means of permutations within the subset S i .
Then we have The problem of finding the numbers W II (N i , G i , s i ) is related to finding the number of partitions of the number N i .The partition of the number N i is its representation in the form of a sum of unordered set of integers m i j , i.e., The disorder implies in this case that those sets {m i j } are considered different and cannot be transferred from one into another be means of permutations of the numbers m i j .The function W II (N i , G i , s i ) specifies a number of partitions of the number N i such that the number of parts in them does not exceed G i and the size of the part is not greater than s i .According to [7], the generating function for W II (N i , G i , s i ) has the form: Examples of the functions W II (N i , G i , s i ) for G i = 7, s i = 2 and G i = 7, s i = 3 are shown in the fourth column of Tables 1 and 2.
The distribution of the macrostate probabilities and the physical entropy have the forms: Let us consider the case of Fermi-states (s i = 1).We obtain: We can see that all macrostates are equally possible.Therefore, there no equilibrium macrostate in this case.

Probability Characteristics of Paramacrosystems of Order "s" with Unequal-Probable Microstates
A case when the microstates have unequal probabilities is very wide-spread at the applied problems.For instance, the behaviour of the users in the transportation modeling is described by the unequal prior probabilities.Migratory decisions of the individuals are characterized by the different prior probabilities.At last, the prior images in a problem of the computer tomography are described in the terms of the unequal prior probabilities.
Existence of the unequal-probable microstates significantly influences the morphological properties of the macrostate probability characteristics for the paramacrosystems of the order s with D and I elements and states.We will account the unequal-probable microstates following the method from Sections 2 and 3.

D E D S -Paramacrosystem
According to ( 5) and ( 16), the distribution of the macrostates probabilities is where the functions W DD (N i , G i , s i ) are defined by the equalities (13), and the normalization constant These expressions differ from the corresponding expressions ( 16) and ( 17).The multipliers [ϕ(a i )] N i (3) depend on the prior probabilities a i and components of the macrostate's vector N i .Moreover, the definition (57) includes as a normalization not a full number of microstates Z, but a number of microstates Γ DD (Y ) that corresponds to adopted prior probabilities only.
Let us note that values of the Γ DD (Y ) for various values of the Y can be found using the generating function: Consider the special cases of the paramacrosystems of the DD-class, namely, with Fermi-and Einstein-states in the subsets S 1 , . . ., S m .
Let us recall that for the Fermi-states, the s i = 1 and From (56) the distribution of the macrostates probabilities for Fermi-macrosystem takes the form: The physical entropy is The generalized information entropy H F DD (N) [8] is defined by the following expression: Consider the DD-paramacrosystems with Einstein-states, for which the capacities of states are unbounded.So, The distribution of the macrostate probabilities takes the form: where the normalization constant is The physical entropy takes the form: where Using the Stirling's approximation we can obtain the information entropy for the DD-paramacrosystem with Einstein-states: From these formulas we can see that the distribution of the macrostate probabilities and the entropy functions do not depend on the capacities of the states.So, the capacity of states can be any value.

I E D S -Paramacrosystem
According to (14), the distribution of the macrostate probabilities for ID-paramacrosystem acquires the form: where the functions W ID (N i , G i , s i ) are defined by the equalities (32) and For the macrosystem with the Fermi-states, the expression (68) is transformed to the distribution (59).
For the macrosystem with the Einstein-states, we will have: The physical entropy is The generalized information entropy by Einstein takes the form:

D E I S -Paramacrosystem
According to (5), the distribution of the macrostate probabilities is defined by the following equality: where the functions W DI (N i , G i , s i ) are defined by the generating function (39), and Consider the special cases of the function (73).If the DI-paramacrosystem has Fermi-states (s i = 1), then according to (39) W F DI (N) = 1 for N i ≤ G i .The distribution of the macrostate probabilities for the DI-paramacrosystem with Fermi-states takes the form: Let us consider the DI-paramacrosystem with Einstein-states.According to (46) and (47) we will have

I E I S -Paramacrosystem
According to (5) the distribution of the macrostate probabilities takes the form: where the functions W II (N i , G i , s i ) are defined by the generating functions (52).
For the II-paramacrosystem with Fermi-states W II (N i , G i , s i ) = 1, the distribution of the macrostate probabilities is 5. Examples

DD-Paramacrosystem
We consider a subway train consisting of m cars, each of which can accommodate R passengers.The car has two types of places in which passengers can be disposed: the seats and the car floor.The seats and floor are quantified, i.e., there are Q "sitting" and (R − Q) "standing" places.We will assume that the numbers of "sitting" and "standing" places are identical, i.e., R = 2Q.In addition, the "sitting" and "standing" places differ by their location in the car.The passengers are also different.We assume that the passengers are distributed in the car randomly and independently of one another.This distribution N 1 , . . ., N m is also random.

Unequal prior probabilities.
A survey of the transport behavior of passengers shows that the position of a car in the train plays an important role in the choice by the passenger of one or another car.Therefore, it seems to be natural to assign to each car a definite probability a i of the fact that it will be chosen by a passenger and, respectively, the probability (1 − a i ) of the fact that ith car will not be chosen.Now let us describe this object in paramacrosystem terms.In this case, elements are the passengers distinguishable by their characteristics.As to states, we will consider the states of the first type, when a passenger can sit, and the states of the second type, when a passenger can only stand.The ith car is the subset S i of close states.
Thus, there are m subsets S 1 , . . ., S m , each of which contains two different states, i.e., the capacities of the subsets are The states of the first type and of the second type have identical capacities s = Q.
Since the states and elements are distinguishable, and the states have a finite capacity Q > 1, we have the model of the DD-paramacrosystem of the order Q.Its macrostates is specified by the vector N = {N 1 , . . ., N m }, the components of which are the numbers of passengers in appropriate cars.
By way of illustration, we will give a simple numerical example.We consider a train of two cars (m = 2), each of which contains Q = 3 seats and R − Q = 3 standing places.Consequently, G 1 = G 2 = G = 2 and s = 3, R = 6.The total number of passengers that the train can accommodate is equal to 12.The passengers select the first or the second types of places, respectively, in a random way, independently of one another, and with prior probabilities a 1 = 0.4 and a 2 = 0.8.According to (3) the functions ϕ(a 1 ) = 0.67; ϕ(a 2 ) = 4.
Using the definition of the generating function (13), we can represent the function W DD (n, 2, 3) by the following equality: Equating the coefficients at identical degrees t, we can obtain values of the function W DD (n, 2, 3), which are given in Table 3.
Equal prior probabilities.If a i = a, then the distribution of the macrostates probabilities takes the form: where Its values are given in Table 5, and its graphic representation is shown in Figure 2.  As it would be expected, the distribution of the macrostates probabilities proves to be symmetric at equal prior probabilities.Its maximum equals to 0.0801 and corresponds to the macrostate N DD = (2, 2).

ID-Paramacrosystem
Let us consider the object of the first example assuming the passengers are indistinguishable, while the states (places) are distinguishable.
Unequal prior probabilities.All parameters remain the same as those in the preceding example.In this case, the function W ID (n, 2, 3) will be defined by the generating function (31), which at the given parameters will take the form: Values of the function W ID (n, 2, 3) are given in Table 6.
Equal prior probabilities.In this case, the distribution of the macrostates probabilities takes the form: where ID(N 1 , 2, 3)ID(N 2 , 2, 3) (88) Values of the function P ID (N 1 , N 2 ) are listed in Table 8, and its graphic representation is shown in Figure 4.For the paramacrosystem under consideration, the distribution of the macrostates probabilities has the unique maximum equal to 0.062 and the corresponding argument (3, 3).

Conclusions
The equilibrium theory of macrosystems is based on the assumption that their elements can occupy Fermi-states or Einstein-states only and these states are indistinguishable.However, there is quite a

Table 2 .
Examples of the allocation functions for