Socio-Thermodynamics—Evolutionary Potentials in a Population of Hawks and Doves

The socio-thermodynamics of a population of two competing species exhibits strong analogies with the thermodynamics of solutions and alloys of two constituents. In particular we may construct strategy diagrams akin to the phase diagrams of chemical thermodynamics, complete with regions of homogeneous mixing and miscibility gaps.


Introduction
Random thermal motion and forces of interaction compete to determine the behaviour of thermodynamic systems of molecules.The former finds its formal expression in the entropy s, which probabilistically tends to a maximum, and the latter in the energy e, which deterministically tends to a minimum.The relative strength of the entropic and energetic effects is determined by the temperature T, which reflects the strength of the random motion.Thus a thermodynamic system tends to a minimum by making the free energy e-Ts minimal.
Analogous dichotomies of entropic and energetic contributions to the overall comportment may be identified in other fields of study, like economics, ecology, biology and sociology, provided that their models are suitably simplified.In the present paper a sociological analogy is described and exploited.The system is a population of two species of birds, who compete for the same resource.The random element is introduced by the stochastic nature of inheritance between successive generations, while the deterministic element stems from the striving of the birds toward higher gain; this dictates evolutionary changes over the generations.The relative significance of the two traits is determined by the price of the resource.

OPEN ACCESS
The thermodynamic treatment of the population suggests that the species segregate when the price of the resource is high, while they form a homogeneously mixed society for a small price level.There exists a close analogy between the segregation of species into colonies at large price and the separation of constituents of a solution or an alloy into nearly pure phases at small temperatures.
The contest strategy of the birds is adapted from a model of game theory, which was invented by Maynard-Smith and Price [1] in order to show that two species can coexist in a population, even when they compete for the same resource (see also Straffin [2] and Dawkins [3]).I have used that game before in [4][5][6].However, the present work differs from my previous efforts in that here I adopt the statistical definition of entropy rather than the entropy of phenomenological thermodynamics based on the second law.The present version has the advantage of simplicity and enhanced plausibility.The suitability and effectiveness of phase diagrams for the segregation and integration of human populations donsisting of different ethnic or religious groups has previously been pointed out by Mimkes [7].

Evolutionary Entropic Drift toward an Equi-Distribution
We consider a population of N birds, N H = z H N hawks and N D = (1 − z H )N doves.Generally the distribution {N H ,N D } changes from one generation to the next one, and we assume a priori that-by the stochastic character of inheritance-every one of the realizations of the new distribution is equally probable [8].The maximum number of realizations occurs with the distribution {N H ,N D } = {½,½} so that statistically it is inevitable that any given initial distribution will be shifted toward that equi-distribution.The shift occurs unless, of course, there is a bias for a particular value of z H other than ½.The shift may be expressed as the tendency of the population entropy S to grow [9]: The growth ends when the maximum of S is reached at z H = ½.Figure 1a provides a plot of this function.
Analysis shows that the slopes of the function at z H = 0 and at z H = 1 are infinite.Therefore the probability for a shift away from a pure population of either doves or hawks is overwhelming.On the other hand, the equi-distribution z H = ½ is probabilistically unchanged.Thus we may say that the population is pushed toward the equi-distribution with an entropic driving force which we define as: where s = S/N is the specific population entropy.

Gain-Driven Drift toward an Evolutionarily Stable Distribution
However, a bias may exist for a hawk fraction different from z H = ½, if hawks and doves compete for the same resource.We consider a particularly simple contest strategy which, in view of a subsequent alternative, we call strategy A.

Strategy A
If two hawks meet over the resource, they fight until one is injured.The winner gains the value τ, while the loser, being injured, needs time for healing his wounds.Let that time be such that the hawk must buy two resources, worth 2τ, to feed himself during convalescence.Two doves do not fight; they merely engage in a symbolic conflict, posturing and threatening, but not actually fighting.One of them will eventually win the resource-always with the value τ-but on average both lose time such that after every dove-dove encounter they need to catch up by buying part of a resource, worth 0.2τ.When a hawk meets a dove, the dove walks away, while the hawk wins the resource; there is no injury, nor is any time lost.
Assuming that winning and losing the fights or the posturing game is equally probable, we conclude that the elementary expectation values for the gain per encounter are given by the arithmetic mean values of the gains in winning and losing, i.e.,   0.5 2 0.5 for the four possible encounters HH,HD,DH, and DD [10].The price is out of control for the population, but it has to adjust to it.

Thus the gain expectations
The specific gain expectation e A per bird-hawk or dove-and per encounter reads: (1 ) This gain is graphically represented by a concave parabola as a function of z H with a maximum at z H max = 1/6, see Figure 1b.
We assume that a population profits evolutionarily from a higher gain, so that-in the course of evolution, i.e., over many generations-the distribution tends to the value z H max , because, in a manner of speaking, the population with that value of z H is fitter than any other one.We may thus say that there is a gain-driven force toward z H max .It is defined as the increase of the gain with changing z H :

Combined Entropic and Gain Driven Trends
Thus we have identified two evolutionary forces for an adjustment of the hawk fraction z H : A probabilistic entropic one and a deterministic gain-driven one.Obviously in the interval ¹/ 6 < z H < ½ the forces point into different directions.In general both forces are active, and we speak of an evolutionary equilibrium when they are equal in size and opposite to each other: We call p A = e A + s the evolutionary potential and conclude that in equilibrium it has a maximum.
Figure 2 represents the evolutionary potential graphically for several prices τ.The maxima determine the hawk fractions of evolutionary equilibrium.Inspection shows that the equilibrium hawk fraction shifts from 1 / 6 to 1 / 2 for increasing values of τ.
It is useful for a comparison with thermodynamics to make the price explicit in the equilibrium condition by defining a unit gain, i.e., a gain per price unit, viz.:

Thus the equilibrium condition reads:
In terms of A e the evolutionary potential reads p A = A e  + s.

Analogy with Thermodynamics of Mixtures
In thermodynamic language we should consider the population of hawks and doves with hawk fraction z H as a binary mixture of two constituents with the mol fraction X of constituent 1 (say).The entropy s would be the entropy of mixing of the constituents, while the price τ obviously is reciprocal to the thermodynamic temperature T; we have to set τ = 1/T.The unit gain A e represents the thermodynamic specific energy to within sign, and the potential p A = A e  + s in evolutionary thermodynamics plays the role of the thermodynamic free energy of a binary mixture,-again to within sign.Due to the sign difference the free energy of thermodynamics becomes minimal in equilibrium, while the evolutionary potential A e  + s tends to a maximum.
Thus there is a far-reaching formal analogy between the present consideration of evolution in a population of hawks and doves and thermodynamics of binary mixtures.We proceed to show that the analogy can be expanded when we consider a different contest strategy of the birds and the possibility of segregation of hawks and doves into colonies.

Non-Convex Potentials. Concavification
Evolution is a slow process.It takes several generations to make its effect shown.During times which are short on an evolutionary time scale the hawk fraction in the population is constant and there is no way-in the short run-to increase the evolutionary potential p A = A e  + s, at least not, if strategy A of Section 2.2 is employed by the birds.This is not an interesting case, and therefore we look at an alternative strategy, which is more interesting even without evolution.

Strategy B
The hawks adjust the severity of the fighting-and thus the gravity of an injury-to the prevailing price τ of the resource.If the price is higher than 1, they fight less, so that the mean time of convalescence in case of a defeat is shorter and the value to be bought during convalescence is reduced from 2 τ to 2τ [1 − 0.2(τ − 1)].Likewise the doves adjust the duration of the posturing, so that the payment for lost time is reduced from 0.2 τ to 0.2 τ[1 − 0.3(τ − 1)] But that is not all: To be sure, in strategy B the doves will still not fight when they find themselves competing with a hawk, but they will try to grab the resource and run.Let them be successful 4 out of 10 times.However, if unsuccessful, they risk injury from the enraged hawk and may need a period of recovery at the cost of 2τ[1 + 0.5(τ − 1)] [11].Thus the elementary expectation values for gains under strategy B may be written as: And therefore, by ( 5) the specific gain is given by: 2 0.86 ( 1) (0.72 0.08) (0.06 0.24) Obviously for τ > 1 this function is convex.The entropy is unchanged from the previous case,-a concave function of z H , see Figure 1a-and therefore the graph of the evolutionary potential p B = τ B e + s may result-for a proper value of τ as a plot with variable curvature, see Figure 3a.Once again, if there is no evolution, z H is fixed.There is a single value of p B in that case and the population seems to have no choice: It should be stuck with that value [12].
However, there is an alternative.For a given H z under the convex range of p B (z H ) the population can assume a higher potential than ( ) H p z by forsaking homogeneity.Indeed, let the population segregate into dove-rich and hawk-rich colonies ′ and ″ with H z and H z   respectively, and with as bird fractions in the respective colonies.Obviously, the population must then have the potential: which is the weighed sum of the potentials in the colonies with weighing factors x and 1 − x.This is a function of three variables, viz.x, H z , and H z which, however, are constrained by the condition: (1 ) Since the population strives for a maximal potential, it will effect the segregation in such a way that the function ( , , )   has a maximum.Necessary condition for that to be the case is that the derivatives of the function: ) vanish.λ is the Lagrange multiplier that takes care of the constraint (13).Thus necessary conditions for a maximum may be written as:   We conclude that a population which employs strategy B can segregate into colonies with definite but different hawk fraction and thereby achieve a higher potential than a homogeneously mixed population of hawks and doves.This possibility exists only for potentials with a convex branch.That branch vanishes for the model, if τ is too small, see Figure 3b.We may construct a strategy diagram, in which the area of segregation lies within the curve: That diagram is shown in Figure 3b.We conclude that integration for all values of z H is only possible for small prices.For high prices integration can only happen for values of z H which are either close to 0 or close to 1: The conclusion is that minorities can be integrated.

Thermodynamic Analogy
In thermodynamics of mixtures there is an analogy to the above-described phenomenon of segregation in a population.Indeed, a solution like phenol (C 6 H 5 OH) in water has a miscibility gap, i.e., it decompose into two phases at low temperature which are phenol-rich and water-rich respectively.By the analogy discussed in Section 2.4 high price corresponds to low temperature.Therefore phase diagrams are "upside-down" in comparison with strategy diagrams.In that case the equilibrium mol fractions X of the phases are obtained by convexification of the free energy function rather than concavification of the evolutionary potential.

Intersecting Graphs p A and p B
We continue to consider the population of N hawks and doves.So far we have discussed the case that the birds could adopt only one contest strategy, either A or B. But now we let them choose: They may adopt either strategy depending on which one provides them with a higher value of the evolutionary potential at the extant price level.Therefore we must be interested in the tableau shown in It is obvious that for τ = 1 strategy A will be adopted by the birds, because it provides a higher potential and it does that for all values of z H between 0 and 1.For higher values of τ the graphs of p A (z H ) and p B (z H ) intersect each other so that there is the possibility of concavification which was explained in Section 3.1.For τ = 2, 2.4, and 3.2 there are two common tangents to concave parts of the potential functions, one each for small and large values of z H, , see Figure 4.The states on those tangents represent populations that are segregated in colonies in which the birds employ different strategies.Thus for τ = 2.4 and for z H ≈ 0.1 there will be a colony with z H << 1 which employs strategy B and another colony with z H ≈ 0.2 which employs strategy A. On the other hand, again for τ = 2.4, but for z H ≈ 0.7 there will be a hawk-rich colony with z H ≈ 1 employing strategy B and another colony with strategy A which has z H ≈ 0.6.Eventually, for τ > 3.6 or thereabout the colonies will either be dove-rich or hawk-rich and both types employ strategy B. That is the high-price strategy.
Note that the graph max[p A ,p B ] is non-concave even for values of τ for which both p A and p B are concave.We may therefore use concavification of that graph as shown in Figure 4a-e and then construct a strategy diagram for the population by projecting the common tangents onto the appropriate horizontal lines in a (τ, z H )-diagram, and by connecting the end points of those projections.In this manner we obtain Figure 4f in which six regions may be identified:

Analogy with Thermodynamics of Solutions and Alloys
Chemical engineers and metallurgists are familiar with phase diagrams in thermodynamics of solutions and alloys that look much like the strategy diagram of Figure 4f, e.g., the phase diagram for a (Pb,Sb)-alloy, or a (Pb,Sn)-alloy; except that phase diagrams are (temperatureT,mol-fractionX)diagrams so that they are upside down compared to the (priceτ,hawk-fractionz H )-diagram of the figure.This inversion is due to the fact that the price τ corresponds to the reciprocal of the temperature T, see Section 2.4.
The terms eutectic line and eutectic point used above come from metallurgy.Eutectic essentially means easy-melting and the eutectic point is the state (T,X) for which melting of an alloy is achieved at the lowest temperature.In the analogy to populations the eutectic line is the lower boundary of the region of segregation,-or miscibility gap.And the eutectic point marks the state (τ, z H ) where integration can be maintained up to the highest price level.
11. τ = 1 is a reference price in which both strategies coincide, except for the grab-and-run feature of strategy B. Penalties for either fighting or posturing should never turn into rewards for whatever permissible value of τ.This condition imposes an upper bound on τ: 0 < τ< 4.33.That constraint could be avoided, if we allowed non-linear penalty reductions which we do not do for the sake of simplicity.12.If there were evolution, the phase fraction would shift to the abscissa of the maximum of p B over subsequent generations.13.It is fortunate that (14) lends itself to such a simple graphical interpretation, since an analytic solution is impossible because of the ln-terms in the entropic part of p B (z H ). Actually, however, in Figure 3 the influence of entropy is arbitrarily enhanced by a factor 2, because otherwise the concave parts of p B (z H ) would not be sufficiently well pronounced to make the construction clear.
© 2012 by the authors; licensee MDPI, Basel, Switzerland.This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution license (http://creativecommons.org/licenses/by/3.0/).

Figure 1 .
Figure 1.(a) Specific entropy S s N  as function of z H ; (b) Specific gain expectation as function of z H for τ = 2.
z   is a linear function of H z .In Figure3athe position of the colonies are marked by open rectangles and the position of the segregated population as a whole is marked by a black rectangle.The above-described graphical method for the determination of H z and H z may be called the concavification of the graph of the potential function p B (z H ).

Figure 3 .
Figure 3. (a) Evolutionary potential for strategy B; (b) Strategy diagram with areas of integration and segregation.

Figure 4 .
The individual graphs shown in Figure 4a-e represent evolutionary potentials as functions of z H appropriate to different values of τ.The dashed ones refer to Strategy A, while the solid ones refer to Strategy B.

I
. Homogeneous population employing Strategy A for all hawk fractions.II.Segregated population with two types of colonies: Dove-rich colonies employing Strategy B and colonies with moderate hawk fractions and Strategy A. III.Segregated population with two types of colonies: Hawk-rich ones with Strategy B and colonies with moderate hawk fractions and Strategy A. IV.Segregated population with hawk-rich and dove-rich colonies both employing Strategy B. V. Homogeneous dove-rich populations with Strategy B. (This region is not visible in Figure 4f, because on the scale of the figure it lies virtually on the τ-axis.)VI.Homogeneous hawk-rich populations with Strategy B. The horizontal line separating the regions IV from II and III is called the eutectic line and the point E, in which three types of colonies can exist, is called the eutectic point.Both namings are in analogy with thermodynamics of alloys, see below.
the points of contact of the common tangent to the concave parts of p B (z H ), see Figure3a[13].The colonial fractions of birds and the potential of the two-colony population follow from the constraint (13) and from (12).They read: