- freely available
- re-usable

*Games*
**2011**,
*2*(3),
355-364;
doi:10.3390/g2030355

^{1}

^{2}

^{3}

Published: 14 September 2011

## Abstract

**:**The replicator-mutator dynamics is a set of differential equations frequently used in biological and socioeconomic contexts to model evolutionary processes subject to mutation, error or experimentation. The replicator-mutator dynamics generalizes the widely used replicator dynamics, which appears in this framework as the extreme case where replication is perfectly precise. This paper studies the influence of strictly dominated strategies on the location of the rest points of the replicator-mutator dynamics, at the limit where the mutation terms become arbitrarily small. It can be proved that such limit rest points for small mutation are Nash equilibria, so strictly dominated strategies do not occur at limit stationary points. However, we show through a simple case how strictly dominated strategies can have an influence on the location of the limit rest points for small mutation. Consequently, the characterization of the limit rest points of the replicator-mutator dynamics cannot in general proceed safely by readily eliminating strictly dominated strategies.

## 1. Introduction

The continuous time selection mutation equation [1], usually called Replicator-Mutator Dynamics (RMD) [2], is a set of differential equations frequently used in biological and socioeconomic contexts to model evolutionary processes subject to mutation or experimentation. Among other applications, the replicator-mutator has been used to study molecular reactions [3], the evolution of viral variants [4], the evolution of cooperation [5], the evolution of language [6–8], signaling games [9,10] and, with some modifications over the standard version, carcinogenesis and tumor progression [11]. Formally, the replicator-mutator dynamics reads:

Here x_{i} represents the fraction of individuals in a large (infinite) population using pure strategy i (i = 1,…, n) and μ_{ij} is the probability that strategy i generates an offspring using strategy j (therefore, Σ_{j} μ_{ij} =1). The payoff or fitness matrix is A = [a_{ij}], where a_{ij} ≥ 0 is the payoff that an i-strategist obtains in an interaction with a j-strategist. The fitness of strategy i is f_{i} = Σ_{j} x_{j} a_{ij} and the average fitness is f̄ = Σ_{i} x_{i}f_{i}.

In the replicator-mutator dynamics, the unit simplex Δ_{n} = {(x_{1},…,x_{n})∈ℜ^{n}: Σ_{i} x_{i} = 1 and x_{i} ≥ 0 }is forward invariant: if the state vector x = (x_{1},…,x_{n}) starts in the unit simplex, it remains there; existence and uniqueness of trajectories can be proved by the Picard-Lindelöf theorem; and the existence of at least one stationary point (in the interior of the simplex if μ_{ij} > 0) can be proved using Brouwer's fixed point theorem. Results for the extension of the replicator-mutator to an infinite number of possibly mixed strategies are provided by Bomze and Bürger [12].

For the particular case of symmetric payoff matrices (which corresponds to the standard population-genetic model of natural selection on a large diploid population) and mutation rates μ_{ji} = μ_{i} for i ≠ j (an assumption introduced by Kingman [13] in his “house of cards” model), a global Lyapunov function can be found which excludes cyclic behavior and guarantees that all orbits converge to the set of fixed points [1,9]. However, this “nice” behavior is not the general case [1,3,14].

A well-known particular instance of the Replicator-Mutator Dynamics is the widely-used replicator dynamics. The Replicator Dynamics (RD) appears in this framework as the extreme case where replication is perfectly precise, i.e., where i-strategists can only give birth to i-strategists, leaving no room for mutation, error or experimentation. A crucial point in this regard is to note the difference between an evolutionary process without mutation (i.e., the RD or, equivalently, the RMD with μ_{ij} = 0 for i ≠ j) and an evolutionary process subject to arbitrarily rare mutations, which can be studied using the limit of the RMD when μ_{ij} → 0 for i ≠ j. Any property of the RD that does not hold in the small mutation limit of the RMD is a property that vanishes if only arbitrarily small departures from the perfect model could happen; thus the importance of studying discrepancies between the RD and the RMD with small mutation. Bomze and Bürger [12] show that an important difference between the RD and the RMD is that, in general, the effect of introducing mutation in the RD is to dissolve continua of neutrally stable equilibria into isolated asymptotically stable ones.

In this paper we focus on the influence of strictly dominated strategies on the location of the rest points of the RMD in the limit of small mutation. Following Samuelson [15], we will refer to the limit of the stationary states of the RMD, as the mutation terms become arbitrarily small, as “limit stationary states”. The limit stationary states of the RMD constitute a subset of the stationary points of the RD. For the sake of completeness, we start by reviewing the results concerning weakly dominated strategies.

It is well known that weakly dominated strategies in the RD may remain present forever [16-18]. While at any point in the interior of the simplex a weakly dominated strategy obtains a strictly lower payoff than some alternative (pure or mixed) strategy, the dynamics may lead the process “quickly” towards the boundary of the simplex, where the selection pressure over weakly dominated strategies may disappear.

In the RMD with μ_{ij} > 0, where a persistent form of mutation, migration or noise guarantees that all strategies enjoy a minimum inflow into the system (i.e., the process is pushed away from the boundaries of the simplex towards its interior), weakly dominated strategies always earn a strictly lower payoff than some other strategy. Thus, one could expect that this permanent selection pressure against weakly dominated strategies would keep them at minimal levels (i.e., those strictly induced by the mutation), and therefore, that in the small mutation limit (i.e., when those minimal levels tend to zero) weakly dominated strategies would be asymptotically wiped out. However, rather surprisingly, it has been shown that weakly dominated strategies are not wiped out in the limit of the RMD, or in more general perturbed selection dynamics [15,19,20].

Let us now turn to strictly dominated strategies. In the RD, starting from any interior point, strictly dominated strategies are asymptotically wiped out [20,21]. This result has been extended to some more general selection dynamics [22], but it has also been shown not to hold for many other common dynamics [23]. The disappearance of strictly dominated strategies along interior trajectories in the RD suggests the (stronger) conjecture that, in order to calculate the set of points to which these trajectories converge, strictly dominated strategies can be safely removed from the analysis. In any case, we show in this paper that this conjecture does not hold for the limit stationary points of the RMD.

For the RMD with μ_{ij} > 0 and a_{ii} > ∀ i, j = 1,…n, (from now on we will assume that these conditions hold) it can be proved—by the same arguments put forward by Samuelson [15] (Proposition 4.7) or Samuelson and Zhang [20] (Theorem 9)—that the limit stationary states for small mutation are Nash equilibria, so strictly dominated strategies are also absent from any limit stationary state. However, we show in this paper that strictly dominated strategies, even though they disappear at the limit stationary states of the RMD, can completely modify their position, thus changing the set of limit stationary points that correspond to trajectories that begin in the interior of the simplex. Strictly dominated strategies can dramatically alter the position of even asymptotically stable rest points. As a result, when analyzing the asymptotic dynamics of this kind of process for low mutation rates, and particularly the set of limit points, one should not readily dispose of strictly dominated strategies.

A biological implication of this result is that, in an evolutionary system in which the flow of mutations between behaviors, species or varieties is small, a very poorly fit and very rarely observed behavior in an ecosystem can be the main force explaining, predicting or controlling the observed proportions of the other behaviors or species. The impact of the poorly fit behavior can be more profound than the mere selection of a particular point within a set of neutrally stable equilibria subject to random drift (like in the RD): in the RMD with arbitrarily rare mutations, the poorly fit behavior may modify the location of a unique asymptotically stable point. Below, we use an example to show that equilibria that, in the RD, would be subject to random drift within a large range of values, can actually be stabilized at a precise particular level which is influenced by the scarce appearance of strictly dominated strategies or entrants.

The dependence of limit stationary states of the RMD on strictly dominated strategies is not as disheartening as it may seem: there are some cases where one can safely calculate the limit stationary states of the RMD with relation to the stationary states of the RD [15,19]. For instance, if we are dealing with a hyperbolic stationary state z of the RD, then the RMD has a rest point close to z which moves arbitrarily close to z as the mutation term becomes arbitrarily small, and has the same stability properties as z [24]. Bomze and Bürger [12,25], Stadler and Nuno [26] and Stadler and Schuster [3] provide further results on the relation between stationary states of the RD and the RMD, and some particular cases have been studied in detail [27].

## 2. Results

We study a replicator-mutator system with three strategies, one of which is strictly dominated, and we provide an analytical formula for the limit of its stationary state as the mutation rate goes to zero. The limit stationary state is shown to depend on the parameters that correspond to the strictly dominated strategy.

Let μ be the total fraction of mutants or entrants in the population, and let m_{i} be the fraction of mutants that adopt strategy i, so that μ_{ji} = μ_{i} for j ≠ i, where μ_{i} = μ_{i} ·m_{i}, with m_{i} > 0 and Σ_{i} m_{i} = 1. Then the persistence rate equals μ_{ii} = 1 — μ (1 — m_{i}). The replicator-mutator equation for this case can be written as:

Assuming a_{ii} > 0, Equation (1) is equivalent (via a change in speed) to

_{i}= 0, the first term in the right-hand side of Equation (2) is null, it is straightforward to see that, for μ

_{i}= μ·m

_{i}> 0, any stationary state of this system must be interior and a solution to

Let us now consider the payoff matrix

Let ${x}^{*}=\left[{x}_{1}^{*},{x}_{2}^{*},{x}_{3}^{*}\right]$ be a stationary state of the replicator-mutator Equation (3) for matrix A. We show in the appendix that ${lim}_{\mu \to 0}{x}_{3}^{*}=0$ and that x* satisfies the equation

Consequently, for small μ, x* must be in a small neighborhood of some point l = [l _{1}, 1 − l _{1}, 0]which satisfies

Note that g(l _{1}) is a quadratic function. Given that g(0) = −m _{1}(1 − a_{32}) < 0 and g(1) = m_{2}(1 − a_{31}) > 0, there is a unique solution to the equation g(l _{1}) = 0 in l_{1} ∈[0,1], which proves that there is a unique limit stationary state l. This solution is given by

Note also that the limit stationary state does not depend on the payoff a_{33}, and the analysis is locally valid dropping the constraint a_{33} < min(a_{13}, a_{23}), as there would still be an ε > 0 such that f _{3} < f_{2} and f_{3} < f_{1}, for x_{3} < ε.

Finally, notice that, without mutation, the 3-strategy case we have selected presents a connected component of critical points along the edge where the strictly dominated strategy is null (x_{3} = 0). In this neutral component the other two strategies are payoff-equivalent (f_{1} = f_{2}). Thus, the selection of one single limit stationary point within this neutral component is necessarily due to the second-order forces induced by mutations [28]. Our results show that, at least in such situations where first-order selection forces vanish and second-order forces come into play, regardless of the number of strategies involved, strictly dominated strategies may influence the location of the limit stationary states of the RMD.

## 3. Example

Consider the case

_{ji}= μ

_{i}for j ≠ i, all orbits converge to the set of fixed points [1,9]. The fixed points are the solutions to

For small mutation the limit stationary state l = [l _{1}, 1 − l _{1}, 0] can be calculated according to Equation (4). In the particular case m_{1} =m_{2} = m_{3} = 1/3, this leads to

Figure 1 represents l_{1} as a function of α and β. It can be seen how the limit stationary state l = [l _{1}, 1 − l _{1}, 0] can vary from one extreme to the other with the parameters α and β that correspond to the strictly dominated strategy. Figure 2 shows the limit stationary state in the unit simplex corresponding to three different combinations of values of α and β. Figure 2 can be reproduced using the Mathematica® computer program provided as supplementary material. This program can be run with Wolfram CDF Player, which is freely available on the Web.

It might be thought that which particular point is selected out of a continua of RD equilibria, such as the line x_{1} + x_{2} = 1 in this example, is not very relevant, given that strategy 1 and strategy 2 are equivalent in the absence of other strategies. Note, however, that the response of this system to shocks or perturbations can be very different depending on the proportions of strategy 1 and strategy 2. Suppose, for instance, that the model corresponds to the coexistence of three species in an ecosystem, and the system is resting at the stationary point where x_{1} + x_{2} ≈ 1. If a small fraction x_{4} of individuals of a fourth species arrives at this ecosystem, and this fourth species rates poorly against species 1, but well against species 2 and against itself, needing a minimal value of x_{2} in order to proliferate (i.e., in order to obtain enough fitness), it is clear that both the short-run and the long-run behavior of this system in response to the potential invasion can be completely different depending on the initial proportions of species 1 and 2.

## 4. Conclusions

The limit stationary points of the RMD constitute a subset of the stationary points of the RD. Bomze and Bürger [12] show that the effect of introducing mutation in the RD (in a framework which admits mixed strategies) is to dissolve continua of neutrally stable equilibria into isolated asymptotically stable ones. This paper provides a formula to calculate a limit stationary point of the RMD for a simple kind of game and illustrates that, in general, the location of a limit stationary point of the RMD depends not only on the surviving strategies at that point and their mutation rates, but it can also depend on the non-surviving strategies, including strictly dominated strategies. It also shows as a corollary that, in order to calculate the set of limit stationary points of the RMD, strictly dominated strategies cannot be readily eliminated.

**Figure 1.**Proportion l

_{1}of strategy 1 in the limit stationary state of the RMD for matrix A as a function of the payoffs α and β, with mutation fractions m

_{1}= m

_{2}= m

_{3}.

**Figure 2.**The red circle shows the unique stationary state of the RMD for matrix A, with mutation fractions m

_{1}= m

_{2}= m

_{3}, and mutation rate μ = 10

^{−4}, for three different combinations of values of the payoffs [α,β,γ]. (

**a**) [α,β,γ] = [0.99, 0.01, 0.4]; (

**b**) [α,β,γ] = [0.5, 0.5, 0.4]; (

**c**) [α,β,γ] = [0.01, 0.99, 0.4].

The authors would like to thank Fernando Vega-Redondo and two anonymous reviewers for comments. This work has received financial support from the Spanish JCyL (GREX251-2009 and VA006B09), Ministry of Science and Innovation (TIN2008-06464-C03-02, DPI2010-16920 and CSD2010-00034) and Ministry of Education (grant JC2009-00263).

## Appendix

From Equation (2), and considering that f_{3} − f̄ ≤ 0 (with the equality holding only at x_{3} = 1), we have
${x}_{3}^{*}\le {m}_{3}<1$ This, with the strict dominance relation, implies

From (3), noting that ${f}_{i}^{*}>0$ and, consequently ${x}_{i}^{*}-\mu \xb7{m}_{i}>0:$

So,

Equation (a1) together with Equation (a2) imply ${lim}_{\mu \to 0}{x}_{3}^{*}=0$

Besides,

So, from Equation (a2),

From the conditions of stationary state Equation (3) for strategies 2 and 3:

Considering that ${x}_{1}^{*}+{x}_{2}^{*}=1-{x}_{3}^{*}$,

And considering that ${x}_{2}^{*}=1-{x}_{1}^{*}+O\left({x}_{3}^{*}\right)$, we finally obtain

As a consequence of Equations (a3) and (a4), a stationary state ${x}^{*}=\left[{x}_{1}^{*},{x}_{2}^{*},{x}_{3}^{*}\right]$must satisfy the equation

## References

- Hofbauer, J. The selection mutation equation. J. Math. Biol.
**1985**, 23, 41–53. - Page, K.M.; Nowak, M.A. Unifying evolutionary dynamics. J. Theor. Biol.
**2002**, 219, 93–98. - Stadler, P.F.; Schuster, P. Mutation in autocatalytic reaction networks—An analysis based on perturbation-theory. J. Math. Biol.
**1992**, 30, 597–632. - Arbiza, J.; Mirazo, S.; Fort, H. Viral quasispecies profiles as the result of the interplay of competition cooperation. BMC Evol. Biol.
**2010**, 10, 137:1–137:9. - Imhof, L.A.; Fudenberg, D.; Nowak, M.A. Evolutionary cycles of cooperation and defection. Proc. Natl. Acad. Sci. USA
**2005**, 102, 10797–10800. - Komarova, N.L. Replicator-mutator equation, universality property and population dynamics of learning. J. Theor. Biol.
**2004**, 230, 227–239. - Nowak, M.A.; Komarova, N.L.; Niyogi, P. Evolution of universal grammar. Science
**2001**, 291, 114–118. - Tavares, J.M.; da Gama, M.M.T.; Nunes, A. Coherence thresholds in models of language change and evolution: The effects of noise, dynamics, and network of interactions. Phys. Rev. E.
**2008**, 77, 18517691:1–18517691:19. (Epub 11 April 2008). - Hofbauer, J.; Huttegger, S.M. Feasibility of communication in binary signaling games. J. Theor. Biol.
**2008**, 254, 843–849. - Huttegger, S.M.; Skyrms, B.; Smead, R.; Zollman, K.J.S. Evolutionary dynamics of Lewis signaling games: Signaling systems vs. partial pooling. Synthese
**2010**, 172, 177–191. - Sachs, R.K.; Hlatky, L. A rapid-mutation approximation for cell population dynamics. B. Math. Biol.
**2010**, 72, 359–374. - Bomze, I.M.; Bürger, R. Stability by mutation in evolutionary games. Game. Econ. Behav.
**1995**, 11, 146–172. - Kingman, J.F.C. A simple model for the balance between selection and mutation. J. Appl. Prob.
**1978**, 15, 1–12. - Akin, E. The Geometry of Population Genetics; Springer: Berlin, Germany, 1979.
- Samuelson, L. Evolutionary Games and Equilibrium Selection; IT Press: Cambridge, MA, USA, 1997.
- Hofbauer, J.; Sigmund, K. Evolutionary Games and Population Dynamics; Cambridge University Press: Cambridge, UK, 1998.
- Vega-Redondo, F. Economics and the Theory of Games; Cambridge University Press: Cambridge, UK, 2003.
- Weibull, J.W. Evolutionary Game Theory; MIT Press: Cambridge, MA, USA, 1995.
- Binmore, K.; Samuelson, L. Evolutionary drift and equilibrium selection. Rev. Econ. Stud.
**1999**, 66, 363–393. - Samuelson, L.; Zhang, J. Evolutionary stability in asymmetric games. J. Econ. Theor.
**1992**, 57, 363–391. - Akin, E. Domination or equilibrium. Math. Biosci.
**1980**, 50, 239–250. - Hofbauer, J.; Weibull, J.W. Evolutionary selection against dominated strategies. J. Econ. Theor.
**1996**, 71, 558–573. - Hofbauer, J.; Sandholm, W.H. Survival of dominated strategies under evolutionary dynamics. Theor. Econ.
**2011**. in press. - Hirsch, M.W.; Smale, S. Differential Equations, Dynamical Systems and Linear Algebra; Academic Press: New York, NY, USA, 1974.
- Bomze, I.M.; Bürger, R. Evolution Equations, Control Theory, and Biomathematics; Clement, P., Lumer, G., Eds.; Marcel Dekker, Inc.: New York, NY, USA, 1994; pp. 11–23.
- Stadler, P.F.; Nuno, J.C. The influence of mutation on autocatalytic reaction networks. Math. Biosci.
**1994**, 122, 127–160. - Stadler, P.F.; Schnabl, W.; Forst, C.V.; Schuster, P. Dynamics of small autocatalytic reaction networks 2. Replication, mutation and catalysis. B. Math. Biol.
**1995**, 57, 21–61. - Binmore, K.; Samuelson, L. Sex and evolutionary stability. J. Theor. Biol.
**2011**, 278, 63–73.

© 2011 by the authors; licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution license (http://creativecommons.org/licenses/by/3.0/).