Abstract
We consider various approaches for a characteristic function construction on the example of an n players differential game of pollution control with a prescribed duration. We explore the effect of the presence of an absorption coefficient in the game on characteristic functions. As an illustration, we consider a game in which the parameters are calculated based on the real ecological situation of the Irkutsk region. For this game, we compute a number of characteristic functions and compare their properties.
1. Introduction
Differential games are used for describing continuous processes of decision making in conflict situations that happen in industry, ecology, biology, political science, and so on. Models of differential games are often utilized for solving problems in the field of environmental protection policy and the optimal exploitation of natural resources [1,2,3,4,5,6,7].
To solve the problems of environmental management, it is effective to use games with negative externalities [4,5,6,7]. In that class of games, the increasing of the controls of some players, which are the volumes of environmental pollution over time, leads to the decreasing value of the payoff functions for others.
In this paper, we consider a cooperative differential game of pollution control with negative externalities modeling the behavior of several enterprises. They have an agreement to limit environmental pollution. This limitation has a negative effect on the total profit of each enterprise. Moreover, the high level of environmental pollution leads to profit loss associated with the higher environmental costs and taxes. We focus our attention on two cases when there is an absorption coefficient and when there is not.
In the theory of cooperative differential games, the concept of a characteristic function is one of the basic ones. The characteristic function shows the worth of a coalition and affects the formation of coalitions [8,9]. Therefore, players or coalitions have the motivation to cooperate with each other if the characteristic function of the joint coalition is greater than the sum of the original characteristic functions. Additionally, the significance of each player in the coalition can be determined by its marginal contribution to the characteristic function. For example, this approach is used in constructing the Shapley value and Banzhaf power index [10,11,12].
We present different techniques for characteristic function construction [13,14,15]. For the above-mentioned cooperative differential game, we compute a number of characteristic functions and compare their properties. Further, we analyze the effect of the absorption coefficient representing the natural environment purification on player’s payoffs.
As an illustration, we explore a game of pollution control based on the acute ecological situation of the Irkutsk region. We use a cooperative differential game of three players, which are the largest enterprises of Bratsk [16]. Furthermore, we add the absorption coefficient to this model and focus on the effect this coefficient has on the payoffs.
2. Cooperative Differential Game in the form of the Characteristic Function
2.1. Differential Game in Normal Form
Let be a set of players participating in a classical cooperative differential game with a prescribed duration [17]. The game starts from the initial state at time and evolves over the interval .
The dynamics of the game are described by the system of differential equations:
where .
We assume that all standard restrictions [18] on the parameters, controls, and trajectory function are satisfied.
The payoff function of the player is:
where are continuous functions and is a solution of the Cauchy problem for System (1) under controls .
2.2. Different Methods of Characteristic Function Construction
To define the cooperative game, we have to construct a characteristic function for every coalition in the game.
A characteristic function is a mapping from the set of all possible coalitions:
The value is typically interpreted as the worth or the power of the coalition S. One of the most important properties of the characteristic function is superadditivity:
Superadditive characteristic functions provide some useful advantages in solving various problems in the field of cooperative game theory in static and dynamic settings. More information about this can be found in [19].
Currently, there are different approaches to the calculation of the characteristic function (see [7,19,20,21,22]). A systematic overview of different characteristic functions and their properties was presented in [23]. This paper provides an analysis of -, -, -, and -characteristic functions.
2.2.1. -Characteristic Function
A classical approach to the construction the characteristic function is called the -characteristic function. It was introduced in [20] and was the only way to construct a cooperative game for a long time. The main idea of this method is using the lower value of the zero-sum game between the coalition S as the first player and coalition as the second player.
We assume that the maximum and minimum is achieved on (3). The value is interpreted as the maximum value that coalition S can get when acts against S.
It was proved in [24] that the -characteristic function is superadditive.
This approach of defining the characteristic function has some issues. It is necessary to solve complicated optimization problems. It is hard to find (3) in analytical form in differential games due to computational problems. Finally, from an economic standpoint, it is unlikely that players of form an anti-coalition [7].
2.2.2. -Characteristic Function
The technique of the construction the -characteristic function was proposed in [7]. The process of the calculation of this function consists of two steps. Firstly, one has to calculate the Nash equilibrium strategies for all players. Secondly, players from S maximize their total payoff while players from use strategies from the Nash equilibrium.
This form of the characteristic function requires fewer computational operations compared the with -characteristic function. Additionally, the previously constructed Nash equilibrium simplifies the computation of . Moreover, (4) has a practical economic interpretation. Players not from the coalition S do not tend to form anti-coalition in real models (see [25,26,27]).
Nevertheless there are some problems of this approach. In general, the -characteristic function is a non-superadditive function (see examples in [28]). Besides, one has to consider the problem of the existence and uniqueness of the Nash equilibrium solution.
2.2.3. -Characteristic Function
The -characteristic function was introduced in [19]. The first step of calculation of this characteristic function for coalition S is finding optimal controls maximizing the total payoff of the players. In the second step, players from coalition S use the cooperative optimal strategies, while the left-out players from use the strategies minimizing the total payoff of the players from S.
We assume that the maximum and minimum are attained in (5).
The constructed is superadditive in general [19]. Additionally, already computed optimal controls are used for the -characteristic function, which simplifies the computation process compared with the -characteristic function. Besides, these controls exist and could be found for a wide class of games under rather weak constraints. Lastly, the -characteristic function is applicable to games with fixed coalition structures [29].
2.2.4. -Characteristic Function
The idea of the -characteristic function was presented in [22]. This characteristic function is based on strategies from the optimal profile and strategies from the Nash equilibrium . We use for players from S (as in the -characteristic function) and for players from (as in the -characteristic function).
This function models the case when players from decide instead of optimal strategies to use strategies from Nash equilibrium .
The construction of the -characteristic function has some technical advantages. It is much simpler in terms of calculation compared with the -characteristic function. As mentioned above, optimal controls exist and could be found for a wide class of games. The drawback of this function is the problem of the existence and uniqueness of the Nash equilibrium solution. Furthermore, is not superadditive in the general case [23].
3. Problem of Optimal Pollution Control
3.1. Problem Statement
We assume there is an enterprise having a production site in its territory. The volume of production is directly proportional to harmful emissions to the atmosphere , which the enterprise controls.
The dynamics of the total amount of pollution is described by the following differential equation:
where is the absorption coefficient, (we use square brackets to denote the dimension of the respective variable). Note that does not need to belong to the interval as the value of is determined by the dimension of the time unit. For instance, 1 [1/day]=30 [1/month].
The instantaneous profit of the enterprise is defined as:
There is also an ecotax that is proportional to the amount of pollution. Hence, the net instantaneous payoff is obtained as the difference between the profit and the tax:
where is the tax coefficient. Thus, the total payoff is:
It is straightforward to show that the optimal control maximizing the payoff is:
We start by analyzing what values the optimal control can achieve. Before proceeding to the main result, we define:
where is the principal branch of the Lambert function, defined as the solution to the equation [30].
Proposition 1.
The optimal control Function (7) is bounded by b. The optimal control for all if or and . If and , then the optimal control function changes sign from minus to plus at the point:
The proof is given in Appendix A.
Proposition 1 gives the conditions guaranteeing that the optimal control is defined by (7). Then, the corresponding trajectory is given by:
and the payoff is:
where .
If and , the function is defined as:
and the corresponding trajectory is:
The corresponding value of the payoff is:
where . Note that the latter case differs from the former one in that the optimal control is equal to zero on the interval .
3.2. Influence of the Absorption Coefficient on the Payoff
Proposition 2.
Proposition 2 is proven by applying L’Hospital’s rule to (8) three times.
Figure 1, Figure 2, Figure 3, Figure 4 and Figure 5 demonstrate the dependence of the payoff from the absorption coefficient in special cases when the control has a switch point. Here and later on, we follow the convention that the overall plot is shown on the left, while the right plot shows a zoomed-in part of the graph.
Figure 1.
, , , , . (a) and (b) .
Figure 2.
, , , , . (a) and (b) .
Figure 3.
, , , , . (a) and (b) .
Figure 4.
, , , , . (a) and (b) .
Figure 5.
, , , , . (a) and (b) .
4. Game-Theoretical Model of Pollution Control
4.1. No Absorption Coefficient Model
In this section, we consider a differential game of pollution control with a prescribed duration based on the game-theoretical models issued in [4]. The game involves n players (companies or countries), and each of them has an industrial production site in its territory. A three player game was considered in [31].
Let with be a set of players. The strategy of player i is the amount of pollution emitted to the atmosphere over time . We will look for the solution in the class of open-loop strategies .
The dynamics of the total amount of pollution is described by the following differential equation:
The total payoff of the player is defined along the same lines as in Section 3.1. Thus, we write the payoff of the player as:
where and are the respective parameters that can be different for each player.
To simplify notation, we introduce the following parameters:
We also assume that the regularity constraints hold for all . These constraints guarantee that .
We assume the players have made a cooperative agreement on maximizing the total payoff of the players. To compute the cooperative solution (Shapley value, core, Harsanyi dividend, Banzhaf power index, etc.), one has to compute a characteristic function that plays a key role in cooperative game theory. In [23], we constructed the following characteristic functions for every coalition .
4.2. Absorption Coefficient Model
We consider a modification of the differential game of pollution control. A special case of this game where was considered in detail in [32]. In the paper [33], the construction of the -characteristic function was presented for the example based on real data.
The dynamics of the total amount of pollution is described by an extended equation:
where is an absorption coefficient introduced earlier. The payoff function is defined by (10).
In the following, we assume that all additional regularity constraints defined above are satisfied.
Functions (17)–(20) are superadditive. The construction of characteristic functions and the proof of their superadditivity are given in Appendix B and Appendix C. It can also be checked that the relations between characteristic Functions (15) are satisfied. In addition, we obtain the result:
Theorem 1.
The limits of the α-, δ-, ζ-, and η-characteristic functions exist and are equal as δ tends to infinity.
Theorem 1 is proven by computing limits with the use of the L’Hospital rule.
5. Optimal Control of Pollution Emissions for the Irkutsk Region
As an illustration, we considered a differential game of pollution control based on real data for enterprises of the Irkutsk region [16,33]. The ecological situation in Bratsk is one of the most acute in the region. We observed that the three largest enterprises of Bratsk pollute the environment: OJSC «RUSAL Bratsk», OJSC «ILIM Group», and units of OJSC «Irkutskenergo».
We used the coefficients of the differential game that were found in the paper [16].
We considered two cases. In the first case, the dynamics of the total amount of pollution is described by (9). This means that there is no absorption coefficient in the model.
Using the provided numerical values of the parameters, we used (11)–(14) to compute -, -, -, and -characteristic functions as functions of and .
Figure 6 shows the influence of the initial time on the characteristic functions of the individual players. Similar results can be shown for the case of coalitions. In the following figures, we present the respective dependence on the left side and the zoomed-in fragments of the respective plots on the right side.
Figure 6.
(a) , (b) , (c) , (d) , (e) , and (f) .
We now proceed to the case with non-zero pollution absorption. The dynamics of is described by (16). Using the numerical values from Table 1 and the expressions for the characteristic Functions (17)–(20), we calculated the -, -, -, and -characteristic functions.
Table 1.
Coefficient values.
Below, we present the plots showing the effect of the initial time and the absorption coefficient on the values of the respective characteristic functions. In particular, Figure 7 shows the influence of the initial time on the characteristic functions of the individual players, while Figure 8 illustrates the dependence of characteristic functions on the parameter . All presented results can be demonstrated for the coalitions as well.
Figure 7.
(a) , (b) , (c) , (d) , (e) , and (f) .
Figure 8.
(a) , (b) , (c) , (d) , (e) , and (f) .
Finally, in Figure 9, we illustrate the difference between the characteristic functions for the cases when the absorption coefficient is equal to zero (blue line) and when the absorption coefficient is taken from Table 1. For the illustration, we chose the -characteristic function.
Figure 9.
(a) , (b) , (c) , and (d) .
Conclusions
In this paper, we considered a cooperative differential game of pollution control with a prescribed duration. We analyzed two cases when there was an absorption coefficient and when there was not. For these games, -, -, -, and -characteristic functions were constructed for the general case of n players.
It was shown that the parameter had a significant impact on the characteristic functions. We also obtained analytical formulas for the limiting values of the characteristic functions with increasing absorption coefficient.
All results were illustrated with the differential game of pollution control based on real data for enterprises of the Irkutsk region.
Author Contributions
Conceptualization: E.G. Formal analysis: E.M., P.B. Funding acquisition: E.G. Investigation: E.M., E.G., A.S., P.B. Methodology: E.G., E.M. Project administration: E.M. Supervision: E.G. Validation: E.M., P.B. Visualization: E.M. Writing – original draft: E.M., E.G. All authors have read and agreed to the published version of the manuscript.
Funding
Ekaterina Gromova acknowledges the grant from Russian Science Foundation 17-11-01079.
Conflicts of Interest
The authors declare no conflict of interest.
Appendix A. Construction of Optimal Pollution Control
Proof of Proposition 1
Proof.
The proof of is trivial because the second term is not positive.
We differentiate with respect to t:
Therefore, is an increasing function of t. This means that the function takes a minimum value at a point :
We differentiate with respect to :
Obviously, and . To define the sign of :
Hence, is an increasing function of . It follows that the function is positive for . This completes the proof that .
Thus, is an increasing function of , then:
If , which is the same as , then and . Next, we consider the case . We find that provides .
Note that for sufficiently large . If tends to zero, then at at least. Define the delta at which under the condition is an increasing function of t and .
whence, upon some algebraic manipulation, we get:
We define:
Since , then . Hence, we obtain the equation . Solving this equation with respect to , we get:
Finally, we arrive at the following expression for the threshold value of :
If , then and . Otherwise, if , then . We determine the moment at which the optimal control turns to zero: . Solving:
we get:
Thus, is the point where the control changes sign. □
Appendix B. Computation of the Characteristic Functions
Appendix B.1. Nash Equilibrium
The computation of the Nash equilibrium strategies (NE) is fairly obvious, so we skip most details. Using the Pontryagin maximum principle, we find the Nash equilibrium strategies:
and the corresponding trajectory:
Following the same scheme as that shown in Appendix A, we obtain that if , then and .
Appendix B.2. Cooperative Agreement
The optimal cooperative strategies are:
and the optimal trajectory is:
For the optimal control, we have that if , which is the same as , then and .
Appendix B.3. Construction of the α-Characteristic Function
We consider a minimization problem:
For this problem, the optimal strategies are:
Next, we consider a maximization problem:
For this problem, we obtain the controls:
The corresponding trajectory is:
For the controls (A4), we have that if , then and .
Appendix B.4. Construction of the δ-Characteristic Function
We consider a maximization problem:
For this problem, the optimal controls are:
and the corresponding trajectory is:
Similar to the previous cases, we have that if , then and .
Appendix B.5. Construction of the ζ-Characteristic Function
We consider the minimization problem:
In this case, the optimal strategies are:
Appendix B.6. Construction of the η-Characteristic Function
Appendix C. Proofs of Superadditivity Characteristic Functions
Appendix C.1. Additional Statement
Proposition A1.
Proof.
Let , then we need to prove:
We solve the quadratic equation:
The roots of the equation are:
The branches of the parabola are directed downwards. This means that:
when:
We change x to . Let us prove that:
We make a replacement . Therefore, we prove:
Secondly, let us show that:
We transform the expression:
We clearly have . To prove , we need to differentiate with respect to m:
Obviously, for . Let us show:
Assume the converse. Then:
Hence:
because . Therefore:
This contradiction proves (A12). This means that in (A11):
That is, the function is increasing for and:
This implies the inequality (A10). Finally, using (A9) and (A10), we get (A8). This yields
and hence, . □
Appendix C.2. Superadditivity of the α-Characteristic Function
We prove that the -characteristic function is superadditive using (2).
Clearly,
According to Proposition A1:
Hence, .
Appendix C.3. Superadditivity of the δ-Characteristic Function
We verify the superadditivity of the -characteristic function using the definition (2).
Using , we get . It is obvious that:
According to Proposition A1:
Therefore, .
Appendix C.4. Superadditivity of the ζ-Characteristic Function
Let us show that the -characteristic function is superadditive using (2).
Trivially,
According to Proposition A1:
It follows that .
Appendix C.5. Superadditivity of the η-Characteristic Function
Let us check that the -characteristic function is superadditive using (2).
We obtain:
According to Proposition A1:
Therefore, .
References
- Petrosjan, L.; Zakharov, V. Mathematical Models in Ecology; Izdatelstvo Sankt-Peterburgskogo Universiteta: St. Petersburg, Russia, 1997. [Google Scholar]
- Mazalov, V.; Rettieva, A. Nash equilibrium in environmental problems. Math. Model. 2006, 18, 73–90. [Google Scholar]
- Rettieva, A. Cooperative incentive condition in bioresource sharing problem. Upravleniye Bolshimi Sistemami 2009, 26, 366–384. [Google Scholar]
- Breton, M.; Zaccour, G.; Zahaf, A. A differential game of joint implementation of environmental projects. Automatica 2005, 41, 1737–1749. [Google Scholar] [CrossRef]
- Dockner, E.; Van Long, N. International pollution control: Cooperative versus noncooperative strategies. J. Environ. Econ. Manag. 1993, 25, 13–29. [Google Scholar] [CrossRef]
- Haurie, A.; Zaccour, G. Differential game models of global environmental management. Ann. Int. Soc. Dyn. Games 1995, 2, 3–23. [Google Scholar]
- Petrosjan, L.; Zaccour, G. Time-consistent Shapley value allocation of pollution cost reduction. J. Econ. Dyn. Control 2003, 27, 381–398. [Google Scholar] [CrossRef]
- Greenberg, J. Coalition structures. In Handbook of Game Theory with Economic Applications; North Holland: Amsterdam, The Netherlands, 1994; Volume 2, pp. 1306–1337. [Google Scholar]
- Hajduková, J. Coalition formation games: A survey. Int. Game Theory Rev. 2006, 8, 613–641. [Google Scholar] [CrossRef]
- Shapley, L. A value for n-person games. In Contributions to the Theory of Games II; Princeton University Press: Princeton, NJ, USA, 1953; pp. 307–317. [Google Scholar]
- Winter, E.; Aumann, R. The Shapley value. In Handbook of Game Theory with Economic Applications; North Holland: Amsterdam, The Netherlands, 2002; Volume 3, pp. 1521–2351. [Google Scholar]
- Alvin, E. Introduction to the Shapley value. In The Shapley Value: Essays in Honor of Lloyd S. Shapley; Cambridge University Press: Cambridge, UK, 1988. [Google Scholar]
- Basar, T.; Olsder, G. Dynamic Noncooperative Game Theory, 2nd ed.; Society for Industrial and Applied Mathematics (SIAM): Philadelphia, PA, USA, 1999. [Google Scholar]
- Hull, D. Optimal Control Theory for Applications; Springer: New York, NY, USA, 2003. [Google Scholar]
- Moulin, H. Equal or proportional division of a surplus, and other methods. Int. J. Game Theory 1987, 16, 161–186. [Google Scholar] [CrossRef]
- Gromova, E.; Tur, A. On the optimal control of pollution emissions for the largest enterprises of the Irkutsk region of the Russian Federation. Matematicheskaya Teoriya Igr i Ee Prilozheniya 2018, 2, 150–152. [Google Scholar]
- Petrosjan, L.; Danilov, N. Cooperative Differential Games and Their Applications; Tomsk University Press: Tomsk, Russia, 1982. [Google Scholar]
- Krasovskii, N.; Subbotin, A. Game-Theoretical Control Problems; Springer: New York, NY, USA, 1989. [Google Scholar]
- Gromova, E.; Petrosyan, L. On an approach to constructing a characteristic function in cooperative differential games. Autom. Remote Control 2017, 78, 1680–1692. [Google Scholar] [CrossRef]
- von Neumann, J.; Morgenstern, O. Theory of Games and Economic Behavior; Princeton University Press: Princeton, NJ, USA, 1953. [Google Scholar]
- Reddy, P.; Shevkoplyas, E.; Zaccour, G. Time-consistent Shapley value for games played over event trees. Automatica 2013, 49, 1521–1527. [Google Scholar] [CrossRef]
- Gromova, E.; Marova, E. Coalition and anti-coalition interaction in cooperative differential games. IFAC PapersOnLine 2018, 51, 479–483. [Google Scholar] [CrossRef]
- Gromova, E.; Marova, E.; Gromov, D. A substitute for the classical Neumann-Morgenstern characteristic function in cooperative differential games. J. Dyn. Games 2020, 7, 105–122. [Google Scholar] [CrossRef]
- Petrosjan, L.; Danilov, N. Stability of solutions in non-zero sum differential games with transferable payoffs. Vestnik Leningradskogo Universiteta. Ser. Matematika Mekhanika Astronomiya 1979, 1, 52–59. [Google Scholar]
- Dockner, E.; Jorgensen, S.; van Long, N.; Sorger, G. Differential Games in Economics and Management Science; Cambridge University Press: Cambridge, UK, 2000. [Google Scholar]
- Kostyunin, S.; Palestini, A.; Shevkoplyas, E. On a nonrenewable resource extraction game played by asymmetric firms. SIAM J. Optim. Theory Appl. 2014, 163, 660–673. [Google Scholar] [CrossRef]
- Mazalov, V.; Rettieva, A. Fish wars with many players. Int. Game Theory Rev. 2010, 12, 385–405. [Google Scholar] [CrossRef]
- Gromova, E.; Malahova, A.; Marova, E. On the superadditivity of a characteristic function in cooperative differential games with negative externalities. In Proceedings of the Constructive Nonsmooth Analysis and Related Topics, St. Petersburg, Russia, 22–27 May 2017; pp. 1–4. [Google Scholar]
- Petrosjan, L.; Gromova, E. Two-level cooperation in coalitional differential games. Trudy Instituta Matematiki i Mekhaniki UrO RAN 2014, 20, 193–203. [Google Scholar]
- Corless, R.M.; Gonnet, G.H.; Hare, D.E.G.; Knuth, D.E. On the Lambert W function. Adv. Comput. Math. 1996, 5, 329–359. [Google Scholar] [CrossRef]
- Gromova, E.; Marova, E. On the characteristic function construction technique in differential games with prescribed and random duration. Contrib. Game Theory Manag. 2018, 11, 53–65. [Google Scholar]
- Barsuk, P.; Gromova, E. Properties of one cooperative solution in a differential game of pollution control. In Proceedings of the IV Stability and Control Processes Conference 2020, Saint Petersburg, Russia, 20–24 April 2020. [Google Scholar]
- Gromova, E.; Tur, A.; Barsuk, P. A Pollution Control Problem for the Aluminum Production in Eastern Siberia: Differential Game Approach. 2020. Available online: https://arxiv.org/abs/2005.08260 (accessed on 15 April 2020).
© 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).