Abstract
We describe the growth dynamics of a stock using stochastic differential equations with a generalized logistic growth model which encompasses several well-known growth functions as special cases. For each model, we compute the optimal variable effort policy and compare the expected net present value of the total profit earned by the harvester among policies. In addition, we further extend the study to include parameters sensitivity, such as the costs and volatility, and present an explicitly Crank–Nicolson discretization scheme necessary to obtain optimal policies.
Keywords:
Crank–Nicolson scheme; harvesting policies; Hamilton–Jacobi–Bellman equation; generalized logistic; stochastic optimal control; profit optimization; stochastic differential equations MSC:
60H10; 60H35; 92D25; 93E20
1. Introduction
Stochastic differential equations (SDEs) can be applied to model several physical, mechanical, biological, economic, financial, and social events. In [], readers can find innovative research dedicated to the study of a stock’s growth dynamic under a randomly varying environment in order to maximize the profit from harvesting. Such policies are usually designed to maximize the expected net present value of the total profit over a finite time horizon T. While policies considering infinite time have been studied, they are not be discussed here. Because stock size is affected by fishing effort, it seems natural to consider a controlled effort and use optimal control techniques to maximize profit, which is then discounted by a social rate. In [], the authors provide a comprehensive account of optimal harvesting policies for profit optimization in a deterministic environment. Under general assumptions, except for near the end of a finite time horizon, T, the optimal policy consists of harvesting with the highest possible effort when the stock size exceeds a previously determined threshold and stopping harvesting when the stock is below that level. After the stock has reached the threshold size, the harvesting rate must be kept constant at an equilibrium value in order for the stock to remain at that size. When the stock size falls below the threshold, harvesting should be halted until the stock size reaches the threshold, which may take several years.
Stochastic optimal control methods have been applied to design optimal harvesting policies in a randomly varying environment (see for instance [,,]). The optimal policy is the same as in the deterministic case. However, because of random fluctuations in the environment, the stock size continues to fluctuate. The harvesting effort must be adjusted at every instant to ensure that the stock’s size does not exceed the equilibrium value. Adjustments to the harvesting effort at every instant are incompatible with the logistics of fishing. Aside from harvesting absences, which have negative social and economic consequences (such as unemployment and company subsidies), these policies involve knowledge of stock size at all times in order to determine the appropriate level of effort. The current method of estimating the size of a stock is difficult, costly, time-consuming, and inaccurate.
One possible way to overcome these social and economic problems is to apply an optimal policy with variable effort subject to a penalization structure on the control, that is, to incorporate in the model a term that represents a running energy cost based on effort. This extra cost term represents a method of penalizing profit values when the effort abruptly changes from a reference value at each time instant. In [,,], references therein, and forthcoming papers from the same authors, readers can see several examples of the application of such a penalized policy. In [,,,,], the authors proposed a constant effort optimal sustainable policy, taking into account the Gompertz and logistic growth models (with and without Allee effects) to avoid social and economic problems as well as to estimate the current stock size at each time instant. That policy, however, implies a profit reduction, which they show to be slight for the models and data considered.
Optimal variable effort policies have been studied considering, among others, a logistic growth model, as in [,,], or the Gompertz model, as in [,]. An optimal harvesting policy with a slight generalization of the logistic model, the Pella–Tomlinson model, can be found in [].
This paper extends all of the above by considering a truly generalized logistic (GL) model in terms of stock growth models. From the GL model, we can obtain each of the growth models mentioned above. We note that each special case retains the sigmoidal and asymptotic properties of the Verhulst logistic curve (as in []). We obtain the optimal variable effort policy and study the effects of parameter sensitivity. The rest of this paper is structured as follows: in Section 2, we present the model formulation and the Crank–Nicolson discretization scheme, then use a dynamic programming method to solve the optimization variable effort problem. Numerical experiments involving several stock growth models and parameter sensitivities are discussed in Section 3. Finally, in Section 4 we provide closing remarks.
2. Optimal Policy with Variable Effort
2.1. Generalized Logistic Growth Model
The logistic growth model was introduced by Verhulst [] in 1838. After that, according to [], several authors have derived other growth models based on the logistic model. The generalized logistic (GL) growth model considered here can be found in [] and is provided by the ordinary differential equation (ODE):
with positive parameters and c. While negative parameter values can be considered, the risk of losing biological meaning is high. The GL model retains the logistic model’s most important properties, namely, the existence of a horizontal asymptote at , the possibility of reaching a maximum value, and the presence of an inflection point. Several other properties and features can be found in []. In Equation (1), represents the stock size at time instant t, r is the population intrinsic growth rate, and K stands for the carrying capacity (sometimes known as the saturation level).
In the presence of harvesting and under a stochastic environment, the stock dynamic can be modeled by the SDE:
where and K are defined above, is the catchability coefficient, is the harvesting effort (a Markov control), measures the strength of environmental fluctuations, is a standard Wiener process (see for instance []), and represents the stock size at the initial time 0. Equation (2) is an Itô autonomous SDE and its solution, , is a homogeneous diffusion process with drift coefficient and diffusion coefficient . In [,], after a few adaptations, it is possible to find conditions that allow for a unique solution to Equation (2), provided that the drift and satisfy certain regularity and growth conditions. Hence, it is sufficient to have , where during a small time interval (as in Appendix A).
Two quantities of special interest in harvesting are the yield per unit time and the fishing mortality rate, .
For a triplet , we denote Equation (2) by , i.e., the generalized logistic growth model with parameters , and c. For instance, corresponds to the well known logistic model. Figure 1 shows several curves for the stock growth rate as a function of a stock size for several particular cases of the GL model (a deterministic case without harvesting). From [], and after a few simplifications, we can observe the following well known models: the logistic model, Blumberg’s model (particular case), the and Richards models, and , a particular case of a GL model. Other forms of correspond to models that are not specified here, such as the Generalized von Bertalanffy model (), the Generalized Gompertz model (), and the Hyperbolic model ().
Figure 1.
Stock growth rate, , as a function of stock size, , for several particular cases of the GL model (deterministic case without harvesting).
2.2. Optimal Policy
A stochastic optimal control problem (SOCP) is the process of determining an optimal policy with variable effort based on profit optimization. The profit net value earned by the harvester per unit time, , can be defined as the difference between sales revenues per unit time () and harvesting costs per unit time (), i.e.,
To derive a well-posed SOCP in a finite time, we assume that harvesting occurs within the time interval . Future harvester profits are discounted at a rate of , for example, to accounting for currency depreciation and opportunity costs. The optimal harvesting policy maximizes the expected net present value of the total profit. The maximized value of the expected total discounted profit within the interval , denoted by , is
for which we use the short notation . Finally, the SOCP consists in obtaining the maximized value for the interval :
considering as a control subject to the population dynamics provided in Equation (2), the control restrictions , and the terminal condition .
To obtain the maximized Hamilton–Jacobi–Bellman (HJB) equation, the following SOCP is solved using stochastic dynamic programming (see pp. 259–268 in [] along with [,]), as detailed in Appendix A:
which represents the expected total discounted profit. The optimal variable effort is
where
is the unconstrained effort (as in []), which can be denoted by the optimal variable effort as well.
2.3. Domain Discretization and Finite Difference Approximation
The HJB Equation (4) is a nonlinear parabolic PDE involving a temporal variable and a spatial variable. Unfortunately, it is impossible to solve it analytically, and thusu we resort to numerical methods and apply a Crank–Nicolson discretization scheme based on finite differences. This problem’s natural domain is ; however, to obtain a numerical solution it is necessary to define a bounded computational domain. As a result, we define the bounded domain as with such that the probability of exceeding is negligible. Moreover, we consider uniform grids in space and time domains as follows:

The partitions for space and time are
They form a grid of points where and , with and . Because the boundary condition is terminal rather than initial, the computation uses time to move backwards from T to 0.
As in [], the space derivatives are approximated by central differences obtained by averaging the regressive and progressive approximations (for ):
and
The time derivative is approximated using a two time instant scheme:
2.4. Numerical Solution
Using the above approximations, the discretized version of the HJB Equation (4) is (for )
and
with in both expressions.
The discretized version of the HJB equation can be written as a system of m equations (for )
and
The system can be written using the appropriate matrices A, B, and C in the form
with
where T is the transpose operator. Solving the system, we obtain the optimal solution for the grid points. Polynomial interpolation between the values at the neighbouring points of X in the partition yields the optimal solution when the stock is at a given value X at a time .
3. Results
To compute , that is, the profit earned by the harvester during the interval , we performed 1000 Monte Carlo simulations for the stock, the effort, and the profit. The stock dynamics were simulated based on a Euler scheme. In [,], we discovered a fairly complete set of parameter values (namely, , and ) for the Pacific halibut (Hippoglossus hippoglossus). The other parameters ( and ), for which we had no data, were empirically chosen to be reasonable, and the time horizon was set at years. It is important to keep in mind that n and m were chosen from a pool of several trials in order for the algorithm to reach convergence. We were unable to estimate any parameters due to the lack of historical data, namely, stock size and harvesting effort. Table 1 contains the complete set of parameter values.
Table 1.
Parameter values used to run the simulations. The definition of an SFU (Standardized Fishing Unit) is explained in [].
The models chosen to obtain the optimal policies were the ones referenced before as particular cases of the GL growth model in Section 2.1. For each one, we ran 1000 simulations to obtain the optimal effort and optimal profit. The results are listed in Table 2.
Table 2.
Optimal profit and standard deviation values for the particular cases of the GL growth model in Section 2.1. Values are in millions of US dollars. SD represents standard deviation.
It can be observed from Table 2 that the highest profit, USD , comes from the application of model , followed by models , , , and , in decreasing order. This is not a surprise, as is, according to Figure 1, the one with a higher growth rate. Model yields the lowest profit value, USD , and is the model with the lowest growth rate, as seen in Figure 1. In terms of standard deviation, the highest value is related to model and the lowest is related to model . The remaining models have identical values.
For the models presented in Table 2, Figure 2, Figure 3 and Figure 4 depict what could happen when applying the optimal harvesting policy to such growth models. The thin lines represent one possible reality in each image that a harvester would experience (one of the 1000 simulations). The thicker lines represent the mean of 1000 simulations, which is a good approximation of the expected value appearing in the expression (3). For each model, a trajectory and sample mean for the stock size , yield , fishing mortality , and optimal profit per unit time can be found. Conclusions based on Figure 2, Figure 3 and Figure 4 are similar to the results presented in Table 2. Indeed, model shows the largest stock size compared with other models, implying higher fishing mortality.
Figure 2.
Stock, fishing mortality, yield, and profit sample paths (thinner line) and mean (ticker line) obtained by the application of models (top panel) and (bottom panel). Unit values are described in Table 1.
Figure 3.
Stock, fishing mortality, yield, and profit sample paths (thinner line) and mean (ticker line) obtained by the application of models (top panel) and (bottom panel). Unit values are described in Table 1.
Figure 4.
Stock, fishing mortality, yield, and profit sample paths (thinner line) and mean (ticker line) obtained by the application of model . Unit values are described in Table 1.
Sensitivity Analysis
We now examine the implications of changing the values of , , , and from the ones in Table 2 used for the simulations. To perform a sensitivity analysis, we chose the model and ran simulations identical the the ones before while changing each parameter one at a time. A summary of the alternative parameter values and the obtained profit per unit time is provided in Table 3.
Table 3.
Alternative parameter values for model . The parameters used to perform the sensitivity analysis were and . Profit and standard deviation values are in millions of US dollars. SD represents standard deviation.
Increasing the value of has a large effect on the profit value and implies a decrease of about . This is to be expected, as the increase in represents a depreciation in the value of the currency. A greater depreciation () implies a greater loss of profit. The initial value of is shallow, and thus the increase to is negligible. However, increasing that value to reduces the profit, as expected. An increase in has implications for profit reduction, and may imply a profit reduction. We note that represents unexpected costs (unspecialized gear and/or vessels) typically associated with extra costs. The influence of stochastic fluctuations is analysed by changing values of . A rise in stochastic fluctuations, i.e., or , has a huge influence on profit. The values of the standard deviation show such implications.
4. Conclusions
In this paper, we have worked with a stochastic differential equation generalized logistic stock growth model. From this model, we show how to obtain particular models typically used for harvesting problems. We have formulated a stochastic optimal control problem to obtain the optimal variable effort policy. We deduced the HJB equation using dynamic programming techniques and showed its solution through numerical methods by applying a Crank–Nicolson discretization scheme. We have applied the optimal policy for several particular models, considering realistic parameter values estimated from real stock. We conclude that models with a higher growth rate imply higher profit values, as expected. In addition, we examined the sensitivity of the expected total discounted profit to the discount factor, cost parameters, and stochastic environmental fluctuations.
Funding
The author was partially supported by the projects CEMAPRE/REM-UIDB/05069/2020 and EXPL/EGE-IND/0351/2021, both financed by FCT/MCTES through national funds.
Data Availability Statement
Not applicable.
Conflicts of Interest
The author declares no conflict of interest.
Appendix A
To obtain the Hamilton–Jacobi–Bellman Equation (4), appropriate assumptions must be made and the following approximations must be used for small values of , which leads to error terms of as , while being careful to use Itô calculus, i.e., a second order Taylor expansion in x:
- (A)
- is a small positive quantity;
- (B)
- ;
- (C)
- ;
- (D)
- ;
- (E)
- is known;
- (F)
- during time interval , the control is constant.
Now, we consider the current value form of Equation (3):
and divide the integrand function in two parts as follows, with :
Using assumption (B), we can write
Applying Bellman’s principle of optimality (see [,,]), we have
Alternatively, using assumptions (C) and (F),
The Taylor series of about provides
Writing and replacing in (A2) with the approximation in (D), we have
After a few simplifications, we can write
We can deduce from the Wiener process properties that and . Thus, rearranging the latter equation provides
Dividing (A4) by and allowing results in
where represents the expected value of the maximized accumulated discounted profit earned from the start of harvesting at time t to the end at time T.
The above Hamilton–Jacobi–Bellman equation is the solution to the stochastic control problem stated in Section 2.
The optimal variable effort is obtained from the HJB Equation (A5). Here, we denote by D a function that represents the control switching term in (A5), that is,
and denote the unconstrained effort resulting from the maximization in Equation (A6) as . Thus, by solving the equation with respect to E, we obtain :
The maximized HJB equation is obtained by representing the constrained optimal effort as and replacing with in Equation (A5):
where the effort is provided by
and with
being the unconstrained effort.
References
- Beddington, J.R.; May, R.M. Harvesting natural populations in a randomly fluctuating environment. Science 1977, 197, 463–465. [Google Scholar] [CrossRef] [PubMed]
- Clark, C.W. Mathematical Bioeconomics: The Optimal Management of Renewable Resources, 2nd ed.; Wiley: New York, NY, USA, 1990. [Google Scholar]
- Alvarez, L.H.R.; Sheep, L.A. Optimal harvesting of stochastically fluctuating populations. J. Math. Biol. 1998, 37, 155–177. [Google Scholar] [CrossRef]
- Alvarez, L.H.R. On the option interpretation of rational harvesting planning. J. Math. Biol. 2000, 40, 383–405. [Google Scholar] [CrossRef]
- Alvarez, L.H.R. Singular stochastic control in the presence of a state-dependent yield structure. Stoch. Process. Their Appl. 2000, 86, 323–343. [Google Scholar] [CrossRef]
- Brites, N.M.; Braumann, C.A. Harvesting in a Random Varying Environment: Optimal, Stepwise and Sustainable Policies for the Gompertz Model. Stat. Optim. Inf. Comput. 2019, 7, 533–544. [Google Scholar] [CrossRef]
- Brites, N.M.; Braumann, C.A. Harvesting optimization with stochastic differential equations models: Is the optimal enemy of the good? Stoch. Model. 2021, 0, 1–19. [Google Scholar] [CrossRef]
- Brites, N.M.; Braumann, C.A. Profit optimization of stochastically fluctuating populations: The effects of Allee effects. Optimization 2022, 1–12. [Google Scholar] [CrossRef]
- Brites, N.M.; Braumann, C.A. Fisheries management in random environments: Comparison of harvesting policies for the logistic model. Fish. Res. 2017, 195, 238–246. [Google Scholar] [CrossRef]
- Brites, N.M.; Braumann, C.A. Fisheries management in randomly varying environments: Comparison of constant, variable and penalized efforts policies for the Gompertz model. Fish. Res. 2019, 216, 196–203. [Google Scholar] [CrossRef]
- Brites, N.M.; Braumann, C.A. Stochastic differential equations harvesting policies: Allee effects, logistic-like growth and profit optimization. Appl. Stoch. Model. Bus. Ind. 2020, 36, 825–835. [Google Scholar] [CrossRef]
- Brites, N.M.; Braumann, C.A. Harvesting Policies with Stepwise Effort and Logistic Growth in a Random Environment. In Current Trends in Dynamical Systems in Biology and Natural Sciences; Aguiar, M., Braumann, C., Kooi, B.W., Pugliese, A., Stollenwerk, N., Venturino, E., Eds.; Springer: Cham, Switzerland, 2020; pp. 95–110. [Google Scholar] [CrossRef]
- Shah, M.A.; Sharma, U. Optimal harvesting policies for a generalized Gordon–Schaefer model in randomly varying environment. Appl. Stoch. Model. Bus. Ind. 2003, 19, 43–49. [Google Scholar] [CrossRef]
- Tsoularis, A.; Wallace, J. Analysis of logistic growth models. Math. Biosci. 2002, 179, 21–55. [Google Scholar] [CrossRef]
- Verhulst, P.F. Notice sur la loi que la population poursuit dans son accroissement. Corresp. Math. Phys. 1838, 10, 113–121. [Google Scholar]
- Braumann, C.A. Stochastic differential equation models of fisheries in an uncertain world: Extinction probabilities, optimal fishing effort, and parameter estimation. In Proceedings of the Mathematics in Biology and Medicine, Bari, Italy, 18–22 July 1985; Capasso, V., Grosso, E., Paveri-Fontana, S.L., Eds.; Springer: Berlin, Germany, 1985; pp. 201–206. [Google Scholar]
- Braumann, C.A. Introduction to Stochastic Differential Equations with Applications to Modelling in Biology and Finance; John Wiley & Sons, Inc.: New York, NY, USA, 2019. [Google Scholar]
- Kamien, M.I.; Schwartz, N.L. Dynamic Optimization; North-Holland, The Netherlands, 1993. [Google Scholar]
- Fleming, W.H.; Soner, H.M. Controlled Markov Processes and Viscosity Solutions; Springer: New York, NY, USA, 2006. [Google Scholar]
- Touzi, N. Optimal Stochastic Control, Stochastic Target Problems, and Backward SDE; Springer: New York, NY, USA, 2013. [Google Scholar]
- Hanson, F.B.; Ryan, D. Optimal harvesting with both population and price dynamics. Math. Biosci. 1998, 148, 129–146. [Google Scholar] [CrossRef]
- LeVeque, R.J. Finite Difference Methods for Ordinary and Partial Differential Equations; Society for Industrial and Applied Mathematics: Philadelphia, PA, USA, 2007. [Google Scholar] [CrossRef]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the author. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).