Abstract
In the present paper, we investigate the Merton portfolio management problem in the context of non-exponential discounting, a context that gives rise to time-inconsistency of the decision-maker. We consider equilibrium policies within the class of open-loop controls that are characterized, in our context, by means of a variational method which leads to a stochastic system that consists of a flow of forward-backward stochastic differential equations and an equilibrium condition. An explicit representation of the equilibrium policies is provided for the special cases of power, logarithmic and exponential utility functions.
Keywords:
stochastic optimization; investment-consumption problem; Merton portfolio problem; non-exponential discounting; time inconsistency; equilibrium strategies; stochastic maximum principle MSC:
93E20; 60H30; 93E99; 60H10
1. Introduction
In recent years, there has been a renewed attention in time inconsistency for optimality problems, as well as financial models. Generally, time inconsistency arises in several optimality problems when the optimal strategy selected at some time s is no longer optimal at time . In other words, a strategy is time-inconsistent when the decision-maker at future time is tempted to deviate from the strategy determined at time s. It is well known that an optimization problem gives raise to time-inconsistent strategies when the dynamic programming principle cannot be applied, and Bellman’s principle does not hold.
In practice, an important illustration of time-inconsistent problem is the mean-variance selection problem, where the time inconsistency is due to the fact that there is a nonlinear function of the expectation of the final wealth in the objective criterion. Another important problem which produces a time-inconsistent behavior is the investment-consumption problem with non-exponential discounting. This was the case studied by Strotz (1955–1956), where the time inconsistency arises by the fact that the initial point in time enters in a crucial manner the objective criterion.
The common assumption in classical investment-consumption problems under discounted utility is that the discount rate is assumed to be constant over time which leads to the discount function be exponential. This assumption provides the possibility to compare outcomes occurring at different times by discounting future utility by some constant factor. But, on the other hand, results from experimental studies contradict this assumption, indicating that discount rates for the near future are much lower than discount rates for the time further away in future. Ainslie (1995) established experimental studies on human and animal behavior and found that discount functions are almost hyperbolic; that is, they decrease like a negative power of time rather than an exponential. Loewenstein and Prelec (1992) showed that economic decision-makers are impatient about choices in the short term but are more patient when choosing between long-term alternatives; therefore, a hyperbolic type discount function would be more realistic.
Unfortunately, as soon as a discount function is non-exponential, discounted utility models become time-inconsistent in the sense that they do not admit the Bellman’s optimality principle. Consequently, the classical dynamic programming approach may not be applicable to solve these problems. According to Strotz (1955–1956), there are two basic ways of handling time inconsistency in non-exponential discounted utility models. In the first one, under the notion of naive agents, every decision is taken without taking into account that their preferences will change in the near future. The agent at time will solve the problem as a standard optimal control problem with initial condition If we suppose that the naive agent at time 0 solves the problem, his or her solution corresponds to the so-called pre-commitment solution, in the sense that it is optimal as long as the agent can pre-commit his or her future behavior at time .
Kydland and Prescott (1997) indeed argue that a pre-committed strategy may be economically meaningful in certain circumstances. The second approach consists in the formulation of a time-inconsistent decision problem as a non-cooperative game between incarnations of the decision-maker at different instants of time. Nash equilibrium of these strategies are then considered to define the new concept of solution to the original problem. Strotz (1955–1956) was the first who proposed a game theoretic formulation to handle the dynamic time inconsistent optimal decision problem on the deterministic Ramsey problem; see Ramsey (1928). Then, by capturing the idea of non-commitment, and letting the commitment period being infinitesimally small, he provided a primitive notion of Nash equilibrium strategy.
1.1. Related Works
Further work along this line in continuous and discrete time has been done by Pollak (1968); Phelps and Pollak (1968); Goldman (1980); Barro (1990); and Krusell and Smith (2003). Keeping the same game theoretic approach, Ekeland and Lazrak (2008) and Marín-Solano and Navas (2010) treated the optimal consumption problem where the utility involves a non-exponential discount function in the deterministic framework. They characterized the equilibrium strategies by a value function that has to satisfy a certain “extended Hamilton–Jacobi–Bellman (HJB) equation”, which is a non-linear differential equation displaying a non-local term that depends on the global behavior of the solution. In this situation, every decision at time t is taken by a agent which represents the incarnation of the controller at time t and is referred in Marín-Solano and Navas (2010) as a “sophisticated agent”.
Björk and Murgoci (2010) extended the idea to the stochastic setting where the controlled dynamic is driven by a quite general class of Markov process and a fairly general objective function. Yong in Yong (2011), by a discretization of time, studied a class of time inconsistent deterministic linear quadratic models and derive equilibrium controls via some class of Riccati-Voltera equations. Yong (2012), also by a discretization of time, investigated a general discounting time inconsistent stochastic optimal control problem and characterizes a feedback time-consistent Nash equilibrium control via the so-called “equilibrium HJB equation”.
The Nash equilibrium solution to the mean-variance problem was established first by Basak and Chabakauri (2010) and then extended to a further general class of time-inconsistent problems by Björk and Murgoci (2010). Other papers on the consistent planning approach for the mean-variance problem are Hu et al. (2012); Czichowsky (2013); and Björk et al. (2014).
Concerning equilibrium strategies for an optimal consumption-investment problem with a general discount function, Ekeland and Pirvu (2008) were the first to investigate Nash equilibrium strategies where the price process of the risky asset is driven by geometric Brownian motion. They characterized the equilibrium strategies through the solutions of a flow of BSDEs, and they show, for an special form of the discount function, that the BSDEs reduce to a system of two ODEs, which has a solution. Ekeland et al. (1995) added life insurance to the investor’s portfolio and they characterize the equilibrium strategy by an integral equation. In Yong (2012), the case of time-inconsistent consumption-investment problem under a power utility function is discussed. Following Yong’s approach, Zhao et al. (2014) studied the consumption-investment problem with a general discount function and a logarithmic utility function. Recently, Zou et al. (2014) investigated equilibrium consumption-investment decisions for Merton’s portfolio problem with stochastic hyperbolic discounting.
As for the comparison between different methods to time inconsistency, Wang and Forsyth (2012) evaluate time-consistent against pre-commitment strategies and compare their related efficient frontiers for a mean-variance optimization problem. The evaluation among the naive and the sophisticated approaches is given by Chen et al. (2014), who study the optimal dividend model of an insurance company in the existence of time inconsistency created by non-exponential discount factor. Cong and Oosterlee (2016) found a relation linking the time-consistent and the pre-commitment investment strategies in a defined contribution pension scheme. Cui et al. (2017) emphasize the shortcomings of pre-commitment and game theoretical strategies, and examine a self-coordination strategy that aims at corresponding global concern and local interests of the decision-maker. Van Staden et al. (2018) consider the pre-commitment and the time-consistent policies in the attendance of realistic investment constraints. Bensoussan et al. (2019) evaluate the produce of constraints on the value function of both pre-commitment and game theoretical approaches, and discover the unexpected result that for the game theoretical approach the occurrence of constraints can improve the payoff, whereas, for the pre-commitment approach, this paradox does not arise. Menoncin and Vigna (2020) evaluate the contribution pension scheme and prove that the dynamically optimal policy reacts better to extreme scenarios of market returns.
Time-inconsistent consumption-investment problem with a non-exponential discount function and a general utility function. We use the game theoretic approach to handle the time inconsistency in the same perspective as Björk and Murgoci (2010). Noting that, the game perspective that we will consider is as follows: We first consider a game with one player at each point t in time. This player represents the incarnation of the decision maker at time t and can be referred to as “player t”. This player can control the system only at time t by taking his/her strategies. A control process is then viewed as a complete description of the chosen strategies of all players in the game. The reward to player t is given by utility function of an investment-consumption optimization problem. From this description, we introduce the concept of a “perfect Nash equilibrium strategy” of the game. This is an admissible control process satisfying some admissibility conditions.
We focus on a variational technique approach leading to a version of a necessary and sufficient condition for equilibrium, which involves a flow of forward-backward stochastic differential equations (FBSDEs) along with a certain equilibrium condition. We also present a verification theorem that covers some possible examples of utility functions. Then, by decoupling the flow of the FBSDEs, we derive a closed-loop representation of the equilibrium strategies via a parabolic non-linear partial differential equation (PDE). We show that within a special form of the utility function (logarithmic, power, and exponential) the PDE reduces to a system of ODEs which has an explicit solution.
1.2. Novelty and Contribution
Different from Marín-Solano and Navas (2010) and Ekeland and Pirvu (2008), where the authors derived explicit solutions for special forms of the discount factor, in our model, the non-exponential discount function is in a fairly general form. Moreover, we consider equilibrium strategies in the open-loop sense, as defined in Hu et al. (2012) and Hu et al. (2015), which is different from most of the existing literature on this topic. Note also that the time-inconsistency, in our paper, arises from a non-exponential discounting in the objective function, while the works Hu et al. (2012) and Hu et al. (2015) are concerned with a quite different kind of time-inconsistency which is caused by the presence of non-linear terms of expectations in the terminal cost. On other hand, the objective functional, in our paper, is not reduced to the quadratic form as in Hu et al. (2012) and Hu et al. (2015).
We accentuate that, different from most of the existing literature on this topic, where some feedback equilibrium strategies are derived via several very complicated highly non-linear integro-differential equations, an explicit representation of the equilibrium strategies are obtained in our work via simple ODEs. In addition, this method can provide the necessary and sufficient conditions to characterize the equilibrium strategies, while the extended HJB techniques can create, in general, only the sufficient condition in the form of a verification theorem that characterizes the equilibrium strategies.
1.3. Structure of the Paper
The rest of the paper is organized as follows. In Section 2, we formulate the problem and give the necessary notations and preliminaries. In Section 3, we present the main results of the paper, Theorem 1 and Theorem 2, that characterize the equilibrium decisions by some necessary and sufficient conditions. In Section 4, we derive an explicit representation of the equilibrium consumption-investment strategy. Section 5 is devoted to some comparisons with existing results in the literature. The paper ends with an Appendix containing some proofs.
2. Problem Formulation
In what follows, we assume that is a d-dimensional standard Brownian motion defined on a filtered probability space , such that is a natural filtration that satisfies the usual conditions, in particular, contains all -null sets and for an arbitrarily fixed finite time horizon Recall that stands for the information available up to time t, and any decision made at time t is based on this information.
2.1. Notations
Throughout this paper, we use the following notations: : the transpose of the vector (or matrix) M, the inner product of and , that is, For a function we denote by (resp. the first (resp. the second) derivative of f with respect to the variable
For any Euclidean space E with Frobenius norm , we let, for any
- for any the set of valued measurable random variables such that
- the space of valued, adapted continuous processes , with
- for any the space of valued, adapted processes , with
2.2. Financial Market
Consider an individual facing the inter-temporal consumption and portfolio problem where the market environment consists of one riskless and d risky securities. The risky securities are stocks and their prices are modeled as Itô processes. Namely, for the price for of the i-th risky asset, satisfies
with for and the coefficients and for are progressively measurable processes with values in and , respectively. For brevity, we use to denote the drift rate vector and to denote the random volatility matrix.
The riskless asset, or the savings account, has the price process , for governed by
where is a process with values in that represents the interest rate. We assume that for . This is a very natural assumption since, otherwise, nobody is willing to invest in the risky stocks.
2.3. Investment-Consumption Policies and Wealth Process
Starting from an initial capital at time 0, during the time horizon , the decision-maker is allowed to dynamically invest in the stocks, as well as in the bond and consuming. A consumption-investment strategy is described by a -dimensional stochastic process where represents the consumption rate at time and for represents the amount invested in the i- risky stock at time The process is called an investment strategy. The amount invested in the bond at time s is
where is the wealth process associated with the strategy and the initial capital . The evolution of can be described as
Accordingly, the wealth process solves the SDE:
where .
As time evolves, it is natural to consider the controlled stochastic differential equation parametrized by and satisfied by
Definition 1
(Admissible Strategy). A strategy is said to be admissible over if and for any the equation has a unique solution
We impose the following assumption about the coefficients.
- (H1)
- Processes , and are uniformly bounded and moreover we assume the following uniform ellipticity condition:for some , where denotes the identity matrix on
Under (H1), for any the state equation has a unique solution . Moreover, we have the estimate
for some positive constant K. In particular, for and the state equation has a unique solution , and the following estimate holds:
2.4. General Discounted Utility Function
Most of financial-economics works have considered that the rate of time preference is constant (exponential discounting). However, there is growing evidence to suggest that this may not be the case. In this section, we discuss the general discounting preferences. We also introduce the basic modeling framework of Merton’s consumption and portfolio problem. We refer the reader to Ainslie et al. (1991); Karatzas et al. (1987); Merton (1969, 1971), and Pliska (1986) for more detail about the classical Merton model.
2.4.1. Discount Function
As soon as discounting is non-exponential, most papers work with special form of the non-exponential discount factor. Differently from these works, we consider a general form of the discount factor.
Definition 2.
A discount function is a continuous and deterministic function satisfying and
Remark 1.
Some examples of discount functions are given in many papers, such as exponential discount functions (see Merton (1969) and Merton (1971)), mixture of exponential functions (see Ekeland and Pirvu (2008)), and hyperbolic discount functions (see Zhao et al. (2014)).
2.4.2. Utility Functions and Objective
In order to evaluate the performance of a consumption-investment strategy, the decision-maker derives utility from inter-temporal consumption and final wealth. Let be the utility of inter-temporal consumption and the utility of the terminal wealth at some non-random horizon T (which is a primitive of the model). Then, for any , the investment-consumption optimization problem is reduced to maximize the utility function given by
over subject to where . We restrict ourselves to utility functions which satisfy the following conditions.
- (H2)
- The maps are strictly increasing, strictly concave and satisfy the integrability condition
Noting that, most literature on the necessary and/or sufficient optimality conditions in stochastic control problem that considers more strong conditions about the coefficients, in which the derivatives and are bounded or have linear or quadratic growth; see, e.g., Yong and Zhou (1999). It is also worth mentioning that , several papers impose an bounds on the control process for . Those restrictions make it impossible to apply the stochastic maximum principle approach directly to study the consumption–investment problem. Certainly, in that important problem, the optimal control is not necessarily -integrable, and the derivatives of the running cost and the terminal cost do not necessarily follow the global polynomial growth conditions.
In this paper, we overcome the technical difficulties mentioned above and treat some limiting procedures. To do so, let us introduce further technical integrability conditions of the utilities, which will be used in the proof of the main result.
- (H3)
- The maps are twice continuously differentiable functions, so all the derivatives and are continuous.
- (H4)
- For all admissible strategy pairs, there exists a constant such that
If we write , and we denote and
then the optimal control problem associated with and is equivalent to maximize
subject to
over
2.4.3. Time Inconsistency
Let us first note that the optimal policies, although they exist, will not be time-consistent in general. First of all, as an illustration, let us consider the model in (8)–(9) with logarithmic utility functions. We suppose that the financial market consists of one riskless asset and d risky assets. Arguing as in Ekeland and Pirvu (2008), we can prove that, if the agent is naive and starts with a given positive wealth x, at some instant then, by the standard dynamic programming approach, the value function associated with this stochastic control problem solves the following Hamilton–Jacobi–Bellman equation.
The HJB equation contains the term , which depends not only on the current time s but also on initial time t, so the optimal policy will depend on t, as well. Indeed, the first order necessary conditions yield the optimal policy
Let us consider the following example: The naive agent for the initial pair solves the problem, assuming that the discount rate of time preference will be , for and the optimal consumption strategy will be
This solution corresponds to the so-called pre-commitment solution, in the sense that it is optimal as long as the agent can pre-commit (by signing a contract, for example) his or her future behavior at time . If there is no commitment, the 0-agent will take the action , but, in the near future, the -agent will change his decision rule (time-inconsistency) to the solution of the HJB equation with In this case, the optimal control trajectory for will be changed to , given by
If , where is the constant discount rate, then
hence, the optimal consumption plan is time consistent. As soon as discount function is non-exponential
Then, the optimal consumption plan is not time consistent. In general, the solution for the naive agent will be constructed by solving the family of HJB equations for , and patching together the “optimal” solutions If the agent is sophisticated, things become more complicated. The standard HJB equation cannot be used to construct the solution, and a new method is required in what follows.
3. Equilibrium Strategies
It is well known that the problem described above by (8)–(9) turns out to be time inconsistent in the sense that it does not satisfy the Bellman optimality principle, since a restriction of an optimal control for a specific initial pair on a later time interval might not be optimal for that corresponding initial pair. For a more detailed discussion see Ekeland and Pirvu (2008) and Yong (2012). Due to the lack of time consistency, we consider open-loop Nash equilibrium controls instead of optimal controls. As in Hu et al. (2012), we first consider an equilibrium by local spike variation, given, for an admissible consumption-investment strategy For any valued, measurable and bounded random variable v and for any define
We have the following definition.
Definition 3
(Open-loop Nash equilibrium). An admissible strategy is an open-loop Nash equilibrium strategy if
for any where is the equilibrium wealth process that solves the SDE
3.1. A Necessary and Sufficient Condition for Equilibrium Controls
In this paper, we follow an alternative approach, which is essentially a necessary and sufficient condition for equilibrium. In the same spirit of proving the stochastic Pontryagin’s maximum principle for equilibrium in Hu et al. (2012) for the case of linear quadratic models, we derive this condition by a second-order expansion in the spike variation.
Now, we introduce the adjoint equations involved in the characterization of open-loop Nash equilibrium controls.
3.1.1. Adjoint Processes
Let an admissible strategy and denote by the corresponding wealth process. For each , we introduce the first order adjoint equation defined on the time interval , and satisfied by the pair of processes as follows
where Under the assumption (H1), the BSDE is uniquely solvable in Moreover, there exists a constant such that, for any we have the following estimate
The second order adjoint equation is defined on the time interval and satisfied by the pair of processes as follows:
where Under (H1), the above BSDE has a unique solution . Moreover, we have the following representation for :
Indeed, if we define the function for each as the fundamental solution of the linear ODE
and we apply the Itô’s formula to on by taking conditional expectations, we obtain . Note that, since , then .
3.1.2. A Characterization of Equilibrium Strategies
The following theorem is the first main result of this work, and it provides a necessary and sufficient condition for equilibrium. As we have said before, the proof is inspired by Hu et al. (2012) and Hu et al. (2015).
First, we define the process , and we introduce the following notations:
and, for a certain
Theorem 1.
Let (H1)–(H4) hold. Given an admissible strategy , let for any the process
be the unique solution to the BSDE . Then, is an equilibrium consumption-investment strategy, if and only if, the following condition holds
In order to derive the proof of this theorem, let us, first of all, derive some technical results. First, denote by the solution of the state equation corresponding to . Since the coefficients of the controlled state equation are linear, using the standard perturbation approach (see, e.g., Yong and Zhou (1999)), we have
where, for any valued, measurable, and bounded random variable v, and for any and , solve, respectively, the following linear stochastic differential equations:
and
Proposition 1.
Let (H1)–(H4) hold. For any the following estimates hold for any
In addition, we have the following equality:
Proof.
See Appendix A. □
Now, we present the following technical lemma needed later. The proof follows an argument adapted from Hamaguchi (2019).
Lemma 1.
Under assumptions (H1)–(H4), there exists a sequence satisfying as , such that
- (1)
- (2)
Proof.
See Appendix A. □
Proof
(Proof of Theorem 1.). Given an admissible strategy
for which holds, according to Lemma 1, we have from that, for any , and for any valued, measurable, and bounded random variable there exists a sequence satisfying as , such that
where we have used in the last inequality the fact that, under the concavity condition of and ,it follows Hence, is an equilibrium strategy.
Conversely, assume that is an equilibrium strategy. Then, by , together with and Lemma 1, for any the following inequality holds:
Now, we define
Clearly, is well defined. In fact, it is a second order polynomial in terms of the components of vector Easy manipulations show that the inequality is equivalent to
So, it is easy to see that the maximum condition leads to the following condition:
According to Lemma 1, the expression follows immediately. This completes the proof. □
3.2. A Characterization of Equilibrium Strategies by Verification Argument
In classical (time-consistent) stochastic control theory, the sufficient condition of optimality is of significant importance for computing optimal controls. It says that, if an admissible control satisfies the maximum condition of the Hamiltonian function, then the control is indeed optimal for the stochastic control problem. This allows one to solve examples of optimal control problems, where one can find a smooth solution to the associated adjoint equation.
The aim of the following theorem is to characterize the open-loop equilibrium pair only by a sufficient condition of equilibrium. Let us introduce an alternative to (H3) hypothesis:
- (H3′)
- The maps are continuously differentiable, and the first order derivatives are continuous.
Then, we have the following theorem:
Theorem 2.
Let (H1), (H2) and (H3’) hold. Given an admissible strategy , let, for any the process
be the unique solution to the BSDE . Then, is an equilibrium consumption-investment strategy, if the following condition holds:
Proof.
Suppose that is an admissible control for which the condition (32) holds. In addition, for any and , we consider by Then, we have the following difference.
Noting that, by the concavity of , we have
Accordingly, by the terminal condition in the BSDE (14), we obtain that
By applying Ito’s formula to on , we get
By the concavity of , we find
By taking and in it follows that
Now, dividing both sides by and taking the limit when vanishes, by Lemma 1, we conclude that ·) is an equilibrium control. □
Remark 2.
The purpose of the sufficient condition of optimality is to find an optimal control by computing the difference in terms of the Hamiltonian function, where is an arbitrary admissible control. Here, the spike variation perturbation plays a key role in deriving the sufficient condition for equilibrium strategies, which reduces to the computation of the difference , without the necessity to achieving the second order expansion in the spike variation.
4. Equilibrium When the Coefficients Are Deterministic
Theorems 1 and 2 show that one can obtain equilibrium consumption-investment strategies by solving a system of FBSDEs which is not standard since the “flow” of the unknown process is involved. Moreover, there is an additional constraint that act on the “diagonal” (i.e., when ) of the flow. As far as we know, the explicit solvability of this type of equations remains an open problem, except for some particular form of the utility function. However, we are able to solve quite thoroughly this problem when the parameters , and are deterministic functions. In this section, we define what we mean by an equilibrium rule, and then we derive a parabolic backward PDE. Our PDE is comparable with the one obtained in Marín-Solano and Navas (2010) and Ekeland and Pirvu (2008), for some particular discount functions in a finite horizon with different utility functions.
In this section, let us look at the Merton’s portfolio problem with general discounting and deterministic parameters. At first, we consider the following parabolic backward partial differential equation:
where we denote by the inverse function of the strictly decreasing marginal derivative utility and .
We have the following verification theorem.
Theorem 3.
Let (H1)–(H4) hold. If there exists a classical solution
of the PDE such that the stochastic differential equation,
has a unique solution in which the following estimate holds
then, the equilibrium consumption-investment strategy is given by
Proof.
Suppose that is an equilibrium control and denote by the corresponding wealth process. Then, in view of Theorem 1, there exists an adapted process, solution of the following flow of forward-backward SDEs, parametrized by
with conditions
From the terminal condition in the first order adjoint process, we consider the following Ansatz
for some deterministic function such that
Applying Itô’s formula to , it yields
Next, comparing the term in by the ones in the second equation in we deduce that
and by comparing the terms we also get
We put the above expressions of and at into and and then
and
which leads to the following representation
Then, by taking expressions and into , this suggests that coincides with the solution of the PDE , evaluated along the trajectory solution of the state equation. □
Remark 3.
Equation is comparable with the one in Marín-Solano and Navas (2010) and Ekeland and Pirvu (2008), in which the equilibrium is defined within the class of feedback controls.
Remark 4.
Theorem 3 enables us to derive a suitable equilibrium strategy , as well as , at each , and this permits us to derive directly an explicit expression of equilibrium control in the cases of power, logarithmic, and exponential utility functions. While the duality approach used in Hamaguchi (2019) permits to characterize a stochastic equilibrium solution in terms of a complicated FBSDE system of a closed form, it does not provide an explicit representation.
5. Special Utility Functions
Equilibrium investment-consumption strategies for Merton’s portfolio problem with general discounting and deterministic parameters have been studied in Marín-Solano and Navas (2010); Ekeland and Pirvu (2008); and Yong (2012), among others, in different frameworks. In this section, we discuss some special cases in which the function may be separated into functions of time and state variables. Then, one needs only to solve a system of ODEs in order to completely determine the equilibrium strategies. We will compare our results with some existing ones in the literature.
5.1. Power Utility Function
To make the problem (8)–(9) explicitly solvable, we consider power utility functions for the running and terminal costs. That is, and with and In this case, the PDE reduces to
From the terminal condition, we consider the following trial solution
for some deterministic function with the terminal condition Then, by substituting in we obtain
where
and
It remains to determine the function First, by the change of variable
we find that should solve the following ODE
A variation of constant formula yields to
and, subsequently, we obtain
In view of Theorem 3, the representation of the Nash equilibrium strategies – gives
This consumption–investment strategy determines a wealth process given by
The above solution is comparable with the one obtained by Marín-Solano and Navas (2010); Ekeland and Pirvu (2008); and Yong (2012).
5.2. Logarithmic Utility Function
Now, let us analyze the case where and with In this case, the PDE reduces to
Once again, we know that the solution of will be of the form
where By substituting in we get
which is explicitly solved by
In view of Theorem 3, the representation of the Nash equilibrium strategies – gives
This consumption–investment strategy determines a wealth process given by
5.3. Exponential Utility Function
Next, we consider the case where and with . The terminal condition PDE becomes
We try a solution of the form
where , such that and By substituting in , we get
This suggests that functions and should solve the following system of equations:
which is explicitly solvable for by
and
The representation of the Nash equilibrium strategies – gives
This consumption–investment strategy determines a wealth process given by
The above solution is comparable with the ones obtained in Marín-Solano and Navas (2010) by solving an extended Hamilton–Jacobi–Bellman (HJB) equations.
6. Special Discount Function
As well documented in Marín-Solano and Navas (2010), an agent making a decision at time t is usually called the t-agent, and can act in two different ways: naive and sophisticated. Naive agents make decisions without taking into account that their preferences will change in the near future, and then any t-agent will solve the problem as a standard optimal control problem with initial condition , and his decision will be, in general, time-inconsistent. In order to obtain a time consistent strategy, the t-agent should be sophisticated, in the sense of taking into account the preferences of all the s-agents, for . Therefore, the approach to handle the time inconsistency in dynamic decision-making problems is by considering time-inconsistent problems as non-cooperative games with a continuous number of players, in which decisions at every instant of time are selected. The solution to the problem of the agent with non-constant discounting should be constructed by looking for the sub-game perfect equilibrium of the associated game with an infinite number of t-agents. In Marín-Solano and Navas (2010), the authors looked for a solution of a sophisticated agent to the modified HJB (which is not a partial differential equation due to the presence of a non-local term). Then, they need to define the Markov equilibrium strategies, while, in our work, and different from Marín-Solano and Navas (2010), we use the open-loop equilibrium strategies. This is a significant difference which leads to obtain an important change in the results.
6.1. Exponential Discounting with Constant Discount Rate (Classical Model)
At first, we consider the standard exponential discount function , , where is a constant representing the discount rate. In this case, our equilibrium solution for the three cases become:
(1) Logarithmic utility
(2) Power utility
(3) Exponential utility
where are given by and respectively, and
Notice that our solutions given above coincide with the optimal solutions of classical Merton portfolio problem (see, e.g., Marín-Solano and Navas (2010) in the case with constant discount rate). This confirms the well-known fact that the time-consistent equilibrium strategy for an exponential discount function is nothing but the optimal strategy. A relevant remark is that the portfolio rule is independent of the discount factor, and it is the same for a non-exponential discount function.
6.2. Exponential Discounting with Non-Constant Discount Rate (Karp’s Model)
Now, following Karp (2007), let us assume that the instantaneous discount rate is non-constant, but a continuous and positive function of time , for Impatient agents will be characterized by a non-increasing discount rate . The discount factor used to evaluate a payoff at times ≥ 0, is given by
In this case, the objective is exactly the same as Marín-Solano and Navas (2010), in which the equilibrium is, however, defined within the class of feedback controls. In Marín-Solano and Navas (2010), the (feedback) equilibrium consumption-investment solutions (also called the sophisticated consumption-investment strategies) are summarized as:
(1) Logarithmic utility
(2) Power utility
where is the solution of the integro-differential equation,
with given by and
(3) Exponential utility
where is given by and satisfies the following very complicated integro-differential equation,
where
with
Our (open-loop) equilibrium solutions reduce to
(1) Logarithmic utility
(2) Power utility
(3) Exponential utility
where are given by and respectively, and
Remark 5.
Comparing the results of this special case with our solutions, we find the following facts: The equilibrium proportion investment strategies coincide in the three cases. The consumption strategies are different in the three cases. Moreover, our equilibrium consumption strategies are well defined and explicitly given, while, in Marín-Solano and Navas (2010), equilibrium consumption strategies in the case of Power utility, as well as in the case of Exponential utility, are obtained via a very complicated integro-differential equations, in which unique solvability are not established.
Author Contributions
All authors have contributed equally. All authors have read and agreed to the published version of the manuscript.
Funding
This research received no external funding.
Acknowledgments
The authors are particularly grateful for the editor and anonymous reviewers for their valuable and constructive suggestions.
Conflicts of Interest
The authors declare no conflict of interest.
Appendix A
We derive the proof of Proposition 1 by means of the duality analysis and some limiting procedures. Moreover, since our objective function is not in quadratic form, we need to adapt some results obtained in Hu et al. (2012) and Hu et al. (2015) according to our control problem which concerns a general and non-necessary quadratic utility maximization.
Proof
(Proof of Proposition 1.). The estimates – follow from Theorem 4.4 in Yong and Zhou (1999). Moreover, the following representation holds for the objective functional:
Now, from and by applying the second order Taylor-Young expansion, we find that
By applying the second order Taylor-Lagrange expansion, we get
From , it holds that
Notice that
Now, by applying Itô’s formula to on , we get
Again, by applying Itô’s formula to on we get
where On the other hand, we conclude from (H1), together with that
By taking , and in it follows that
which is equivalent to
Now, we derive the proof of Lemma 1 by using some limiting procedures. First, let us recall the following lemma which was proved by Wang (2020) (Lemma 3.3). □
Lemma A1.
If with and , then, for a.e. , there exists a sequence depending on t such that and
Proof
(Proof of Lemma 1). We define, for and
Then, for any in the interval the pair satisfies
Moreover, it is clear that, from the uniqueness of solutions to , we have the equality for any such that Hence, the solution does not depend on the variable t, and this allows us to denote the solution of by
We have then, for any and
Now, using we have, under (H2), for any and
and
From which, we have, for any and
Noting that, since is continuous, we get
for Moreover, since , we get
Noting that , then According to (H3), by using the dominated convergence theorem,
Therefore,
Hence, for each t, there exists a sequence such that and
Moreover, since and
we get, from Lemma A1, that there exists a sub-sequence of , which is also denoted by such that
To derive the statement 2) in the Lemma 1, it is sufficient to prove the following, for each t there exists a sequence such that and
Let us prove the first limit. We have
Applying the same arguments used in the first limit, we obtain, according to Lemma A1,
at least for a sub-sequence. □
Appendix B. Conclusions
It is well known that the inconsistent optimal control problems are complicated to solve in general. In this paper, we have studied optimal investment and consumption problem, since the objective functional may depend on the non-exponential discount function. So, inspired from the previous literature, we made some restrictive conditions on the coefficients of the utility function, which allows to treat some limiting procedures in the original problem.
We have used the game theoretic approach to handle the time inconsistency. Specifically, feedback Nash equilibrium controls are explicitly constructed as an alternative of optimal controls. This has been accomplished through the necessary and sufficient condition for equilibrium during stochastic system that includes a flow of forward-backward stochastic differential equations. We derive the closed-from expression of the equilibrium investment-consumption strategy. Moreover, some particular cases of our model are discussed and compared with the previous literature from the extended HJB equations with a verification theorem.
The work can be extended in several ways. For example, this approach can be extended to a general continuous-time stochastic control problem with delay under a fairly general time-inconsistent objective functional. Another challenging problem, is the study of some statistical testing method for validation of the smoothness assumptions about the coefficients; see, e.g., Pešta and Wendler (2020). The research on these topics is in progress and will appear in our forthcoming papers.
References
- Ainslie, George. 1995. Specious reward: A behavioral theory of impulsiveness and impulse control. Psychological Bulletin 82: 463–96. [Google Scholar] [CrossRef] [Scilit]
- Barro, Robert J. 1999. Ramsey meets Laibson in the neoclassical growth model. Quarterly Journal of Economics 114: 1125–52. [Google Scholar] [CrossRef] [Scilit]
- Basak, Suleyman, and Georgy Chabakauri. 2010. Dynamic mean-variance asset allocation. Review of Financial Studies 23: 2970–3016. [Google Scholar] [CrossRef] [Scilit]
- Bensoussan, Alain, Kwok C. Wong, and Sheung C. P. Yam. 2019. A paradox in time-consistency in the mean-variance problem? Finance and Stochastics 23: 173–207. [Google Scholar] [CrossRef] [Scilit]
- Björk, Tomas, and Agatha Murgoci. 2010. A general theory of Markovian time-inconsistent stochastic control problems. SSRN Electronic Journal 55: 1694759. [Google Scholar] [CrossRef] [Scilit]
- Björk, Tomas, Agatha Murgoci, and Xun Y. Zhou. 2014. Mean-variance portfolio optimization with state-dependent risk aversion. Mathematical Finance 24: 1–24. [Google Scholar] [CrossRef] [Scilit]
- Chen, Shumin, Zhongfei Li, and Yan Zeng. 2014. Optimal dividend strategies with time-inconsistent preferences. Journal of Economic Dynamics and Control 46: 150–72. [Google Scholar] [CrossRef] [Scilit]
- Cong, Fengyu, and Cornelis W. Oosterlee. 2016. On pre-commitment aspects of a time-consistent strategy for a mean-variance investor. Journal of Economic Dynamics and Control 70: 178–93. [Google Scholar] [CrossRef] [Scilit]
- Cui, Xiangyu, Duan Li, and Yun Shi. 2017. Self-coordination in time inconsistent stochastic decision problems: A planner-doer game framework. Journal of Economic Dynamics and Control 75: 91–113. [Google Scholar] [CrossRef] [Scilit]
- Czichowsky, Christoph. 2013. Time-mean-variance portfolio selection in discrete and continuous time. Finance and Stochastics 17: 227–71. [Google Scholar] [CrossRef] [Scilit]
- Ekeland, Ivar, and Ali Lazrak. 2008. Equilibrium policies when preferences are time inconsistent. arXiv arXiv:0808.3790v1. [Google Scholar]
- Ekeland, Ivar, and Traian A. Pirvu. 2008. Investment and consumption without commitment. Mathematics and Financial Economics 2: 57–86. [Google Scholar] [CrossRef] [Scilit]
- Ekeland, Ivar, Oumar Mbodji, and Traian A. Pirvu. 2012. Time-consistent portfolio management. SIAM Journal of Financial Mathematics 3: 1–32. [Google Scholar] [CrossRef] [Scilit]
- Fleming, Wendell H., and annd Thaleia Zariphopoulou. 1991. An optimal investment/consumption model with borrowing constraints. Mathematics of Operations Research 16: 802–22. [Google Scholar] [CrossRef] [Scilit]
- Goldman, Steven M. 1980. Consistent plans. Review of Financial Studies 47: 533–37. [Google Scholar] [CrossRef] [Scilit]
- Hamaguchi, Yushi. 2019. Time-inconsistent consumption-investment problems in incomplete markets under general discount functions. arXiv arXiv:1912.01281v2. [Google Scholar]
- Hu, Y., H. Jin, and X. Y. Zhou. 2012. Time-inconsistent stochastic linear quadratic control. SIAM Journal on Control and Optimization 50: 1548–72. [Google Scholar] [CrossRef] [Scilit]
- Hu, Ying, Hanqing Jin, and Xun Y. Zhou. 2012. Time-Inconsistent Stochastic Linear-Quadratic Control: Characterization and Uniqueness of Equilibrium. SIAM Journal on Control and Optimization 55: 1261–79. [Google Scholar] [CrossRef] [Scilit]
- Karatzas, Ioannis, John P. Lehoczky, and Steven E. Shreve. 1987. Optimal portfolio and consumption decisions for a “small investor” on a finite horizon. SIAM Journal on Control and Optimization 25: 1157–86. [Google Scholar] [CrossRef] [Scilit]
- Karp, Larry. 2007. Non-constant discounting in continuous time. Journal of Economic Theory 132: 557–68. [Google Scholar] [CrossRef] [Scilit]
- Krusell, Per, and Anthony A. Smith. 2003. Consumption and savings decisions with quasi-geometric discounting. Econometrica 71: 366–75. [Google Scholar] [CrossRef] [Scilit]
- Kydland, Finn E., and Edward E. Prescott. 1997. Rules rather than discretion: The inconsistency of optimal plans. Journal of Political Economy 85: 473–92. [Google Scholar] [CrossRef] [Scilit]
- Loewenstein, George, and Drezen Prelec. 1992. Anomalies in inter-temporal choice: Evidence and an interpretation. The Quarterly Journal of Economics 107: 573–97. [Google Scholar] [CrossRef] [Scilit]
- Marín-Solano, Jesús, and Jorge Navas. 2010. Consumption and portfolio rules for time-inconsistent investors. European Journal of Operational Research 201: 860–72. [Google Scholar] [CrossRef] [Scilit]
- Menoncin, Francesco, and Elena Vigna. 2020. Mean-variance dynamic optimality for DC pension schemes. European Actuarial Journal 10: 125–48. [Google Scholar] [CrossRef] [Scilit]
- Merton, Robert C. 1969. Lifetime portfolio selection under uncertainty: The continuous-time case. Review of Econometrics Statistics 51: 247–57. [Google Scholar] [CrossRef] [Scilit]
- Merton, Robert C. 1971. Optimum consumption and portfolio rules in a continuous-time model. Journal of Economic Theory 3: 373–413. [Google Scholar] [CrossRef] [Scilit]
- Phelps, Edmund S., and Robert A. Pollak. 1968. On second-best national saving and game-equilibrium growth. The Review of Economic Studies 35: 185–99. [Google Scholar] [CrossRef] [Scilit]
- Pešta, Michal, and Martin Wendler. 2020. Nuisance-parameter-free changepoint detection in non-stationary series. TEST 29: 379–408. [Google Scholar] [CrossRef] [Scilit]
- Pliska, Stanley R. 1986. A stochastic calculus model of continuous trading: Optimal portfolios. Mathematics of Operations Research 11: 371–82. [Google Scholar] [CrossRef] [Scilit]
- Pollak, Robert A. 1968. Consistent planning. The Review of Economic Studies 35: 201–8. [Google Scholar] [CrossRef] [Scilit]
- Ramsey, Frank P. 1928. A Mathematical Theory of Saving. The Economic Journal 38: 543–59. [Google Scholar] [CrossRef] [Scilit]
- Strotz, Robert H. 1955–1956. Myopia and inconsistency in dynamic utility maximization. The Review of Economic Studies 23: 165–80. [Google Scholar] [CrossRef] [Scilit]
- Van Staden, Pieter M., Duy-Mihn Dang, and Peter A. Forsyth. 2018. Time-consistent mean-variance portfolio optimization: A numerical impulse control approach. Insurance: Mathematics and Economics 83: 9–28. [Google Scholar] [CrossRef] [Scilit]
- Wang, Tianxiao. 2020. Uniqueness of equilibrium strategies in dynamic mean-variance problems with random coefficients. Journal of Mathematical Analysis and Applications 490: 124199. [Google Scholar] [CrossRef] [Scilit]
- Wang, Jin, and Peter A. Forsyth. 2012. Comparison of mean variance like strategies for optimal asset allocation problems. International Journal of Theoretical and Applied Finance 15: 1250014. [Google Scholar] [CrossRef] [Scilit]
- Yong, Jiongmin. 2011. A deterministic linear quadratic time-inconsistent optimal control problem. Mathematical Control and Related Fields 1: 83–118. [Google Scholar] [CrossRef] [Scilit]
- Yong, Jiongmin. 2012. Time-inconsistent optimal control problems and the equilibrium HJB equation. Mathematical Control and Related Fields 2: 271–329. [Google Scholar] [CrossRef] [Scilit]
- Yong, Jiongmin, and Xun Y. Zhou. 1999. Stochastic Controls: Hamiltonian Systems and HJB Equations. New York: Springer. [Google Scholar]
- Zhao, Qian, Yang Shen, and Jiaqin Wei. 2014. Consumption-investment strategies with non-exponential discounting and logarithmic utility. European Journal of Operational Research 283: 824–35. [Google Scholar] [CrossRef] [Scilit]
- Zou, Ziran, Shou Chen, and Lei Wedge. 2014. Finite horizon consumption and portfolio decisions with stochastic hyperbolic discounting. Journal of Mathematical Economics 52: 70–80. [Google Scholar] [CrossRef] [Scilit]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).