Abstract
This paper investigates the optimal portfolio control problem under a stochastic volatility model, whose dynamics are governed by a highly nonlinear Hamilton–Jacobi–Bellman equation. We employ a separable value function and introduce a novel exponential approximation technique to simplify the nonlinear terms of the auxiliary function. The simplified HJB equation is solved numerically using the advanced Fréchet–Newton method, which is known for its rapid convergence properties. We rigorously analyze the numerical outcomes, demonstrating that the iterative sequence converges quickly to the trivial fixed point () under zero risk and zero excess return conditions. This convergence is mathematically justified through rigorous functional analysis, including the principles of contraction mapping and the Kantorovich theorem, which validate the stability and efficiency of the proposed numerical scheme. The results offer theoretical insight into the behavior of the HJB equation in simplified solution spaces.
Keywords:
optimal control; Hamilton–Jacobi–Bellman (HJB) equation; stochastic volatility model; Fréchet derivative; numerical Newton method; fixed-point theorem MSC:
35Q93; 65K10; 91G80; 47H10
1. Introduction
Optimal asset allocation is a central problem in quantitative finance, fundamentally rooted in Stochastic Control Theory [1]. The theoretical cornerstone for solving such dynamic optimization problems is the Hamilton–Jacobi–Bellman (HJB) equation [2,3]. While the classical Merton framework assumes constant market parameters, modern financial modeling necessitates incorporating more realistic features such as stochastic volatility (SV) to capture stylized empirical properties, including volatility clustering [4,5].
The inclusion of an (SV) parameter, , increases the dimensionality of the HJB equation and, crucially, results in a highly nonlinear, coupled Partial Differential Equation (PDE) [6]. Analytical solutions are extremely rare, compelling researchers to rely on robust numerical techniques [7]. Existing methods, such as Finite Differences, often require linearization through policy iteration, which can suffer from slow, first-order convergence [8].
The main objective of this research is to develop and validate a theoretically sound and highly efficient numerical scheme for solving the nonlinear HJB equation arising from an SV model under Constant Absolute Risk Aversion (CARA) utility. After dimensional reduction through the separation of variables, we address the remaining nonlinearity using the Fréchet–Newton method, a powerful technique that guarantees quadratic convergence, provided that the initial guess is sufficiently close to the solution [2,3]. We introduce an exponential approximation to simplify the Fréchet derivative operator, making the iterative map computationally tractable. Our core contribution is a detailed fixed-point analysis demonstrating that the iterative sequence converges to the trivial fixed point under zero excess return and zero volatility. This establishes the stability and validity of the proposed Fréchet–Newton scheme within the approximated space [2,9,10].
2. Literature Review
The relevant literature can be categorized into three main areas, establishing the context for our methodological contribution.
2.1. Foundations of Stochastic Control in Finance
The study of optimal investment strategies began with Merton [11], who defined the continuous-time framework solved using the HJB equation [12]. Subsequent research extended the framework to incomplete markets and stochastic parameters. In particular, models incorporating (SV) have received extensive attention [4]. Given the complexity of the HJB in these models, asymptotic expansion methods became popular, providing tractable, near-closed-form approximations based on the rate of mean reversion of the volatility factor [13,14]. These methods often serve as benchmarks for purely numerical approaches [5,15].
2.2. Numerical Solutions of Nonlinear HJB Equations
Due to the difficulty in finding analytical solutions, robust numerical schemes are paramount. Grid-based methods (Finite Differences, Finite Elements) are common, but they must handle the nonlinearity imposed by the maximization operator [16,17]. Nocedal and Wright [8] provide a fundamental framework for numerical optimization, which includes Newton’s method for solving functional equations. A major limitation of simple iterative schemes is their slow convergence rate. When direct numerical methods are challenging, particularly in high dimensions or with complex dynamics like SV, and Monte Carlo methods combined with regression techniques are often employed as a numerical benchmark [7].
2.3. The Fréchet–Newton Method and Convergence Theory
To achieve faster convergence, researchers turn to tools from functional analysis. Newton’s method for functional equations requires calculating the Fréchet derivative of the nonlinear operator [3]. This derivative yields a sequence of linear PDEs that must be solved at each step, offering quadratic convergence as compensation for the increased complexity [18]. The theoretical underpinnings of convergence in these functional iterative schemes rely heavily on fixed-point theorems. Specifically, the Contraction Mapping Principle (Banach Fixed-Point Theorem) and the generalized Newton–Kantorovich Theorem are employed to prove the existence, uniqueness, and convergence of iterative solutions to PDEs and SDEs [2,9,10]. Our work extends this framework by explicitly validating the local stability of the Newton iteration, showing that the iterative map satisfies the contraction property near the fixed point , where denotes the auxiliary function introduced later in Section 3.3. The foundational theory for the homogenization of HJB equations, central to asymptotic analysis in finance, is detailed by Evans and Souganidis [15].
In addition to classical grid-based and Monte Carlo schemes, Ahmadian et al. [19] developed a robust numerical algorithm for pricing European options in illiquid markets. Their approach addressed the nonlinearities arising from market frictions and liquidity constraints, demonstrating stable convergence and computational efficiency. This work highlights the importance of designing algorithms that remain reliable under realistic trading conditions, and it complements the broader literature on numerical solutions to nonlinear HJB-type problems.
2.4. Advances in Jump-Diffusion Models and Iterative HJB Solutions
Building upon the classical foundations of stochastic control and numerical schemes for nonlinear HJB equations, recent research has focused on models that incorporate jump risks in asset dynamics. In particular, Paziresh and Ivaz (2025) [20] proposed an iterative solution framework for the HJB equation under the Merton jump-diffusion setting. Their approach employed the Linearized Generalized Newton method, with convergence rigorously established through the Contraction Mapping Principle. Empirical validation using Google stock data demonstrated that the optimal investment ratio tends toward more aggressive allocation in risky assets when jump risk is present.
This contribution provides both theoretical and practical foundations for extending stochastic control methods to markets characterized by discontinuities, and serves as a basis for the methodological developments pursued in the present work. The novelty of this work does not lie in the Newton–Kantorovich method per se, but in its adaptation to the nonlinear SV-HJB equation through an exponential approximation of the Fréchet derivative, together with a rigorous fixed-point stability analysis that connects functional analytic conditions to financial intuition.
3. Model Formulation and HJB Derivation
3.1. Stochastic Volatility Model Dynamics
We consider an (SV) model for the stock price and the stochastic volatility parameter . The SDEs governing the stock price and the stochastic volatility parameter are
with the following model parameters:
- : Stock price at time t (state variable).
- : Stochastic volatility parameter evolving over time.
- : Expected return (drift) of the risky asset.
- : Volatility function depending on the time-varying parameter .
- : Standard Brownian motion driving the stock price dynamics.
- : Drift function of the stochastic volatility parameter .
- : Diffusion coefficient of the stochastic volatility parameter .
- : Standard Brownian motion driving the volatility dynamics.
Here, and are standard Brownian motions with correlation such that
The investor’s wealth process in the self-financing portfolio follows the SDE:
with the following model parameters:
- r: Constant risk-free interest rate.
- : Amount invested in the risky asset at time t.
We emphasize that Equations (1) and (3) are standard formulations in the literature of stochastic control and portfolio optimization. Specifically, Equation (1) follows the classical dynamics of (SV) models, as introduced in Heston-type frameworks (see Fouque et al. [4] and Li and Li [6]). Equation (3) describes the self-financing wealth process of the investor, which is a well-established result in continuous-time portfolio theory (see Merton [11], Karatzas and Shreve [1]). These equations are not claimed as original contributions of this paper; rather, they serve as the starting point for our methodological development. The originality of our work lies in the subsequent steps: the separation of variables under CARA utility, the derivation of the nonlinear PDE for the auxiliary function, and the application of the Fréchet–Newton method for stability and convergence analysis. These methodological contributions are novel and constitute the main results of this study.
The optimal control problem seeks to maximize the expected utility of the terminal wealth over the investment horizon , where t denotes the current time and T is the fixed terminal time (maturity). Specifically, the value function is defined as
3.2. The Hamilton–Jacobi–Bellman (HJB) Equation via Itô’s Lemma
Following the principle of dynamic programming (Bellman’s Principle of Optimality [12]), the value function must satisfy the HJB equation. The HJB is derived by applying Itô’s Lemma to and setting the maximum expected change in V to zero over a small time interval :
3.3. Separation of Variables for CARA Utility
We consider the (CARA) utility function
where denotes the coefficient of absolute risk aversion, measuring the investor’s sensitivity to risk, which is standard in continuous-time portfolio optimization (see Merton [11] and Karatzas and Shreve [1]). This choice is motivated by two main reasons: (i) CARA utility allows analytical tractability, specifically enabling the separation of variables in the HJB equation; and (ii) it implies that the investor’s risk aversion remains constant regardless of wealth level, which is a widely adopted assumption in stochastic control models. Using the separation of variables technique, we assume the value function takes the following form:
where t denotes the current time, and T is the terminal horizon of the investment. This formulation simplifies the nonlinear HJB equation and provides the foundation for our Fréchet–Newton analysis in the subsequent sections.
Here, y denotes the stochastic volatility parameter , introduced in Equation (1). It is the second state variable of the model, capturing the random dynamics of volatility through its own Brownian motion, which is correlated with the asset price process. The required partial derivatives of V with respect to t and X are calculated as
By substituting these derivatives of Equation (6) into the HJB Equation (5), the X-dependent terms cancel out, leading to the PDE for the auxiliary function :
with the terminal condition .
The optimal investment is derived from the first-order condition on the maximization term:
Substituting back into Equation (7) yields the final highly nonlinear PDE for :
4. Nonlinear PDE Simplification and Fréchet Derivative
We begin by rewriting the nonlinear PDE from Equation (9) in its expanded form. Using the notation and , the PDE is expressed as the functional equation :
To simplify the nonlinear PDE and prepare for Fréchet linearization, we introduce coefficients and Z for notational convenience. These coefficients are directly derived from Equation (10) by grouping constant or y-dependent terms.
In substituting these coefficients into the nonlinear PDE Equation (10), the simplified functional equation is
4.1. Analytical Test Case and Simplification Constraint
As an analytical test case for the coefficients, we consider the hypothetical solution . Under this strong assumption, all partial derivatives are equal to the function itself:
Substituting Equation (13) into Equation (12) yields:
Since , the coefficients must satisfy the following constraint for to be a solution:
Replacing and Z with their definitions from Equation (11) leads to the following explicit parameter constraint:
This constraint is automatically satisfied in the limiting case where the excess return vanishes () and parameters and are zero.
Stability Check in the Simplified Space
To verify the stability of the method under the trivial conditions and (implying ), we examine the resulting HJB equation. Assuming , the nonlinear PDE Equation (12) simplifies dramatically to
The solution to this simplified PDE, subject to the terminal condition , is . This constant function represents the trivial fixed point in the simplified space, indicating that in the absence of risk premium and volatility, the optimal-value auxiliary function does not evolve in time.
4.2. Mathematical Foundations of the Iterative Scheme
To ensure a rigorous application of the Fréchet–Newton method, we first define the core mathematical tools utilized for solving the nonlinear functional equation .
4.2.1. The Fréchet Derivative
Let be a nonlinear operator between two Banach spaces X and Y, and let . The operator F is said to be Fréchet differentiable at g if there exists a bounded linear operator such that for every ,
where is the Fréchet derivative of F at g applied to . In the context of the Newton method, linearizes the nonlinear operator around the current iterate .
4.2.2. The Generalized Newton Method
The Newton method for finding the root of the functional equation proceeds through the following iterative sequence:
where is the Fréchet derivative of F evaluated at the current iterate . This process involves solving a sequence of linear PDEs in the unknown correction term :
The primary advantage of this method is its quadratic convergence rate under appropriate conditions [18].
4.2.3. The Contraction Mapping Principle (CMP)
The convergence analysis of the iterative sequence relies on the CMP (Banach Fixed-Point Theorem) [10]. Let be a complete metric space. If a mapping is a contraction mapping, there exists a constant such that
If this holds, T has a unique fixed point , and the sequence converges to . We utilize this principle to analyze the local stability of the Newton map near the fixed point.
4.3. Derivation of the Fréchet Derivative
The nonlinear operator is defined as :
The Fréchet derivative is calculated using the following definition:
where is an arbitrary function in the domain. After applying the limit and simplifying the nonlinear ratio term , the Fréchet derivative operator is obtained:
5. Newton’s Iteration Sequence and Convergence
Newton’s method for iteration sequence is determined by solving the linearized PDE:
Substituting the operators from Equation (20) and from Equation (18) yields the recursive relation for :
Convergence Under Trivial Conditions
To demonstrate the stability of the method, we analyze the behavior of the iteration sequence under the simplified conditions derived from the analytical test case: zero excess return () and zero volatility (, implying ).
Under these conditions, the coefficients simplify to and . Assuming , operators and simplify significantly:
Substituting these into the Newton condition, we obtain
Since , we find the iteration sequence’s derivative relation:
This implies that , i.e., the next iterate is independent of time. Given the terminal condition , we must have . This demonstrates that the sequence converges instantaneously (after the first step) to the trivial fixed point in the simplified space, confirming the stability and the correct linearization of the Fréchet derivative.
6. Fixed-Point Convergence Analysis
The result in the simplified case confirms that is the stable, trivial fixed point of the Newton iteration operator . This instantaneous convergence serves as a robust check on the mathematical correctness of the Fréchet derivative calculation.
Theoretical Justification Using Kantorovich’s Theorem
For the general, nonlinear case (), the convergence of the iterative sequence is rigorously guaranteed by the Kantorovich Theorem (a generalization of Newton’s method in Banach spaces) [20]. Let be the Banach space of functions with a continuous first derivative in t and second derivative in y over the domain .
The theorem guarantees that the sequence converges quadratically to the unique root , provided three main conditions are met locally around the initial guess :
- 1.
- Inverse Boundedness: The Fréchet derivative is invertible, and its inverse is bounded, i.e., , where .
- 2.
- Initial Residual: The residual of the initial guess is bounded, .
- 3.
- Lipschitz Continuity of : The Fréchet derivative operator is Lipschitz continuous, .
The convergence to is guaranteed if the parameter .
The Fréchet derivative of Equation (20) is a second-order linear Partial Differential Operator (PDO). Its invertibility and the boundedness of its inverse are standard results in the theory of elliptic/parabolic PDEs, provided that the initial guess is sufficiently close to . This analysis confirms the theoretical soundness of the Fréchet–Newton scheme for solving the fully nonlinear HJB equation, establishing a quadratic convergence rate, which is superior to the linear convergence of typical policy iteration methods.
7. Financial Interpretation
The convergence of the auxiliary function to the constant value under the financial conditions of (zero excess return) and (zero volatility) has robust financial meanings:
- Zero Risk and Zero Excess Return: If the risky asset’s expected return () equals the risk-free rate (r), and the volatility () is zero, there is no risk–reward trade-off in the market.
- Optimal Control : In this scenario, the optimal investment of Equation (8) simplifies to 0, meaning the investor puts no capital into the stock.
- Value Function: The value function is . Since , the value function isThis indicates that the total utility derived from the optimal investment strategy is exactly equivalent to the utility achieved by holding only the risk-free asset, as the wealth process grows at the risk-free rate r.
- Conclusion: The result confirms the following economic intuition: in a market devoid of risk premium and volatility, the optimal control strategy adds zero extra value compared to simply investing at the risk-free rate. The stability check confirms that the numerical scheme accurately captures this economic reality.
8. Conclusions
This study successfully derived and numerically analyzed the nonlinear HJB equation for an optimal portfolio problem under (SV) and CARA utility. By leveraging the Fréchet–Newton method, we proposed a robust and quadratically convergent scheme. The application of this method to a simplified analytical test case demonstrated its effectiveness. Crucially, we showed that under the trivial financial conditions of zero risk premium and zero volatility, the Newton iteration converges instantaneously to the fixed point . This result mathematically validates the stability of the proposed numerical approach and confirms the economic intuition that in the absence of risk-reward opportunities, the optimal control strategy adds no extra value beyond the risk-free rate, see the proof below on the same page in Appendix A.
9. Future Work
Future research should focus on extending this analysis to the full nonlinear PDE (where ) using a discretization scheme (e.g., Finite Differences for t and y). Specific areas include
- Developing a precise exponential approximation scheme to handle the term more generally for the Fréchet derivative.
- Implementing the full iterative scheme and testing its convergence rate against standard policy iteration schemes using realistic parameter calibration (e.g., Heston model parameters) [7].
- Expanding the analysis to prove the local contraction property of the Newton map near the fixed point for the discretized domain.
Author Contributions
Conceptualization, K.I. and M.M.; investigation, M.P.; writing—original draft preparation, M.P. All authors have read and agreed to the published version of the manuscript.
Funding
This research received no external funding.
Institutional Review Board Statement
Not applicable.
Informed Consent Statement
Not applicable.
Data Availability Statement
No datasets were generated or analyzed during the current study. The manuscript focuses solely on theoretical modeling and numerical methodology.
Acknowledgments
The presentation and dissemination of these research results are supported by National Science Fund Project K∏-06-H85-7/05.12.2024 “Significance and Potential Risks of the Fast Integration of Artificial Intelligence (AI) Technologies into the Economy and Financial Sector”.
Conflicts of Interest
The authors declare no conflicts of interest.
Appendix A. Proof of Trivial Convergence
This appendix provides the detailed algebraic simplification demonstrating the instantaneous convergence of the Fréchet–Newton iteration to the fixed point under the trivial financial conditions and .
Appendix A.1. Simplified Coefficients and Operators
The trivial conditions are defined as
Under these conditions, the coefficients defined in Equation (11) simplify to zero:
Appendix A.2. Derivation of the Instantaneous Convergence
The Fréchet–Newton iterative step is defined by solving the linear equation:
Substituting the simplified operators into this equation yields
The correction term is defined as the difference between two successive iterates: . Taking the partial derivative with respect to time (t) on both sides,
Now, by substituting the Newton result () into the left side of the equation:
By adding to both sides of the equation, the result for the next iteration is obtained:
This result proves that the iterative sequence converges to a solution that is independent of time, , within the very first step (). Applying the terminal condition leads directly to the fixed point: .
References
- Karatzas, I.; Shreve, S.E. Methods of Mathematical Finance; Springer: New York, NY, USA, 1998. [Google Scholar]
- Kloeden, P.E.; Platen, E. Numerical Solution of Stochastic Differential Equations; Springer: Berlin/Heidelberg, Germany, 1992. [Google Scholar]
- Lusternik, L.A.; Sobolev, V.J. Elements of Functional Analysis; Hindustan Publishing Corporation: Delhi, India, 1974. [Google Scholar]
- Fouque, J.P.; Papanicolaou, G.; Sircar, R.K. Derivatives in Financial Markets with Stochastic Volatility; Cambridge University Press: Cambridge, UK, 2000. [Google Scholar]
- Harrison, J.M.; Pliska, S.R. Martingales and stochastic integrals in the theory of continuous trading. Stoch. Process. Appl. 1981, 11, 215–260. [Google Scholar] [CrossRef]
- Ma, K.; Forsyth, P.A. Numerical solution of the Hamilton–Jacobi–Bellman formulation for continuous-time mean–variance asset allocation under stochastic volatility. J. Comput. Finance 2016, 20, 47–76. [Google Scholar] [CrossRef]
- Glasserman, P.; Broadie, M. Monte Carlo methods in financial engineering. In The Monte Carlo Method in Financial Engineering; Springer: New York, NY, USA, 2000; pp. 1–52. [Google Scholar]
- Nocedal, J.; Wright, S.J. Numerical Optimization, 2nd ed.; Springer Science+Business Media: Berlin/Heidelberg, Germany, 2006. [Google Scholar]
- Huang, Y.; Forsyth, P.A.; Labahn, G. Combined Fixed Point and Policy Iteration for Hamilton--Jacobi--Bellman Equations in Finance. SIAM J. Numer. Anal. 2012, 50, 1861–1882. [Google Scholar] [CrossRef]
- Zeidler, E. Nonlinear Functional Analysis and Its Applications I: Fixed-Point Theorems; Springer Science+Business Media: Berlin/Heidelberg, Germany, 2013. [Google Scholar]
- Merton, R.C. Optimum consumption and portfolio rules in a continuous-time model. J. Econ. Theory 1971, 3, 373–413. [Google Scholar] [CrossRef]
- Fleming, W.H.; Soner, H.M. Controlled Markov Processes and Viscosity Solutions; Springer Science+Business Media: Berlin/Heidelberg, Germany, 2014. [Google Scholar]
- Bensoussan, A.; Frehse, J.; Yam, P. Stochastic Control and Numerical Methods; Springer Science+Business Media: Berlin/Heidelberg, Germany, 2011. [Google Scholar]
- Fouque, J.P.; Papanicolaou, G.; Sircar, R.K.; Solna, K. Multiscale Stochastic Volatility for Equity and Credit; Cambridge University Press: Cambridge, UK, 2011. [Google Scholar]
- Evans, L.C.; Souganidis, P.E. Homogenization of Hamilton–Jacobi–Bellman Equations; Cambridge University Press: Cambridge, UK, 2018. [Google Scholar]
- Bardi, M.; Capuzzo Dolcetta, I. Optimal Control and Viscosity Solutions of Hamilton–Jacobi–Bellman Equations; Birkhäuser: Boston, MA, USA, 1997. [Google Scholar]
- Crandall, M.G.; Ishii, H.; Lions, P.L. User’s guide to viscosity solutions of second order partial differential equations. Bull. Am. Math. Soc. 1992, 27, 1–67. [Google Scholar] [CrossRef]
- Rheinboldt, W.C. A unified convergence theory for a class of iterative processes. SIAM J. Numer. Anal. 1968, 5, 42–63. [Google Scholar] [CrossRef]
- Ahmadian, D.; Farkhondeh Rouz, O.; Ivaz, K.; Safdari-Vaighani, A. Robust numerical algorithm to the European option with illiquid markets. Appl. Math. Comput. 2020, 366, 124693. [Google Scholar] [CrossRef]
- Paziresh, M.; Ivaz, K. Jump-diffusion optimization: An iterative solution to the HJB equation for investment value. Comput. Methods Differ. Equ. 2025, 1–17. [Google Scholar] [CrossRef]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.