1. Introduction
In 1995, Cranston and Le Jan [
1] introduced a linear self-attracting diffusion process. This process satisfies a stochastic differential equation (SDE) of the following form:
where the parameter
is a constant. The solution to this equation was shown to be unique. As a result,
converges both in mean square and almost surely to a normally distributed random variable. Equation (
1) is a special case of self-interacting diffusion invented by Durrett and Rogers [
2] in 1992. The processes have been studied from different aspects for many years. Herrmann and Michael [
3] analyze the rate of convergence for certain self-attracting diffusions and establish an estimate specifically for the linear case. Yan et al. [
4] introduce a linear fractional self-attracting diffusion. This process is driven by a fractional Brownian motion with Hurst index
. They study its convergence and the corresponding weighted local time. Jie He and Qian Guo [
5] propose an explicit numerical scheme to approximate the linear self-interacting diffusion. They analyze the mean-square convergence of this method and establish that its convergence order is 1. Prior research is predicated on the assumption that the parameter
is known. Given that
is inherently unknown in practical applications, its estimation is therefore essential.
As a core branch of statistical inference, parameter estimation plays an irreplaceable role. In the statistical applications of SDEs, parameter estimation has accumulated a substantial body of systematic research findings [
6]. These findings include weak consistency [
7], strong consistency [
8], and asymptotic normality [
9], all of which have been extensively studied. Yan et al. [
10] investigate the asymptotic properties of the least squares estimators under continuous observation. They establish the strong consistency and asymptotic normality of the estimators. Jørgensen and Sørensen [
11] proved the existence of a consistent estimator under the conditions
and
. They further established the asymptotic normality of the estimator under the additional rate condition
. Mazzonetto and Nieto [
12] proved the consistency and asymptotic normality of MLE and quasi-maximum likelihood estimators for the drift parameters of ergodic threshold Chan–Karolyi–Longstaff–Sanders processes. Their results apply to both continuous observations and high-frequency discrete observations with an infinite horizon.
Stochastic process observation schemes are divided into continuous and discrete types. Continuous observation of diffusion represents a mathematical idealization, underpinned by a robust theoretical framework. However, as practical measurement equipment cannot realize continuous tracking, real-world observational data are inherently discrete. In light of this, this paper derives the maximum likelihood estimator (MLE) and least squares estimator (LSE) for the parameter under continuous and discrete observation scenarios, respectively.
We now clarify the relationship between our approach and the works of Han [
13] and Chen et al. [
14]. Under the discrete observation framework, both prior works explicitly employ the auxiliary process
to construct their estimators and derive corresponding theoretical properties. Nevertheless, the process
itself is unobservable in practice, as only discrete measurements
are accessible in real applications. To overcome this critical limitation, we propose a discrete-time approximation
for the unobservable
in this paper.
The structure of the paper is as follows. In the next section, we introduce an auxiliary process
. With this process, we rewrite the SDE (
1) as a two-dimensional vector SDE (
4). In
Section 3, we derive MLE and LSE for both continuous and discrete observations. In
Section 4, we focus on the continuous observation framework. As
, we prove the almost sure convergence of
to
and establish a central limit theorem. In
Section 5, we consider the discrete observation framework. Under the conditions
and
, we establish the convergence in probability of
to
. Finally, in
Section 6, we examine the finite-sample performance of
with simulated data. Numerical results are shown.
2. Preliminaries
In the theory of ordinary differential equations [
15], it is a well-established result that higher-order ordinary differential equations can be reformulated as systems of first-order ordinary differential equations. This approach not only greatly reduces the analytical complexity of such equations but also provides a convenient framework for their numerical solution. In a similar spirit, we introduce an auxiliary stochastic process defined by
. The Itô formula gives
then
satisfies a linear SDE. Considering the integrating factor [
16]
, then
which yields
and
Building on the formulation
, we define the state components as
and
. This allows us to rewrite the SDE (
1) as a two-dimensional vector SDE.
where
Note that the linear self-attracting diffusion does not have the Markov property. However, after introducing the auxiliary stochastic process , the bivariate stochastic process is a two-dimensional Markov process.
Given that the coefficients
and
satisfy the global Lipschitz and linear growth conditions, the well-known Euler–Maruyama method [
17] can be used to obtain numerical solutions. For two-dimensional vector SDE (
4), the Euler–Maruyama scheme is given:
where
. The discrete time approximation
converges strongly to the exact solution
with order
. In particular, under the additive noise
, it turns out that the Euler–Maruyama scheme has order of strong convergence
. Thus,
The analytical solution (
3) is in integral form. Given the complex dependence with respect to s, the Itô integral requires numerical approximation. Therefore, in
Section 6, we employ the Euler–Maruyama method to simulate discrete observations of the linear self-attracting diffusion process
.
3. Maximum Likelihood Estimator and Least Squares Estimator
Maximum likelihood and least squares are the two most commonly used methods in modern statistical inference. In this section, based on both continuous and discrete observation data, we present MLE and LSE for parameter . The final results show that the estimators obtained by the two methods are identical.
3.1. MLE and LSE Under Continuous Observation
Let
be the probability measure generated by the process
on the space
, where
denotes the set of all continuous functions from
, and
is the corresponding Borel
-algebra under the supremum norm. Let
be the true value of the parameter, which lies inside the parameter space
, where
is a compact in
. From (
2),
is a zero-mean Gaussian process. Then
Then, the stochastic exponential process
is a martingale. According to the Girsanov theorem [
18], the likelihood function can be expressed as
Let
, MLE is defined as
By differentiating the log-likelihood function, we obtain
and
Thus, the MLE of
is
It should be noted that the self-attracting diffusion process considered in this paper requires
. Strictly speaking,
is not the MLE of
, as it may take negative values. A rigorous definition is provided in Kutoyants [
19]. Nevertheless, we retain this terminology for convenience.
In order to obtain LSE under continuous observation data, following the approach of Hu and Nualart [
20], we consider the following objective function:
The notation
is a widely used convention in physics and applied stochastic analysis. As the underlying process
is an Itô process driven by Brownian motion—its sample paths being almost nowhere differentiable—the symbol
is not mathematically well-defined in the classical sense. It is instead employed as a formal shorthand, with the intended meaning that
. LSE for
is then defined as
Differentiating the objective function yields
and
Thus, LSE of
is
which is identical to MLE. Therefore, the same notation is used.
3.2. MLE and LSE Under Discrete Observation
In the preceding subsection, we focused on the setting where the self-attracting diffusion process is observed continuously. In practice, however, it is difficult to obtain fully continuous observations of the sample path, and discrete sampling is far more common. Thus, we consider high-frequency observations of the self-attracting diffusion process over an infinite time horizon. Specifically, observations are made at equally spaced discrete time points , i.e., , so that . We assume that as . This condition has two important implications. First, it ensures that the total observation time tends to infinity, which is necessary for obtaining consistent estimates of parameter . Second, it reflects the high-frequency nature of the observations, enabling us to better approximate the continuous-time process by discrete-time data.
Parameter estimation for general diffusion processes follows two common approaches. The first approach constructs the MLE from continuous observations and then approximates it using discrete samples. The second approach directly formulates the MLE or LSE from discrete observations by leveraging a discretized version of the diffusion process. In the context of discrete observations, this paper adopts the first approach to construct the MLE. Following the method of Yoshida [
21], we approximate the likelihood function in Equation (
5) to derive the approximate log-likelihood function:
It is important to note here that our observation data are
. The auxiliary stochastic process
is unobservable, and therefore needs to be estimated using the observable data. Specifically, an estimator for
can be constructed as:
. Differentiating the aforementioned approximate log-likelihood function yields
and
Thus, the approximate MLE of
is
where
.
To obtain LSE based on discrete observations, we consider the Euler–Maruyama method. This approach is motivated by Florens–Zmirou [
22], who studied a minimum contrast estimator based on a first-order Euler–Maruyama type discrete time approximation of the SDE. Therefore, the first step is to construct the Euler–Maruyama scheme for Equation (
1). The Euler–Maruyama scheme for Equation (
1) is given by
where
and
. Treating
as the dependent variable,
as the independent variable, and
as the random error term, the parameter
becomes the unknown coefficient in the regression equation. According to the classical least squares method, the objective function in this case is
Differentiating the objective function yields
and
Thus, LSE of
is
which is identical to the approximate MLE. Therefore, the same notation is used.
The results above indicate that, whether under continuous or discrete observations, the expressions for MLE and LSE are identical. Therefore, hereafter, we will collectively refer to them as the estimator, without further emphasis on which specific estimation method is employed.
4. Asymptotic Properties of the Estimator Under Continuous Observation
The asymptotic properties of a parameter estimator provide an intuitive reflection of the estimator’s effectiveness and the corresponding estimation method, thereby offering solid theoretical support for the rationality and reliability of the method. Without such asymptotic theoretical guarantees, any statistical inference based on finite samples would lack scientific justification. For this reason, this chapter focuses on studying the consistency and asymptotic normality of the proposed estimator.
Consistency is the most fundamental and essential requirement for any reasonable point estimator [
23]. The following theorem shows that the estimator
is a strongly consistent estimator of
.
Theorem 1. There exists a root to , which is strongly consistent, i.e., Proof. Observe that, for
,
Then
Similarly, we obtain
From (
2), it follows that for any
,
and
Using the strong law of large numbers for Brownian motion [
24],
Therefore, for almost every
, there exist some
such that for
,
Since
is continuous in
on the compact set
, it has a local maximum and it is attained at a measurable
in
. Since
, for almost every
, there exist some
such that for
,
. i.e.,
Since
is differentiable with respect to
, it follows that
. From the derivation of
, we have
. Consequently, the estimator
is a strongly consistent estimator of the true value
. □
Theorem 2. is asymptotically normally distributed. As , Proof. Then
Since (
2) holds, the process
is adapted to the natural filtration
generated by the Brownian motion
. For any
, Itô isometry implies that
Therefore,
is a square-integrable martingale, with
and its quadratic variation being
. Consequently, by the central limit theorem for square-integrable martingales [
25], it follows that as
,
Then
The desired conclusion is established. □
5. Asymptotic Properties of the Estimator Under Discrete Observation
It is well known that the theory of diffusion processes is established on the basis of continuous-time observations, and many of their important properties also rely on the continuity of time. Therefore, when conducting statistical inference for diffusion processes under continuous observation, there are many well-developed tools available, which makes the statistical inference problem relatively tractable in such a scenario. However, in practical situations with discrete observations, many tools suitable for continuous observation are difficult to apply directly, thereby making the statistical inference problem for diffusion processes based on discrete observational data more challenging.
Before formally establishing the weak consistency and asymptotic normality of the estimator , we introduce several key lemmas. For a fixed T, these lemmas establish the convergence rate of the numerator and denominator of to the corresponding terms in . This convergence occurs in mean square and quantifies the information loss induced by discretization.
Lemma 1. For all , the solution satisfieswhere here, and in the following, C denotes a universal positive constant, which is independent of T and N, and whose value may change from line to line. Proof. Without loss of generality, assume
. First, we determine the range of
. Since
and
, we have
.
Then, using the independence of the random variables
and
, along with the Itô isometry, we obtain
Since
, we have the bound
for the second term. For the first term,
, we consider three cases in its analysis.
Case 1: , .
Case 3:
, note that when
, we have
. Thus,
Then
In summary,
The proof is completed. □
Lemma 2. For all , Proof. Let
, then
is the largest integer index
j such that
does not exceed
s. Consequently, for
, we have
. Then,
From Lemma 1 and the Cauchy–Schwarz inequality, we have
Lemma 2 is proved. □
Using the preceding two lemmas, we derive the following convergence rates for the approximants to their corresponding integrals.
Proof. For any with , we define .
(1) Applying Lemma 2 along with the Itô isometry, we obtain
This completes the proof of Equation (
6).
(2) Using Cauchy–Schwarz inequality, we have
This proves Equation (
7).
(3)
Then, using the fourth-moment formula for the normal distribution,
Similarly,
Using Cauchy–Schwarz inequality, we have
Then
The proof is complete. □
Theorem 3. Given a fixed T, for any Proof. It follows from Lemma 3 and Chebyshev’s inequality that, as
,
Therefore, by applying the arithmetic rules for convergence in probability, as
,
The proof is complete. □
To write down the difference between the estimators, introduce the following notations:
Then
Proof. Given that
, the process
is a zero-mean Gaussian process. By virtue of the Itô isometry, its variance satisfies
Applying Fubini’s theorem, we obtain
By using L’Hospital rule, we have
Then as
,
Without loss of generality, assume
. Using the covariance formula for Itô integrals, we obtain
Since
is a zero-mean Gaussian process, the random vector
follows a bivariate normal distribution. Consequently,
Hence, by applying Fubini’s theorem, we have
By using L’Hospital rule, we have
Then
Thus, as
,
By Chebyshev’s inequality, for every
, as
,
Therefore,
converges in probability to
. □
Theorem 4. As , and , Proof. Define the event
. Then, by Lemma 4, as
,
For any
, it follows from Equation (
7) that as
,
, and
,
Then
Similarly, from Equation (
8), we have
From Equation (
6), we have
By the continuous mapping theorem and Slutsky’s theorem, we obtain
Furthermore, from Theorem 1, we have
. Hence,
Therefore,
By Theorem 1, we have
. Hence, for any
, as
and
,
The proof is complete. □
The condition guarantees estimator consistency by bounding the first-order discretization error. Asymptotic normality requires control over higher-order biases and accumulated stochastic fluctuations. This demands stricter sampling rate conditions. We now state the conditions and results for the estimator’s convergence in distribution.
Theorem 5. As , and , Proof. Then
Define the event
. Then, by Lemma 4, as
,
For any
, it follows from Equation (
7) that as
,
, and
,
Similarly, from Equation (
8), we have
From Equation (
6), we have
Thus,
,
and
. By the continuous mapping theorem and Slutsky’s theorem, we obtain
Then,
Furthermore, from Theorem 2, we have
. Since
and by Slutsky’s theorem, we have the following convergence in distribution:
Then,
The proof is complete. □
6. Simulation
We simulate the trajectory of using the Euler–Maruyama scheme over the interval with a total time of discretized into steps. The estimator (where ) is then plotted against T for the true parameters and .
For both subplots in
Figure 1, the solid black line represents the estimated parameter
computed from discrete observations, while the dashed red line indicates the true parameter value
. We can clearly observe that, regardless of whether the true parameter is set to
or
, the estimator
converges rapidly in the early iterations and quickly stabilizes at the level corresponding to the true parameter value (indicated by the red dashed line in the figures), demonstrating excellent rapid convergence and stability. This confirms the consistency of our proposed estimator.
For a comparison, the following table lists the values of
for different choices of
h. These results are based on 100 independent realizations of the process
, each simulated via the Euler–Maruyama method, from which we obtain the average value of the estimator
(see
Table 1).
It can be observed from the table that as the step size h decreases and the time horizon T increases, the average value of the estimator approaches the true parameter . Furthermore, the standard deviation of decreases as T increases, which aligns with our theoretical consistency results.
7. Conclusions
In this paper, we have studied parameter estimation for a class of linear self-attracting diffusion processes with a drift coefficient of the form . The estimation problem is investigated under both continuous and discrete observation schemes. Explicit formulas for the MLE and LSE are derived, and it is shown that the two estimators coincide in both continuous and discrete observations. The consistency and asymptotic distribution of the estimators and are established. Furthermore, the performance of is evaluated via Monte Carlo simulations using synthetic data generated from the model. A natural direction for future work is to investigate the properties of the estimators under generalized nonlinear settings. This would further extend our asymptotic results and address the challenges posed by nonlinear self-attracting diffusion processes, which we have identified as a promising research direction in the concluding discussion.