Next Article in Journal
Microencapsulated Jaboticaba Berry (M. cauliflora) Juice Improves Storage Stability and In Vitro Bioaccessibility of Polyphenols
Previous Article in Journal
Linear DNA–Chitosan Nanoparticles: Formulation Challenges and Transfection Efficiency in Lung Cell Line
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Two-Stage Method for Decorrelating the Errors in Log-Linear Models for Spectral Density Comparisons in Neural Spike Sequences

by
Georgios E. Michailidis
,
Vassilios G. Vassiliadis
and
Alexandros G. Rigas
*
Department of Electrical and Computer Engineering, Democritus University of Thrace, GR67100 Xanthi, Greece
*
Author to whom correspondence should be addressed.
Appl. Biosci. 2025, 4(2), 30; https://doi.org/10.3390/applbiosci4020030
Submission received: 22 March 2025 / Revised: 20 May 2025 / Accepted: 3 June 2025 / Published: 12 June 2025

Abstract

In this paper, we present three log-linear models for comparing spectral density functions (SDFs) of neural spike sequences (NSSs). The logarithmic (ln) ratios of the estimated SDFs are modeled as polynomial expressions with respect to angular frequencies plus residual series with autocorrelated errors. The advantage of the proposed models is that they can be applied within certain frequency ranges. Analysis of point processes in the frequency domain can be performed to obtain estimates of the SDFs of NSSs by smoothing the mean-corrected periodograms using moving average weighting schemes. The weighting schemes may differ in the estimated SDFs. To decorrelate the error terms in the log models, we apply a two-stage method: in the first stage, the error terms are identified by choosing a suitable model, while in the second stage, the reliable estimates of the unknown parameters involved in the polynomial expressions are derived by decorrelating the data. An illustrative example from the field of neurophysiology is described, in which the neuromuscular system of the muscle spindle is affected by three different stimuli: (a) a gamma motoneuron, (b) an alpha motoneuron, and (c) a combination of gamma and alpha motoneurons. It is shown that the effect of the gamma motoneuron on the muscle spindle is shifted by the presence of the alpha motoneuron to lower frequencies in the range of [1.03, 7.6] Hz, whereas the presence of the gamma motoneuron shifts the effect of the alpha motoneuron in two bands of frequencies: one in the range of [13.5, 19.9) Hz and the other in the range of [19.9, 30.8] Hz.

1. Introduction

In practice, neural spike sequences (NSSs) are often considered as realizations of point processes (see [1,2,3,4,5,6,7,8,9,10] for relevant studies that apply such a consideration). Therefore, methods for analyzing point processes can be used to study the information contained in NSSs. Such methods in the frequency domain involve the estimation of the SDF (see [1,11,12,13,14] for relevant applications). In this context, recent studies have proposed a broad range of relevant methods. Regularization techniques for the estimation of the spectral density matrix in high-dimensional multivariate point processes have been developed [12]. Center-outward ranks and the Isometric Log-Ratio (ILR) transformation have been utilized to define a rank-based likelihood for spike trains, resulting in an efficient method for the identification of typical patterns and outliers in spike train data, thus enhancing classification and ranking tasks [13]. A multivariate generalization of the Skellam process with resetting (MSPR) has been introduced to model simultaneously recorded neural spike trains [14]. However, the aforementioned methods are oriented to multivariate point processes. Furthermore, relevant studies have focused either on estimating neuronal connectivity [12,14] or classification and ranking [13]. Methods for SDF estimation have been proposed based on the smoothing of the mean-corrected periodogram [11,15].
In this paper, we discuss log-linear models that enable the comparison of SDFs in NSSs. These models consist of polynomial expressions plus residual series with autocorrelated errors. While direct applications of log-linear models for comparing SDFs in NSSs are limited, relevant methodologies have been studied. Generalized Linear Models (GLMs) have been used to characterize the coding properties of neural populations [16,17]. A simulation-based study proposed a method for augmentation of the log-likelihood using terms measuring the dissimilarity between simulated and recorded activity, with the aim of improving the realism of simulated neural activity [18]. Two recent studies [13,19] have proposed filtered point process models that are capable of capturing both rhythmic and broadband components of neural activity. The aforementioned studies represent an ongoing effort to enhance the analysis of NSSs through spectral density estimation and statistical modeling. However, the direct application of log-linear models for comparison of spectral densities in spike sequences remains an under-explored area. In addition, the issue of autocorrelated errors (a case that can occur in recorded datasets, causing significant issues) has not been addressed. The presence of autocorrelated errors can lead to unreliable estimates for the unknown parameters of the log-linear models. An important point of this study is recognizing the information carried by the I a sensory axon of the muscle spindle to the spinal cord when it is affected simultaneously by gamma and alpha motoneurons and how this is related to the effect of a gamma motoneuron alone, as well as the effect of an alpha motoneuron alone in certain frequency bands. This can be achieved by comparing the logarithms of the ratios of the estimated SDFs using the appropriate log-linear model. By subtracting the correlated part from the data, we can derive reliable estimates of the unknown parameters involved in the log-linear models. In this study, such decorrelation is achieved using a two-stage method. In the first stage, the error terms are identified with a suitable model. In the second stage, we obtain reliable estimates for the parameters of the polynomial expressions by decorrelating the data.
An illustrative example from the field of neurophysiology is used to demonstrate the application of log-linear models. The data sets are sequences of NSSs obtained from the complex system of the muscle spindle when it is affected by (a) a gamma motoneuron, (b) an alpha motoneuron, and (c) a combination of gamma and alpha motoneurons, considered as three different experimental cases. The data and source code files are publicly available at Github repository (https://github.com/bvasil/muscle-spindle/tree/main/data/response (accessed on 20 February 2025) (datasets), https://github.com/ymichai/mspindle/tree/main (accessed on 5 May 2025) (source code files)). MATLAB R2016a and R 4.4.3 were used. The only information that we need is the response of the muscle spindle, and through comparison of the estimated SDFs of the responses in certain frequency bands, we reach useful conclusions with respect to the information that is transferred to the spinal cord through the I a sensory axon. In particular, the effect of the gamma motoneuron is shifted by the presence of the alpha motoneuron to lower frequencies in the range of [ 1.03 ,   7.6 ]   H z , whereas the presence of the gamma motoneuron shifts the effect of the alpha motoneuron to two ranges of higher frequencies: one in the range of [ 13.5 ,   19.9 )   H z and the other in the range of [ 19.9 ,   30.8 ]   H z .
In the Section 2, we present the notation, definitions, and SDF estimation method, which involves smoothing the mean-corrected periodogram with the help of a moving average weighting scheme. A description of the general problem is also provided. The log-linear models that involve the ratios of the estimated SDFs are discussed in the Section 3, together with the process of decorrelating the data. In the Section 4, an example from the field of neurophysiology is described along with the derived results, while in the Section 5 of this paper, the conclusions are summarized.

2. Materials and Methods

2.1. Notation, Definitions, and the Estimation of SDF

Consider the realizations N t ,   t 0 , T and M t ,   t 0 , T of two stationary point processes (SPPs). The point processes are assumed to be orderly, obey a (strong) mixing condition, and their increments are d N t and d M t , respectively. These assumptions have been described in [20,21,22] and are approximately valid in practice. Let p N and q N N ( u ) denote the mean intensity and the second-order cumulant density of { N t } , respectively [20,23]. Then, the second-order SDF is defined by
f N N λ = 2 π 1 p N + 2 π 1 + e x p i λ u q N N u d u , < λ < +
For large λ ,   f N N λ tends to a constant value; that is
lim λ f N N λ = 2 π 1 p N .
This constant value corresponds to the SDF of a Poisson point process with mean intensity p N . The SDF exists when + q N N u d u < + .
The second-order SDF of { M t } is similarly defined in terms of p M and q M M ( u ) .

2.2. A Way of Estimating the Mean-Corrected Periodogram

Let N t , t 0 be a stationary point process, which is observed over a finite interval of length T . The second-order mean-corrected periodogram of N ( t ) is defined by
I ^ N N T λ = 1 2 π H 2 T ( 0 ) d ^ N T λ 2 ,   λ 0
where d ^ N T λ is the finite mean-corrected Fourier–Stieltjes transform of the increments of the point process, given by
d ^ N T λ = 0 T h T t e x p i λ t d N t p ^ N d t .
The quantity H 2 T 0 is defined by
H 2 T 0 = 0 T h T 2 t d t ,
where h T ( t ) is a data window or a taper. More details about the mean-corrected periodogram and data windows are given in [15,24]. In practice, (4) can be approximated by the following expression:
d ^ N T λ t = 0 T 1 h T t e x p i λ t N t + 1 N t p ^ N ,
where p ^ N = N ( T ) / T is an estimate of the mean intensity. By N T , we denote the number of events of { N t } in the interval [ 0 , T ] . For more details regarding this approach, we refer the reader to [11]. The discretization approach is helpful in using the FFT algorithm for the computation of the mean-corrected periodogram.
As the mean-corrected periodogram is not a good estimate of the SDF (see [15]), we use a moving average weighting scheme over 2 m 1 + 1 frequencies to improve its properties, as follows:
f N N T λ j = 2 m 1 + 1 1 r = m 1 m 1 I ^ N N T λ j + r , λ j = 2 π j T , j = 1,2 , , n , w h e r e   n = T 1 / 2   a n d ·   d e n o t e s   t h e   i n t e g r a l   p a r t .
It can be proven, from (6), that the distribution of f N N T λ is asymptotically of the following form ([11]):
f N N T λ ~ f N N λ Χ 2 k 1 2 / 2 k 1 ,   k 1 = 2 m 1 + 1 ,
where Χ 2 k 1 2 denotes a chi-square distribution with 2 k 1 degrees of freedom. Moreover, from (7), for large k 1 , the estimate l o g 10 f N N T λ asymptotically follows a normal distribution, with mean l o g 10 f N N λ and variance given by
S T c P l o g 10 e 2 m 1 + 1 ,  
where C p = 0 1 h t 4 d t 0 1 h t 2 d t 2 and S is the extended sample interval obtained by adding zeroes to the end of the observed interval T until a power of 2 is obtained, enabling the use of the FFT algorithm [15,25]. As C p   1 , it is obvious from (8) that there is a small increase in the value of the variance. This, however, significantly reduces the phenomenon of leakage by using a data window in (5) [24]. Through choosing a suitable value of m 1 in (6), we can reduce the variance of l o g 10 f N N T λ and obtain a good estimate of l o g 10 f N N λ . In addition, an approximate 95% confidence interval of l o g 10 f N N T λ can be found, as follows:
l o g 10 f N N T λ 1.96 l o g 10 e S T C p 1 2 m 1 + 1 1 / 2 < l o g 10 f N N λ < l o g 10 f N N T λ + 1.96 l o g 10 e S T C p 1 2 m 1 + 1 1 / 2 .
An approximate 95% confidence interval for a Poisson point process can be constructed by setting f N N T λ = p ^ N / 2 π in (9).
Figure 1 represents the base 10 logarithms of the estimated SDFs for the response of the I a sensory axon of the muscle spindle when it is affected by (a) a gamma motoneuron, (b) an alpha motoneuron, and (c) a combination of gamma and alpha motoneurons. In case (a), the number of neural spikes in the interval of length T = 15,870   ms is N ( T ) = 538 . Notably, 10% of the data N t + 1 N t p ^ N , t = 0,1 , 2 , , T 1 at the beginning and 10% at the end are multiplied by a split bell cosine data window [25]. Thus, the value of C p is equal to 1.116 for p = 0.2   [25]. Then, the sample T is extended to S = 16,384 = 2 14 by adding 514 zeroes in the end. This permits the use of the Sande–Tukey Radix 2 form of the FFT for the computation of d ^ N T λ in (5) [26]. The estimate of the SDF is then obtained from (6) by choosing m 1 = 40 . The black dotted line in the middle of Figure 1a corresponds to l o g 10 p ^ Ν / 2 π , while the red solid lines above and below this value correspond to the approximate confidence limits calculated using (9). As l o g 10 p ^ Ν / 2 π corresponds to l o g 10 of the estimate of the SDF of a Poisson point process, it is clear that l o g 10 f N N T λ differs from l o g 10 p ^ Ν / 2 π in the frequency range of [ 10 ,   35 ]   H z . As the angular frequency λ becomes larger, the l o g 10 f N N T λ value tends to l o g 10 p ^ Ν / 2 π .
In case (b), similar results hold as in case (a), except that N ( T ) = 358 . Figure 1b is interpreted the same as Figure 1a, except that the estimate of the mean intensity p ^ Ν is different. The estimate l o g 10 f N N T λ is quite different than l o g 10 p ^ Ν / 2 π in the frequency range of [ 0 ,   70 ]   H z and, as λ becomes larger, the former tends to l o g 10 p ^ Ν / 2 π .
In case (c), the number of neural spikes in the interval of length T = 11,360   ms is N ( T ) = 356 . The interval T is extended to S = 16,384 by adding 5024 zeroes at the end of the initial data. The estimate of the SDF is obtained from (6) by choosing m 1 = 30 . Figure 1c is interpreted similarly to Figure 1b, except that the estimate of p ^ Ν   is different in this case. The estimate l o g 10 f N N T λ is quite different from those in the previous two cases, and tends to l o g 10 p ^ Ν / 2 π as λ becomes larger.
The SDF estimates presented in Figure 1 were obtained using the MATLAB R2016a software [27].

2.3. A Description of the General Problem

In this subsection, we discuss the general problem of comparing two SDFs using log-linear models, in which the residual series has autocorrelated errors. The presence of autocorrelation in the residual series leads to the production of unreliable estimates of the parameters. By decorrelating the initial data, we can obtain reliable estimates of the unknown parameters involved in the log-linear model. The whole procedure is performed using a two-stage method [28,29].
In the first stage, the natural logarithm (ln) of the ratio of the estimates of the SDFs can be described by an l t h order log-linear model of the form:
l n Y t = a 0 + a 1 t + a 2 t 2 + + a l t l + v t ,   l = 1 , , 4
where Y t = f N N T λ t / f M M T λ t ;   λ t = 2 π t / S ; t = 1,2 , , n . By f M M T λ t   a n d   f M M T λ t we denote the estimates of the SDFs and, by v t , we denote a residual series with autocorrelated errors. The mean value of v t is zero, and its variance is σ v 2 .
Through the identification of a suitable model for the residual series v t , we can estimate its unknown parameters with the help of a valid regression model. Then, we can derive the estimated residual series,   v ^ t ,   and, thus, an estimate of the uncorrelated residual series e t   can be obtained, where e t =   v t v ^ t .
In the second stage, we subtract the v ^ t from both sides of (10) to obtain
l n Y t v ^ t = a 0 + a 1 t + a 2 t 2 + + a l t l + v t v ^ t = a 0 + a 1 t + a 2 t 2 + + a l t l + e t ,   l = 1 , , 4 ,   t = 1,2 , , n .
Hence, the expression (11) is a valid regression model with respect to   t ,   t 2 , , t l , as e t represents a sequence of uncorrelated errors [30]. The quantity l n Y t v ^ t represents the decorrelated data.
More details of this general problem are given in the following sections, where special cases of (10) are discussed when analyzing the three experimental neurophysiological situations.
The proposed methodology is carried out in five steps for the general case and six steps for the changepoint case (see Section 4.2.2). The aforementioned steps are summarized in the flow charts presented in Figure 2 and Figure 3, respectively.
  • Step 1—Estimation of SDF: The estimate of the SDF for each signal is obtained through the mean corrected periodogram (Equation (6));
  • Step 2—Model fitting to the ratio of the spectra: The ratio of the estimated SDFs of the two examined signals is calculated, and a log-linear model is fitted to the real data. Fitted values are subtracted from the real values to obtain the residual series v t . Estimates of the autocorrelation function (ACF) and the partial autocorrelation function (PACF), with their 95% confidence intervals, are also obtained. The ACF indicates whether the residual series are autocorrelated or not, while the PACF is used to determine a suitable model to describe the autocorrelation structure of the residual series v t . The number of residuals that fall outside the confidence limits of the PACF indicates the order of the model that is required for the description of the residual structure;
  • Step 3—Estimation of the unknown parameters of the AR model: Calculations based on the residual values v t are performed. Estimates of the unknown parameters of the AR model are obtained, which will be used for decorrelation of the initial correlated data;
  • Step 4—Reliable estimates for the unknown parameters of the log-linear model: Reliable estimates for the unknown parameters of the log-linear model of the decorrelated data are obtained. The ACF, PACF, and Q–Q plots are also calculated, and a normality test is performed in the case of uncorrelated residual series e t ;
  • Step 5—Estimation of the 95% prediction intervals: Estimates of the 95% prediction intervals for the log-linear model of the decorrelated data are obtained.

3. The Proposed Log-Linear Models

As mentioned above, the comparisons between the muscle spindle responses are carried out based on the estimated SDFs. Three log-linear models are presented for comparison of the estimated SDFs using the natural logarithm of their ratio in the three experimental cases. The models were selected in accordance with [31,32,33]. The correlation coefficients, partial autocorrelation coefficients, and corresponding A R ( 1 ) A R ( 2 ) models for the residual series were estimated in accordance with [25,34].

3.1. The γ α γ Case

Figure 1c shows that the presence of the alpha motoneuron shifts the effect of the gamma motoneuron to lower frequencies in the range of [ 1.03 ,   7.6 ]   H z . Therefore, the estimated SDF for the response of the muscle spindle in the presence of the gamma motoneuron in the frequency range of [ 5.4 ,   12.0 ]   H z was compared with that in the presence of a combination of gamma and alpha motoneurons in the frequency range of [ 1.03 ,   7.6 ]   H z . The aforementioned frequency ranges are presented in Figure 4. In this case, the proposed log-linear model is given by
l n Y t = a 0 + a t + b t 2 + c t 3 + d t 4 + v t , t = 1,2 , , 108
where Y t denotes the ratio of the estimated SDFs, and v t is the residual series. The angular frequency λ t is defined by λ t = 2 π t / S and corresponds to the frequency t / S , where S = 16,384   ms . In both frequency ranges (i.e., [ 1.03 ,   7.6 ]   H z and [ 5.4 ,   12.0 ]   H z ), the frequencies t / S correspond to the index values t = 1,2 , , 108 .
Estimates of the unknown parameters a 0 , a ,   b ,   c , and d can be derived using the least squares method in the model (12). These estimates and their standard deviations are given in Table 1. The proposed model has an Akaike Information Criterion (AIC) value of 302.72 , while the linear model demonstrates an AIC value of 164.93 . Therefore, the log-linear model fits the real values much better.
Figure 5a presents the real data (black curve; i.e., l n Y t ,   t = 1,2 , , 108 ) and the fitted fourth-order model (red curve). Figure 5b shows the residual series when the fitted fourth-order model is subtracted from the real data.
Figure 6a shows the estimated autocorrelation coefficient function (ACF) for the residual series shown in Figure 5b. A strong correlation is clearly observed among residual values. Figure 6b presents the estimated partial autocorrelation coefficient function (PACF) of the residual series. The first value of the estimated PACF is very significant, and, thus, the correlation amongst the residual values can be modeled by an autoregressive model of order 1; namely, A R ( 1 ) . The presence of a strong correlation between the values of the residuals indicates that the estimates of the parameters a 0 , a ,   b ,   c ,   d , and φ are not reliable, where v t = φ v t 1 + ε t , and ε t is a sequence of uncorrelated errors. In the next section, we present a method for obtaining reliable estimates of the parameters a 0 , a ,   b ,   c ,   d , and φ .

3.2. The α α γ First Case

3.2.1. First Approach

Figure 1b shows that there is an increase in power of the estimated SDF in the frequency range of [ 2.6 ,   9.0 ]   H z . This refers to the situation where an alpha motoneuron affects the muscle spindle. Almost the same pattern (see Figure 1c) is observed in the situation where the muscle spindle is affected by a combination of gamma and alpha motoneurons. However, this pattern occurs in the frequency range of [ 13.5 ,   19.9 )   H z . Therefore, the estimated SDF of the response of the muscle spindle in the presence of an alpha motoneuron in the frequency range of [ 2.6 ,   9.0 ]   H z will be compared with that in the presence of a combination of gamma and alpha motoneurons in the frequency range of [ 13.5 ,   19.9 )   H z . This indicates that the presence of a gamma motoneuron shifts the effect of the alpha motoneuron at higher frequencies in the range of [ 13.5 ,   19.9 ) H z . The aforementioned frequency ranges are presented in Figure 7. In this case, the proposed log-linear model is given by
l n Y t = a + b t 2 + v t , t = 1,2 , , 105
where Y t denotes the ratio of the estimated SDF, and v t is a residual series. The frequencies t / S ,   t = 1,2 , , 105 correspond to both frequency ranges (i.e., [ 2.6 ,   9.0 ]   H z and [ 13.5 ,   19.9 ]   H z ), where S = 16,384   ms .
Estimates of the unknown parameters a and b can be derived using the least squares method in the model (13). These estimates and their standard deviations are given in Table 2. The proposed model has an Akaike Information Criterion (AIC) value of 344.31 , while the linear model demonstrates an AIC value of 447.46 . Therefore, the linear model fits the real values much better. However, the log-linear model provides a better approximation of the normal distribution of errors e t (see Section 4.2), while its fitting is still very satisfactory.
Figure 8a presents the real data (black curve; i.e., l n Y t ,   t = 1,2 , , 105 ) and the fitted quadratic model (red curve). Figure 8b shows the residual series when the fitted quadratic model is subtracted from the real data.
Figure 9a shows the estimated ACF for the residual series shown in Figure 8b. A strong correlation is clearly observed amongst the residual values. Figure 9b shows the estimated PACF for the residual series. In this case, there is again a very significant first value in the estimated PACF, indicating that the correlation amongst the residual values can be modeled using an A R ( 1 ) model. This implies that the estimates of the unknown parameters a , b , and φ are not reliable, where v t = φ v t 1 + ε t , and ε t is a sequence of uncorrelated errors. Reliable estimates of the parameters a , b , and φ will be discussed in the next section.

3.2.2. Second Approach

If we look carefully at Figure 8a, we can see that there is a changepoint in the α α γ   first case data. To check that there is a changepoint in the α α γ   first case data in the frequency range of [ 13.5 ,   19.9 )   H z , we use the changepoint analysis R 4.4.3 package, as described in [35]. The obtained changepoint corresponds to the index value t = 62   ( 17.27   H z ) , as shown in Figure 10. For more details about the analysis of the changepoint models, we refer the reader to [36]. Thus, the frequency band [ 13.5 ,   19.9 ) H z can be separated into two parts: one in the range of [ 13.5 ,   17.3 )   H z , referred to as α α γ ( 1 ) , and the other in the range of [ 17.3 ,   19.9 )   H z , referred to as α α γ ( 2 ) . In the α α γ ( 1 ) case, the proposed log-linear model is given by
l n Y t = a 1 + b 1 t + v 1 t , t = 1,2 , , 62
where Y t denotes the ratio of the estimates of the SDFs, and v 1 t is a residual series. The index values t = 1,2 ,   , 62 correspond to the frequencies in the range of [ 13.5 ,   17.3 )   Hz .
Estimates of the unknown parameters a 1 and b 1 were obtained by applying the least squares method in the model (14). The estimates and their standard deviations are given in Table 3. The proposed model has an Akaike Information Criterion (AIC) value of 250.39 , while the linear model demonstrates an AIC value of 325.78 . Therefore, the linear model fits the real values much better. However, the log-linear model provides a better approximation of the normal distribution of errors e t (see Section 4.2), while its fitting is still very satisfactory.
Figure 11a shows the real data (black curve; i.e., l n Y t ,   t = 1,2 , , 62 ) and the fitted first-order model (red curve). Figure 11b presents the residual series obtained when the fitted first-order model is subtracted from the real data.
Figure 12a presents the estimated ACF for the residual series shown in Figure 8b, from which a strong correlation is clearly observed among the residual values. Figure 12b shows the estimated PACF for the residual series. Again, this shows that the first value of the estimated PACF is very significant, indicating that the correlation amongst the residual values can be modeled using an A R ( 1 ) model. This implies that the estimates of the unknown parameters a 1 , b 1 , and φ are not reliable, where v 1 t = φ v 1 t 1 + ε 1 t , and ε 1 t is a sequence of uncorrelated errors. Reliable estimates of the parameters a 1 , b 1 , and φ will be given in the next section.
In a similar way, we can analyze the α α γ ( 2 ) data. In this case, the proposed log-linear model is given by
l n Y t = a 2 + b 2 t + v 2 t , t = 63,64 , , 105
where Y t denotes the ratio of the estimated SDFs, and   v 2 t is a residual series. The index values   t = 63,64 ,   , 105 correspond to the frequencies in the range of [ 17.3 ,   19.9 )   H z .
Estimates of the unknown parameters a 2 and b 2 were obtained by applying the least squares method in the model (15). The estimates and their standard deviations are given in Table 4. The proposed model has an Akaike Information Criterion (AIC) value of 145.63 , while the linear model demonstrates an AIC value of 179.33 . Therefore, the linear model fits the real values much better. However, the log-linear model provides a better approximation of the normal distribution of errors e t (see Section 4.2), while its fitting is still very satisfactory.
Figure 13a presents the real data (black curve; i.e., l n Y t ,   t = 63,64 , , 105 ) and the fitted first-order model (red curve), whereas Figure 13b shows the residual series when the fitted first-order model is subtracted from the real data.
Figure 14 presents the estimated ACF and PACF for the residual series shown in Figure 13b, from which a strong correlation among the values of the residuals is clearly observed (see Figure 14a); furthermore, the first value of the estimated PACF (see Figure 14b) is significant, indicating that the correlation among the residual values can be modeled using an A R ( 1 ) model. The presence of correlation in the residual series implies that the estimates of the unknown parameters a 2 , b 2 , and θ are not reliable, where v 2 t = θ v 2 t 1 + ε 2 t , and ε 2 t is a sequence of uncorrelated errors. Reliable estimates of the parameters a 2 ,   b 2 , and θ will be discussed in the next section.

3.3. The α α γ Second Case

In this case, we compare the estimated SDF for the response of the muscle spindle when it is affected by an alpha motoneuron in the frequency range of   [ 9.3 ,   20.5 ]   H z with the estimated SDF for the response of the muscle spindle when it is affected simultaneously by gamma and alpha motoneurons in the frequency range [ 19.9 ,   30.8 ]   H z . The aforementioned frequency ranges for each signal are presented in Figure 15. The proposed log-linear model for this case is given by
l n Y t = a 0 + a t + b t 2 + c t 3 + d t 4 + v t , t = 1,2 , , 178
where Y t denotes the ratio of the estimated PS, and v t is a residual series. The angular frequency λ t is defined by λ t = 2 π t / S and corresponds to a frequency of t / S , where S = 16,384   ms . Here, the index values t = 1,2 , , 178 correspond to the frequencies in the ranges of [ 9.3 ,   20.5 ]   H z and 19.9 ,   30.8 H z , respectively.
Estimates of the unknown parameters a 0 , a , b , c , and d were obtained by applying the least squares method to the model (16). The estimates and their standard deviations are given in Table 5. The proposed model has an Akaike Information Criterion (AIC) value of 361.16 , while the linear model demonstrates an AIC value of 484.87 . Therefore, the log-linear model fits the real values much better.
Figure 16a presents the real data (black curve; i.e., l n Y t ,   t = 1,2 , , 178 ) and the fitted fourth-order model (red curve). Figure 16b shows the residual series when the fitted fourth-order model is subtracted from the real data.
Figure 17a shows the estimated ACF for the residual series shown in Figure 16b, from which a strong correlation among the residual values is clearly observed. Figure 17b presents the estimated PACF of the residual series. The first two values of the estimate of PACF are significant, which indicates that the residual series can be modeled using an autoregressive model of order 2, that is, A R ( 2 ) . The presence of a strong correlation amongst the residual values indicates that the estimates of the parameters a 0 , a ,   b ,   c ,   d ,   φ 1 , and φ 2 are not reliable, where v t = φ 1 v t 1 + φ 2 v t 2 + ε t , and ε t is a sequence of uncorrelated errors. Reliable estimates of these parameters are discussed in the next section.
All the computations and graphical presentations in this section were executed using the Time Series Analysis (TSA) and Changepoint libraries in the R 4.4.3 package [37].

4. Reliable Estimates for the Parameters of the Log-Linear Models

In this section, we discuss reliable estimates for the unknown parameters of the log-linear models with autocorrelated errors described in the previous section.

4.1. The γ α γ Case

To find reliable estimates for the unknown parameters of Equation (12), we use a two-stage method [28,29]. In the first stage, we obtain a reliable estimate of the parameter φ while, in the second stage, we obtain reliable estimates of the parameters a 0 , a ,   b ,   c , and d using the estimated φ ^ . This approach can be summarized as follows:
Setting t 1 in the place of t in (12), we have
l n Y t 1 = a 0 + a ( t 1 ) + b ( t 1 ) 2 + c ( t 1 ) 3 + d ( t 1 ) 4 + v t 1 , t = 2,3 , , 108
If we multiply (17) by φ and subtract the new equation from (12), we obtain
l n Y t = φ l n Y t 1 + a 0 1 φ + a t + α φ t 1 + b t 2 b φ t 1 2 + c t 3 c φ t 1 3 + d t 4 d φ t 1 4 + ε t , where   ε t = v t φ v t 1 , t = 2,3 , , 108
Then, ε t is a sequence of uncorrelated errors, and, hence, the expression (18) is a valid regression equation model with respect to l n Y t 1 ,   t ,   t 2 , t 3 , and t 4 [30]. This enables us to estimate the parameter φ reliably. In particular, this estimate is given by φ ^ = 0.901914 .
In the second stage, we set Z t = l n Y t φ ^   l n Y t 1 , V t = t φ ^   t 1 , X t = t 2 φ ^   ( t 1 ) 2 , Y t = t 3 φ ^   t 1 3 , W t = t 4 φ ^   t 1 4 , and e t = v t φ ^ v t 1 , and, thus, obtain the following equation:
Z t = a 0 1 φ ^ + a V t + b X t + c Y t + d W t + e t , t = 2,3 , , 108
Expression (19) is a valid regression equation, from which estimates of the parameters a 0 ,   a ,   b ,   c , and d can be obtained, where a 0 = a 0 1 φ ^ .
An alternative method for estimation of the unknown parameters a 0 , a , b , c , and d can be derived from (12) by decorrelating the real data, as follows:
l n Y t φ ^ v t 1 = a 0 + a t + b t 2 + c t 3 + d t 4 + v t φ ^ v t 1 = a 0 + a t + b t 2 + c t 3 + d t 4 + e t , t = 2,3 , , 108
Both methods provide similar results for the estimates of the unknown parameters a 0 , a , b , c , and d. The values of these estimates, with their standard deviations derived from (20), are given in Table 6.
Figure 18a presents the estimated ACF, whereas Figure 18b shows the estimated PACF of the error series e t . Both figures verify that e t is a sequence of uncorrelated errors.
Figure 19a presents the Q–Q plot for the error series e t . Applying the Shapiro–Wilk test [30] to the series e t , we obtain W = 0.984 with a p-value of 0.215 . This implies that the null hypothesis—stating that the error series e t follows a normal distribution—cannot be rejected.
Substituting the estimates of the parameters a 0 , a , b , c , and d into (12), we find
l n Y t φ ^ v t 1 = a ^ 0 + a ^ t + b ^ t 2 + c ^ t 3 + d ^ t 4 + v t φ ^ v t 1 = a ^ 0 + a ^ t + b ^ t 2 + c ^ t 3 + d ^ t 4 + e t , t = 2,3 , , 108 .
The decorrelated data l n Y t φ ^ v t 1 are produced by subtracting the estimated autocorrelated errors v ^ t = φ ^ v t 1 from the real data   l n Y t . Figure 19b shows the smoothed curve of the fourth-order model with the 95% predictive intervals. Only five values of the modified data are outside the 95% predictive intervals, indicating that the fit of the model (21) is quite satisfactory. The statistical test results provided in Table 6 are also valid, as the error series e t follows a normal distribution.
We know that the effect of a gamma motoneuron results in lengthening of the central sensory region of the muscle spindle, leading to increased firing rate of the I a response (see [38]).
It is obvious, from our results, that the gamma effect on the muscle spindle is shifted by the presence of the alpha motoneuron from the frequency range of [ 5.4 ,   12.0 ]   H z to the range of [ 1.03 ,   7.6 ] H z . This indicates that the mechanistic function of the inner fibers of the muscle spindle continue to affect the terminals of the sensory axon and produce action potentials in the new range of frequencies at almost the same rate, in a manner depending on frequency as a fourth-order polynomial function.

4.2. The α α γ F i r s t Case

4.2.1. First Approach

If we apply the two-stage method mentioned above, we find the following:
In the first stage, working as in the γ α γ case, from expression (13) we obtain the following regression equation:
l n Y t = a 1 φ + φ l n Y t 1 + b t 2 b φ t 1 2 + ε t , t = 2,3 , , 105
where ε t is a residual series with uncorrelated errors. This is a valid regression equation from which an estimate of the parameter φ is found. The value of the estimate is equal to φ ^ = 0.779354 . The predicted error values of v t are calculated using the equation v ^ t = φ ^ v t 1 .
In the second stage, by subtracting v ^ t from both sides of (13), we obtain
l n Y t v ^ t = a + b t 2 + v t v ^ t = a + b t 2 + e t , t = 2,3 , , 105
The values e t = v t v ^ t are the estimated uncorrelated errors ε t . Expression (23) is a valid regression equation, from which estimates of the unknown parameters a and   b can be derived. These estimates, along with their standard deviations, are given in Table 7.
Figure 20a shows the estimated ACF, whereas Figure 20b presents the estimated PACF of the error series e t . Both figures verify that e t is a sequence of uncorrelated errors.
Figure 21a presents the Q–Q plot for the error series e t . The Shapiro–Wilk test gives W = 0.983 with corresponding p - v a l u e = 0.21 . This implies that the null hypothesis—stating that the error series e t follows a normal distribution—cannot be rejected.
Substituting the estimates for a ^ and b ^ into (23), we have
l n Y t v ^ t = a ^ + b ^ t 2 + v t v ^ t = a ^ + b ^ t 2 + e t , t = 2,3 ,   , 105
Figure 21b shows the smoothed curve of the quadratic model passing through the decorrelated data l n Y t v ^ t , together with the 95% predictive intervals. Only six values of the decorrelated data are outside the 95% predictive intervals, indicating that the fit of model (24) is quite good. The statistical test results provided in Table 7 are considered to be valid, as the error series e t follows a normal distribution.
It is known that active muscle contraction is produced by the activation of alpha motoneurons [38]. Each time an alpha spike stimulates the parent muscle, it would be expected that the muscle will contract as well as the muscle spindle because it lies in parallel with the extrafusal fibers, leading to the interruption of the spindle’s discharge.
The presence of the gamma motoneuron shifts the effect of the alpha motoneuron from the frequency range of [ 2.6 ,   9.0 ]   H z to the range of [ 13.5 ,   19.0 ]   H z . It is clear that the muscle spindle does not respond to the effect of the alpha motoneuron at low frequencies and starts producing action potentials gradually at higher frequencies with a rate that depends on frequency, in particular, in a manner that can be modeled using a quadratic function.

4.2.2. Second Approach

The α α γ ( 1 ) Case
A similar approach can be described for the α α γ ( 1 ) data as in the case of the first approach of the α α γ case. In the first stage, we obtain the following equation from expression (14):
l n Y t = a 1 1 φ + φ l n Y t 1 + b 1 t b 1 φ t 1 + ε 1 t , t = 2,3 , , 62
where ε 1 t is a residual series with uncorrelated errors. This is a valid regression equation, from which an estimate of the unknown parameter φ can be derived. In particular, this estimate is equal to φ ^ = 0.540223 .
In the second stage, by subtracting   v ^ 1 t from both sides of (14), we obtain
l n Y t   v ^ 1 t = a 1 + b 1 t + v 1 t   v ^ 1 t = a 1 + b 1 t + e 1 t , t = 2,3 , , 62
Expression (26) is a valid regression equation, from which estimates of the unknown parameters a 1 and b 1 can be obtained. These estimates, along with their standard deviations, are given in Table 8.
The estimated ACF and PACF for the error series e 1 t are shown in Figure 22, which verifies that e 1 t is a sequence of uncorrelated errors.
Figure 23a shows the Q–Q plot for the error series e 1 t . The Shapiro–Wilk test gave W = 0.977 with the corresponding p - v a l u e = 0.29 . This implies that the null hypothesis—stating that the error series e 1 t follows a normal distribution—cannot be rejected.
Substituting the estimates a ^ 1 and b ^ 1 into (26), we have
l n Y t   v ^ 1 t = a ^ 1 + b ^ 1 t + v 1 t   v ^ 1 t = a ^ 1 + b ^ 1 t + e 1 t , t = 2,3 , , 62
Figure 23b presents the smoothed curve of the first-order model passing through the decorrelated data l n Y t φ ^ v t 1 , together with the 95% predictive intervals. Only one value of the decorrelated data falls outside the 95% predictive intervals, indicating that the fit of model (27) is quite satisfactory. The statistical test results provided in Table 8 are considered valid, as the error series e 1 t follows a normal distribution.
The α α γ ( 2 ) Case
The analysis of the α α γ ( 2 ) data was carried out in the same manner as for the α–αγ(1) data.
In the first stage, from Equation (15), we obtain
l n Y t = α 2 1 θ + θ l n Y t 1 + b 2 t b 2 θ t 1 + ε 2 t , t = 64,65 , , 105
where ε 2 t is a residual series with uncorrelated errors. As (28) is a valid regression equation, an estimate of the unknown parameter θ can be obtained. In particular, this estimate was found to be θ ^ = 0.769608 .
In the second stage, by subtracting   v ^ 2 t from both sides of (15), we obtain
l n Y t   v ^ 2 t = a 2 + b 2 t + v 2 t   v ^ 2 t = a 2 + b 2 t + e 2 t , t = 64,65 , , 105
Expression (29) is a valid regression equation, from which estimates of the unknown parameters a 2 and b 2 can be derived. These estimates, along with their standard deviations, are provided in Table 9.
The estimated ACF and PACF for the error series e 2 t are shown in Figure 24, which verifies that e 2 t is a sequence of uncorrelated errors.
Figure 25a provides the Q–Q plot for the error series e 2 t . The Shapiro–Wilk test gives W = 0.965 with corresponding p-value of 0.229 . This implies that the null hypothesis—stating that the error series e 2 t follows a normal distribution—cannot be rejected.
Substituting the estimates a ^ 2 and b ^ 2 into (29), we have
l n Y t   v ^ 2 t = a ^ 2 + b ^ 2 t + v 2 t   v ^ 2 t = a ^ 2 + b ^ 2 t + e 2 t , t = 64 , 65 , , 105
Figure 25b presents the smoothed curve of the first-order model passing through the decorrelated data l n Y t v ^ 2 t , together with the 95% prediction intervals. Only two values of the decorrelated data are clearly outside the 95% predictive intervals, while a third one is also outside but very close to the lower interval, indicating that the fit of the model (30) is satisfactory. The statistical test results provided in Table 9 are considered valid, as the error series e 2 t follows a normal distribution.
Assuming that there is a changepoint in the α α γ data at a frequency of 17.27   H z , Figure 18b and Figure 20b show the logarithms of the ratios of the SDF estimates fitted by two different straight lines with positive trends. This indicates that the muscle spindle produces action potentials gradually at two different rates, which depend linearly on the frequency.

4.3. The α α γ Second Case

In this case, we follow the steps described for analysis of the γ α γ data.
In the first stage, we obtain the following equation from expression (16)
l n Y t = a 0 1 φ 1 φ 2 + φ 1 l n Y t 1 + φ 2 l n Y t 2 + α t α φ 1 t 1 α φ 2 t 2 + b t 2 b φ 1 t 1 2 b φ 2 t 2 2 + c t 3 c φ 1 t 1 3 c φ 2 t 2 3 + d t 4 d φ 1 t 1 4 d φ 2 t 2 4 + ε t , t = 3,4 , 178
where ε t = v t φ 1 v t 1 φ 2 v t 2 is a residual series of uncorrelated errors. This is a valid regression equation, from which estimates of the unknown parameters φ 1 and φ 2 can be derived. In particular, φ ^ 1 = 1.113922 and φ ^ 2 = 0.228612 .
In the second stage, by subtracting v ^ t from both sides of (16), we obtain
l n Y t v ^ t = a 0 + a t + b t 2 + c t 3 + d t 4 + v t v ^ t = a 0 + a t + b t 2 + c t 3 + d t 4 + e t , t = 3,4 , 178
where e t = v t φ ^ 1 v ^ t 1 φ ^ 2 v ^ t 2 . This is a valid regression equation, from which estimates of the unknown parameters a 0 ,   a ,   b ,   c , and d can be derived. These estimates, along with their standard deviations, are given in Table 10.
The estimated ACF and PACF for the error series e t are shown in Figure 26, which verifies that e t is a residual series of uncorrelated errors.
Figure 27a presents the Q–Q plot for the error series e t . The Shapiro–Wilk test gives W = 0.978 , with a corresponding p-value of 0.007 . This suggests that the null hypothesis—stating that the error series e t follows a normal distribution—must be rejected.
Substituting the estimates a ^ 0 , a ^ , b ^ , c ^ , and d ^ into (32), we have
l n Y t φ ^ 1 v t 1 φ ^ 2 v t 2 = a ^ 0 + a ^ t + b ^ t 2 + c ^ t 3 + d ^ t 4 + e t , t = 3,4 , , 178
Figure 27b shows the smoothed curve of the fourth-order model passing through the decorrelated data l n Y t φ ^ 1 v t 1 φ ^ 2 v t 2 , together with the 95% predictive intervals. Only eight values of the decorrelated data are outside the 95% predictive intervals, indicating that the fit of model (33) is satisfactory. The statistical test results provided in Table 10 must be interpreted cautiously, as the error series e t does not follow a normal distribution.
In this case, the presence of the gamma motoneuron shifts the effect of the alpha motoneuron from the frequency range of [ 9.3 ,   20.5 ]   H z to the range of 19.9 ,   30.8   H z . According to Figure 27b, which presents the logarithm of the ratio of the SDF estimates, there is a small shift in the power values in the beginning and a larger shift as the frequency increases. This indicates that initially, the muscle spindle produces action potentials at a lower rate, which increases at higher frequencies and varies with the frequency in a manner described by a fourth-order polynomial function.
Thus, the flexibility of the system to cope with a more complicated case, which involves the simultaneous effect of two stimuli, allows for its explanation via a more realistic mechanistic model, which contains three different ranges of frequencies (as described above).
All computations and graphics in this section were completed using the TSA library in R 4.4.3 [37].

5. Conclusions

We described three log-linear models for comparison of the estimated SDFs for neural spike trains with autocorrelated errors. The estimated SDFs were obtained from mean-corrected periodograms using simple moving average weighting schemes. However, the existence of autocorrelation leads to estimates for the unknown parameters of the log-linear models that are not reliable. Therefore, a two-stage procedure was applied for decorrelation of the data, allowing for the determination of reliable estimates for the unknown parameters. An illustrative example from the field of neurophysiology was presented, consisting of three experimental cases in which a muscle spindle is affected by the following: (a) a gamma motoneuron, (b) an alpha motoneuron, and (c) gamma and alpha motoneurons simultaneously. It was shown that the effect of the gamma motoneuron in the presence of the alpha motoneuron was shifted to lower frequencies in the range of 1.03 ,   7.6   H z , whereas the presence of the gamma motoneuron shifted the effect of the alpha motoneuron to higher frequencies in the ranges of 13.5 ,   19.9   H z and 19.9 ,   30.8   H z . The mathematical expression of the ratio of the estimated SDFs was found to follow a fourth-order model for the γ α γ case in the range of 1.03 ,   7.06   H z , a quadratic model for the α α γ case in the range of 13.5 ,   19.9   H z (or two straight lines with positive trends if we assume that there is a changepoint at 17.27   H z ), and a fourth-order model for the α α γ case in the range of 19.9 ,   30.8   H z .
The muscle spindle is a complex receptor that receives many inputs and responds with two different sensory axons. In future work, we would like to consider the case that the muscle spindle is affected by more inputs—for example, two gamma motoneurons and an alpha motoneuron simultaneously—and responds with both sensory axons (i.e., the I a primary and the I I secondary axon). The aim of such research would be to compare the information that is transferred to the spinal cord and, from there, to the central nervous system by the I a primary sensory axon and the I I secondary sensory axon.

Author Contributions

Conceptualization, G.E.M. and A.G.R.; methodology, G.E.M. and A.G.R.; software, G.E.M. and A.G.R.; validation, A.G.R. and V.G.V.; writing—original draft preparation, G.E.M. and A.G.R.; writing—review and editing, A.G.R. and V.G.V.; supervision, A.G.R. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The datasets are publicly available from Github at https://github.com/bvasil/muscle-spindle/tree/main/data/response. (accessed on 20 February 2025).

Acknowledgments

We are most grateful to G.P. Moore and J.R. Rosenberg for providing the neurophysiological data.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Brillinger, D.R. Fourier analysis of stationary processes. Proc. IEEE 1974, 62, 1628–1643. [Google Scholar] [CrossRef]
  2. Brillinger, D.R. Nerve cell spike train data analysis: A progression of technique. J. Am. Stat. Assoc. 1992, 87, 260–271. [Google Scholar] [CrossRef]
  3. Cox, D.R.; Lewis, P.A.W. Statistical Analysis of Series of Events; Methuen: London, UK, 1968. [Google Scholar]
  4. Lindsay, K.A.; Rosenberg, J.R. Linear and quadratic models of point process systems: Contributions of patterned input to output. Prog. Biophys. Mol. Biol. 2012, 109, 76–94. [Google Scholar] [CrossRef]
  5. Michailidis, G.E.; Spyroglou, I.I.; Zaridis, D.; Rigas, A.G. A method of estimating the partial power spectrum of a bivariate point process and an application to a neurophysiological data set. J. Stat. Theory Pract. 2020, 14, 36. [Google Scholar] [CrossRef]
  6. Rosenberg, J.R.; Amjad, A.M.; Breeze, P.; Brillinger, D.R.; Haliday, D.M. The Fourier approach to the identification of functional coupling between neuronal spike trains. Prog. Biophys. Mol. Biol. 1989, 53, 1–31. [Google Scholar] [CrossRef] [PubMed]
  7. Vassiliadis, V.G.; Spyroglou, I.I.; Rigas, A.G.; Rosenberg, J.R.; Lindsay, K.A. Dealing with the phenomenon of quasi-complete separation and a goodness of fit test in logistic regression models in the case of long data sets. Stat. Biosci. 2019, 11, 567–596. [Google Scholar] [CrossRef]
  8. Ramezan, R.; Marriott, P.; Chenouri, S. Multiscale analysis of neural spike trains. Stat. Med. 2014, 33, 238–256. [Google Scholar] [CrossRef]
  9. Ramezan, R.; Marriott, P.; Chenouri, S. Skellam process with resetting: A neural spike train model. Stat. Med. 2016, 35, 5717–5729. [Google Scholar] [CrossRef]
  10. Segundo, P. A history of spike trains as point processes in neural coding. J. Biophys. Paris 2010, 104, 156–159. [Google Scholar] [CrossRef]
  11. Brillinger, D.R. Time Series: Data Analysis and Theory; Society for Industrial and Applied Mathematics—SIAM: Philadelphia, PA, USA, 2001. [Google Scholar]
  12. Pinkney, C.; Euan, C.; Gibberd, A.; Shojaie, A. Regularised Spectral Estimation for High-Dimensional Point Processes. arXiv 2024, arXiv:2403.12908. [Google Scholar]
  13. Ma, Y.; Wu, W. A novel point process model for neuronal spike trains. Front. Appl. Math. Stat. 2024, 10, 1349665. [Google Scholar] [CrossRef]
  14. Ramezan, R.; Chen, M.; Lysy, M.; Marriott, P. A multivariate point process model for simultaneously recorded neural spike trains. arXiv 2022, arXiv:2206.09903. [Google Scholar]
  15. Rigas, A.G.; Vassiliadis, V.G. A semi-parametric approach for comparing the estimated spectra of two stationary point processes. Math. Biosci. 2007, 210, 361–377. [Google Scholar] [CrossRef]
  16. Sarmashghi, M.; Jadhav, S.P.; Eden, U. Efficient spline regression for neural spiking data. PLoS ONE 2021, 16, e0258321. [Google Scholar] [CrossRef]
  17. Weng, G.; Clark, K.; Akbarian, A.; Noudoost, B.; Nategh, N. Time-varying generalized linear models: Characterizing and decoding neuronal dynamics in higher visual areas. Front. Comput. Neurosci. 2024, 18, 1273053. [Google Scholar] [CrossRef] [PubMed]
  18. Bellec, G.; Wang, S.; Modirshanechi, A.; Brea, J.; Gerstner, W. Fitting summary statistics of neural data with a differentiable spiking network simulator. Adv. Neural Inf. Process. Syst. 2021, 34, 18552–18563. [Google Scholar]
  19. Bloniasz, P.F.; Oyama, S.; Stephen, E.P. Filtered Point Processes Tractably Capture Rhythmic And Broadband Power Spectral Structure in Neural Electrophysiological Recordings. bioRxiv 2024, 10, 616132. Available online: https://www.biorxiv.org/content/10.1101/2024.10.01.616132v1.full (accessed on 21 May 2025). [CrossRef]
  20. Brillinger, D.R. The identification of point process systems. Ann. Probab. 1975, 3, 909–929. [Google Scholar] [CrossRef]
  21. Cox, D.R.; Isham, V. Point Processes; Chapman and Hall: London, UK, 1980. [Google Scholar]
  22. Daley, D.J.; Vere-Jones, D. An Introduction to the Theory of Point Processes; Springer: Berlin, Germany, 1988. [Google Scholar]
  23. Bartlett, M.S. The spectral analysis of point processes. J. R. Stat. Soc. B 1963, 25, 264–296. [Google Scholar] [CrossRef]
  24. Bloomfield, P. Fourier Analysis of Time Series, 2nd ed.; Wiley: New York, NY, USA, 2000. [Google Scholar]
  25. Chatfield, C.; Xing, H. The Analysis of Time Series: An Introduction with R, 7th ed.; Chapman and Hall/CRC Press: New York, NY, USA, 2019. [Google Scholar]
  26. Gentleman, W.M.; Sande, G. Fast Fourier transforms-for fun and profit. In Proceedings of the AFIPS ’66: Proceedings of the Fall Joint Computer Conference, San Francisco, CA, USA, 7–10 November 1966; Volume 28, pp. 563–568. [Google Scholar]
  27. The MathWorks Inc. MATLAB Version: R2016a; The Mathworks Inc.: Natick, MA, USA, 2016; Available online: https://www.mathworks.com (accessed on 25 February 2025).
  28. Durbin, J. The Fitting of Time-Series Models. Rev. Int. Stat. Inst. 1960, 28, 233–243. [Google Scholar] [CrossRef]
  29. Rao, P.; Griliches, Z. Small-Sample properties of several two-stage regression methods in the context of auto-correlated errors. J. Am. Stat. Assoc. 1969, 64, 253–272. [Google Scholar] [CrossRef]
  30. Shapiro, S.S.; Wilk, M.B. An Analysis of Variance Test for Normality (complete samples). Biometrika 1965, 52, 591–611. [Google Scholar] [CrossRef]
  31. Myers, R.H.; Montgomery, D.C.; Vining, G.G.; Robinson, T.J. Generalized Linear Models with Applications in Engineering and the Sciences, 2nd ed.; John Wiley and Sons: New York, NY, USA, 2010. [Google Scholar]
  32. Dobson, A.J.; Barnett, A.G. An Introduction to Generalized Linear Models, 4th ed.; Chapman and Hall/CRC: New York, NY, USA, 2018. [Google Scholar]
  33. Montgomery, D.C.; Perk, E.A.; Vining, G.G. Introduction to Linear Regression Analysis, 6th ed.; John Wiley and Sons: New York, NY, USA, 2021. [Google Scholar]
  34. Shumway, R.H.; Stoffer, D.S. Time Series Analysis and Its Applications With R Examples, 5th ed.; Springer: New York, NY, USA, 2025. [Google Scholar]
  35. Killick, R.; Eckley, I.A. Changepoint: An R Package for Changepoint Analysis. J. Stat. Softw. 2014, 58, 1–19. [Google Scholar] [CrossRef]
  36. Eckley, I.A.; Fearnhead, P.; Killick, R. Analysis of changepoint models. In Bayesian Time Series Models; Barker, D., Cemgil, A.T., Chiappa, S., Eds.; Cambridge University Press: Cambridge, UK, 2011. [Google Scholar]
  37. CRAN. The R Project for Statistical Computing. Available online: http://www.r-project.org (accessed on 25 February 2025).
  38. Boyd, I.A. The isolated mammalian muscle spindle. Trends Neurosci. 1980, 3, 258–265. [Google Scholar] [CrossRef]
Figure 1. Base 10 logarithms of the estimated SDFs for the responses of a muscle spindle affected by (a) a gamma motoneuron, (b) an alpha motoneuron, (c) gamma and alpha motoneurons simultaneously. The dotted line in the middle corresponds to a Poisson point process with the same mean intensity, and the solid red lines indicate 95% confidence intervals.
Figure 1. Base 10 logarithms of the estimated SDFs for the responses of a muscle spindle affected by (a) a gamma motoneuron, (b) an alpha motoneuron, (c) gamma and alpha motoneurons simultaneously. The dotted line in the middle corresponds to a Poisson point process with the same mean intensity, and the solid red lines indicate 95% confidence intervals.
Applbiosci 04 00030 g001aApplbiosci 04 00030 g001b
Figure 2. Flow chart of the proposed methodology (general case).
Figure 2. Flow chart of the proposed methodology (general case).
Applbiosci 04 00030 g002
Figure 3. Flow chart of the proposed methodology (changepoint case).
Figure 3. Flow chart of the proposed methodology (changepoint case).
Applbiosci 04 00030 g003
Figure 4. Base 10 logarithms of the estimated SDFs for the responses of a muscle spindle affected by (a) gamma motoneuron [5.4, 12.0] Hz; (b) gamma and alpha motoneurons simultaneously [1.03, 7.6] Hz.
Figure 4. Base 10 logarithms of the estimated SDFs for the responses of a muscle spindle affected by (a) gamma motoneuron [5.4, 12.0] Hz; (b) gamma and alpha motoneurons simultaneously [1.03, 7.6] Hz.
Applbiosci 04 00030 g004
Figure 5. (a) Real values of l n Y t ,   t = 1,2 , , 108 (black curve) fitted by a fourth-order log-linear model (red curve); (b) residual series obtained by subtracting the values of the fourth-order model from the real values.
Figure 5. (a) Real values of l n Y t ,   t = 1,2 , , 108 (black curve) fitted by a fourth-order log-linear model (red curve); (b) residual series obtained by subtracting the values of the fourth-order model from the real values.
Applbiosci 04 00030 g005
Figure 6. (a) Estimate of the autocorrelation coefficient function for the residual series   v t ; (b) estimate of the partial autocorrelation function for the residual series.
Figure 6. (a) Estimate of the autocorrelation coefficient function for the residual series   v t ; (b) estimate of the partial autocorrelation function for the residual series.
Applbiosci 04 00030 g006
Figure 7. Base 10 logarithms of the estimated SDFs for the responses of a muscle spindle affected by: (a) alpha motoneuron [2.6, 9.0] Hz; (b) gamma and alpha motoneurons simultaneously (13.5, 19.9) Hz.
Figure 7. Base 10 logarithms of the estimated SDFs for the responses of a muscle spindle affected by: (a) alpha motoneuron [2.6, 9.0] Hz; (b) gamma and alpha motoneurons simultaneously (13.5, 19.9) Hz.
Applbiosci 04 00030 g007
Figure 8. (a) Real values of l n Y t ,   t = 1,2 , , 105 (black curve) fitted by a second-order log-linear model (red curve); (b) residual series obtained by subtracting the values of the second-order model from the real values.
Figure 8. (a) Real values of l n Y t ,   t = 1,2 , , 105 (black curve) fitted by a second-order log-linear model (red curve); (b) residual series obtained by subtracting the values of the second-order model from the real values.
Applbiosci 04 00030 g008
Figure 9. (a) Estimate of the autocorrelation coefficient function for the residual series v t ; (b) estimate of the partial autocorrelation function for the residual series.
Figure 9. (a) Estimate of the autocorrelation coefficient function for the residual series v t ; (b) estimate of the partial autocorrelation function for the residual series.
Applbiosci 04 00030 g009
Figure 10. Changepoint for the α α γ first case data.
Figure 10. Changepoint for the α α γ first case data.
Applbiosci 04 00030 g010
Figure 11. (a) Real values of l n Y t ,   t = 1,2 , , 62 (black curve) fitted by a first-order log-linear model (red curve); (b) residual series obtained by subtracting the values of the first-order model from the real values.
Figure 11. (a) Real values of l n Y t ,   t = 1,2 , , 62 (black curve) fitted by a first-order log-linear model (red curve); (b) residual series obtained by subtracting the values of the first-order model from the real values.
Applbiosci 04 00030 g011
Figure 12. (a) Estimate of the autocorrelation coefficient function for the residual series v t ; (b) estimate of the partial autocorrelation function for the residual series.
Figure 12. (a) Estimate of the autocorrelation coefficient function for the residual series v t ; (b) estimate of the partial autocorrelation function for the residual series.
Applbiosci 04 00030 g012
Figure 13. (a) Real values of l n Y t ,   t = 63,64 , , 105 (black curve) fitted by a first-order log-linear model (red curve); (b) residual series obtained by subtracting the values of the first-order model from the real values.
Figure 13. (a) Real values of l n Y t ,   t = 63,64 , , 105 (black curve) fitted by a first-order log-linear model (red curve); (b) residual series obtained by subtracting the values of the first-order model from the real values.
Applbiosci 04 00030 g013
Figure 14. (a) Estimate of the autocorrelation coefficient function for the residual series v t ; (b) estimate of the partial autocorrelation function for the residual series.
Figure 14. (a) Estimate of the autocorrelation coefficient function for the residual series v t ; (b) estimate of the partial autocorrelation function for the residual series.
Applbiosci 04 00030 g014
Figure 15. Base 10 logarithms of the estimated SDFs for the responses of a muscle spindle affected by: (a) alpha motoneuron [9.3, 20.5) Hz; (b) gamma and alpha motoneurons simultaneously [19.9, 30.8) Hz.
Figure 15. Base 10 logarithms of the estimated SDFs for the responses of a muscle spindle affected by: (a) alpha motoneuron [9.3, 20.5) Hz; (b) gamma and alpha motoneurons simultaneously [19.9, 30.8) Hz.
Applbiosci 04 00030 g015
Figure 16. (a) Real values of l n Y t ,   t = 1,2 , , 178 (black curve) fitted by a fourth-order log-linear model (red curve); (b) residual series obtained by subtracting the values of the fourth-order model from the real values.
Figure 16. (a) Real values of l n Y t ,   t = 1,2 , , 178 (black curve) fitted by a fourth-order log-linear model (red curve); (b) residual series obtained by subtracting the values of the fourth-order model from the real values.
Applbiosci 04 00030 g016
Figure 17. (a) Estimate of the autocorrelation coefficient function for the residual series v t ; (b) estimate of the partial autocorrelation function for the residual series.
Figure 17. (a) Estimate of the autocorrelation coefficient function for the residual series v t ; (b) estimate of the partial autocorrelation function for the residual series.
Applbiosci 04 00030 g017
Figure 18. (a) Estimate of the autocorrelation coefficient function for the residual series e t ; (b) estimate of the partial autocorrelation function for the residual series.
Figure 18. (a) Estimate of the autocorrelation coefficient function for the residual series e t ; (b) estimate of the partial autocorrelation function for the residual series.
Applbiosci 04 00030 g018
Figure 19. (a) Q–Q plot for the error series e t ; (b) 95% predicted intervals.
Figure 19. (a) Q–Q plot for the error series e t ; (b) 95% predicted intervals.
Applbiosci 04 00030 g019
Figure 20. (a) Estimate of the autocorrelation coefficient function for the residual series e t ; (b) estimate of the partial autocorrelation function for the residual series.
Figure 20. (a) Estimate of the autocorrelation coefficient function for the residual series e t ; (b) estimate of the partial autocorrelation function for the residual series.
Applbiosci 04 00030 g020
Figure 21. (a) Q–Q plot for the error series e t ; (b) 95% predicted intervals.
Figure 21. (a) Q–Q plot for the error series e t ; (b) 95% predicted intervals.
Applbiosci 04 00030 g021
Figure 22. (a) Estimate of the autocorrelation coefficient function for the residual series e 1 t ; (b) estimate of the partial autocorrelation function for the residual series.
Figure 22. (a) Estimate of the autocorrelation coefficient function for the residual series e 1 t ; (b) estimate of the partial autocorrelation function for the residual series.
Applbiosci 04 00030 g022
Figure 23. (a) Q–Q plot for the error series e 1 t ; (b) a total of 95% predicted intervals.
Figure 23. (a) Q–Q plot for the error series e 1 t ; (b) a total of 95% predicted intervals.
Applbiosci 04 00030 g023
Figure 24. (a) Estimate of the autocorrelation coefficient function for the residual series e 2 t ; (b) estimate of the partial autocorrelation function for the residual series.
Figure 24. (a) Estimate of the autocorrelation coefficient function for the residual series e 2 t ; (b) estimate of the partial autocorrelation function for the residual series.
Applbiosci 04 00030 g024
Figure 25. (a) Q–Q plot for the error series   e 2 t ; (b) 95% predicted intervals.
Figure 25. (a) Q–Q plot for the error series   e 2 t ; (b) 95% predicted intervals.
Applbiosci 04 00030 g025
Figure 26. (a) Estimate of the autocorrelation coefficient function for the residual series e t ; (b) estimate of the partial autocorrelation function for the residual series.
Figure 26. (a) Estimate of the autocorrelation coefficient function for the residual series e t ; (b) estimate of the partial autocorrelation function for the residual series.
Applbiosci 04 00030 g026
Figure 27. (a) Q–Q plot for the error series e t ; (b) a total of 95% predicted intervals.
Figure 27. (a) Q–Q plot for the error series e t ; (b) a total of 95% predicted intervals.
Applbiosci 04 00030 g027
Table 1. Results obtained from the fourth-order model given by (12).
Table 1. Results obtained from the fourth-order model given by (12).
CoefficientEstimateStd. Errort-ValuePr (>|t|)
a 0 8.50408778 × 10−12.9384156640 × 10−228.94106<2.22 × 10−16
a −2.11292204 × 10−43.6987624613 × 10−3−0.05713 0.95456
b −7.07267755 × 10−41.3709407880 × 10−4−5.159001.2100 × 10−6
c 1.43736266 × 10−5 1.8856341793 × 10−67.622701.2699 × 10−11
d −7.34781793 × 10−88.5831713996 × 10−9−8.560731.1490 × 10−13
Residual Std. Error0.057713392Degrees of freedom103
Multiple R-Squared0.8676911Adjusted R-squared0.8625517
F-statistic168.86869Degrees of freedom4 and 103
p-value<2.2204460 × 10−16
Table 2. Results obtained from the quadratic model given by 13.
Table 2. Results obtained from the quadratic model given by 13.
CoefficientEstimateStd. Errort-ValuePr (>|t|)
a −6.24145146 × 10−16.76522941 × 10−3−92.25779<2.22 × 10−16
b 2.92669467 × 10−51.35596128 × 10−621.58391<2.22 × 10−16
Residual Std. Error0.04607669Degrees of freedom103
Multiple R-squared0.81893777Adjusted R-squared0.81717988
F-statistic465.865184Degrees of freedom1 and 103
p-value<2.220446 × 10−16
Table 3. Results obtained from the quadratic model given by (14).
Table 3. Results obtained from the quadratic model given by (14).
CoefficientEstimateStd. Errort-ValuePr (>|t|)
a 1 −0.63302330.0079985−79.143<2 × 10−16
b 1 0.00114310.00022085.1782.75 × 10−6
Residual Std. Error0.03111Degrees of freedom60
Multiple R-squared0.3088Adjusted R-squared0.2973
F-statistic26.81Degrees of freedom1 and 60
p-value2.751 × 10−6
Table 4. Results obtained from the quadratic model given by (15).
Table 4. Results obtained from the quadratic model given by (15).
CoefficientEstimateStd. Errort ValuePr (>|t|)
a 2 −0.44558180.0131921−33.78<2 × 10−16
b 2 0.00221460.00052234.240.000124
Residual Std. Error0.0425Degrees of freedom41
Multiple R-squared0.3048Adjusted R-squared0.2879
F-statistic17.98Degrees of freedom1 and 41
p-value0.0001239
Table 5. Results obtained from the model given by (16).
Table 5. Results obtained from the model given by (16).
CoefficientEstimateStd. Errort-ValuePr (>|t|)
a 0 −3.06599633 × 10−12.35705707 × 10−2−13.00773<2.22 × 10−16
a 1.97784140 × 10−31.81372982 × 10−31.090480.27702
b −2.36808412 × 10−44.10412459 × 10−5−5.770013.584 × 10−8
c 3.03725688 × 10−63.44035850 × 10−78.828321.146 × 10−15
d −1.00040256 × 10−89.53543397 × 10−10−10.49142<2.22 × 10−16
Residual Std. Error0.06078627Degrees of freedom173
Multiple R-Squared0.80823249Adjusted R-squared0.80379856
F-statistic182.28352Degrees of freedom4 and 173
p-value<2.220446 × 10−16
Table 6. Results obtained from Equation (20).
Table 6. Results obtained from Equation (20).
ConstantEstimateStd. Errort-ValuePr (>|t|)
a 0 1.01231699 1.38967653 × 10−272.84551<2.22 × 10−16
a −1.85923157 × 10−21.765304245 × 10−3−10.53207<2.22 × 10−16
b −6.51206952 × 10−56.60325763 × 10−5−0.986190.32637
c 5.84503339 × 10−69.16623405 × 10−76.376705.3463 × 10−9
d −3.55283094 × 10−84.21099460 × 10−9−8.437042.2836 × 10−13
Residual Std. Error0.0271533Degrees of freedom102
Multiple R-Squared0.9716365Adjusted R-squared0.9705242
F-statistic873.541783Degrees of freedom4 and 102
p-value<2.220446 × 10−16
Table 7. Results obtained from Equation (23).
Table 7. Results obtained from Equation (23).
CoefficientEstimateStd. Errort-ValuePr (>|t|)
a −6.26750309 × 10−14.20319573 × 10−3−149.11281<2.22 × 10−16
b 2.91575577 × 10−58.38429201 × 10−734.77641<2.22 × 10−16
Residual Std. Error0.02831701Degrees of freedom102
Multiple R-Squared0.9222205Adjusted R-squared0.9214579
F-statistic1209.398702Degrees of freedom1 and 102
p-value<2.220446 × 10−16
Table 8. Results obtained from Equation (26).
Table 8. Results obtained from Equation (26).
CoefficientEstimateStd. Errort-ValuePr (>|t|)
a 1 −0.642008430.00678814−94.57797<2.22 × 10−16
b 1 0.001373700.000185857.391295.8785 × 10−10
Residual Std. Error0.02555751Degrees of freedom59
Multiple R-squared0.48077658Adjusted R-squared0.47197619
F-statistic54.631238Degrees of freedom1 and 59
p-value5.87851 × 10−10
Table 9. Results obtained from Equation (29).
Table 9. Results obtained from Equation (29).
CoefficientEstimateStd. Errort ValuePr (>|t|)
a 2 −0.444157980.00894584−49.64963<2.22 × 10−16
b 2 0.002244320.000350036.41174 1.247 × 10−7
Residual Std. Error0.02749600Degrees of freedom40
Multiple R-squared0.50684496Adjusted R-squared0.49451608
F-statistic41.110394Degrees of freedom1 and 40
p-value1.247004 × 10−7
Table 10. Results obtained from Equation (31).
Table 10. Results obtained from Equation (31).
CoefficientEstimateStd. Errort-ValuePr (>|t|)
a 0 −3.7749757 × 10−11.1331616 × 10−2−33.31366<2.22 × 10−16
a 4.6681041 × 10−38.4080734 × 10−35.551931.0614 × 10−7
b −2.5989716 × 10−41.8528108 × 10−5−14.02718<2.22 × 10−16
c 3.0240552 × 10−61.5280872 × 10−719.78981<2.22 × 10−16
d −9.5555194 × 10−94.1899271 × 10−10−22.80593<2.22 × 10−16
Residual Std. Error0.0253854Degrees of freedom171
Multiple R-squared0.9587728Adjusted R-squared0.9578084
F-statistic994.186305Degrees of freedom4 and 171
p-value<2.220446 × 10−16
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Michailidis, G.E.; Vassiliadis, V.G.; Rigas, A.G. A Two-Stage Method for Decorrelating the Errors in Log-Linear Models for Spectral Density Comparisons in Neural Spike Sequences. Appl. Biosci. 2025, 4, 30. https://doi.org/10.3390/applbiosci4020030

AMA Style

Michailidis GE, Vassiliadis VG, Rigas AG. A Two-Stage Method for Decorrelating the Errors in Log-Linear Models for Spectral Density Comparisons in Neural Spike Sequences. Applied Biosciences. 2025; 4(2):30. https://doi.org/10.3390/applbiosci4020030

Chicago/Turabian Style

Michailidis, Georgios E., Vassilios G. Vassiliadis, and Alexandros G. Rigas. 2025. "A Two-Stage Method for Decorrelating the Errors in Log-Linear Models for Spectral Density Comparisons in Neural Spike Sequences" Applied Biosciences 4, no. 2: 30. https://doi.org/10.3390/applbiosci4020030

APA Style

Michailidis, G. E., Vassiliadis, V. G., & Rigas, A. G. (2025). A Two-Stage Method for Decorrelating the Errors in Log-Linear Models for Spectral Density Comparisons in Neural Spike Sequences. Applied Biosciences, 4(2), 30. https://doi.org/10.3390/applbiosci4020030

Article Metrics

Back to TopTop