Abstract
We consider a noisy leaky integrate-and-fire (NLIF) neuron model. The resulting nonlinear time-dependent partial differential equation (PDE) is a Fokker-Planck Equation (FPE) which describes the evolution of the probability density. The finite element method (FEM) has been proposed to solve the governing PDE. In the realistic neural network, the irregular space is always determined. Thus, FEM can be used to tackle those situations whereas other numerical schemes are restricted to the problems with only a finite regular space. The stability of the proposed scheme is also discussed. A comparison with the existing Weighted Essentially Non-Oscillatory (WENO) finite difference approximation is also provided. The numerical results reveal that FEM may be a better scheme for the solution of such types of model problems. The numerical scheme also reduces computational time in comparison with time required by other schemes.
1. Introduction
The large-scale neural network models in computational neuroscience have become familiar. The classical description of these (excitatory-inhibitory) neural network models is based on the deterministic/stochastic system. One of the most common models is known as the noisy leaky integrate-and-fire (NLIF) neuron model in which the behavior of the whole population of neurons is encoded in a stochastic differential equation (SDE) for the time evolution of membrane potential of a single neuron representative of the network. The dynamics of a single neuron is given by ([1,2,3,4,5,6])
where represents the membrane potential of a single neuron and is the time relaxation of the membrane potential in the absence of any communication. The communication of a single neuron with the network is modeled by the synaptic input current, The form of is a stochastic process, given by ([7])
Here, each spike is treated as a delta function, and if a spike occurs at time it is denoted by The terms and in above equation represent the time of mth-spike receiving from nth-presynaptic neuron for excitatory and inhibitory neurons, respectively. Moreover, the terms and are the total number of presynaptic neurons, where and are the strength of the synapses for excitatory and inhibitory neurons, respectively. Since the above form of synaptic input current is the discrete Poisson process, it becomes very difficult for further investigation. In addition, the researchers have used the diffusion approximation in which the synaptic input current is approximated by a continuous in time Ornstein-Uhlenbeck-type stochastic process as given by
Initially, it is assumed that every neuron generates spikes according to a stationary Poisson process with constant probability of generating a spike per unit time and it is also assumed that all these processes are independent between neurons, because of these assumptions, the mean value of the current, indicated by , is given by and its variance, Here, we have to depict the likelihood of firing per unit time of the Poissonian spike train r and it is thus recognized as the firing rate, which should be computed as where is the mean firing rate of the network. On the other side, is the standard Brownian motion in above equation.
The next important factor in the modeling is that the neurons generate a spike only when its membrane potential arrives at a certain voltage, known as threshold and instantly reset toward a resetting potential and sends a signal over the network.
Comprising the continuous form of in SDE model (1), we obtain
where We suppose that the voltage of a neuron arrives at threshold level at time , i.e., and after that the voltage arrives suddenly at resting potential, i.e., Furthermore, one can write the associated FPE with source term by using Ito’s rule [8], for the evolution of probability density function of finding neurons at a voltage with time ()
where and is the mean firing rate of the network which is computed as the flux of neuron at the firing voltage. The source term of the Equation (2) comes from the fact that when the neurons generate spikes and send the signals over the network, their voltage immediately reset to the reset potential At the relaxation time, no neuron have the firing voltage, for this reason, the initial and boundary conditions are given by
We can easily verify the conservation of the total number of neurons in above equation. For this purpose, we need to describe the mean firing rate for the network. Since the mean firing rate is the flux of neurons at , the value of is given by Integrating (3) across the voltage domain and using the above boundary conditions, we obtain the required condition.
Equation (2) represents the evolution of probability density function and therefore
If we translate the new voltage variable by considering then we have and diffusion coefficient is of the form
In [8], the authors provide theoretical and numerical analysis using finite difference approximation. For the references of mathematical aspects of nonlinear NLIF models, we refer [9,10,11,12,13]. We are concern about finding the value of the unknown using alternative approach. The problem (2)–(4) cannot be solved analytically, because of its complexity arising from nonlinearity and having a source term [14,15,16]. Therefore, numerical methods are generally used, for example, finite difference method (FDM) is used to find the approximate solution of the governing equation [8]. However, FDM has some disadvantages, for instance, the singularity in the delta source term, as in the above mentioned equation, makes the solution divergent. In order to use the FDM appropriately, the governing equation must be modified, due to the fact that the procedure becomes complicated.
Hence, in the present work, we propose a formulation based on finite element approximation to find the solution of governing equation. FEM is one of the powerful numerical methods for the solutions of problems that describe the real-life situations. Moreover, the characteristics of FEM tackle the singularity problem in an effective manner [17,18,19,20,21,22,23,24,25,26,27]. The applicability of FEM regarding this model problem is demonstrated in the final section.
Description of the present paper is as follows: We consider the NLIF model described by Equations (2) and (3). In Section 2, we develop the numerical approximation based on the finite element approach. The analysis for the stability is provided in Section 3. We report some numerical examples from [8] and discuss the solution behavior graphically in Section 4. In the last section, we conclude the work done in this research article.
Preliminaries
Here, we state some basic definitions and auxiliary results, which will be used throughout the manuscript. As we are studying a nonlinear version of the FPE, we start with the notion of weak solution.
Definition 1.
We say that a pair of non-negative functionswithis a weak solution of (2) and (3) if for any test functionsuch that, we have
Here, the space , refers to the space of functions such that is integrable in , while corresponds to the space of bounded functions in . The set of infinitely differentiable functions in is denoted by used as test functions in the notion of weak solution. The blow-up of solution and a priori estimates are given in [8]. We here just state the results.
Theorem 1.
(Blow-up) Assume that the drift and diffusion coefficients satisfy
for alland all, and let us consider the average-excitatory network where. Choose. If the initial data is concentrated enough around, in the sense that
is close enough to, then there are no global-in-time weak solutions to (2)–(4).
Lemma 1 (A priori estimates).
Assumeon the drift and diffusion coefficients and thatis a global-in-time solution of (2)–(4) in the sense of Definition 1 fast decaying at, then the following a priori estimates hold for all:
- If, then
- IfthenMoreover, if in addition a is constant, then
In a latest work [8], it was demonstrated that the problem (2)–(4) can produce a finite time blow-up solution for excitatory networks when the initial data is concentrated near sufficient to the threshold voltage. This result was obtained by giving no information about the behavior at the blow-up time. In a recent work [12], we state the theorem gives a characterization of this blow-up time when it occurs for
Theorem 2.
Letbe a non-negativefunction such thatand
There exist a classical solution of (2)–(4) in the time interval with The maximal existence time can be characterized as
Moreover, whenwe have thatwhile forthere exist classical solutions which blow up at a finite timeand consequently have diverging mean firing rate as
We now state the main result on steady states from [8].
Theorem 3.
Let,with.
- Under either the conditionsand, or the condition, then there exists at least one steady state solution to (2)–(4).
- If bothandhold, then there are at least two steady states to solution to (2)–(4).
- There is no steady state to (2)–(4) under the high connectivity condition’
2. Finite Element Approximation
We construct the numerical approximation of the problem given in (2) and (3) in two ways: First we use FEM for space discretization that provides a system of ordinary differential equations, which is then solved by Euler’s backward difference for time. Spatial discretization involves the construction of a weak formulation of problem over a given domain with specified boundary conditions at and Weak formulation of the problem (2) and (3) is obtained by multiplying the equation with some test function and integrating over ,
In the present study, the mean firing rate is approximated by using backward FDM. Performing the integration by parts in above equation, we get the following equation:
This resulting integral (8) is called weak formulation because it allows approximate function with less continuity (or differentiability) than the strong form given in Equation (2). Once we obtained the weak formulation, next step is to discretize the weak form for the easy representation and to capture the local effects more precisely. Weak form discretization consists of dividing the entire domain into set of elements, then developing the finite element model by seeking the approximation of a solution over a typical element. This discretization is tackled by taking n non-overlapping elements say for with step size h given by:
The unknown function must be approximated in a manner so that continuity or differentiability demands by weak formulation can be met. Since the weak formulation contains the first order derivative of any function with non-zero first derivative would be a candidate for approximation. Thus, semi discretization consists of finding
where are the nodal values and are the basis functions given by
There are many choices of weight function to be used. Particular choice for the weight function in Galerkin approach is the same as the choice of basis function Thus, substituting weight function and approximation for the solution defined by Equation (10) in weak formulation obtained in Equation (9) leads to the following equation:
On simplification of the above, we get as follows
Solving Equation (12), we get the system of ordinary differential equations for which can be expressed in matrix notation given by
where
By assembling the contribution from all elements, we get the following system for the global nodal vector on the entire domain
where f is the column vector with all entries are zero except at reset potential Ordinary differential Equation (14) requires implicit and stable time-stepping method to avoid extremely small time-step. Firstly we discretize the time domain into m subintervals with time step We use the Euler’s backward difference in time and get the following system from Equation (14):
this algebraic system (15) can be solved for
3. Stability Analysis of the Scheme
Fourier method is a very flexible tool for analyzing stability developed by von Neumann. In this method, initial data is demonstrated in terms of finite Fourier series and we examine the growth of individual Fourier component. After assembling the reduced system (13) and using and , we get the finite element difference-differential equation at the th node given by
where
Let us denote the error as at the th stage for nodal value j to satisfy Equation (16)
At each time level, error can be expanded as Thus, substituting the error in Equation (17), we get as follows:
Simplification of the above equation, we get the following
Performing some algebraic manipulation, we get
where , and .
Whenever we get hence, the scheme is conditionally stable.
4. Numerical Experiments
In this section, we present some numerical examples to demonstrate the behavior of the solutions of the nonlinear NLIF model. The performance of the developed scheme is tested by comparing our results with the existing scheme in the literature. Consider the system (2) and (3) with initial data as follows
where change in mean and variance describe different scenario of a solution. We notice that the behavior of the solution depends upon the value of excitatory () and inhibitory average network. First we take constant diffusion coefficient and find the effect on solution with change in value of
In Figure 1a, we find that after some time the solution goes to steady state by taking excitatory case i.e., small enough.
Figure 1.
The approximate solution for initial data (20) with mean and variance The system is considered for the excitatory case i.e., by taking with activity dependent noise Figure 1a depicts the numerical solution using FEM at different time level using initial data (20); Figure 1b shows the comparison of the existing scheme and FEM for numerical Solution at .
The approximate solution for at different time levels is plotted in Figure 1 with a reset potential From Figure 1a, we see that height of impulse decreases as time increases and after some time it reaches a steady state. In Figure 1b, we perform numerical approximation based upon FEM and compare the results obtained in [8] at a final time
The evolution of firing rate with the time , is plotted in Figure 2. We find that firing rate has different range with change in excitatory case as well as the inhibitory case In Figure 2a, we consider the case when the initial data is centered at with We observe that the solution reaches a steady state. We also take the cases when the initial data is centered at and different values of to find different phenomena based on these values in Figure 2.
Figure 2.
Firing rates for with initial data given in Equation (20). Top left: with: and Top-right: with: and . The top-right case seems to illustrate a blow-up phenomenon. Bottom left: with: and Bottom right: with: and
The errors for the approximate solution simulated in Figure 1, Figure 3 and Figure 4 are plotted in Figure 5, Figure 6 and Figure 7 respectively. Numerical values of these errors and CPU time (MATLAB and Statistics Toolbox Release 2013a, The MathWorks, Inc., Natick, MA, United States) of the two methods are shown in Table 1 and Table 2.
Figure 3.
Left: The approximate solution Right: Firing rate for initial data given in Equation (20) with mean and variance The system is considered for the excitatory case i.e., by taking with activity dependent noise (a): Comparison of the existing scheme and FEM for the numerical Solution ; (b): Time evolution of the firing rate .
Figure 4.
Left: The approximate solution Right: Firing rate for initial data given in Equation (20) with mean and variance The system is considered for the excitatory case i.e., by taking with activity dependent noise . (a): Comparison of existing scheme and FEM for numerical Solution ; (b): Time evolution of the firing rate .
Figure 5.
Error for the approximate solution plotted in Figure 1.
Figure 6.
Error for the approximate solution plotted in Figure 3a.
Figure 7.
Error for the approximate solution plotted in Figure 4a.
Table 1.
Error table using FEM for the approximate solution graphically represented in Figure 1, at a final time with the finest grid being
Table 2.
Error table using finite difference-WENO scheme for the approximate solution graphically represented in Figure 1, at a final time with the finest grid being
Errors of the numerical solution are calculated in different norms norms which are defined as follows
where is the numerical solution at finest grid For the numerical experiments, we find the errors with the finest grid being Our test outcomes show that the error defined above is sure a monotone decreasing function as N increases i.e.,
In Figure 3a, we performed numerical approximation based upon FEM and compared the results obtained in [8] at a time The evolution of firing rate with the time , is plotted in Figure 3b, which describes the blow-up situation when the initial data is concentrated around with Table 3 and Table 4 gives the different error values at the final time for the same data that is graphically represented in Figure 6.
Table 3.
Error table using FEM for the approximate solution graphically represented in Figure 3, at a final time with the finest grid being
Table 4.
Error table using WENO-FDM for the approximate solution graphically represented in Figure 3, at a final time with the finest grid being
From Figure 4a, it is clear that when initial data is concentrated enough near the threshold point solution blows up at a finite time which is earlier than the phenomena described in Figure 3b. This happens because initial data is concentrated enough near the threshold point i.e., with small enough. For different error values and CPU time for the data graphically represented in Figure 4, see Table 5 and Table 6.
Table 5.
Error table using FEM for the approximate solution graphically represented in Figure 4, at a final time with the finest grid being
Table 6.
Error table using WENO-FDM for the approximate solution graphically represented in Figure 4, at a final time with the finest grid being
In Figure 8, we treat the cases for type activity dependence noise. Figure 8a shows that by taking and solution goes to steady state. This further indicates that solution goes to a steady state earlier than the solution behavior provided in Figure 8b by taking . Figure 8c shows blow-up situation of a solution by taking and . From Figure 8d, we find that by reducing the noise factor , solution goes to steady state.
Figure 8.
Firing rates for the initial data given in Equation (20) with and and activity dependence noise . Top left: and Top-right: and The bottom left case seems to depict a blow-up phenomenon. Bottom left: and Bottom right: and
The behavior of the solution by taking noise factor for both the cases of excitatory and inhibitory are represented in Figure 9. From Figure 10a, we find that solution blows up in a finite time and right figure indicate the situation of steady state by reducing the noise factor.
Figure 9.
The approximate solution for initial data given in Equation (20) with mean and variance and with activity dependent noise Left: The system is considered for the excitatory case i.e., by taking ; Right: The system is considered for the inhibitory case i.e., by taking
Figure 10.
The approximate solution using FEM for the initial data given in Equation (20) with and and activity dependence noise Top left: and Top-right: and
5. Conclusions
In this article, we proposed a finite element method to find the approximate solution of the nonlinear NLIF model. The performance of the proposed method is validated by comparing with an existence scheme in the literature. The approximate solutions determined by Galerkin finite element method have same accuracy as achieved by high-order finite difference scheme (WENO-FDM). The proposed scheme takes less computational time as compared to WENO-FDM. The reason behind that the existing scheme contains many computational factors such as smoothness indicator functions and non-negativity weights etc. Moreover, we also included the role of both excitatory and inhibitory impulses in the model equation. The stability analysis of the proposed scheme is discussed which shows that the scheme is conditionally stable. The behavior of the solution is plotted by taking some test examples. The results reveal that the continuous Galerkin FEM is better than the WENO-FDM for simulating dynamics of large-scale neuronal networks in the brain.
Author Contributions
Formal analysis, Methodology, Implementation of numerical schemes and Writing of the manuscript was completed by D.S. Supervision, Review & Editing by P.S. and Proof Reading and Review was done by R.P.A. and M.E.K. All authors read and approved the final manuscript.
Funding
This research received no external funding.
Acknowledgments
The authors are thankful to the anonymous referees for their invaluable suggestions.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Omurtag, A.; Knight, B.W.; Sirovich, L. On the simulation of large populations of neurons. J. Comput. Neurosci. 2000, 8, 51–63. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Brunel, N.; Hakim, V. Fast global oscillations in networks of integrate-and-fire neurons with long firing rates. Neural Comput. 1999, 11, 1621–1671. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Brunel, N. Dynamics of sparsely connected networks of excitatory and inhibitory spiking neurons. J. Comput. Neurosci. 2000, 8, 183–208. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Sirovich, L.; Omurtag, A.; Lubliner, K. Dynamics of neural populations: Stability synchrony. Netw. Comput. Neural Syst. 2006, 17, 3–29. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Tuckwell, H.C. Nonlinear and stochastic theories. In Introduction to Theoretical Neurobiology; Cambridge University Press: Cambridge, UK, 1988; Volume 2. [Google Scholar]
- Izhikevich, E.M. Dynamical Systems in Neuroscience; MIT Press: Cambridge, MA, USA, 2010. [Google Scholar]
- Tuckwell, H.C. Stochastic Processes in the Neurosciences; SIAM: Philadelphia, PA, USA, 1989; Volume 56. [Google Scholar]
- Cáceres, M.J.; Carrillo, J.A.; Perthame, B. Analysis of nonlinear noisy integrate-and-fire neuron models: blow-up and steady states. J. Math. Neurosci. 2011, 1, 1–7. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Cáceres, M.J.; Roux, P.; Salort, D.; Schneider, R. Global-in-time classical solutions and qualitative properties for the NNLIF neuron model with synaptic delay. arXiv 2018, arXiv:1806.01934. [Google Scholar]
- Cáceres, M.J.; Schneider, R. Analysis and numerical solver for excitatory-inhibitory networks with delay and refractory periods. ESAIM Math. Model. Numer. Anal. 2018, 52, 1733–1761. [Google Scholar] [CrossRef] [Scilit]
- Cáceres, M.J.; Schneider, R. Blow-up, steady states and long time behaviour of excitatory-inhibitory nonlinear neuron models. Kinetic Related Models 2017, 10, 587–612. [Google Scholar] [CrossRef] [Scilit]
- Carrillo, J.A.; González, M.d.M.; Gualdani, M.P.; Schonbek, M.E. Classical solutions for a nonlinear Fokker-Planck equation arising in computational neuroscience. Commun. Part. Differ. Equ. 2013, 38, 385–409. [Google Scholar] [CrossRef] [Scilit]
- Carrillo, J.A.; Perthame, B.; Salort, D.; Smets, D. Qualitative properties of solutions for the noisy integrate and fire model in computational neuroscience. Nonlinearity 2015, 28, 3365. [Google Scholar] [CrossRef] [Scilit]
- Evans, L.C. Partial Differential Equations; American Mathematical Society: Providence, RI, USA, 2010. [Google Scholar]
- Cáceres, M.J.; Carrillo, J.A.; Tao, L. A numerical solver for a nonlinear Fokker–Planck equation representation of neuronal network dynamics. J. Comput. Phys. 2011, 230, 1084–1099. [Google Scholar] [CrossRef] [Scilit]
- de Kamps, M. A simple and stable numerical solution for the population density equation. Neural Comput. 2003, 15, 2129–2146. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Huang, C.H.; Lin, C.C.K.; Ju, M.S. Finite element method for population density approach for large-scale neuronal networks. J. Med. Biol. Eng 2013, 33, 552–563. [Google Scholar] [CrossRef]
- Burnett, D.S. Finite Element Analysis: From Concepts to Applications; Addison-Wesley: Reading, MA, USA, 1987. [Google Scholar]
- Lakkis, O.; Pryer, T. A finite element method for nonlinear elliptic problems. SIAM J. Sci. Comput. 2013, 35, A2025–A2045. [Google Scholar] [CrossRef] [Scilit]
- Galán, R.F.; Ermentrout, G.B.; Urban, N.N. Stochastic dynamics of uncoupled neural oscillators: Fokker-Planck studies with the finite element method. Phys. Rev. E 2007, 76, 056110. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Harrison, G.W. Numerical solution of the Fokker Planck equation using moving finite elements. Numer. Methods Part. Differ. Equ. 1988, 4, 219–232. [Google Scholar] [CrossRef] [Scilit]
- Reddy, J.N. An Introduction to the Finite Element Method; McGraw-Hill Education: New York, NY, USA, 2019. [Google Scholar]
- Thomée, V. Galerkin Finite Element Methods for Parabolic Problems; Springer: Berlin, Germany, 2006. [Google Scholar]
- Kumar, P.; Narayanan, S. Solution of Fokker-Planck equation by finite element and finite difference methods for nonlinear systems. Sadhana 2006, 31, 445–461. [Google Scholar] [CrossRef] [Scilit]
- Eriksson, K.; Johnson, C. Adaptive finite element methods for parabolic problems IV: Nonlinear problems. SIAM J. Numer. Anal. 1995, 32, 1729–1749. [Google Scholar] [CrossRef] [Scilit]
- Öchsner, A.; Merkel, M. One-Dimensional Finite Elements: An Introduction to the FE Method; Springer: Berlin/Heidelberg, Germany, 2012. [Google Scholar]
- Burrage, K.; Burrage, P.; Leier, A.; Marquez-Lago, T. A Review of Stochastic and Delay Simulation Approaches in Both Time and Space in Computational Cell Biology. In Stochastic Processes, Multiscale Modeling, and Numerical Methods for Computational Cellular Biology; Holcman, D., Ed.; Springer: Cham, Switzerland, 2017; pp. 241–261. [Google Scholar]
© 2019 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).









