Next Article in Journal
Design and Evaluation of an Adjustable Compliant Constant-Force Microgripper
Previous Article in Journal
Simulating an Integrated Photonic Image Classifier for Diffractive Neural Networks
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Behavioral Modeling of Memristors under Harmonic Excitation

Department of Electrical Engineering Theory, Saint Petersburg Electrotechnical University “LETI”, 197022 St. Petersburg, Russia
*
Author to whom correspondence should be addressed.
Micromachines 2024, 15(1), 51; https://doi.org/10.3390/mi15010051
Submission received: 20 November 2023 / Revised: 21 December 2023 / Accepted: 22 December 2023 / Published: 26 December 2023

Abstract

:
Memristors are devices built on the basis of fourth passive electrical elements in nanosystems. Because of the multitude of technologies used for memristor implementation, it is not always possible to obtain analytical models of memristors. This difficulty can be overcome using behavioral modeling, which is when mathematical models are constructed according to the input–output relationships on the input and output signals. For memristor modeling, piecewise neural and polynomial models with split signals are proposed. At harmonic input signals of memristors, this study suggests that split signals should be formed using a delay line. This method produces the minimum number of split signals and, as a result, simplifies behavioral models. Simplicity helps reduce the dimension of the nonlinear approximation problem solved in behavioral modeling. Based on the proposed method, the piecewise neural and polynomial models with harmonic input signals were constructed to approximate the transfer characteristic of the memristor, in which the current dynamics are described using the Bernoulli differential equation. It is shown that the piecewise neural model based on the feedforward network ensures higher modeling accuracy at almost the same complexity as the piecewise polynomial model.

1. Introduction

Technological progress is closely related to the emergence of new materials, the improvement and development of technologies and equipment, and their active implementation into production. One example of this progress is the creation of technical devices and systems based on memristors [1,2,3,4,5,6,7,8].
A memristor is a resistor with memory, known as the fourth passive electrical element (other elements: resistor, capacitor, inductance), which was theoretically described by L. Chua in 1971 [9]. The resistance of a memristor nonlinearly depends on the history of changes in its current, i.e., the current at a given moment in time and a past moment in time.
The intensive use of the memristor began with its physical creation based on the nanoscale metal-dielectric-metal structure at Hewlett Packard in 2008 [10]. The physical memristor consisted of two platinum nanowire electrodes separated by a semiconductor material (approximately 5 nm of titanium dioxide film). On one side of the film, a doping impurity was added, and an oxygen-depleted TiO2−x layer was formed, in which an oxygen deficiency was observed in the form of positive vacancies. When the contact voltage was positive, positive oxygen vacancies repelled and moved into the insulating (undoped) layer of titanium dioxide TiO2. As a result, the boundary between the layers moved the width of the conducting TiO2−x layer, and the memristor conductivity increased. The more conductive state of the memristor is called “set or reset”. With negative voltage polarity across the contact mentioned, the attraction of positive oxygen vacancies, a decrease in the width of the conducting TiO2−x layer, and an increase in the memristor resistance were observed. The less conductive state of the memristor is called “off or erasing”. After switching off the voltage, the memristor did not change its state, i.e., it “remembered” the last value of conductivity (resistance).
The developed technologies of memristors underlie the following classification [1,2,3,4,5,6,7,8]:
-
Resistive memristors with metal-dielectric-metal structures (various oxides are used as a dielectric, for example, titanium, gadolinium, aluminum, hafnium, graphene). Memristor activity is associated with oxidation–reduction (redox) reactions;
-
Spintronic magnetic memristors, the resistances of which vary in accordance with their magnetization (in accordance with electron spins). Here, the electron is represented as a spinning ball and possesses a quantum mechanical property called “spin”. Spin characterizes magnetism; for instance, materials are magnetized when most electrons have codirectional spins;
-
Memristors with transition from one phase state (polycrystalline) to another (amorphous) and vice versa;
-
Ferroelectric memristors based on ferroelectric tunnel connections. The memristor consists of two metal electrodes with a thin ferroelectric layer (material changing electrical polarization spontaneously) in between. Polarization switching under the influence of an external electric field changes the memristor resistance;
-
Organic (polymer) memristors, in which electrochemical reactions are a mechanism for switching resistance.
Different memristors possess the following general properties [1,2,3,4,5,6]:
-
Memristor resistance in analog mode can take any value, not only 0 or 1. Such variability can be implemented on one element, wherein the memristor size is reduced to several nanometers, and the response speed is reduced to nanoseconds;
-
The memristor does not store its properties in the form of a charge. Thus, it is resistant to charge leakages, which have to be dealt with when switching to nanometer-scale microcircuits. It is completely nonvolatile, and data can be stored as long as the materials used for its implementation exist;
-
Memristors placed on crossbars can be used to form densely packed memory;
-
Low power consumption by the memristor makes it a very promising element in energy-efficient areas. For instance, contemporary high-performance computing and cooling systems consume tens of megawatts of energy. The systems based on memristors open the way to energy saving in this area;
-
A lot of memristor materials are compatible with CMOS technology.
Memristors have a wide field of application: electrical and radio engineering, telecommunication and control systems, computing and neuromorphic systems, robotics, cryptography, etc. Memristors are the basis of multifunctional devices, such as, in the analog field:
  • Oscillators, variable gain amplifiers, nonlinear filters, Schmidt trigger, and rectifiers [1,2,3,4,5,6,7,8];
  • Chains with chaotic vibrations [11,12,13,14];
  • Neural networks (direct propagation, recurrent, cellular) performing modeling, filtering, signal generation, object management, and speech and image processing [3,13,15,16,17,18,19,20,21];
  • Neuromorphic systems that imitate the functioning of nerve tissues or biological brain structures [3,6,8,22,23,24];
  • Programmable analog integrated circuits [3,8,25].
In the digital field:
  • Logic circuits, reconfigurable logic circuits, digital gates, and associative memories (content-addressable memory) [8,25,26];
  • Nonvolatile storage devices [27].
Models of memristive devices are presented in analytical form (systems of nonlinear differential equations), as well as numerically in software environments [1,2,4,28]. Memristor models are based on physical mechanisms and their synthesis technologies [3,6,29,30,31,32,33].
Models of memristors, which are implemented on metal oxides, are widespread. For instance, the linear ionic drift model (the HP model) [10], nonlinear ionic drift models with different weight functions (Benderli model, Joglekar model, Biolek model, Prodromakis model, Zha model, Yakopcic model, Ascoli–Corinto model), nonlinear Lehtonen-Laiho model, Simmons tunnel barrier model with nonlinear and asymmetric switching characteristics), and the threshold adaptive memristor model (the TEAM model) [28,32,33]. The variety of physical principles underlying the technologies for creating memristors and the wide range of applications of memristor-based devices set the task to develop mathematical memristor models that are universal in relation to the physics of modeled processes and the types of input and output signals of devices, which are different in the application fields.
The “black box” (behavioral) models are universal. Within the framework of the “black box” principle, behavioral modeling of the object, which is presented as a “black or gray box”, establishes the unique input–output correspondence between the sets of the input and output signals [34,35,36,37]. Universal behavioral models include the following:
-
The functional Volterra series in time and frequency forms [37,38,39,40,41];
-
Regression models, mostly recurrent [37];
-
Models based on split signals [42,43].
The functional Volterra series has a severe handicap. It is used in its convergence region, so it is applicable in a weakly nonlinear mode of operation. Regression models can be used in a severely nonlinear mode. However, regression models tend to have feedback, which results in the problem of ensuring the stability of nonlinear processes. While the methods of ensuring stability in recurrent linear systems are known, there are no similar general methods for recurrent nonlinear systems.
Modeling based on split signals is advisable. Splitting means that the input scalar signal is converted into a vector signal so that the phase portrait does not intersect, touch, or cross zero. Splitting is necessary to ensure the unique input–output correspondence. The elements of the split signal vector are used as basic functions in nonlinear models, such as multidimensional polynomials, fractional functions, and neural networks. The model parameters result from solving the approximation task in the mean square norm. Thus, the dynamics and dimensionality of the model are formed using signal splitting, and the model nonlinearity is formed using the nonlinear inertialess transformation of split signals [35,42,43]. The splitting operation is performed for the input signal, so the behavioral model is adapted to the input signals. This adaptation makes the model simpler in comparison with a universal model, such as the Volterra series.
The paper contains four sections. The importance of memristors in many areas of technique, the variety of technologies, and consequently, models for memristors, and the building of universal behavioral models, especially models based on split signals, which have a number of advantages in comparison with other behavioral models, have been described in the Introduction. Behavioral modeling with split signals and splitting harmonic input signals using a delay line are presented in Section 2. The modeling results of the memristors, in which the dynamics of currents are described using the Bernoulli differential equation, the used piecewise polynomial and neural models, their comparison, and the corresponding conclusions are presented in Section 3 and Section 4.

2. Behavioral Model with Split Signals

According to the splitting method [35,42,43], the operator of a nonlinear device F ε is composed of two operators: the splitter operator F s and the operator of a nonlinear inertialess converter P . The block scheme of a model with split signals is shown in Figure 1.
The splitter F s converts the scalar input signals x ( A , t ) X of the device, where A G a is the vector of signal parameters from the set G a , into the following vector signals:
X s ( A , t ) = F s [ x ( A , t ) ] = [ x s 1 ( A , t ) ,   x s 2 ( A , t ) ,   ,   x s m ( A , t ) ] T ,
where T is the transposition sign. The vector signals (1) are split on the set of their existence. This means that they obey the following conditions:
-
The vector signals are not zero;
X s ( A , t ) 0 ,
at all A G a , t G t ;
-
The vector signals are different at every point in time, i.e., at any, A α A β , A α G a ,   A β G a , and t α t β , t α G t , t β G t , inequality
X s ( A α , t α ) X s ( A β , t β ) ,
is true.
As the analysis of inequalities (2) and (3) shows, splitting means that the phase portrait based on X s ( A , t ) does not intersect, touch, or cross zero [11,30,31,44].
The signal splitting is realized using linear and nonlinear and stationary and nonstationary converters [35,36,42]. Splitting depends on the class of the input scalar signal. An important criterion for the selection of a splitter is the minimum number of the splitter channels (minimum length of the split signal vector). The smaller the length of the vector X s ( A , t ) , the smaller the dimensionality of the model. As a result, the model is simplified.
The operator P of a nonlinear inertialess converter (Figure 1) maps the vector signals X s ( A , t ) into the scalar output signals y ( t ) Y of the model. The mathematical forms of the converter are different, for instance, polynomials, fractions, neural networks. The converter schemes are both non-recursive and recursive [35,36,42]. For example, the polynomial is of the form:
P [ X s ( A , t ) ] = j 1 = 0 J 1 j 2 = 0 J 2 j m = 0 J m C j 1 j 2 j m [ x s 1 ( A , t ) ]   j 1 [ x s 2 ( A , t ) ]   j 2 [ x s m ( A , t ) ]   j m ,
the power of polynomial (4) is equal to J = r = 1 m J r . The structure of the three-layer feedforward neural network is shown in Figure 2.
In Figure 2, the block “Input” contains a vector of split signals. These signals are processed in two consecutive hidden layers of “Hidden 1” and “Hidden 2”, which comprise several neurons with nonlinear activation functions. Then, the layer “Hidden 2” is followed by “Output layer” with a neuron and the linear activation function. As a result, a scalar signal is formed at the output of the neural network. Behavioral modeling based on the three-layer network provides a higher modeling accuracy than the two-layer network. This fact is justified by the fact that the first hidden layer describes the local properties of processes by dividing the operator space into subspaces and the second hidden layer describes the global properties of processes by combining the output signals of the neurons of the first hidden layer [45].
Harmonic signals are the input signals of memristors and memristive devices to build transfer characteristics. In addition, harmonic signals are an important class for analyzing dynamic devices, namely, to determine the frequency characteristics, calculate the steady-state processes, and perform spectral analysis.
Therefore, the common task is to construct a splitter for harmonic signals. Below, we describe the solution of this task and present the resulting splitter structure as a delay line.

2.1. Splitting of Harmonic Signals with Amplitude Equal One

Let us consider a class of sine wave signals with an amplitude equal to one:
x ( t ) = sin ( ω 0 t ) = sin ( t ¯ ) ,
where ω 0 = 2 π / T x is the angular frequency; T x is the signal period; and t ¯ = ω 0 t , t ¯ [ 0 , 2 π ) is the normalized continuous time.
Statement 1. 
The split signal on set  t ¯ [ 0 , 2 π )  is a vector
X s ( t ¯ ) = [ sin ( t ¯ ) , sin ( t ¯ t ¯ 0 ) ] T ,
where  t ¯ 0  is a constant, denoting a shift in normalized time, and  T  is the transposition sign.
The block scheme of the splitter with the delay element based on Statement 1 is depicted in Figure 3a. Now we can prove Statement 1.
Proof of Statement 1. 
To prove the splitting of signal (6), we consider the following equalities:
sin ( t ¯ α ) = sin ( t ¯ β ) ,
sin ( t ¯ α t ¯ 0 ) = sin ( t ¯ β t ¯ 0 ) .
On the basis of trigonometric formulas, we convert the equality (8) to the form:
sin ( t ¯ α ) cos ( t ¯ 0 ) cos ( t ¯ α ) sin ( t ¯ 0 ) = sin ( t ¯ β ) cos ( t ¯ 0 ) cos ( t ¯ β ) sin ( t ¯ 0 ) ,
in view of equality (7), we write:
sin ( t ¯ α ) cos ( t ¯ 0 ) cos ( t ¯ α ) sin ( t ¯ 0 ) = sin ( t ¯ α ) cos ( t ¯ 0 ) cos ( t ¯ β ) sin ( t ¯ 0 ) ,
from this, we get:
cos ( t ¯ α ) = cos ( t ¯ β ) ,
or
sin ( π / 2 + t ¯ α ) = sin ( π / 2 + t ¯ β ) .
Thus, instead of Equations (7) and (8), we analyze Equations (7) and (9).
Figure 4 shows the signal sin ( t ¯ ) . As one can see in Figure 4, two areas (with positive and negative signal values) should be considered.
On the time interval t ¯ [ 0 , π ] , equality (7) is true under two conditions:
t ¯ β = t ¯ α ,
t ¯ β = π t ¯ α ,
where t ¯ α [ 0 , π ] , t ¯ β [ 0 , π ] .
Equality (9) is true under condition (10) and not true under condition (11), as
sin ( π / 2 + t ¯ α ) sin ( π / 2 + ( π t ¯ α ) ) ,
sin ( π / 2 + t ¯ α ) sin ( π / 2 t ¯ α ) ,
sin ( π / 2 + t ¯ α ) sin ( π / 2 + t ¯ α ) .
On the time interval t ¯ [ π , 2 π ) , equality (7) is true under two conditions: one of which is expression (10), the other is the following:
t ¯ α = π + t ¯ γ ,   t ¯ β = 2 π t ¯ γ ,
where t ¯ α [ π , 2 π ) , t ¯ β [ π , 2 π ) , t ¯ γ [ 0 , π ) .
Equality (9) is true under condition (10) and not true under condition (12), as
sin ( π / 2 + ( π + t ¯ γ ) ) sin ( π / 2 + ( 2 π t ¯ γ ) ) ,
sin ( π / 2 + t ¯ γ ) sin ( π / 2 t ¯ γ ) ,
sin ( π / 2 t ¯ γ ) sin ( π / 2 t ¯ γ ) .
Thus, Equations (7) and (9), as well as (7) and (8) are true only under condition (10). Note that on the time interval t ¯ [ 0 , 2 π ) , the vector X s ( t ¯ ) from expression (6) does not equal zero.
Eventually, signals in vectors [ sin ( t ¯ ) , sin ( π / 2 + t ¯ ) ] T and [ sin ( t ¯ ) , cos ( t ¯ ) ] T , as well as in vector X s ( t ¯ ) from Formula (6) are split on a set. □

2.2. Splitting of Harmonic Signals with Variable Amplitude

Let us consider a class of sine wave signals with variable amplitude:
x ( A , t ¯ ) = A sin ( t ¯ ) ,
where A > 0 , A G A , G A is the value set of variable A , t ¯ [ 0 , 2 π ) .
Statement 2. 
The signal split with respect to variable  A  and  t ¯  on set  G A × [ 0 , 2 π )  is a vector
X s ( A , t ¯ ) = [ A sin ( t ¯ ) , A sin ( t ¯ t ¯ 0 ) ] T ,
where  t ¯ 0  is a constant representing the time shift,  T  is the transposition sign.
The block scheme of the splitter with the delay element based on Statement 2 is shown in Figure 3b. Now we can prove Statement 2.
Proof of Statement 2. 
From the vector signal (14), we come to a vector signal:
[ A sin ( t ¯ ) , A cos ( t ¯ ) ] T ,
and analyze the splitting of its elements.
For this, we form a pair of equations:
A α sin ( t ¯ α ) = A β sin ( t ¯ β ) ,
A α cos ( t ¯ α ) = A β cos ( t ¯ β ) .
Then, we determine the squares of Equations (16) and (17), add them together, and obtain:
A α 2 = A β 2 .
Equality (18) is true under conditions: A β = A α and A β = A α . Because A > 0 , we keep only the following expression:
A β = A α .
Instead of Equations (16) and (17), it is sufficient to analyze Equations (7) and (9), taking into account equality (19). On proving the splitting vector (6), equalities (7) and (9) are shown to be true under condition (10). It should be emphasized that vectors (14) and (15) are not zero on the interval t ¯ [ 0 , 2 π ) .
Thus, vector (15) and, consequently, vector (14) are split on the set G A × [ 0 , 2 π ) . □
The vectors (6) and (14) of split signals constructed for signal classes (5) and (13), respectively, are basic functions of two-dimensional polynomial (4) ( m = 2 ).
As a consequence, the splitter in the form of a delay line is synthesized for the widely used class of harmonic signals. This splitter ensures the minimum possible memory length of nonlinear models. The implementation of the delay line is convenient in digital technology developed for radio and telecommunication systems, control systems, neurocomputers, robotic complexes, etc.

3. Behavioral Modeling of the Bernoulli Memristors

As an example of modeling with the help of multidimensional polynomials and neural networks based on split signals, we consider the behavioral modeling of memristors, in which the dynamics of currents are described using the Bernoulli differential equation. These memristors are called “Bernoulli memristors”. The Bernoulli memristors belong to the class of ideal memristors [44,46]. The element controlled by charge and excited by voltage is described using a pair of equations [44]:
d q ( t ) d t = i ( t ) ,
i ( t ) = 1 M ( q ( t ) ) v ( t ) ,
where q(t) is a charge (control signal or memristor state variable); v(t), i(t) are the voltage (input) and current (output) signals, respectively; and M(q(t)) is a memristance.
The current dynamics are determined using the Bernoulli differential equation [44,46]:
d i ( t ) d t d v ( t ) / d t v ( t ) i ( t ) = k 2 v ( t ) i α + 2 ( t ) ,
where α 1 , 2 is an integer and k 2 = d M ( q ( t ) ) d q ( t ) is a variable related to the physical structure of the memristor.
The memristance dynamics are described using expression [44,46]:
d M ( q ( t ) ) d t = k 2 i α ( t ) = d M ( q ( t ) ) d q ( t ) i α ( t ) .
The behavioral models, which we construct, approximate the transfer characteristics (functional operators) to establish correspondence between the set of the input and output signals. The input signal of the Bernoulli memristor is the voltage applied to the memristor, and the output signal is the current flowing through it. Thus, the transfer characteristic is the dependence of current on voltage i ( v ) .
The set of the input signals of the Bernoulli memristor include harmonic signals described as:
v ( t ¯ ) = A sin ( ω 0 t ) = x ( A , t ¯ ) = A sin ( t ¯ ) ,
where A, A ( 0.5 ; 1 ] is an amplitude; ω 0 is the angular frequency; and t ¯ = ω 0 t , t ¯ [ 0 , 2 π ) is the normalized continuous time.
The set of output signals is developed using the equality [36,44]:
i ( t ¯ ) = v ( t ¯ ) M 0 [ 1 + β 2 0 t ¯ v α ( τ ) d τ ] 1 / ( α + 1 ) ,
where M 0 = v ( 0 ) / i ( 0 ) , β 2 = ( α + 1 ) k 2 A / M 0 α + 1 . Expression (22) is the analytical solution of Equation (20) in view of the input signal (21) [44].
When assigning variable α , for instance, α = 1 and input (21), we modify equality (22) and obtain [44]:
i ( t ¯ ) = v ( t ¯ ) M 0 [ 1 + β 2 ( 1 cos ( t ¯ ) ) ] 1 / 2 .
Furthermore, when M 0 = 2 , k 2 = 2 , we get β 2 = A , and from expression (23), we come to the formula:
i ( t ¯ ) = v ( t ¯ ) 2 [ 1 + A ( 1 cos ( t ¯ ) ) ] 1 / 2 .
Thus, the set of the memristor output signals includes the current signals i ( t ¯ ) , obtained from expression (24) at the input voltage signals v ( t ¯ ) from (21).
As follows from the analysis of expressions (22)–(24), the nonlinearity of the transfer characteristic depends severely on the amplitude of the input signal. This is why it is advisable to build piecewise behavioral models on subsets of the input and corresponding output signals. Hence, the general approximation task of high dimension is divided into several subtasks of low dimension. These subtasks are solved using the test input signals of different amplitudes from the subsets of the impact.
For Bernoulli memristor modeling, the amplitude range of the input signal is divided into five subranges: (−0.5; −0.45], (−0.45; −0.4], (−0.4; 0), (0; 0.5), [0.5; 1]. Within each subrange, we chose some amplitudes to build (train) models. These amplitudes form the following vectors:
A 1 = [ 0.48 ;   0.47 ;   0.46 ;   0.45 ] , A 2 = [ 0.449 ;   0.44 ;   0.43 ;   0.42 ;   0.41 ;   0.4 ] , A 3 = [ 0.399 ;   0.3 ;   0.2 ;   0.1 ;   0.001 ] , A 4 = [ 0.001 ;   0.1 ;   0.2 ;   0.3 ;   0.4 ;   0.499 ] , A 5 = [ 0.5 ;   0.6 ;   0.7 ;   0.8 ;   0.9 ;   1 ] ,
where 1, 2, …, 5 are the indices of vectors, which denote the numbers of the subranges mentioned above.
Figure 5 shows the pinched hysteresis current-voltage relationships of the Bernoulli memristor. The transfer characteristics corresponding to the subranges (−0.5; −0.45] and [0.5; 1] of the input signal amplitude are depicted in Figure 5a,b. The curve numbers correspond to the numbers of an elements in vectors A1 (Figure 5a) and A5 (Figure 5b). Input signals (21) with amplitudes from vectors A1 and A5, as well as the output signals calculated using formula (24) were used to define the represented transfer characteristics.
From Figure 5a,b, we see the significant dependence of the transfer characteristic on the input signal amplitude. This fact confirms the above-mentioned expediency of building piecewise behavioral models on the subsets of the input signal.
Behavioral models describing the transfer characteristics of the Bernoulli memristors are constructed in piecewise polynomial and neural forms. The splitter is described using the expression (14) and has the structure shown in Figure 3b.
The piecewise polynomial model of the memristor contains five polynomials constructed on the subsets of the input harmonic signal, taking into account the signal amplitudes from vectors A1, A2, …, A5. For each subset, a polynomial is formed on the basis of expression (4) at m = 2 (the number of splitting channels) as the following:
y k ( t ¯ ) = j 1 = 0 J 1 j 2 = 0 J 2 C k , j 1 j 2 [ x s 1 ( A , t ¯ ) ]   j 1 [ x s 2 ( A , t ¯ ) ]   j 2 = = j 1 = 0 J 1 j 2 = 0 J 2 C k , j 1 j 2 [ A sin ( t ¯ ) ]   j 1 [ A sin ( t ¯ t ¯ 0 ) ]   j 2 ,
where x s 1 ( A , t ¯ ) , x s 2 ( A , t ¯ ) are the basis functions of the multidimensional polynomial (the elements of the split signals vector (14)), k is the number of the input signal subset (of the subrange of the input signal amplitude), and J = r = 1 2 J r is the power of the polynomial. At the first subset of the input signal, the power of polynomial (25) is J = 6 (the number of the polynomial parameters is 27), and at other subsets, the power is J = 5 (the parameters number of every polynomial is 20). The total number of parameters of the piecewise polynomial model is 107.
The piecewise neural model of the memristor contains five three-layer neural networks. Every neural network has the structure shown in Figure 2. The number of neurons in the hidden layers is chosen so that its increase minimally reduces the modeling error. Thus, the size of every three-layer neural network is 3 × 2 × 1. The activation functions in the hidden layers are specified as hyperbolic tangents. The total number of the parameters of the piecewise neural model is 100. Neural networks are trained in the MATLAB system using the back propagation method with the Levenberg-Marquardt optimization algorithm, which is the combination of the gradient and Newton-Gauss methods and has a high convergence rate [45].
Three test input signals ( θ = 1, 2, 3) different from trained signals are assigned within every subset of the input signal to evaluate the accuracy of piecewise polynomial and neural models. The amplitudes of these test signals in five subsets form the following vectors:
A c 1 = [ 0.475 ;   0.465 ;   0.455 ] , A c 2 = [ 0.445 ;   0.425 ;   0.405 ] , A c 3 = [ 0.35 ;   0.25 ;   0.05 ] , A c 4 = [ 0.05 ;   0.25 ;   0.45 ] , A c 5 = [ 0.55 ;   0.75 ;   0.95 ] ,
where the numeric index (1, 2, …, 5) of a vector denotes the subset number. It should be emphasized that the elements of vectors Ac1, Ac2, …, Ac5 of the amplitudes of the input test signals do not match the elements of vectors A1, A2, …, A5 of the amplitudes of input signals used for training models.
The modeling errors are the following:
The absolute error
Δ k , θ ( t ¯ n ) = i ( t ¯ n ) y k , θ ( t ¯ n ) , n = 1 , 2 , , 628 ,   k = 1 , 2 , , 5 ,   θ = 1 , 2 , 3 ,
and the normalized (reduced) absolute error
Δ ¯ k , θ ( t ¯ n ) = ( i ( t ¯ n ) y k , θ ( t ¯ n ) ) / max t ¯ n ( 0 , 2 π ) ( | i ( t ¯ n ) | ) , n = 1 , 2 , , 628 ,   k = 1 , 2 , , 5 ,   θ = 1 , 2 , 3 ,
where t ¯ n is the value of the normalized time varying in the interval y 1 ( t ¯ n ) with the step of 0.01; i ( t ¯ n ) is the output signal determined from Equation (24); y k , θ ( t ¯ n ) is the output signal of a piecewise model; k is the number of the input signal amplitude range; θ is the input test signal number;
The maximum error is:
Δ ¯ max ( k ) = max θ = 1 , 2 , 3 ( max t ¯ n ( 0 , 2 π ) ( | Δ ¯ k , θ ( t ¯ n ) | ) ) n = 1 , 2 , , 628 ,   k = 1 , 2 , , 5 ,   θ = 1 , 2 , 3 ;
and the root mean square error is:
ε k , θ = 1 Q q = 1 Q ( i ( t ¯ q ) y k , θ ( t ¯ q ) max t ¯ n ( 0 , 2 π ) ( | i ( t ¯ n ) | ) ) 2 , Q = 628 , k = 1 , 2 , , 5 ,   θ = 1 , 2 , 3 , ε ( k ) = ( ε k , 1 + ε k , 2 + ε k , 3 ) / 3 .
The root mean square (Equation (29)) and maximum (Equation (28)) errors of modeling are shown in Figure 6a,b respectively. Curve 1 (blue) is obtained for the piecewise polynomial model, and Curve 2 (red) is obtained for the piecewise neural model.
Figure 7a shows the following curves: curve 1 (blue) is the output signal calculated from Equation (24) when the test signal is v ( t ¯ ) = 0.475 sin ( t ¯ ) ; curve 2 (red) is the output signal y k , θ ( t ¯ n ) ( k = 1 and θ = 1 ) of the piecewise neural model; and curve 3 (black) is the absolute error obtained from Equation (26). In Figure 7b, the normalized absolute errors (Equation (27)) of modeling using the piecewise neural (curve 1, red) and polynomial (curve 2, blue) models are represented. Figure 8a,b shows curves similar to Figure 7a,b when the test signal is v ( t ¯ ) = 0.75 sin ( t ¯ ) .
Analysis of Figure 6, Figure 7 and Figure 8 shows that the piecewise neural model ensures a higher modeling accuracy of the Bernoulli memristor on the set of harmonic signals (21) compared with the piecewise polynomial model. The complexities of these models are nearly equal. The parameter number of the piecewise neural model is 107, and the parameter number of the piecewise polynomial model is 100.

4. Conclusions

Due to the variety of physical processes underlying the technology and wide application of memristors (with different signals, operating modes, and performance requirements), the task of building of the universal behavioral models of memristors and memristor-based devices can be challenging. Behavioral models represent an object as a “black or gray box” and establish a mathematical correspondence between the sets of the input and output signals.
The universal behavioral model based on the split method is represented. According to this method, the operator of a device comprises two operators. The first operation is the splitting of the scalar input signal, i.e., converting it into the split vector signal. The second operation is the mapping (nonlinear, inertialess transformation) of the set of the split vector signals into the set of the output scalar signals. The splitting of the vector signals provides the uniqueness of the mentioned mapping. These two operations result in the behavioral model, which approximates the correspondence between the sets of the input and output signals.
The behavioral model based on split signals has the following advantages:
-
It is universal and, therefore, invariant to physical processes and applicable to different signals and types of memristors and memristor-based devices;
-
It is functional under strong nonlinearity; thus, it surpasses the Volterra series, which is limited by convergency;
-
It is adaptive to the input signals because these signals are split. In a sense, the model loses its universality (excessive one) and, hence, its complexity. As a result, we are approaching a compromise between building a simple model and achieving high accuracy;
-
It is necessary when the description of a device is insufficient or complex.
The splitter structure of harmonic signals is proposed. These signals are used to model different dynamic systems, including memristors and memristive devices. The minimum number of the harmonic signal splitting channels based on the delay line has been determined. This number establishes the minimum dimension of the nonlinear model. Thus, the behavioral model is simplified already at the stage of splitting the input signal.
To increase accuracy, the piecewise behavioral models are represented. A piecewise model is the combination of the models, which are built on the subsets of the input signals and whose complexities (the powers of multidimensional polynomials or the number of neurons) are lower than the complexity of a general model built on the entire assigned set of the input signals. Thus, the high-dimensional operator approximation is divided into several sub-approximations with lower dimensions. This approach solves the poor conditionality problem relevant to polynomials and overcomes the convergence difficulties relevant to training neural networks.
Piecewise models with split signals are used for the behavioral modeling of Bernoulli memristors, whose current dynamics are described using Bernoulli nonlinear differential equations. For the harmonic input signal, the split signal vector is formed using a delay line. The elements of the split vector form basic functions in piecewise polynomial and piecewise neural models. Comparative analysis has shown that the piecewise neural model ensures a higher accuracy than the piecewise polynomial, and the complexities of both models are almost the same (with nearly equal numbers of the model parameters).
The positive results obtained in the modeling of the Bernoulli memristors expand the application of signal splitting behavioral models. The above-mentioned advantages of the proposed models are a basis for modeling not only memristors with different physical processes but also memristive devices, which are synthesized on the basis of different technologies, have severely nonlinear characteristics, and deal with different signals.

Author Contributions

Conceptualization, E.S.; methodology, E.S. and A.S.; validation, E.S. and A.S.; formal analysis, E.S. and A.S.; investigation, E.S. and A.S.; resources, A.S.; data curation, A.S.; writing—original draft preparation, E.S. and A.S.; writing—review and editing, E.S. and A.S.; visualization, A.S.; supervision, E.S.; project administration, E.S.; funding acquisition, E.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Data Availability Statement

Data are contained within the article.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Abunahla, H.; Mohammad, B. Memristor Technology: Synthesis and Modeling for Sensing and Security Applications, 1st ed.; Springer International Publishing: Cham, Switzerland, 2018. [Google Scholar] [CrossRef]
  2. Mannocci, P.; Farronato, M.; Lepri, N.; Cattaneo, L.; Glukhov, A.; Sun, Z.; Ielmini, D. In-memory computing with emerging memory devices: Status and outlook. APL Mach. Learn. 2023, 1, 010902. [Google Scholar] [CrossRef]
  3. Chen, W.; Song, L.; Wang, S.; Zhang, Z.; Wang, G.; Hu, G.; Gao, S. Essential Characteristics of Memristors for Neuromorphic Computing. Adv. Electron. Mater. 2023, 9, 2200833. [Google Scholar] [CrossRef]
  4. Isah, A.; Bilbault, J.-M. Review on the Basic Circuit Elements and Memristor Interpretation: Analysis, Technology and Applications. J. Low Power Electron. Appl. 2022, 12, 44. [Google Scholar] [CrossRef]
  5. Wang, C.; Si, Z.; Jiang, X.; Malik, A.; Pan, Y.; Stathopoulos, S.; Serb, A.; Wang, S.; Prodromakis, T.; Papavassiliou, C. Multi-State Memristors and Their Applications. IEEE J. Emerg. Sel. Top. Circuits Syst. 2022, 12, 723–734. [Google Scholar] [CrossRef]
  6. Im, I.H.; Kim, S.J.; Jang, H.W. Memristive Devices for New Computing Paradigms. Adv. Intell. Syst. 2020, 2, 2000105. [Google Scholar] [CrossRef]
  7. Patil, A.R.; Dongale, T.D.; Kamat, R.K.; Rajpure, K.Y. Binary Metal Oxide-based Resistive Switching Memory Devices. Mater. Today Commun. 2023, 34, 105356. [Google Scholar] [CrossRef]
  8. Xiao, Y.; Jiang, B.; Zhang, Z.; Ke, S.; Jin, Y.; Wen, X.; Ye, C. A review of memristor: Material and structure design, device performance, applications and prospects. Sci. Technol. Adv. Mater. 2023, 24, 2162323. [Google Scholar] [CrossRef]
  9. Chua, L. Memristor—The missing circuit element. IEEE Trans. Circuit Theory 1971, 18, 507–519. [Google Scholar] [CrossRef]
  10. Strukov, D.B.; Snider, G.S.; Stewart, D.R.; Williams, R.S. The missing memristor found. Nature 2008, 453, 80–83. [Google Scholar] [CrossRef]
  11. Slavova, A.; Ignatov, V. Edge of Chaos in Memristor Cellular Nonlinear Networks. Mathematics 2022, 10, 1288. [Google Scholar] [CrossRef]
  12. Yang, K.; Yang, J.J.; Huang, R.; Yang, Y. Nonlinearity in Memristors for Neuromorphic Dynamic Systems. Small Sci. 2021, 2, 2100049. [Google Scholar] [CrossRef]
  13. Slavova, A.; Ignatov, V. Memristor Cellular Nonlinear Networks. Mathematics 2023, 11, 1601. [Google Scholar] [CrossRef]
  14. Yihyis, W.A.; He, S.; Tang, Z.; Wang, H. A Class of Discrete Memristor Chaotic Maps Based on the Internal Perturbation. Symmetry 2023, 15, 1574. [Google Scholar] [CrossRef]
  15. Wen, S.; Xiao, S.; Yang, Y.; Yan, Z.; Zeng, Z.; Huang, T. Adjusting learning rate of memristor-based multilayer neural networks via fuzzy method. IEEE Trans. Comput.-Aided Des. Integr. Circuits Syst. 2019, 38, 1084–1094. [Google Scholar] [CrossRef]
  16. Wang, H.; Duan, S.; Huang, T.; Wang, L.; Li, C. Exponential stability of complex-valued memristive recurrent neural networks. IEEE Trans. Neural Netw. Learn. Syst. 2017, 28, 766–771. [Google Scholar] [CrossRef] [PubMed]
  17. Ye, L.; Gao, Z.; Fu, J.; Ren, W.; Yang, C.; Wen, J.; Wan, X.; Ren, Q.; Gu, S.; Liu, X.; et al. Overview of Memristor-Based Neural Network Design and Applications. Front. Phys. 2022, 10, 839243. [Google Scholar] [CrossRef]
  18. Ascoli, A.; Tetzlaff, R.; Biey, M. Memristor and memristor circuit modelling based on methods of nonlinear system. In Nonlinear Dynamics in Computational Neuroscience; Corinto, F., Torcini, A., Eds.; Springer International Publishing AG: New York, NY, USA, 2019; pp. 99–132. [Google Scholar] [CrossRef]
  19. Horváth, A.; Ascoli, A.; Tetzlaff, R. Deep Memristive Cellular Neural Networks for Image Classification. In Proceedings of the IEEE 22nd International Conference on Nanotechnology (NANO), Palma de Mallorca, Spain, 4–8 July 2022; pp. 457–460. [Google Scholar] [CrossRef]
  20. He, S.; Liu, J.; Wang, H.; Sun, K. A discrete memristive neural network and its application for character recognition. Neurocomputing 2023, 523, 1–8. [Google Scholar] [CrossRef]
  21. Huang, J.; Serb, A.; Stathopoulos, S.; Prodromakis, T. Text Classification in Memristor-based Spiking Neural Networks. Neuromorphic Comput. Eng. 2023, 3, 014003. Available online: https://iopscience.iop.org/article/10.1088/2634-4386/acb2f0/meta (accessed on 31 January 2023). [CrossRef]
  22. You, T.; Zhao, M.; Fan, Z.; Ju, C. Emerging Memtransistors for Neuromorphic System Applications. Sensors 2023, 23, 5413. [Google Scholar] [CrossRef]
  23. Bian, J.; Cao, Z.; Zhou, P. Neuromorphic computing: Devices, hardware, and system application facilitated by two-dimensional materials. Appl. Phys. Rev. 2021, 8, 041313. [Google Scholar] [CrossRef]
  24. Kumar, S.; Wang, X.; Strachan, J.P.; Yang, Y.; Lu, W.D. Dynamical memristors for higher-complexity neuromorphic computing. Nat. Rev. Mater. 2022, 7, 575–591. [Google Scholar] [CrossRef]
  25. Vourkas, I.; Sirakoulis, G.C. Emerging memristor-based logic circuit design approaches. IEEE Circuits Syst. Mag. 2016, 16, 15–30. [Google Scholar] [CrossRef]
  26. Hong, Q.; Yan, R.; Wang, C.; Sun, J. Memristive Circuit Implementation of Biological Nonassociative Learning Mechanism and Its Applications. IEEE Trans. Biomed. Circuits Syst. 2020, 14, 1036–1050. [Google Scholar] [CrossRef] [PubMed]
  27. Zhang, Y.; Wang, X.; Li, Y.; Friedman, E.G. Memristive model for synaptic circuits. IEEE Trans. Circuits Syst. II Express Briefs 2017, 64, 767–771. [Google Scholar] [CrossRef]
  28. Solovyeva, E.B.; Azarov, V.A. Comparative analysis of memristor models with a window function described in LTspice. In Proceedings of the ElConRus, Saint-Petersburg, Moscow, Russia, 26–29 January 2021; pp. 1097–1101. [Google Scholar] [CrossRef]
  29. Ezeogu, A.C. Memristor theory and mathematical modelling. Int. J. Comput. Appl. 2019, 178, 1–9. [Google Scholar] [CrossRef]
  30. Oguz, Y. Mathematical modeling of memristors. In Memristor and Memristive Neural Networks; James, A., Ed.; IntechOpen: Rijeka, Croatia, 2018; pp. 187–205. [Google Scholar] [CrossRef]
  31. Soni, K.; Sahoo, S. A Review on Different Memristor Modeling and Applications. In Proceedings of the MECON, Noida, India, 10–11 March 2022; pp. 688–695. [Google Scholar] [CrossRef]
  32. Mladenov, V.A. Unified and Open LTSPICE Memristor Model Library. Electronics 2021, 10, 1594. [Google Scholar] [CrossRef]
  33. Mladenov, V. Application and Analysis of Modified Metal-Oxide Memristor Models in Electronic Devices. Technologies 2023, 11, 20. [Google Scholar] [CrossRef]
  34. Ma, C.; Xie, S.; Jia, Y.; Lin, G. Macromodeling of the memristor using piecewise Volterra series. Microelectron. J. 2014, 45, 325–329. [Google Scholar] [CrossRef]
  35. Solovyeva, E. Behavioural nonlinear system models specified by various types of neural networks. J. Phys. Conf. Ser. 2018, 1015, 032139. [Google Scholar] [CrossRef]
  36. Solovyeva, E. Operator approach to nonlinear compensator synthesis for communication systems. In Proceedings of the International Siberian Conference on Control and Communications SIBCON, Moscow, Russia, 12–14 May 2016; pp. 1–5. [Google Scholar] [CrossRef]
  37. Mathews, V.J.; Sicuranza, G.L. Polynomial Signal Processing, 1st ed.; John Wiley & Sons, Inc.: Hoboken, NJ, USA, 2000. [Google Scholar]
  38. Birpoutsoukis, G. Volterra Series Estimation in the Presence of Prior Knowledge. Ph.D. Thesis, Vrije Universiteit Brussel, Brussel, Belgium, 2018; 268p. [Google Scholar]
  39. Jing, X.; Lang, Z. Frequency Domain Analysis and Design of Nonlinear Systems Based on Volterra series Expansion. A Parametric Characteristic Approach; Springer International Publishing: Cham, Switzerland, 2015; 331p. [Google Scholar] [CrossRef]
  40. Schoukens, J.; Ljung, L. Nonlinear system identification. A user-oriented roadmap. arXiv 2019, arXiv:1902.00683. [Google Scholar]
  41. Rogers, T.J.; Holmes, G.R.; Cross, E.J.; Worden, K. On a grey box modelling framework for nonlinear system identification. In Special Topics in Structural Dynamics; Dervilis, N., Ed.; Springer: Cham, Switzerland, 2017; Volume 6, pp. 167–178. [Google Scholar] [CrossRef]
  42. Solovyeva, E. A split signal polynomial as a model of an impulse noise filter for speech signal recovery. J. Phys. Conf. Ser. 2017, 803, 012156. [Google Scholar] [CrossRef]
  43. Solovyeva, E.; Schulze, S.; Harchuk, H. Behavioral modeling of memristor-based rectifier bridge. Appl. Sci. 2021, 11, 2908. [Google Scholar] [CrossRef]
  44. Georgiou, P.S.; Barahona, M.; Yaliraki, S.N.; Drakakis, E.M. Device properties of Bernoulli memristors. Proc. IEEE 2012, 100, 1938–1950. [Google Scholar] [CrossRef]
  45. Haykin, S. Neural Networks and Learning Machines, 3rd ed.; Pearson Education, Inc.: Bergen, NJ, USA, 2011; 938p. [Google Scholar]
  46. Biolek, Z.; Biolek, D.; Biolkova, V. Differential equations of ideal memristors. Radioengineering 2015, 24, 369–377. [Google Scholar] [CrossRef]
Figure 1. The block scheme of a model with split signals.
Figure 1. The block scheme of a model with split signals.
Micromachines 15 00051 g001
Figure 2. The convertor structure in the form of a three-layer feedforward neural network.
Figure 2. The convertor structure in the form of a three-layer feedforward neural network.
Micromachines 15 00051 g002
Figure 3. The block scheme of the splitter as a delay line for harmonic signal with an amplitude equal to one (a) and variable (b).
Figure 3. The block scheme of the splitter as a delay line for harmonic signal with an amplitude equal to one (a) and variable (b).
Micromachines 15 00051 g003
Figure 4. Signal with non-splitting values.
Figure 4. Signal with non-splitting values.
Micromachines 15 00051 g004
Figure 5. The pinched hysteresis current-voltage relationships corresponding to the subranges (−0.5; −0.45] (a) and [0.5; 1] (b) of the input signal amplitude.
Figure 5. The pinched hysteresis current-voltage relationships corresponding to the subranges (−0.5; −0.45] (a) and [0.5; 1] (b) of the input signal amplitude.
Micromachines 15 00051 g005
Figure 6. Error ε k (a) and Δ ¯ max ( k ) (b) obtained using the piecewise polynomial and neural models.
Figure 6. Error ε k (a) and Δ ¯ max ( k ) (b) obtained using the piecewise polynomial and neural models.
Micromachines 15 00051 g006
Figure 7. The output signals i ( t ¯ n ) , y 1 , 1 ( t ¯ n ) , Δ 1 , 1 ( t ¯ n ) (a) and normalized absolute errors Δ ¯ 1 , 1 ( t ¯ n ) × 10 2 (b) when the input test signal is v ( t ¯ ) = 0.475 sin ( t ¯ ) .
Figure 7. The output signals i ( t ¯ n ) , y 1 , 1 ( t ¯ n ) , Δ 1 , 1 ( t ¯ n ) (a) and normalized absolute errors Δ ¯ 1 , 1 ( t ¯ n ) × 10 2 (b) when the input test signal is v ( t ¯ ) = 0.475 sin ( t ¯ ) .
Micromachines 15 00051 g007
Figure 8. The output signals i ( t ¯ n ) , y 5 , 2 ( t ¯ n ) , Δ 5 , 2 ( t ¯ n ) (a) and normalized absolute errors Δ ¯ 5 , 2 ( t ¯ n ) × 10 3 (b) when the input test signal is v ( t ¯ ) = 0.75 sin ( t ¯ ) .
Figure 8. The output signals i ( t ¯ n ) , y 5 , 2 ( t ¯ n ) , Δ 5 , 2 ( t ¯ n ) (a) and normalized absolute errors Δ ¯ 5 , 2 ( t ¯ n ) × 10 3 (b) when the input test signal is v ( t ¯ ) = 0.75 sin ( t ¯ ) .
Micromachines 15 00051 g008
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Solovyeva, E.; Serdyuk, A. Behavioral Modeling of Memristors under Harmonic Excitation. Micromachines 2024, 15, 51. https://doi.org/10.3390/mi15010051

AMA Style

Solovyeva E, Serdyuk A. Behavioral Modeling of Memristors under Harmonic Excitation. Micromachines. 2024; 15(1):51. https://doi.org/10.3390/mi15010051

Chicago/Turabian Style

Solovyeva, Elena, and Artyom Serdyuk. 2024. "Behavioral Modeling of Memristors under Harmonic Excitation" Micromachines 15, no. 1: 51. https://doi.org/10.3390/mi15010051

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop