# Birhythmic Analog Circuit Maze: A Nonlinear Neurostimulation Testbed

^{1}

^{2}

^{3}

^{*}

## Abstract

**:**

## 1. Introduction

## 2. Birhythmic Dynamics in 3-Dimensions

## 3. Electronic Physical Realization

#### 3.1. Nonlinear Activation Function Circuit

#### 3.2. Schematics of Electronic Birhythmic RNN

`-tanh`”, where terminals IOP1 and IOP2 are the input and output voltage to each hyperbolic tangent unit, respectively. Furthermore, two analog multiplication chips can be used to introduce the phase flow speed dependence on $z\left(t\right)$ in Equations (8) and (9). Thus, the entire system can be constructed entirely from simple analog components.

`stim_out`represents the output of the nonlinear stimulator circuit and will be discussed in Section 4. The schematic of the electronic realization of Equations (8) and (9) is shown in Figure 5, where the state variables, $x\left(t\right)$ and $y\left(t\right)$, are represented by the voltages across capacitors C1 and C2, respectively. The “z” input to analog multipliers, M1 and M2, is taken from the integrator output labeled “z” in Figure 4.

#### 3.3. Circuit Construction and Experimental Results

## 4. Nonlinear Stimulator Circuit Design and Discussion

`stim_out`in Figure 4, where the output to the stimulator circuit will be fed in and summed with the current value of $\dot{z}$ in the system. By extending the system properly in this way, we can prevent straightforward stimulation patterns (i.e., constant, random, periodic, etc.) from inducing attractor transitions.

`stim_out`, to either increase or decrease. Furthermore, the amount by which the signal can change should exist on a continuum, rather than outputting a voltage from a finite set of values. The final requirement we will enforce for such a circuit will be that a stimulation pulse delivered at a random time should have equal probability of increasing or decreasing the output signal. This last requirement ensures that if one stimulates randomly or continuously, the expected value of

`stim_out`averaged across all time will be zero as time approaches infinity.

`Stimulus`.

`stim_out`.

`stim_out`node in Figure 8 and apply constant stimulation. All of the trials successfully traveled over the separating unstable manifold at $z=0$ as depicted by the red and blue curves in Figure 9, representing the trials initialized on the slow and fast limit cycles, respectively. An example of the behavior for all system coordinates and the stimulator circuit output is shown in Figure 12 for both trajectories initialized on the slow and fast limit cycles.

## 5. Conclusions

## Author Contributions

## Funding

## Conflicts of Interest

## Appendix A. Circuit Component Values

#### Appendix A.1. Component Values for Figure 4

#### Appendix A.2. Component Values for Figure 5

#### Appendix A.3. Component Values for Figure 8

## Appendix B. Hyperbolic Tangent Implementation

**Figure A1.**Input/output relation of three physically realized hyperbolic tangent circuits, interpolated through 21 points, compared with the analytic hyperbolic tangent function.

## References

- Pisarchik, A.N.; Feudel, U. Control of multistability. Phys. Rep.
**2014**, 540, 167–218. [Google Scholar] [CrossRef] - Abou-Jaoudé, W.; Chaves, M.; Gouzé, J.L. Mechanisms for coexistence of two limit cycles in a biochemical model1. IFAC Proc. Vol.
**2011**, 44, 8378–8383. [Google Scholar] [CrossRef] - Decroly, O.; Goldbeter, A. Birhythmicity, chaos, and other patterns of temporal self-organization in a multiply regulated biochemical system. Proc. Natl. Acad. Sci. USA
**1982**, 79, 6917–6921. [Google Scholar] [CrossRef] [Green Version] - Hudson, J.L.; Mankin, J.C. Chaos in the Belousov–Zhabotinskii reaction. J. Chem. Phys.
**1981**, 74, 6171–6177. [Google Scholar] [CrossRef] - Ngonghala, C.N.; Feudel, U.; Showalter, K. Extreme multistability in a chemical model system. Phys. Rev. E
**2011**, 83, 056206. [Google Scholar] [CrossRef] [Green Version] - Biswas, D.; Banerjee, T.; Kurths, J. Control of birhythmicity through conjugate self-feedback: Theory and experiment. Phys. Rev. E
**2016**, 94, 042226. [Google Scholar] [CrossRef] [Green Version] - In, V.; Kho, A.; Neff, J.D.; Palacios, A.; Longhini, P.; Meadows, B.K. Experimental observation of multifrequency patterns in arrays of coupled nonlinear oscillators. Phys. Rev. Lett.
**2003**, 91, 244101. [Google Scholar] [CrossRef] [Green Version] - Ravelet, F.; Marié, L.; Chiffaudel, A.; Daviaud, F. Multistability and Memory Effect in a Highly Turbulent Flow: Experimental Evidence for a Global Bifurcation. Phys. Rev. Lett.
**2004**, 93, 164501. [Google Scholar] [CrossRef] [Green Version] - Shiau, Y.H.; Peng, Y.F.; Hwang, R.R.; Hu, C.K. Multistability and symmetry breaking in the two-dimensional flow around a square cylinder. Phys. Rev. E
**1999**, 60, 6188–6191. [Google Scholar] [CrossRef] [Green Version] - Koseska, A.; Volkov, E.; Zaikin, A.; Kurths, J. Inherent multistability in arrays of autoinducer coupled genetic oscillators. Phys. Rev. E
**2007**, 75, 031916. [Google Scholar] [CrossRef] [Green Version] - Labavić, D.; Meyer-Ortmanns, H. Networks of coupled circuits: From a versatile toggle switch to collective coherent behavior. Chaos Interdiscip. J. Nonlinear Sci.
**2014**, 24, 043118. [Google Scholar] [CrossRef] [Green Version] - Ding, W.C.; Xie, J.H.; Sun, Q.G. Interaction of Hopf and period doubling bifurcations of a vibro-impact system. J. Sound Vib.
**2004**, 275, 27–45. [Google Scholar] [CrossRef] [Green Version] - Kiss, I.Z.; Hudson, J.L. Chaotic cluster itinerancy and hierarchical cluster trees in electrochemical experiments. Chaos Interdiscip. J. Nonlinear Sci.
**2003**, 13, 999–1009. [Google Scholar] [CrossRef] - Little, W.A. The existence of persistent states in the brain. Math. Biosci.
**1974**, 19, 101–120. [Google Scholar] [CrossRef] - Breakspear, M. Dynamic models of large-scale brain activity. Nat. Neurosci.
**2017**, 20, 340–352. [Google Scholar] [CrossRef] - Fairhall, A.; Machens, C. Editorial overview: Computational neuroscience. Curr. Opin. Neurobiol.
**2017**, 46, A1–A5. [Google Scholar] [CrossRef] - Sussillo, D. Neural circuits as computational dynamical systems. Curr. Opin. Neurobiol.
**2014**, 25, 156–163. [Google Scholar] [CrossRef] - La Camera, G.; Fontanini, A.; Mazzucato, L. Cortical computations via metastable activity. Curr. Opin. Neurobiol.
**2019**, 58, 37–45. [Google Scholar] [CrossRef] - Zhao, Y.; Park, I.M. Interpretable Nonlinear Dynamic Modeling of Neural Trajectories. arXiv
**2016**, arXiv:q-bio.QM/1608.06546. [Google Scholar] - Li, H.H.; Rankin, J.; Rinzel, J.; Carrasco, M.; Heeger, D.J. Attention model of binocular rivalry. Proc. Natl. Acad. Sci. USA
**2017**, 114, E6192–E6201. [Google Scholar] [CrossRef] [Green Version] - Churchland, M.M.; Cunningham, J.P.; Kaufman, M.T.; Foster, J.D.; Nuyujukian, P.; Ryu, S.I.; Shenoy, K.V. Neural population dynamics during reaching. Nature
**2012**, 487, 51–56. [Google Scholar] [CrossRef] [PubMed] [Green Version] - Mante, V.; Sussillo, D.; Shenoy, K.V.; Newsome, W.T. Context-dependent computation by recurrent dynamics in prefrontal cortex. Nature
**2013**, 503, 78–84. [Google Scholar] [CrossRef] [PubMed] [Green Version] - Jazayeri, M.; Afraz, A. Navigating the Neural Space in Search of the Neural Code. Neuron
**2017**, 93, 1003–1014. [Google Scholar] [CrossRef] [PubMed] [Green Version] - Wagenaar, R.C.; van Emmerik, R.E.A. Dynamics of movement disorders. Hum. Mov. Sci.
**1996**, 15, 161–175. [Google Scholar] [CrossRef] - Iasemidis, L.D. Epileptic seizure prediction and control. IEEE Trans. Biomed. Eng.
**2003**, 50, 549–558. [Google Scholar] [CrossRef] - Lewis, L.D.; Piantoni, G.; Peterfreund, R.A.; Eskandar, E.N.; Harrell, P.G.; Akeju, O.; Aglio, L.S.; Cash, S.S.; Brown, E.N.; Mukamel, E.A.; et al. A transient cortical state with sleep-like sensory responses precedes emergence from general anesthesia in humans. Elife
**2018**, 7, e33250. [Google Scholar] [CrossRef] - Schiff, N.D.; Nauvel, T.; Victor, J.D. Large-scale brain dynamics in disorders of consciousness. Curr. Opin. Neurobiol.
**2014**, 25, 7–14. [Google Scholar] [CrossRef] [Green Version] - Little, S.; Brown, P. Focusing Brain Therapeutic Interventions in Space and Time for Parkinson’s Disease. Curr. Biol.
**2014**, 24, R898–R909. [Google Scholar] [CrossRef] [Green Version] - Hocker, D.; Park, I.M. Myopic control of neural dynamics. PLoS Comput. Biol.
**2019**, 15, e1006854. [Google Scholar] [CrossRef] [Green Version] - Bao, B.; Qian, H.; Wang, J.; Xu, Q.; Chen, M.; Wu, H.; Yu, Y. Numerical analyses and experimental validations of coexisting multiple attractors in Hopfield neural network. Nonlinear Dyn.
**2017**, 90, 2359–2369. [Google Scholar] [CrossRef] - Rahman, A.; Jordan, I.; Blackmore, D. Qualitative models and experimental investigation of chaotic NOR gates and set/reset flip-flops. Proc. R. Soc. Math. Phys. Eng. Sci.
**2018**, 474, 20170111. [Google Scholar] [CrossRef] [PubMed] [Green Version] - Zhao, Y.; Nassar, J.; Jordan, I.; Bugallo, M.; Park, I.M. Streaming Variational Monte Carlo. arXiv
**2019**, arXiv:1906.01549. [Google Scholar] - Cho, K.; van Merrienboer, B.; Gulcehre, C.; Bahdanau, D.; Bougares, F.; Schwenk, H.; Bengio, Y. Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation. arXiv
**2014**, arXiv:1406.1078. [Google Scholar] - Jordan, I.D.; Sokol, P.A.; Park, I.M. Gated recurrent units viewed through the lens of continuous time dynamical systems. arXiv
**2019**, arXiv:1906.01005. [Google Scholar] - Duan, S.; Liao, X. An electronic implementation for Liao’s chaotic delayed neuron model with non-monotonous activation function. Phys. Lett. A
**2007**, 369, 37–43. [Google Scholar] [CrossRef] - Wilmshurst, T.H. Analog Circuit Techniques: With Digital Interfacing; Elsevier: Amsterdam, The Netherlands, 2001. [Google Scholar]

**Figure 1.**Planar Limit Cycle with 2D continuous-time gated recurrent unit (ct-GRU) depicted in phase space: The red dot indicates an unstable fixed point at the origin unstable, while orange and pink lines represent the x and y nullclines, respectively. Purple lines indicate various trajectories of the hidden state. Direction of the flow is determined by the black arrows, where the colormap underlying the figure depicts the magnitude of the velocity of the flow in log scale.

**Figure 2.**Birhythmicy in 3-dimensions: (

**A**): light blue manifold on the $x-y$ plane separates the basins of attraction of the upper and lower limit cycles. Trajectories are colored either dark blue or purple, depending on which basin of attraction they are initialized in. Red dots indicate fixed points, and black arrows depict the direction of flow. (

**B**,

**C**): x, y, and z components of trajectories initialized in the basins of attractions for the top and bottom limit cycles, respectively. Solid colored lines indicate $x\left(t\right)$, dashed lines indicate $y\left(t\right)$, and black lines indicate $z\left(t\right)$.

**Figure 3.**Electronic circuit realization of the hyperbolic tangent function, as implemented in Reference [30]. ${V}_{in}$ and ${V}_{o}$ represent the input and output signals, respectively.

**Figure 4.**Circuit schematic of $\dot{z}$ for the birhythmic system. The system block labeled

`-tanh`represents the circuit depicted in Figure 3, where

`I01`and

`I02`correspond to ${V}_{in}$ and ${V}_{o}$, respectively. The terminal labeled

`stim_out`represents the output to the stimulator circuit, as discussed in Section 4.

**Figure 5.**Circuit schematic of $\dot{x}$ and $\dot{y}$ for the birhythmic system. The system blocks labeled

`-tanh1`and

`-tanh2`represent the circuit depicted in Figure 3, where

`I01`and

`I02`correspond to ${V}_{in}$ and ${V}_{o}$, respectively, for both blocks. The two multiplier chips, M1 and M2, are assumed to operate with unity gain.

**Figure 6.**Physical birhythmic circuit constructed on a breadboard. Blue boxes represent hyperbolic tangent units. The magenta box indicates the subsection of the circuit generating $\dot{z}$, and the green box indicates the analog multipliers.

**Figure 7.**Experimental recordings of the birhythmic circuit: (

**A**,

**C**): x (yellow), y (blue), and z (pink) with respect to time of trajectories within the basin of attraction of the fast and slow limit cycles, respectively. (

**B**,

**D**): Projection of the corresponding trajectories in (

**A**,

**C**) onto the x-y plane, respectively.

**Figure 8.**Schematic for nonlinear stimulator circuit, with input labeled as Stimulus. The output, labeled

`stim_out`, is fed into the terminal with the same name presented in the circuit diagram shown in Figure 4. The two multiplier chips, M1 and M2, are assumed to operate with unity gain, and the x and y terminals are fed into the equivalently named terminals depicted in Figure 5.

**Figure 9.**A time window of $z\left(t\right)$ for all experimental trials: Red and blue trajectories demonstrate resultant behavior from stimulation patterns designed to transition states from the slow and fast limit cycles, respectively. Turquoise trajectories depict trials of constant stimulation, and orange trajectories show trials of random stimulation.

**Figure 10.**x (yellow), y (blue), z (pink), and stim_out (green) with respect to time of trajectories within the basin of attraction of the slow (

**A**) and fast (

**B**) limit cycles, under constant stimulation. Note that this stimulation regime does not successfully transition between the two attracting states in either direction.

**Figure 11.**x (yellow), y (blue), z (pink), and stim_out (green) with respect to time of trajectories within the basin of attraction of the slow (

**A**) and fast (

**B**) limit cycles, with random stimulation. Note that this stimulation regime does not successfully transition between the two attracting states in either direction.

**Figure 12.**Examples of stimulation patterns capable of inducing transition between states: x (yellow), y (blue), z (pink), and stim_out (green) with respect to time of trajectories initialized within the basin of attraction of the slow (

**A**) and fast (

**B**) limit cycles. As $z\left(t\right)$ changes with stimulation so does the frequency of oscillation. As such, the time window to stimulate shifts continuously.

© 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).

## Share and Cite

**MDPI and ACS Style**

Jordan, I.D.; Park, I.M.
Birhythmic Analog Circuit Maze: A Nonlinear Neurostimulation Testbed. *Entropy* **2020**, *22*, 537.
https://doi.org/10.3390/e22050537

**AMA Style**

Jordan ID, Park IM.
Birhythmic Analog Circuit Maze: A Nonlinear Neurostimulation Testbed. *Entropy*. 2020; 22(5):537.
https://doi.org/10.3390/e22050537

**Chicago/Turabian Style**

Jordan, Ian D., and Il Memming Park.
2020. "Birhythmic Analog Circuit Maze: A Nonlinear Neurostimulation Testbed" *Entropy* 22, no. 5: 537.
https://doi.org/10.3390/e22050537