Non-Equilibrium Quantum Electrodynamics in Open Systems as a Realizable Representation of Quantum Field Theory of the Brain

We derive time evolution equations, namely the Klein–Gordon equations for coherent fields and the Kadanoff–Baym equations in quantum electrodynamics (QED) for open systems (with a central region and two reservoirs) as a practical model of quantum field theory of the brain. Next, we introduce a kinetic entropy current and show the H-theorem in the Hartree–Fock approximation with the leading-order (LO) tunneling variable expansion in the 1st order approximation for the gradient expansion. Finally, we find the total conserved energy and the potential energy for time evolution equations in a spatially homogeneous system. We derive the Josephson current due to quantum tunneling between neighbouring regions by starting with the two-particle irreducible effective action technique. As an example of potential applications, we can analyze microtubules coupled to a water battery surrounded by a biochemical energy supply. Our approach can be also applied to the information transfer between two coherent regions via microtubules or that in networks (the central region and the Nres reservoirs) with the presence of quantum tunneling.


Introduction
What is a physical mechanism of generating memory in the brain, and where is memory stored in the brain? These are still open questions in contemporary neuroscience [1,2]. We know that memory has an aspect of information encoding and retrieval as well meaning attached to this information. In information theory, we adopt Shannon entropy as a measure of information content [3]. This entropy increases as the uncertainty associated with information becomes larger. On the other hand, in thermodynamics we use thermodynamic Boltzmannian entropy as a measure of disorder in a physical system. This entropy increases as the order of the system is reduced. If Shannon entropy represents the same concept as thermodynamic entropy, we must adopt an ordered system to memorize information. There might be no way to memorize information without adopting an ordered physical system as has been earlier discussed within quantum field theory (QFT) [4]. In QFT, order is associated with the breakdown of symmetry [5]. For example, crystals are ordered quantum systems of discretely arranged atoms, where continuous translational symmetry is spontaneously broken. Order is maintained by long-range correlations involving phonons, with Nambu-Goldstone (NG) quanta [6][7][8] emerging as quantum excitations from the ground state in spontaneous symmetry breaking (SSB).
Since NG quanta are massless, macroscopic order emerges due to these long-range correlations.
Ferromagnets are examples of ordered quantum systems composed of magnetic dipoles aligned in the same direction, so that rotational symmetry is spontaneously broken when the ferromagnetic phase is generated by magnetic moment alignment. This order is maintained by long-range correlations involving magnons, which are massless NG quanta emerging in SSB. The concept of SSB can be adopted in QFT (with infinite unitarily-or physically-inequivalent vacua) distinguished from quantum mechanics in which the concept of SSB does not appear. Furthermore, QFT is conventionally applied to macroscopic matter, although its application is not restricted only to microscopic phenomena [5]. Hence, it is reasonable and convenient to adopt QFT with the possibility of spontaneous symmetry breakdown for the physical description of ordered systems, which contain information, or memory.
Quantum field theory of the brain, or quantum brain dynamics (QBD), represents a proposal to describe memory formation in the brain by adopting the breakdown of symmetry [9,10]. Memory in the brain has properties of heterogeneity, long-term but imperfect stability, and diffuse nonlocal nature Each memory is diffused and not localized to particular regions in the brain. It does not disappear due to the destruction of particular local regions. [11][12][13]. The QBD can describe these properties of memory in the brain by adopting unitarily inequivalent vacua, namely diverse coherent states. One vacuum is imperfectly stable and transferred to another over the course of time. Each vacuum is characterized by macroscopic spatial extension with long-range correlations. The QBD originated in the work by Ricciardi and Umezawa in 1967 [14], where external stimuli trigger SSB of the system or macroscopic order. In the 1970s, this model was further developed by Stuart et al. [15,16], whereby the brain is envisaged as a mixed system of classical neurons and microscopic degrees of freedom, namely corticons and exchange bosons, which were not specifically identified at this stage. Around the same time, Fröhlich studied a theory of biological coherence involving electric dipoles contained in the membranes of biological systems [17][18][19][20][21][22]. When the frequencies of oscillating dipoles in the system are within a narrow range around the resonance frequencies and coupling constants of interaction with heat bath and energy pump are large enough, an ordered state with the dielectric polarization (where electric dipoles are dynamically aligned in the same direction) emerges leading to the breakdown of symmetry and the coherent wave propagation of dipole oscillation forms a so-called Fröhlich condensate. In 1976, Davydov and Kislukha proposed a theory of solitary waves propagating in DNA and protein chains (alpha-helices) called the Davydov soliton [23]. The theories of coherence in biological systems by Fröhrich and Davydov can be described by static and dynamical properties of the nonlinear Schrödinger equation with an equivalent quantum Hamiltonian, respectively [24]. In the 1980s, Del Giudice et al., studied collective properties of electric dipoles of water in biological systems based on QFT [25][26][27]. After the analysis of water's electric dipole fields in biological systems, Jibu and Yasue identified concrete microscopic degrees of freedom of QBD (corticons and exchange bosons) in the 1990s, namely water electric dipole fields and massive photon fields [9,[28][29][30][31]. The QBD is essentially Quantum Electrodynamics (QED) of water electric dipoles. They adopted a superradiant phase, which represents the coherent state of water dipoles and massive photons [32][33][34][35][36]. When water electric dipoles are aligned in the same direction, the rotational symmetry is spontaneously broken, and polaritons, NG bosons, emerge in the SSB. They are absorbed into the longitudinal modes of photons, and photons acquire mass due to the Higgs mechanism. The massive photons are called evanescent photons. Since these photons have mass which is proportional to coherent dipole fields or the square root of the number density of aligned dipoles, they can stay in the dynamically-coherent regions of the brain. Memory in this model, therefore, is the coherent state of water electric dipole fields and photon fields with the condensation of the NG modes in the vacuum state. In 1995, Vitiello proposed a dissipative model of QBD to solve the problem of the informational capacity of memory [37]. As a result, a huge informational capacity of memory capacity was proposed to result by regarding the brain as an open system and by doubling the degrees of freedom. In 2003, Zheng and Pollack showed experimentally the existence of the so-called exclusion zone (EZ) water, which formed around hydrophilic surfaces [38] such as those around proteins. The properties of EZ water correspond to those of coherent water in QED [39].
However, the preceding research on this topic lacks the non-equilibrium multi-energy-mode analysis in open systems since it is based on the two-energy-level approximation for charged fields and single-energy-mode analysis for photon fields. Unsurprisingly, the main criticism found in the literature is related to the quantum decoherence phenomena, which means the formed coherent fields might rapidly disappear due to thermal effects destroying the broken symmetry states in the process [40]. Hence, memory proposed in the QFT models discussed above would be rapidly erased. In the above approximations, several components which might induce decoherence are lost, namely field-particle conversion (decoherence), thermal effects, and collision processes with multi-energy-mode incoherent particles. However, whether the decoherence occurs or not must be demonstrated by non-equilibrium numerical simulations based on the multi-energy-mode analysis in open systems. In case coherence is robust, we will be able to find non-equilibrium memory formation processes through numerical simulations.
The aim of this paper is to derive time evolution equations based on QED with charged bosons present in open systems in order to provide a theoretical framework for a concrete description of memory formation processes, which can be further developed in the future. In this paper, to describe multi-energy-mode phenomena, we adopt the Kadanoff-Baym (KB) equations [41][42][43] for quantum fluctuations in QED for open systems, with the use of Klein-Gordon (KG) equations for coherent fields. We can describe general dynamics with the above equations, since the Boltzmann equation, the hydrodynamic equations and the Langevin equations are derived from the KB equation [42,44,45]. We introduce a kinetic entropy current by use of the KB equations, and show the H-theorem in the Hartree-Fock approximation to the 1st order approximation in the gradient expansion. These approximations are adopted as coarse-graining procedures to define a kinetic entropy. We also find the total conserved charge and energy in spatially homogeneous systems. By use of the KG equations and the KB equations, we can describe non-equilibrium, non-secular, multi-energy-mode, charge-energy-conserving dynamics. Finally, we find that it is possible to describe the time evolution of gauge-invariant quantities. This is the main result of this paper. This paper is organized as follows. In Section 2, we provide the Lagrangian density in QED in open systems (with a central region and two reservoirs coupled to it) and derive time evolution equations for coherent fields and quantum fluctuations. In Section 3, we analyze the Kadanoff-Baym equations and show the gauge invariance. In Section 4, we introduce a kinetic entropy current and show the H-theorem. In Section 5, we derive time evolution equations in spatially-homogeneous systems, and give the conserved charge and energy expression for total systems. In Section 6, we discuss our results. In Section 7, we provide conclusions derived from this work. In the Appendix A, several calculations for the O(e 4 |φ| 2 ) self-energy are given. In this paper, we adopt the metric η µν = η µν = diag(1, −1, −1, −1) in 3 + 1 dimensions where the Greek letters (µ, ν) run over 0 to d in d + 1 dimensions and the subscripts (i, j) run over 1 to d. We use the Greek letter α to represent the left L and the right R reservoirs. The speed of light and the Planck constant divided by 2π are both set to be 1.

Two-Particle Irreducible Effective Action and Time Evolution Equations
In this section, we begin with the Lagrangian density of quantum electrodynamics (QED) with charged bosons in open systems, and derive time evolution equations for coherent fields and quantum fluctuations.
The Lagrangian density in open systems (the central region C and the two reservoirs L, R [46][47][48][49] with tunneling effects [50][51][52][53]) depicted in Figure 1 with the background field method [54][55][56][57] is given by, Here the Lagrangian density in the center region is where A µ C is the background photon field in C, a µ C represents the quantum fluctuations in C, F µν [A C ] = ∂ µ A C,ν − ∂ ν A C,µ , ϕ * C and ϕ C are charged Bose fields in C, m is the mass of the charged bosons. The Lagrangian density L α in α = L and R is given by changing the labels C in fields in Equation (2) where we have introduced the tunneling variables v α (x) of charged bosons and the tunneling coupling v a,α of photons. We find that the total Lagrangian density in Equation (1) is invariant under the Type I gauge transformations [54][55][56][57] in open systems, that is, To describe non-equilibrium processes, we consider quantum fields in the closed-time-path C (the Keldysh contour) with the path 1 from t 0 to ∞ and the path 2 from ∞ to t 0 depicted in Figure 2. We impose gauge fixing conditions a 0 C = 0, and a 0 α = 0 with α = L, R on the generating functional with the above total Lagrangian in Equation (1). We adopt the functional integral with a C , a α , ϕ C , ϕ * C , ϕ α , and ϕ * α with α = L, R in the generating functional. We shall perform the Legendre transformation of the generating functional. Then we can derive two-particle irreducible (2PI) effective where d is the spatial dimensions,φ ≡ ϕ ,φ * ≡ ϕ * , andā i ≡ a i with brackets · ≡ Tr(density matrix) × (·). The i∆ −1 0 is given by a 3 × 3 matrix as with (α = L, R), and Further, iD −1 0 is given by a 3 × 3 matrix as where and we set the gauge fixing parameter as ξ = 1. The Green function ∆(x, y) is written by a 3 × 3 matrix as with δϕ = ϕ −φ, and T C representing the time-ordered product in the closed-time-path C. It is possible to express each component in the above matrix by a 2 × 2 matrix in the closed-time-path, with T representing the time-ordered product, andT representing the anti-time-ordered product. Similarly, the Green function D ij (x, y) is written as a 3 × 3 matrix as where D CL,ij (x, y) = T C a C,i (x)a L,j (y) , and D 00 (x, y) = D 0i (x, y) = D i0 (x, y) = 0 with i = 1, · · ·d. The following relations for the 2PI effective action Γ 2PI are derived using the Legendre transformation, and where the coherent fields are labeled by C or α = L, R. By use of the relations in Equation (15), we can derive, and with the definition of self-energy, iΣ ≡ − 1 2 δΓ 2 δ∆ and iΠ ≡ − δΓ 2 δD . The self-energy is given by, and We neglect off-diagonal elements, since they represent a higher order of the tunneling variables or the tunneling coupling constants. The explicit forms of diagonal elements are given by labeling CC or αα with α = L, R in Green functions of self-energy in [58]. These relations are the Kadanoff-Baym (KB) equations in open systems.
Next we derive the Klein-Gordon (KG) equations for coherent fields. The first equation in Equation (16) is written by, where we define and α (x) = 0 due to the gauge fixing condition a 0 C = a 0 α = 0. The second and the third equations in Equation (16) are written by By using the above four equations and the Kadanoff-Baym equations in Equation (17), we can derive the total charge conservation in the Hartree-Fock approximation in the coupling expansion, in 1 2 Γ 2 in [58] and to the leading-order (LO) in the tunneling coupling expansion for the KG and the KB equations. Using the total charge conservation, the identity ∂ µ ∂ ν F µν = 0, and Equations (21) and (22), we arrive at, namely, Here, the time-independent term in the time integration which might be interpreted as an initial condition is set to be zero.

The Kadanoff-Baym Equations in QED in Open Systems
In this section, we write the Kadanoff-Baym (KB) equations in QED in open systems to the 1st order approximation in the gradient expansion by introducing gauge-invariant Green functions under Type I gauge transformation in Equation (4). We find that time evolution equations in diagonal elements are written only by gauge-invariant functions to the 1st order in the gradient expansion. We use the α = L, R to represent the two reservoirs to avoid confusing 'R' (Retarded in Green functions and self-energy) and 'L' (Longitudinal modes in Green functions and self-energy for photons) in this section. We set t 0 to −∞.
We begin with the KB equations given in the previous section. We multiply the matrix ∆ from the right in Equation (17) and take the (C, C) component, then we write, We define We then multiply Equation (32) by exp (iI C (x, y)) [59,60] and define the gauge-invariant Green function and gauge-invariant self-energy as under the Type I gauge transformation in Equation (4). We next Fourier-transform by the relative coordinate x − y with d(x − y)e ip·(x−y) and neglect terms beyond than 1st order in the gradient expansion in Equation (32), then we know that the 1st term on the left-hand side in Equation (32) can be written by gauge-invariant functions in the 1st order in the gradient expansion [58,[61][62][63][64][65].
We show that the 2nd term on the left-hand side in Equation (32) is invariant under the Type I gauge transformation in Equation (4) in the 1st order in the gradient expansion. The (α, C) component in Equation (17) multiplied by the matrix ∆ from the right is written as Here, it is convenient to define the function ∆ −1 g,αα satisfying Using Equation (37) in Equation (36), we arrive at When we define (with the Stokes theorem and the surface integral dS µν of the triangle yxw) and with the definition We find V α (x, w) is gauge invariant under the Type I gauge transformation in Equation (4). Later, we show g αα is a gauge-invariant function in the 1st order in the gradient expansion. With the use of Equation (42), the Fourier transformation of Equation (32) by x−y e ip·(x−y) after multiplying e iI C in the matrix notation is rewritten as, . Here, we have used the Moyal product [61][62][63][64][65] in QED in open systems. When we neglect terms beyond the 1st order of the gradient expansion in the Moyal product, we find that with the arbitrary function M(X, p) and N(X, p) and the Poisson bracket in C written as where the electric field E and the magnetic field B in the central region C are introduced. The electromagnetic fields appear by expanding e iφ C,yxw in the convolution integral. In Equation (44), we define to arrive at where U αα is a function of (X, p). The functions G −1 0 (p), G CC (X, p), Σ CC (X, p), g αα (X, p), and σ z are written using a 2 × 2 matrix in the closed-time-path, but the Fourier-transformed V α (X, p) is a scalar function.
Next, we multiply the matrix ∆ from the left in Equation (17) and take the (C, C) and (C, α) component. Then we can write and With the use of Equations (37) and (50), we can write and taking into account Equations (33), (39), (40), and definitions (34), (41) and (43), With the use of the above equation, we can rewrite Equation (49) in the matrix notation after the Fourier transformation: where Green functions, self-energy and U αα are functions of (X, p) and a 2 × 2 matrix in the closed-time-path. It is possible to derive the solution of the retarded Green function G CC,R ≡ i(G 11 CC − G 12 CC ) of the 0th and 1st order equations in the gradient expansion. We rewrite the self-energy as Σ CC (x, y) = −iδ C (x − y)Σ CC,loc (x) + Σ CC,nonl (x, y) and use the Fourier transformation of the self-energy. By summing Equations (48) and (53) and taking the difference of (1, 1) and (1, 2) components, we arrive at, where the retarded functions are defined as Σ CC,R ≡ i(Σ 11 CC,nonl − Σ 12 CC,nonl ) and U αα,R ≡ i(U 11 αα − U 12 αα ). Furthermore, by taking the difference of Equations (48) and (53) and taking the difference of (a, b) = (1, 1) and (1, 2) components, we arrive at, The solution of the above two equations is The spectral function defined as is given by taking the imaginary part of G CC,R and multiplying by 2.
Next, with the help of the relation (37), we can derive an expression for g αα as and in the matrix notation in the closed-time-path. Here the Moyal product • α in the reservoir α represents with the arbitrary function M(X, p) and N(X, p) and the Poisson bracket in α written as We derive the solution of the retarded Green function g αα,R ≡ i(g 11 αα − g 12 αα ) where we rewrite the self-energy as Σ αα (x, y) = −iδ C (x − y)Σ αα,loc (x) + Σ αα,nonl (x, y) and define Σ αα,R ≡ i(Σ 11 αα,nonl − Σ 12 αα,nonl ). Next we derive time evolution equations of the (α, α) components. Let us multiply the matrix ∆ from the right in Equation (17) and take the (α, α) components. Then we can write them as We know that the 1st term in the above equation is written by gauge-invariant functions given by by multiplying the link variable e iI α (x,y) in the same way as in the isolated system [58,65]. Taking into account Equation (51) and the definition we can write with the definitions (34), (41) and (43). Using the definition Equation (62) is written after the Fourier transformation with x−y e ip·(x−y) as Multiplying the matrix ∆ from the left in Equation (17) and taking the (α, α) components, we arrive at In a similar way to [66], the 0th order solution of the retarded Green function G αα,R ≡ i(G 11 α,α − G 12 αα ) is derived as with Q αα,R ≡ i(Q 11 αα − Q 12 αα ). It is derived by multiplying Equation (62) by ∆ g,αα from the left, multiplying e iI α , and taking only the 0th order terms in the difference of (1, 1) and (1, 2) components after the Fourier transformation. It is also the solution of the 1st order equation of the retarded Green function written by which is derived by taking the difference of Equations (68) and (69) and taking the difference of (1, 1) and (1, 2) components. The spectral function ρ αα ≡ i(G 21 αα − G 12 αα ) is given by taking the imaginary part in Equation (70) and multiplying by 2.
Next, we comment on the gauge dependence of g αα . The relation (37) means that the gauge-dependent function ∆ −1 g,αα has the same gauge dependence as that on the right-hand side. The explicit form of ∆ −1 0,αα is given in Equation (7), and the explicit form of self-energyΣ αα in O(e 2 ) and O(e 4 |φ| 2 ) is calculated in the same way as the case in the isolated system [58] or the Appendix A. We then show that H ≡ e iI α ∆ −1 g,αα = e iI α ∆ −1 0,αα −Σ αα is written in gauge-invariant form as in the isolated system [65]. But no explicit gauge dependence of ∆ g,αα is given, although the explicit gauge dependence of ∆ CC and ∆ αα is given in their definition. We then multiply ∆ g,αα , the inverse function of ∆ −1 g,αα , in Equation (37) from left and right and multiply e iI α , and then take the Fourier transformation to arrive at where g ≡ e iI α ∆ g and we omit the label αα and the label α in the Moyal product. We now perform Type I gauge transformation for Equation (37) and repeat the same procedures as above. Since H is gauge invariant, we can write gauge transformed g h as If there is gauge dependence g h = g + , the above two relations impose We can write the solution of the retarded R in Equation (74) in the 0th and 1st order in the gradient expansion in the same way as [58,67] with ζ = 0 since the right-hand side in Equation (74) is zero. Since the charged bosons are massive (no infrared divergence), m = 0, and the spectral width ImΣ R,αα (X, p) in Γ 2 = 0 around p 0 = ± p 2 + m 2 + · · · is nonzero (even if much smaller than m 2 ) in the presence of nonzero continuous particle distributions in (X, p) in general, the solution is R (X, p) = 0 (no peaks) and (x, y) = 0. Hence, even if the gauge dependence in g remains, it is of higher order in the gradient expansion. Finally, we write the Kadanoff-Baym equations for photons. Starting with Equation (18), we can derive Here, the Moyal product • for photons to the 1st order in the gradient expansion is with The (α, α) components are with iD −1 0,αα,ik (X, p) = p 2 − 2e 2φ * α (X)φ α (X) δ ik .

Kinetic Entropy Current and the H-Theorem
In this section, we derive a kinetic entropy current in QED in open systems by adopting the 1st order approximation in the gradient expansion as a coarse-graining procedure [67][68][69][70][71], and show the H-theorem in the Hartree-Fock approximation in the coupling expansion and in the leading-order (LO) approximation of the tunneling variable and tunneling coupling expansion. In this section, we use the α = L, R to represent the two reservoirs, the R represents the 'retarded' and the L represents the longitudinal of photons.
If we subtract Equation (53) from Equation (48), then we can derive We find that this equation has the same form as [58] with changing Σ nonl to Σ CC,nonl − ∑ α U αα in deriving the kinetic entropy current. By using the Kadanoff-Baym Ansatz G 12 , and by neglecting the 2nd order terms in the gradient expansion [67][68][69][70][71], we can use Then we arrive at and We subtract Equation (69) from Equation (68), to find By using the Kadanoff-Baym Ansatz G 12 αα − Q 12 αα ), and neglecting the 2nd order terms in the gradient expansion, we use f αα ∼ γ αα , γ g,αα ∼ γ Q,αα .
We can also use by neglecting the 2nd order terms in the gradient expansion in the difference of Equation (57) and Equation (58) written by Then, we obtain the following relation in a similar way as [66].
We show that the 3rd and 4th term on the right-hand side in the above equation is positive definite. Using the definitions we can re-express them after the Fourier transformation as with X = x+w 2 and the real function where we have used the expansion v α = |v α |e i(β C −β α +θ α ) withφ C = |φ C |e iβ C andφ α = |φ α |e iβ α . Here, the A C − ∂β C e and the A α − ∂β α e are invariant under the Type I gauge transformation, and these physical quantities are introduced in a similar way to [72]. We find that V α (k) is a semi-positive definite in the 1st order in the gradient expansion. Then, we arrive at where we have used ln with Equations (90) and (91) and omitted X in the Green functions. We find that the tunneling of charged bosons contributes to the entropy production.
In a similar way, we can derive a kinetic entropy current for photons. Let us use the following relations for Fourier-transformed Green functions and self-energy for photons where iΠ = δΓ 2 δD . Using the Kadanoff-Baym Ansatz αα,L ), and neglecting the 2nd order in the gradient expansion, we arrive at where We now show that the sum of the 1st term on the right-hand side in Equation (95) and the 1st and the 2nd term on the right-hand side in Equation (102) is semi-positive definite for O(e 2 ) and O(e 4 |φ| 2 ) self-energy (the Hartree-Fock approximation). We also show that the sum of the 2nd term on the right-hand side in Equation (95) and the 3rd term on the right-hand-side in Equation (102) is semi-positive definite for the O(e 2 ) and O(e 4 |φ| 2 ) self-energy. The proof is the same as that in the isolated system in [58].
Hence, we find that for s µ = s µ matter + s µ photon in the LO of the tunneling variable and coupling expansion in the Hartree-Fock approximation in the 1st order in the gradient expansion. For the equilibrium state, we arrive at where T is absolute temperature, µ C and µ α are the chemical potentials for C and α = L, R, respectively. Chemical potentials are negative signs of gauge invariant parts of scalar potentials. This is derived in the proof of the H-theorem for the O(e 4 |φ| 2 ) self-energy in the Appendix A. Due to the tunneling processes in Equation (99), temperature and the chemical potential in C and α = L, R are the same values in the equilibrium state.

Time Evolution Equations in Spatially-Homogeneous Systems in Open Systems
In this section we derive the Klein-Gordon (KG) equations for coherent fields and the Kadanoff-Baym (KB) equations for quantum fluctuations in the spatially-homogeneous system. In this section, we use the α = L, R to represent the two reservoirs; the R represents the 'retarded' and L represents the 'longitudinal' reservoir of photons.
We derive the following equations from Equations (57) and (58): We obtain the following equations from Equations (68) and (69): where Q αα,F ≡ Q 21 αα +Q 12 . Similarly, we derive the Kadanoff-Baym equations for photons as The Kadanoff-Baym equations for longitudinal modes are given by changing the label T to L in the above equations.
Next, we write the Klein-Gordon equations for coherent fields. We useφ C = |φ C |e iβ C ,φ α = |φ α |e iβ α with α = L, R, and v α = |v α |e i(β C −β α +θ α ) . Multiplying e −iβ C (X) in Equation (25) and taking the real part, we arrive at where P CC,F (X, p) and P CC,R (X, p) are the Fourier transformations of P CC,F (x, y) ≡ P 21 (x,y)+P 12 (x,y) 2 and P CC,R (x, y) ≡ i(P 11 CC (x, y) − P 12 CC (x, y)) with P ab CC (x, y) = D ab CC,ij (x, y)D ab CC,ij (x, y). Here, we have left the 0th order terms in the gradient expansion on the right-hand side. We then write the following equations by using Equation (27): where P ab αα (X, p) is the Fourier transformation of P ab αα (x, y) = D ab αα,ij (x, y)D ab αα,ij (x, y). Let us multiply iφ * C in Equation (25) and iφ C in Equation (26), and take the difference, then we arrive at For the O(e 2 ) and O(e 4 |φ| 2 ) diagrams (the Hartree-Fock approximation), we can use where we have used the relation in the Appendix A and the integration ( p ) of the KB equation (109). Then we can write Equation (125) as The left-hand side represents the time derivative of the charge in the C. This is equivalent to the tunneling of charged bosons between the C and the α = L, R reservoirs on the right-hand side. The first term on the right-hand side represents the Josephson current. We interpret the above equation as representing the time evolution equation where we have used the integration of Equation (113). We now show the total charge conservation as by using the definitions U αα (X, p) = k V α (X, k)g αα (X, p − k) and Q αα (X, p) = k V α (X, k)G CC (X, p + k). We set the total charge to be zero in the spatially-homogeneous system. Using Equations (21) and (22), the Klein-Gordon equations for A i C and A i α are written as When F CC and F αα is symmetric under p i → −p i at the initial time, we find the solutions at any point in time, which are derived in the same way as the isolated system [58].
We find that Equation (99) represents the entropy production in tunneling processes between C and α reservoirs. Here, we discuss only the tunneling phenomena which never change the frequency. Then, we just impose the following constraint on parameters θ α : Finally, we write the total conserved energy. Using the KB equations and the KG equations and assuming the |v α |'s are constants, we derive the total energy as where δm 2 cb = 2e 2 p 1 2 √ p 2 +m 2 , δm 2 C,TorL = e 2 p 1 2 √ p 2 +2e 2 |φ C | 2 , and δm 2 α,TorL = e 2 p 1 2 √ p 2 +2e 2 |φ α | 2 . The notations (C → α) and (CC → αα) represent the terms changing the labeling C to α for coherent fields and the labeling CC to αα in the Green functions and the self-energy in the previous terms, respectively.

Discussion
In this paper, we have derived the Klein-Gordon (KG) equations and the Kadanoff-Baym (KB) equations to describe non-equilibrium phenomena in quantum electrodynamics (QED) with charged bosons in open systems. We have found that time evolution equations of diagonal elements in KB equations are written by gauge-invariant Green functions and self-energy for the Type I gauge transformation to the 1st order in the gradient expansion. We have introduced a kinetic entropy current in QED for open systems to the 1st order approximation in the gradient expansion, and shown the H-theorem in the Hartree-Fock approximation and in LO of the tunneling variable expansion. We have shown that the tunneling processes also contribute to entropy production. We have written the KG equations and the KB equations only with real and pure imaginary functions in the spatially-homogeneous system, namely real statistical functions, pure imaginary spectral functions, and absolute values of coherent fields of charged bosons. It is possible to show the charge-energy conservation in the total system, and no memory integral terms appear in the conserved energy in the Hartree-Fock approximation, in 1st order approximation in the gradient expansion.
It is important to discuss equilibrium states. In an equilibrium state, the central region C and the α = L, R reservoirs have the same temperature and chemical potentials due to the tunneling processes as shown in the proof of the H-theorem. The chemical potentials are negative signs of gauge-invariant parts of scalar potentials as shown in the Appendix A. When scalar potentials have the same constant values, the ∂ 0 θ α in the time derivative of phase factors in the tunneling variables in Equation (132) is zero, namely θ α = constant. Since the tunneling processes are balanced in the central region C and the α = L, R reservoirs and charge flow between systems stops, we find θ α = 0 or π due to Equations (127) and (128). The ratios of the coherent fields of charged bosons |φ C | and |φ α | are determined by setting the left-hand side in Equations (121) and (123) to zero with the same scalar potentials. Since the proof of the H-theorem restricts the distribution functions but does not restrict the dispersion relations for equilibrium states, the |φ C | and the |φ α | (the mass of evanescent photons) might have different values. When the 2nd derivatives on the left-hand side in Equations (121) and (123) remains, the coherent fields of charged bosons |φ C | and |φ α | might oscillate around the minimum value of the potential energy |φ| 2 = m 2 |φ| 2 + c 1 |φ| 2 in the 3rd and the 4th terms in Equation (134) e|φ| 2 with c 1 proportional to the total charge of incoherent particles in the system as in the case of the isolated system [58]. Since the mass of evanescent photons oscillates due to the 2nd order contributions in the gradient expansion, Green functions still oscillate at later times near the equilibrium state.
We have considered three regions as a practical example of an open system. They are rewritten by energy supply (L), water battery (C), and microtubule (R) shown in Figure 3. The energy supply provides incoherent photons to achieve coherent output of water dipoles and photons inside microtubules. The source of photons, which might be mitochondria or reactive-oxygen species (ROS) in living cells [73], is still largely unknown. The water battery plays the role of maintaining coherent states inside microtubules. It will be interesting to investigate the relevant time scales required to maintain coherent states only by the use of the water battery in case no external energy being supplied. We might be able to describe the formation of coherent states in these systems.  We also discuss the equilibration processes in the central region and multiple reservoirs α = 1, 2, . . . , N res , that is, the network. In QBD, there are at least two types of quantum mechanisms for information transfer between systems. The first one is to use self-induced transparency in microtubules which connect two coherent regions [30]. Pulse propagation appears from one side of a microtubule to the opposite end, then the information transfer between coherent regions takes place. The second one is to use quantum tunneling phenomena [31]. In case several coherent regions are surrounded by non-coherent regions and the distances between two coherent regions are smaller than the inverse of mass of evanescent photons, the coherent field transfer and the incoherent particle transfer between systems can occur. We now describe the information transfer with quantum tunneling phenomena in this case. The second one is the same as the Josephson effect, which suggests the tunneling current between two superconducting regions separated by the normal metal regions. We have also shown that the Josephson current appears in Equations (127) and (128) in QED with charged bosons. It is possible to extend our theory to the case of the network by changing ∑ α=L,R to ∑ N res α=1 in all the time evolution equations. If we trace time evolution in the network, we might be able to describe not only the equilibration but also the information transfer among regions in the brain.
In this paper, although we have discussed time evolution equations with relativistic charged bosons, our analysis is applied to a non-relativistic case. In the non-relativistic case, we need to change from iG −1 0 (p) = p 2 − m 2 to iG −1 0 (p) = p 0 − p 2 2m in the KB equations for charged bosons, and multiply by the factor 1 4m 2 in all of the nonlocal self-energy in the relativistic case in this paper. We also need to extend our theory (QED with charged boson fields) to electric dipole fields in order to describe water electric dipoles in open systems. Since we have derived time evolution equations for charged boson fields with the gauge invariant functions in open systems, we only need the theory for dipole fields to perform multi-energy-mode analysis with the KG and the KB equations. Although we can check whether coherent states in QED with charged bosons are robust or not qualitatively, we need to describe time evolution for dipole fields in 3 + 1 dimensions to estimate quantitative behaviors of water electric dipole fields and photon fields in the memory formation in the brain.

Conclusions
In this paper we have derived the Klein-Gordon equations and the Kadanoff-Baym equations in QED with charged singlet bosons in open systems. These equations are expressed only by gauge invariant quantities in the 1st order in the gradient expansion. They describe non-equilibrium, charge-energy conserving, and entropy-producing dynamics in the Hartree-Fock approximation with the LO approximation of tunneling variable and coupling expansion in the 1st order in the gradient expansion. This work paves the way for a concrete implementation of this approach to the modeling of quantum brain dynamics, which until now has not incorporated open system characteristics of the brain. Both metabolic energy supply and thermal dissipation need to be accounted for in addition to the nonlinear interactions between the quantum fields ( Figure 3). The remaining challenge is to represent realistic dynamical degrees of freedom that correspond to information storage and information processing capabilities in neurons and neuronal assemblies. This will not only require a sufficiently long decoherence time for these quantum fields (on the order of 1 ms or more) but also the formulation of testable predictions for such a model. While we are not yet prepared to propose a specific implementation of such a representation, the current model is sufficiently generalised that it covers the essential features expected of a properly formulated quantum brain dynamics theory. At present, the most likely candidate structures for a biophysical representation of the presented model appear to be neuronal microtubules, especially in dendrites. However, we still need to identify specific microscopic degrees of freedom which can be involved in quantum coherence through nonlinear interactions similar to those taking place in laser action. This also requires inclusion of incoherent energy pumping. As is the case with lasers, due to these nonlinear interactions between dynamic degrees of freedom, the pumped energy is transformed into quantum condensed modes, which can overcome the decoherence effects of thermal motion at physiological temperature. This biophysical model development can, for example, involve the interactions between tryptophan residues in tubulin dimers as recently argued by Craddock et al. [74]. While quantum coherence simulated in this work only survives about 1 ps in a single dimer, this can be extended to much longer decoherence times using the nonequilibrium quantum field theory formalism for an entire microtubule including energy pumping which the Craddock et al., paper did not consider.
As in [75,76], after multiplying p 0 in this relation and taking the sum, we need to calculate the following integration by p : We find that the 1st term in Equation (A13) and the 1st term in Equation (A15) has the same form as Equation (A12) except constant factors. As a result, Equation (A11) is rewritten as