Non-Thermal Quantum Engine in Transmon Qubits

Abstract

The design and implementation of quantum technologies necessitates the understanding of thermodynamic processes in the quantum domain. In stark contrast to macroscopic thermodynamics, at the quantum scale processes generically operate far from equilibrium and are governed by fluctuations. Thus, experimental insight and empirical findings are indispensable in developing a comprehensive framework. To this end, we theoretically propose an experimentally realistic quantum engine that uses transmon qubits as working substance. We solve the dynamics analytically and calculate its efficiency.

1. Introduction

Recent advances in nano and quantum technology will necessitate the development of a comprehensive framework for quantum thermodynamics [1]. In particular, it will be crucial to investigate whether and how the laws of thermodynamics apply to small systems, whose dynamics are governed by fluctuations and which generically operate far from thermal equilibrium. In addition, it has already been recognized that at the nanoscale many standard assumptions of classical statistical mechanics and thermodynamics are no longer justified and even in equilibrium quantum subsystems are generically not well-described by a Maxwell-Boltzmann distribution, or rather a Gibbs state [2]. Thus, the formulation of the statements of quantum thermodynamics have to be carefully re-formulated to account for potential quantum effects in, for instance, the efficiency of heat engines [3,4,5,6].

In good old thermodynamic tradition, however, this conceptual work needs to be guided by experimental insight and empirical findings. To this end, a cornerstone of quantum thermodynamics has been the description of the working principles of quantum heat engines [7,8,9,10,11,12,13,14,15,16,17].

However, to date it is not unambiguously clear whether quantum features can always be exploited to outperform classical engines, since to describe the thermodynamics of non-thermal states one needs to consider different perspectives—different than the one established for equilibrium thermodynamics. For instance, it has been shown that the Carnot efficiency cannot be beaten [4,18] if one accounts for the energy necessary to maintain the non-thermal stationary state [19,20,21,22]. However, it has also been argued that Carnot’s limit can be overcome, if one carefully separates the “heat" absorbed from the environment into two different types of energy exchange [23,24]: one is associated with a variation in passive energy [25,26] which would be the part responsible for changes in entropy, and the other type is a variation in ergotropy, a work-like energy that could be extracted by means of a suitable unitary transformation. On the other hand, it has been shown [27] that a complete thermodynamic description in terms of ergotropy is also not always well suited. Having several perspectives to explain the same phenomenon is a clear indication of the subtleties and challenges faced by quantum thermodynamics, and which can only be settled by the execution of purposefully designed experiments. Therefore, theoretical proposals for feasible and relevant experiments appear instrumental.

In this work we propose an experiment to implement a thermodynamic engine with a transmon qubit as the working substance (WS), which interacts with a non-thermal environment composed by two subsystems, an externally excited cavity (a superconducting transmission line) and a classical heat bath [28] with temperature T. The WS undergoes a non-conventional cycle (different from Otto, Carnot, etc.) [29] through a succession of non-thermal stationary states obtained by slowly varying its bare energy gap (frequency) and the amplitude of the pumping field applied to the cavity. We calculate the efficiency of this engine for a range of experimentally accessible parameters [28,30,31,32], obtaining a maximum value of $47\%$, which is comparable with values from the current literature.

2. System Description

We consider a multipartite system, comprised of a transmon qubit of tunable frequency ${\omega }_{\mathrm{T}}$, which interacts with a transmission line (cavity) of natural frequency ${\omega }_{\mathrm{CPW}}$ with coupling strength g. The cavity is pumped by an external field of amplitude $E_d$ and single frequency $\omega$ (see Figure 1). Both systems are in contact with a classical heat bath at temperature T. Such a set-up is experimentally realistic and several implementations have already been reported in different contexts [28,33]. Here and in the following, the transmon is used as a working substance (WS) and the (non-standard) “bath” is represented by the net effect of the other two systems: the cavity and the cryogenic environment (classical bath). There are two subtleties that must be noted here: (i) the bath “seen” by the qubit does not only consist of a classical reservoir at some fixed temperature, but it has an additional component, namely the pumped cavity. By changing the pumping, several cavity states can be realized. Such a feature gives the possibility of making this composed bath non-thermal on demand. In addition, (ii), the proposed engine is devised as containing only one bath (cavity + environment), which does not pose any problems considering that it is an out-of-equilibrium bath.

Figure 1. Sketch of the quantum engine with a transmon qubit as working substance interacting with an externally pumped (E(t)) transmission line (cavity). Both systems are embedded in the same cryogenic environment, which plays the role of a standard thermal bath of temperature T. Such a setup gives a dynamics of a working substance in the presence of a controllable non-thermal environment.

We start our analysis from the Hamiltonian describing a tunable qubit interacting with a single mode pumped cavity through a Jaynes-Cummings interaction

$$\begin{array}{cc}\hfill H(t)& =\frac{\hslash {\omega }_{\mathrm{T}}}{2}{\sigma }_z+\hslash {\omega }_{\mathrm{CPW}}{a}^{†}a+g{\sigma }_x(a+a^{†})\hfill \\ & +E_d\left(a{e}^{i\omega t}+a^{†}{e}^{-i\omega t}\right),\hfill \end{array}$$

(1)

where ${\sigma }_x$ and ${\sigma }_z$ are the Pauli matrices, $a^{†}$ and a are the canonical bosonic creation and annihilation operators associated with the cavity excitations, g is the qubit-cavity coupling strength. The last term represents a monochromatic pumping of amplitude $E_d$ and frequency $\omega$ applied to the cavity. The experimental characterization of the qubit-cavity dissipative dynamics emerging from their interaction with the same thermal bath shows that the system’s steady state is determined by the master equation [28]

$$\begin{array}{cc}\hfill \dot{\rho }(t)& =-\frac{i}{\hslash }[H_{\mathrm{RWA}},\rho ]+K_{\mathrm{CPW}}^{-}\mathcal{D}[a]\rho \hfill \\ & +K_{\mathrm{CPW}}^{+}\mathcal{D}[a^{†}]\rho +{\Gamma }^{-}\mathcal{D}[{\sigma }^{-}]\rho +{\Gamma }^{+}\mathcal{D}[{\sigma }^{+}]\rho ,\hfill \end{array}$$

(2)

with $K_{\mathrm{CPW}}^{-}(K_{\mathrm{CPW}}^{+})$ being the cavity decay (excitation) rate, ${\Gamma }^{-}({\Gamma }^{+})$ the qubit relaxation (excitation) rate and $\mathcal{D}[A]\rho =A\rho A^{†}-1/2(A^{†}A\rho +\rho A^{†}A)$. Please note that these rates satisfy detailed balance for the same bath of temperature T, $K_{\mathrm{CPW}}^{+}/K_{\mathrm{CPW}}^{-}=exp(-\hslash {\omega }_{\mathrm{CPW}}/k_{\mathrm{B}}T)$ and ${\Gamma }^{+}/{\Gamma }^{-}=exp(-\hslash {\omega }_{\mathrm{T}}/k_{\mathrm{B}}T)$. The Hamiltonian part

$$\begin{array}{cc}\hfill H_{\mathrm{RWA}}& =\frac{\hslash }{2}\left({\omega }_{\mathrm{T}}-\omega \right){\sigma }_z+\hslash \left({\omega }_{\mathrm{CPW}}-\omega \right)a^{†}a\hfill \\ & +g({\sigma }_{+}a+{\sigma }_{-}{a}^{†})+E_d(a+a^{†}),\hfill \end{array}$$

(3)

is the system Hamiltonian in the rotating wave approximation (RWA) [34], with ${\sigma }_{+}$(${\sigma }_{-}$) being the spin ladder operators.

Since we are interested in the observed dynamics of the WS, it is necessary to find the qubit’s reduced density matrix ${\rho }_{\mathrm{T}}(t)\equiv {\mathrm{tr}}_{\mathrm{a}}\left\{\rho (t)\right\}$, where ${\mathrm{tr}}_{\mathrm{a}}\left\{·\right\}$ represents the partial trace on the cavity’s degrees of freedom. The system state is in a qubit-cavity product state, i.e., $\rho (t)\approx {\rho }_{\mathrm{T}}(t)\otimes {\rho }_{\mathrm{C}}(t)$, which emerges in the effective qubit-cavity weak coupling regime due to decoherence into the global environment. In addition, the cavity’s stationary state ${\rho }_{\mathrm{C}}(t)$ is assumed to be mainly determined by the external pumping, which can be easily found for situations of strong pumping and/or weak coupling strength g. This closely resembles a situation, in which the cavity acts as a work source of effectively infinite inertia [35]. Thus, changing the state of the qubit does not affect the state of the cavity, but it is still susceptible to the applied field and the cryogenic bath, and we have

$$⟨a⟩={⟨a^{†}⟩}^{*}=\frac{E_d}{\hslash \left[i{\kappa }_{\mathrm{CPW}}/2-({\omega }_{\mathrm{CPW}}-\omega )\right]},$$

(4)

where we defined $K_{\mathrm{CPW}}^{-}={\kappa }_{\mathrm{CPW}}$. Hence, the reduced master equation (2) can be written as

$${\dot{\rho }}_{\mathrm{T}}(t)=-\frac{i}{\hslash }[{\tilde{H}}_{\mathrm{T}},\mathrm{RWA},{\rho }_{\mathrm{T}}]+{\Gamma }^{-}\mathcal{D}[{\sigma }^{-}]{\rho }_{\mathrm{T}}+{\Gamma }^{+}\mathcal{D}[{\sigma }^{+}]{\rho }_{\mathrm{T}},$$

(5)

with

$${\tilde{H}}_{\mathrm{T}},\mathrm{RWA}=\frac{\hslash }{2}({\omega }_{\mathrm{T}}-\omega ){\sigma }_z+g\left[⟨a⟩{\sigma }_{+}+⟨a^{†}⟩{\sigma }_{-}\right].$$

(6)

Please note that the effective qubit Hamiltonian carries information about the interaction with the cavity through $⟨a⟩$ and $⟨a^{†}⟩$, which are dependent on the cavity state.

3. Non-Equilibrium Thermodynamics

3.1. Non-Thermal Equilibrium States

The only processes that are fully describable by means of conventional thermodynamics are infinitely slow successions of equilibrium states. For the operating principles of heat engines, the second law states that the maximum attainable efficiency of a thermal engine operating between two heat baths is limited by Carnot’s efficiency.

An extension of this standard description is considering infinitely slow successions along non-Gibbsian, but stationary states [4,18,19,20,36]. In the present case, namely a heat engine with transmon qubit as working substance, non-Gibbsianity is induced by the external excitation applied as a driving field to the cavity. We will see in the following, however, that identifying the thermodynamic work is subtle – and that the energy exchange can exhibit heat-like character, which is crucial when computing the entropy variation during the engine operation.

The stationary state can be found by solving the master equation Equation (5), and is written as

$${\rho }_{\mathrm{T}}^{ss}=\left(\begin{array}{cc}{\rho }_{\mathrm{T}}^{ee}& {\rho }_{\mathrm{T}}^{eg}\\ {\rho }_{\mathrm{T}}^{ge}& {\rho }_{\mathrm{T}}^{gg}\end{array}\right)$$

(7)

where the matrix elements can be computed explicitly and are summarized in Appendix A.

We observe that for the case of effective qubit-cavity ultra-weak coupling, i.e., $\hslash {\omega }_{\mathrm{T}}\gg g{E}_d/\left|i\hslash {\kappa }_{\mathrm{CPW}}/2-\hslash ({\omega }_{\mathrm{CPW}}-\omega )\right|$, as expected, the obtained non-thermal state asymptotically approaches thermal equilibrium, namely $|{\rho }_{\mathrm{T}}^{eg}|=|{\rho }_{\mathrm{T}}^{ge}|\approx 0$ and ${\rho }_{\mathrm{T}}^{ee}/{\rho }_{\mathrm{T}}^{gg}\approx exp(-\beta \hslash {\omega }_{\mathrm{T}})$. In addition, as also expected, in the high temperature limit $\hslash {\omega }_{\mathrm{T}}/kT\ll 1$ the qubit stationary state becomes the thermal, maximally mixed state, given that the cavity is not strongly pumped.

3.2. The Cycle

In equilibrium thermodynamics cycles are constructed by following a closed path on a surface obtained by the equation of state [29], which characterizes possible equilibrium states for a given set of macroscopic variables. This procedure can be generalized in the context of steady state thermodynamics, where an equation of state is also constructed.

For the present purposes, we use the steady state (7) to devise a cycle for our heat engine. The equation of state in our case is represented by the stationary state’s von Neumann entropy $S({\omega }_{\mathrm{T}},E_d)=-\mathrm{tr}\left\{{\rho }_{\mathrm{T}}^{ss}ln{\rho }_{\mathrm{T}}^{ss}\right\}$, which is fully determined by the pair of controllable variables ${\omega }_{\mathrm{T}}$, the transmon’s frequency, and $E_d$, amplitude field of the pumping applied to the cavity. In order to implement the cycle, the stationary state is slowly varied (quasi-static) (The timescale for which the changes made can be considered slow is such that the conditions imposed to the system state are satisfied, namely the state is a product state and the cavity steady state is a coherent state with Equation (4)) by changing the “knobs” $({\omega }_{\mathrm{T}}$,$E_d)$. It is composed of four strokes where we keep one of the two controllable variables constant and vary the other one, for example, at the first stroke we keep $E_d=E_0$ and vary ${\omega }_{\mathrm{T}}$ from ${\omega }_0$ to ${\omega }_1$. The complete cycle is sketched in Figure 2.

Figure 2. Sketch of the thermodynamic cycle obtained by varying the tunable parameters ${\omega }_{\mathrm{T}}$ and $E_d$. Each one of the strokes are obtained by keeping one of the variables constant while quasi-statically varying the other one.

Since we are interested in analyzing the engine as a function of its parameters of operation, we simulated several cycles with boundary values $({\omega }_1,E_1)$, which will range from the minimum value $({\omega }_0,E_0)$ to the maximum one $({\omega }_{1,\max },E_{1,\max })$. The corresponding cycles lie on the von Neumann entropy surface depicted in Figure 3. In Appendix A plots of the stationary state’s population and quantum coherence ${\rho }_{\mathrm{T}}^{ee}$ and $|{\rho }_{\mathrm{T}}^{eg}|$ as a function of $({\omega }_{\mathrm{T}},E_d)$ are shown. There we can observed clearly that the WS exhibits quantum coherence and population changes during its operation.

Figure 3. Stationary state’s von Neumann entropy in the regime of operation of the thermal engine. Any thermodynamic cycle must be contained on this surface.

Finally, it is worth emphasizing that in the present analysis all parameters were chosen from an experimentally accessible regime [28,30,31,32], under the validity of the approximation of weak-coupling interaction between transmon and cavity. The parameters are collected in Table 1.

Table 1. Engine parameters used in the present analysis.

Parameter	Value
${\omega }_{\mathrm{CPW}}/2\pi$	4.94 GHz
$\omega /2\pi$	4.94 GHz
$g/2\pi \hslash$	120 MHz
T	30 mK
$\Gamma /2\pi$	2 MHz
${\kappa }_{\mathrm{CPW}}/2\pi$	1 MHz
${\omega }_0/2\pi$	100 MHz
${\omega }_{1,\max }/2\pi$	1000 MHz
$E_0/2\pi \hslash$	0.2 MHz
$E_{1,\max }/2\pi \hslash$	2 MHz

4. Work, Heat and Efficiency

The first law of thermodynamics, $\Delta E(t)=W(t)+Q(t)$, states that a variation of the internal energy along a thermodynamic process can be divided into two different parts, work $W(t)$ and heat $Q(t)$, where for Lindblad dynamics we have [4,37],

$$\begin{array}{cc}\hfill W(t)& ={\int }_0^t\mathrm{tr}\left\{\rho (t^{\prime })\dot{H}(t^{\prime })d{t}^{\prime }\right\},\hfill \\ \hfill Q(t)& ={\int }_0^t\mathrm{tr}\left\{\dot{\rho }(t^{\prime })H(t^{\prime })d{t}^{\prime }\right\}.\hfill \end{array}$$

(8)

Typically, work is understood as a controllable energy exchange, which can be used for something useful, while heat cannot be controlled, emerging from the unavoidable interaction of the engine with its environment. As stated before, there are certain situations in which it can be shown that part of $Q(t)$ does not cause any entropic variation [24]. This has led to proposals for the differentiation of two distinct forms of energy contributions to Q: the passive energy $\mathcal{Q}(t)$, which is responsible for the variation in entropy, and the variation in ergotropy $\Delta \mathcal{W}(t)$ which is a “work-like energy” that can be extracted by means of a unitary transformation and consequently would not cause any entropic change. Both terms are defined as,

$$\begin{array}{cc}\hfill \mathcal{Q}(t)& ={\int }_0^t\mathrm{tr}\left\{\dot{\pi }(t^{\prime })H(t^{\prime })d{t}^{\prime }\right\},\hfill \\ \hfill \Delta \mathcal{W}(t)& ={\int }_0^t\mathrm{tr}\left\{[\dot{\rho }(t^{\prime })-\dot{\pi }(t^{\prime })]H(t^{\prime })d{t}^{\prime }\right\},\hfill \end{array}$$

(9)

with $\pi (t)$ being the passive state [25] associated with the state $\rho (t)$ at time t. To calculate the upper bound on the efficiency for systems that exhibit these different “flavors” of energy one should replace Q by $\mathcal{Q}$ in statements of the second law, since the ergotropy is essentially a mechanical type of energy, and consequently not limited by the second law, resulting in a different upper bound, see also Ref. [24].

Distinguishing these types of energy exchanged with the environment is crucial when one is interested in determining the fundamental upper bounds on the efficiency. However, in the present context, we are more interested in experimentally relevant statements, i.e., computing the efficiency in terms of what can be measured directly. Thus, we consider the ratio of the extracted work to the total energy acquired from the bath, independent of its type [24].

The cycle designed here is such that in each stroke one of the knobs $({\omega }_{\mathrm{T}},E_d)$ is kept fixed, while the other one is changed. Recall that the cavity is assumed to be a subpart of the bath seen by the WS, and that its state is modified by $E_d$. Since the WS is always in contact with the environment, one has that heat and work are exchanged in each stroke. Here, such a calculation is done by using Equation (8), considering the stationary state Equation (7) and the effective WS Hamiltonian Equation (6). Then, for the ith stroke, the corresponding $W_i$ and $Q_i$ integrals, representing the work and heat delivered (extracted) to (from) the WS, can be parametrized in terms of the respective knob variation as we can see in Appendix B. These quantities are obtained using the WS effective Hamiltonian ${\tilde{H}}_{\mathrm{T}},\mathrm{RWA}$, which already takes into account the interaction with the external bath and pumped cavity.

Once these quantities are determined, we can calculate the efficiency $\eta$ of this engine, defined by

$$\eta =-\frac{{\sum }_{i=1}^4{W}_i}{Q_{+}},$$

(10)

with the delivered heat to the WS in a complete cycle being given by $Q_{+}={\sum }_{i=1}^4{Q}_{+}^i$, with $Q_{+}^i$ the given heat (only positive contributions inside the stroke) during the $i_{\mathrm{th}}$ stroke (see Appendix B). Therefore, this efficiency represents the amount of work extracted from the engine through the use of the delivered heat to the WS.

Figure 4 shows the engine efficiency $\eta$ attained in the execution of the strokes as a function of the boundary values $({\omega }_1,E_1)$, as depicted in Figure 2. Please note that $({\omega }_1,E_1)$ sweeps the entire spectrum of the tunable parameters $({\omega }_{\mathrm{T}},E_d)$, going from $({\omega }_0,E_0)$ to $({\omega }_{1,\max },E_{1,\max })$ where we find the maximal efficiency. It is worth mentioning here that the highest value of the efficiency is dependent on the chosen regime of parameters, which in our case is based on experimentally attainable values [28,30,31,32]. As usual, in order to extract the predicted work, one has to couple our engine to another system. We envision using the experimental setup of Ref. [28], where a mechanical nanoresonator is present and weakly driven by the transmon. Thus, under such a configuration, by following the nanoresonator’s state (recall that we have assumed infinite inertia, i.e., the transmon is not capable of changing the cavity’s state. In situations where such an assumption does not hold, one has to take into account the possibility of having the transmon doing work on the cavity), one can determine the amount of energy transferred in the form of work. In addition, by observing the transmon’s state, one can obtain the amount of heat given by the non-standard bath, providing a full characterization of our engine.

Figure 4. Efficiency $\eta$ as a function of the upper values $({\omega }_1,E_1)$ for the cycle depicted in Figure 2. The observed highest efficiency of about $47\%$ was attained when $({\omega }_1,E_1)=({\omega }_{1,\max },E_{1,\max })$, with ${\omega }_{1,\max }/2\pi =1000$ MHz and $E_{1,\max }/2\pi \hslash =2$ MHz.

5. Conclusions and Final Remarks

Theoretical research of small heat engines in the quantum domain is common place in quantum thermodynamics [37,38,39,40,41,42,43,44,45,46]. In the present work, we have devised a transmon-based heat engine using an experimentally realistic regime of parameters reaching a maximal efficiency of $47\%$, which turns out to be a reasonable value when compared with the state of the art in quantum heat engines. One of the most recent experiments in quantum heat engine was implemented by Peterson et al. [47] using a spin $-1/2$ system and nuclear resonance techniques, performing an Otto cycle with efficiency in excess of $42\%$ at maximum power. It is important to stress that implementing small heat engines constitutes a hard task, even when dealing with classical systems. Indeed, a representative example is the single ion confined in a linear Paul trap with a tapered geometry, which was used to implement a Stirling engine [48] with efficiency of only $0.28\%$. Additional research is being carried out concerning the behavior of this engine influenced by the presence of coherence and the dimension of the WS. By devising this theoretical protocol for the implementation of a quantum engine, we hope to help the community, and in particular experimentalists, in the formidable task to design and implement quantum thermodynamic systems and to consolidate the concepts of this new exiting field of research.