- freely available
Processes 2013, 1(3), 263-278; doi:10.3390/pr1030263
Published: 30 September 2013
Abstract: The nonlinear behavior of metabolic systems can arise from at least two different sources. One comes from the nonlinear kinetics of chemical reactions in metabolism and the other from nonlinearity associated with regulatory processes. Consequently, organisms at a constant growth rate (as experienced in a chemostat) could display multiple metabolic states or display complex oscillatory behavior both with potentially serious implications to process operation. This paper explores the nonlinear behavior of a metabolic model of Escherichia coli growth on mixed substrates with sufficient detail to include regulatory features through the cybernetic postulate that metabolic regulation is the consequence of a dynamic objective function ensuring the organism’s survival. The chief source of nonlinearity arises from the optimal formulation with the metabolic state determined by a convex combination of reactions contributing to the objective function. The model for anaerobic growth of E. coli was previously examined for multiple steady states in a chemostat fed by a mixture of glucose and pyruvate substrates under very specific conditions and experimentally verified. In this article, we explore the foregoing model for nonlinear behavior over the full range of parameters, γ (the fractional concentration of glucose in the feed mixture) and D (the dilution rate). The observed multiplicity is in the cybernetic variables combining elementary modes. The results show steady-state multiplicity up to seven. No Hopf bifurcation was encountered, however. Bifurcation analysis of cybernetic models is complicated by the non-differentiability of the cybernetic variables for enzyme activities. A methodology is adopted here to overcome this problem, which is applicable to more complicated metabolic networks.
Historically, microorganisms have been utilized for the production of valuable products in our daily life, e.g., bread, vinegar, wine and beer. With the advent of recombinant DNA technology several decades ago, it is common practice to make genetic modifications to microbes for the industrial production of food, energy, medicine and other valuable products. Towards ensuring the economic competitiveness of those commercial processes, maximizing productivity is one of the goals to achieve.
It is a challenge to manipulate cellular metabolism due to its complexity. Metabolic systems often exhibit intricate nonlinear behaviors, such as steady-state multiplicity and dynamic oscillations. It is necessary to understand what triggers this breadth of behavior and to predict when and under what conditions they would occur. Such a study is also practically important, as nonlinear behavior should be avoided if it prevents stable operations  or may be induced if it can lead to higher productivity .
A basic source of nonlinearity in a metabolic system is the intrinsic kinetics of biochemical reactions. More importantly, however, nonlinear metabolic behavior becomes much more complex and diverse due to regulation that dynamically drives individual reactions in response to environmental changes. Dramatic shift between multitudes of metabolic pathways often arises in a dynamic environment as a consequence of metabolic regulation. For the nonlinear analysis of metabolic systems, therefore, it is essential to employ metabolic models that are able to appropriately account for dynamic regulation. Various modeling ideas have been developed for the analysis of metabolic systems, including metabolic pathway analysis [3,4], constraint-based approaches [5,6], kinetic models  and the cybernetic approaches . In the discussion of the conceptual distinctions and commonalities among different modeling frameworks, Song et al.  highlighted the essential need for dynamic modeling frameworks in a wide range of applications, such as the study of complex nonlinear behavior of metabolic processes. Our preference for cybernetic models has been based on its comprehensive accounting for dynamic regulation, not present in other dynamic approaches.
A full kinetic description of metabolic regulation requires detailed knowledge of its molecular mechanism, which is incomplete in most cases. Alternatively, the cybernetic approach  provides a rational description of regulation based on optimal control theory. The cybernetic description of metabolic regulation is based on the assumption that a cell is frugal in using its resources and optimally allocates them among a subset of enzymes to achieve a certain metabolic objective (such as the carbon uptake rate or growth rate). The resulting selective activation of reactions is realized by the cybernetic control variables without introducing additional parameters.
Cybernetic models have been successfully used to perform bifurcation analysis of metabolic systems, such as Klebsiella oxytoca , hybridoma cells  and Saccharomyces cerevisiae . While these analyses were made using lumped reaction networks, it is possible to consider a detailed network structure using the hybrid cybernetic modeling (HCM) framework [13,14,15]. Recently, Kim et al.  built an HCM of the anaerobic growth of Escherichia coli on glucose and pyruvate. Using this model, they predicted three and five steady states in a chemostat and experimentally validated them. These predictions were made by generating hysteresis curves using continuation methods  only at a selected set of parameter values, however.
In this article, Kim et al.’s HCM is subjected to more comprehensive nonlinear analysis for the following two purposes. First, we revisit this model to construct global bifurcation maps over a wide range of parameter space. This will lead to the complete identification of domains where the model exhibits qualitatively different behavior. Second, we develop a practical method that facilitates the nonlinear analysis of the cybernetic models containing the non-differentiable max function. While examples for the rigorous nonlinear analyses of cybernetic models are available in the literature [10,12], we test a more practical method that can readily be realized using an automated software package, such as MATCONT [18,19].
This paper is organized as follows. In the subsequent sections, we provide a summarized description of the Kim et al.’s HCM of E. coli and discuss an idea of introducing an approximate function as a replacement of the non-differentiable max function. Using this idea, we perform comprehensive nonlinear analysis of the model to construct global bifurcation diagrams in a two-parameter space of dilution rate and feed composition. The effect of the total sugar concentration in the feed on bifurcation behavior is also discussed.
2. Metabolic Model
2.1. The HCM Framework
Dynamic mass balances of extracellular metabolites in a chemostat can be represented as follows:
Under the quasi steady-state approximation, the flux vector, r, can be represented as non-negative (or convex) combinations of basic pathways, termed elementary modes (EMs) , i.e.,
The cybernetic approach assumes a certain metabolic objective, such as the maximization of the carbon uptake rate (or growth rate) for which metabolic reactions are optimally regulated. The HCM framework views EMs as metabolic options to achieve such an objective and describe metabolic regulation in terms of their optimal combinations. Flux through the jth EM is modeled as regulated by the control of enzyme level and its activity, i.e.,
Enzyme level eM,j is governed by the following dynamic equation, i.e.:
2.2. HCM for Anaerobic E. coli Growth
Kim et al.  used the HCM framework to model the anaerobic growth of E. coli GJT001 on glucose and pyruvate. The metabolic network contains 14 reactions (one reversible and 13 irreversible) and 18 metabolites (eight extracellular and 10 intracellular). Among 49 EMs obtained using METATOOL 5.1 , four key modes that can represent yield data of fermentation products  were extracted for modeling. Each mode is associated with the consumption of different substrates, i.e., EM1 and EM2 with respective consumption of glucose and pyruvate, while EM3 and EM4 are with simultaneous consumption of both sugars. Model equations and parameters are summarized in Table 1. For a full description of the model, refer to .
Bifurcation analysis of cybernetic models requires special treatment of the non-smooth max function contained in the vM-variables. Among many possibilities, we discuss two ideas of handling this issue, i.e., the combinatoric approach used by Namjoshi and Ramkrishna  and the smooth approximation to the max function.
3.1. Rigorous Combinatoric Analysis
Namjoshi and Ramkrishna  proposed a strategy to enumerate all combinatorial cases, in each of which the model equations are fully differentiable. This leads to four cases by setting one of the vM variables to be 1, while the others are less than or equal to 1 (Table 2).
|Table 1. Model equations and parameter values. EM, elementary mode.|
|Variables or parameters||Equations or parameter values|
|Extracellular metabolites and biomass||Glucose: |
|Parameters and stoichiometric coefficients|| |
|Notations||c: biomass concentration, g/L |
D: dilution rate, 1/h
eM,j, : level of enzyme that catalyzes the jth EM flux and its maximal level
fC,j: factor converting the EM flux (i.e., growth rate) to the carbon uptake rate, C-mmol/gDW (DW = dry weight)
kF: rate constant for formate decomposition
: maximal rate constant for the jth EM flux, 1/h
KF: Michaelis constant for formate decomposition, mM
KG,j, KP,j: Michaelis constants for the jth EM flux, mM
rF: specific rate of formate decomposition into CO2 and H2, mmol/(gDW℘h)
rM,j, : regulated and unregulated fluxes through the jth EM, mmol/(gDW h)
: kinetic part of inducible enzyme synthesis rate, 1/h
sA,j, sE,j, sF,j, sG,j, sP,j: stoichiometric coefficients, mmol/gDW
t: time, h
uM,j: cybernetic variable regulating the enzyme induction
vM,j: cybernetic variable regulating the enzyme activity
xA, xE, xF, xG, xP: concentrations of acetate, ethanol, formate, glucose and pyruvate, mM
xIN,G, xIN,P: feed concentration of glucose and pyruvate, mM
αM,j: constitutive enzyme synthesis rate, 1/h
βM,j: rate of enzyme degradation, 1/h
µ: growth rate, 1/h
|Table 2. Four combinatorial cases for Kim et al.’s E. coli model.|
In each case, we force vM,j to be 1 by replacing the denominator of vM,j, i.e., , with , leading to four independent sets of model equations. Figure 1 shows the resulting four hysteresis curves in the D − c space with a fixed value of γ (i.e., 0.2), obtained from the analysis of Cases I to IV, respectively. Segments highlighted in color represent feasible branches satisfying the constraint, i.e., vM,j = 1 (j = 1 − 4), i.e., green (b), cyan (c) and magenta (d), respectively. Note that no such colored branch is found in Figure 1a, indicating that there exists no feasible solution satisfying vM,1 = 1 along the whole profile.
Finally, we put together individual pieces of feasible branches of each case to obtain the hysteresis curve over the whole range of D (Figure 2a). Throughout this article, we use colors to distinguish one branch from others characterized with different dominant (i.e., most activated) modes. That is, blue, green, cyan and magenta lines imply that their dominant modes are EM1, EM2, EM3 and EM4, respectively. The black line, on the other hand, indicates the trivial solution with nonzero biomass (i.e., wash-out as marked with W). In Figure 2a, other than typical limit points (also called folds, turning points or saddle nodes), there are two sharp corners (C) (solid red circles), as well. These non-smooth folds represent catch-up points at which the maximally activated mode is overtaken by another. That is, around catch-up points in Figure 2a, the most dominant mode is switched between EM2 and EM4 (left) and between EM3 and EM4 (right). This clearly manifests the pathway shift by regulation.
The shape of the hysteresis curve becomes somewhat different at a higher fractional concentration of glucose, γ = 0.4 (Figure 2b). The dominant mode at lower values of D is EM1 (instead of EM2), the mode taking up glucose only. Interestingly, one of the two catch-up points (open red circle) does not correspond to a limit point. Thus, we differentiate this simple transition (T) (open red circle), which does not form a sharp limit point, from non-smooth catch-up points (C). The existence of simple transition points has not been reported in earlier studies using lumped network-based cybernetic models. As simple transitions are not bifurcation points, we do not trace them.
3.2. Smooth Approximation to the Max Function
While the combinatoric approach described above allows for rigorous bifurcation analysis in theory, it is ineffective in cases where the number of EMs is large. Alternatively, we may mollify the pain of handling non-smooth functions by making smooth approximations. Lp-norm is considered as an accurate approximation to the max function when p is sufficiently large. That is, we may approximate with .
Figure 3 shows the reproduction of the hysteresis curve using the Lp-norm approximation with different p-values. No appreciable errors are found when p ≥ 30, while some deviations are observed when p-values are lower than that.
Figure 4 provides an enlarged view of two red windows in Figure 3 around the catch-up points. Approximate models progressively approach the rigorous solution (obtained with the combinatoric method described above) as the value of p increases. While small deviations are unavoidable regardless of how large p is, these tiny errors of below 1 percent are acceptable. Stable and unstable branches are also successfully reproduced using this approximate function. In all calculations hereafter, therefore, we use the Lp-norm approximation with a p value of 70.
The usefulness of the smooth approximation depends on THE cases in consideration . In a number of studies, introduction of smooth approximation facilitated the bifurcation analysis by providing the system with global differentiability. On the other hand, approximate functions may become stiffer to integrate or may generate more complex bifurcation diagrams than the original function. Thus, it would be critical to have a previous check if smooth approximation yields any unexpected difficulties or errors.
If the approximate representation is acceptable as in our case, nonlinear analysis of piecewise-smooth functions is greatly facilitated by using an automated software, such as MATCONT, a standard continuation software package .
3.3. Integration of Two Methods
As a compromise, we may integrate combinatoric enumeration and smooth approximation. That is, we can sketch a bifurcation diagram conveniently using the smooth approximation and refine non-smooth folds using rigorous computations based on the combinatoric approach, because they are only the regions where errors may occur. Catch-up points are readily identified from the hysteresis curve using the approximate function. This combined approach is more accurate than the approximate function alone and more convenient than the full combinatoric enumeration.
4. Results and Discussion
Among three methods discussed in the previous section, we use the Lp-norm approximation (Section 3.2) to explore the nonlinear behavior of the HCM model by Kim et al. presented in Table 1. The smooth approximation is conveniently implementable with no appreciable errors in our case. The main parameters subject to variation include dilution rate (D) and the fractional molar concentration of glucose in the feed (γ), i.e.,
4.1. Hysteresis Behaviors and Bifurcation Diagram
Figure 5 shows the concentration profiles of all components (including glucose, pyruvate, biomass, formate, acetate and ethanol) at a specific condition (i.e., γ = 0.4 and xIN,total = 50). The implication of different colors and solid and dashed lines is the same as before. This parameter set yields up to five steady states in a range of D between 0.325 and 0.335. A catch-up point is observed between EM3 and EM4.
To get a global bifurcation diagram, we explore the whole parameter space spanned by D and γ. In the comprehensive search of all possible bifurcation points using MATCONT, we ended up with only two different kinds of bifurcations: limit and catch-up points. No Hopf bifurcation was detected. That is, the nonlinear behaviors we could identify are limited to steady-state multiplicity, and no existence of metabolic oscillation is found.
Figure 6 shows a global map of multiplicity when xIN,total> is fixed to 50 mM. It shows two closed curves in black and gold (left) and four pairs of lines highlighted in the same color, respectively (right). The gold curve represents the neutral saddles, equilibrium points characterized by two real eigenvalues with the opposite sign. Neutral saddles are, however, not bifurcation points of interest and have nothing to do with steady-state multiplicity. Solid lines (other than neutral saddle lines) represent typical limit points, while thick dotted lines, catch-up points. Therefore, inside each envelop, there exist three multiple steady states (i.e., domains I, II, III, IV and V), at least. In the region where two envelops overlap (i.e., domains VI, VII and VIII), five steady states exist. In the remaining region, a unique solution exists.
To clarify the implication of this global bifurcation diagram, hysteresis curves drawn with nine different values of γ are presented in Figure 7.
4.2. Bifurcation Diagram at a Higher Sugar Concentration in the Feed
The effect of the total sugar concentration in the feed (xIN,total) on nonlinear behavior of the E. coli model is examined. When lowering the total sugar concentration from 50 to 25 mM, no qualitative change is observed in bifurcation behavior. Increasing xIN,total to 100 mL, on the other hand, leads to an additional domain not observed previously.
Figure 8 shows a global bifurcation diagram in the D − γ space at xIN,total of 100 mL. The implication of lines and colors is the same as before. Unlike the previous case, this condition leads to multiplicity regimes with up to seven steady states. That is, seven steady states emerge in the domain (IX) where three different envelops (i.e., red, orange and purple ones) are overlapped. We have highlighted this domain in the figure.
Figure 9 shows hysteresis curves of biomass (a) and pyruvate (b) concentrations when γ = 0.83. We can see seven steady states in a small range of D around 0.34. The figure also provides zoomed-in views of seven steady states existing between two vertical dashed lines. For instance, pyruvate can have seven different concentrations in this domain, i.e., if enumerated from the top, one on the black line, one on the cyan, two on the magenta and three on the blue.
4.3. Experimental Validation
Kim et al.  have provided an experimental verification of the stable steady states for the foregoing two sets of conditions, i.e., at γ = 0.2 and xIN,total = 50, yielding a total of three steady states and five steady states, γ = 0.4 and xIN,total = 25, with a total of five steady states.
Through the comprehensive bifurcation analysis in this work, we could identify a new domain with seven steady states. Experimental verification would require precise control of conditions and concentration measurements, however.
Since the cybernetic variables for enzyme activity control are max functions and, therefore, non-smooth, nonlinear analysis of cybernetic models has had to rely on a suitably convenient methodology to confront this issue. The Lp-norm approximation of the max function tested in this work is a practically useful idea, as it is applicable to general cases considering a large number of metabolic pathway options (i.e., EMs). Replacement of the max function with the Lp-norm representation allows for accurate computation of bifurcation points. While slight errors around non-smooth folds (or catch-up points) are unavoidable, they are negligibly small in our case. When these errors are appreciable in certain cases, however, we can redo rigorous computation only for the non-smooth folds based on the combinatoric idea of Namjoshi and Ramkrishna . Such a combination of these two methods guarantees rigorous results at a minimal level of inconvenience, thus serving as a promising strategy.
Using the approximate function, we could construct global bifurcation diagrams on the D − γ space to identify various multiplicity domains, including the one with seven steady states. Considering the narrowness of that domain, however, there are some issues to be resolved for experimental validation. Despite such a comprehensive analysis performed in this work, dynamic nonlinear behaviors, such as metabolic oscillations, were not detected. This could be a consequence of the condensed set of elementary modes in the model.
Clearly, more detailed models comprising more EMs could produce a considerably greater number of steady states, which may be difficult to observe experimentally without accurate analytical measurements and precise control of experimental conditions. It is our premise that this is an area for extensive future exploration by researchers concerned with modeling metabolism.
The authors acknowledge support for this work from the Center for Science of Information (CSoI), a National Science Foundation (NSF) Science and Technology Center, under grant agreement CCF-0939370.
Conflicts of Interest
The authors declare no conflict of interest.
- Alzate, C.A.C.; Astudillo, I.C.P. Importance of stability study of continuous systems for ethanol production. J. Biotechnol. 2011, 151, 43–55.
- Elnashaie, S.S.; Grace, J.R. Complexity, bifurcation and chaos in natural and man-made lumped and distributed systems. Chem. Eng. Sci. 2007, 62, 3295–3325, doi:10.1016/j.ces.2007.02.047.
- Trinh, C.T.; Wlaschin, A.; Srienc, F. Elementary mode analysis: A useful metabolic pathway analysis tool for characterizing cellular metabolism. Appl. Microbiol. Biotechnol. 2009, 81, 813–826.
- Wagner, C.; Urbanczik, R. The geometry of the flux cone of a metabolic network. Biophys. J. 2005, 89, 3837–3845, doi:10.1529/biophysj.104.055129.
- Orth, J.D.; Thiele, I.; Palsson, B.O. What is flux balance analysis? Nat. Biotechnol. 2010, 28, 245–248.
- Reed, J.L.; Palsson, B.O. Thirteen years of building constraint-based in silico models of Escherichia coli. J. Bacteriol. 2003, 185, 2692–2699.
- Wiechert, W.; Noack, S. Mechanistic pathway modeling for industrial biotechnology: Challenging but worthwhile. Curr. Opin. Biotechnol. 2011, 22, 604–610, doi:10.1016/j.copbio.2011.01.001.
- Ramkrishna, D.; Song, H.S. Dynamic models of metabolism: Review of the cybernetic approach. AIChE J. 2012, 58, 986–997, doi:10.1002/aic.13734.
- Song, H.S.; DeVilbiss, F.; Ramkrishna, D. Modeling metabolic systems: The need for dynamics. Curr. Opin. Chem. Eng. 2013. in press.
- Namjoshi, A.A.; Ramkrishna, D. Multiplicity and stability of steady states in continuous bioreactors: Dissection of cybernetic models. Chem. Eng. Sci. 2001, 56, 5593–5607, doi:10.1016/S0009-2509(01)00166-X.
- Namjoshi, A.A.; Hu, W.S.; Ramkrishna, D. Unveiling steady-state multiplicity in hybridoma cultures: The cybernetic approach. Biotechnol. Bioeng. 2003, 81, 80–91, doi:10.1002/bit.10447.
- Simpson, D.J.; Kompala, D.S.; Meiss, J.D. Discontinuity induced bifurcations in a model of Saccharomyces cerevisiae. Math. Biosci. 2009, 218, 40–49, doi:10.1016/j.mbs.2008.12.005.
- Kim, J.I.; Varner, J.D.; Ramkrishna, D. A hybrid model of anaerobic E. coli GJT001: Combination of elementary flux modes and cybernetic variables. Biotechnol. Prog. 2008, 24, 993–1006, doi:10.1002/btpr.73.
- Song, H.S.; Morgan, J.A.; Ramkrishna, D. Systematic development of hybrid cybernetic models: Application to recombinant yeast co-consuming glucose and xylose. Biotechnol. Bioeng. 2009, 103, 984–1002, doi:10.1002/bit.22332.
- Song, H.S.; Ramkrishna, D. Reduction of a set of elementary modes using yield analysis. Biotechnol. Bioeng. 2009, 102, 554–568, doi:10.1002/bit.22062.
- Kim, J.I.; Song, H.S.; Sunkara, S.R.; Lali, A.; Ramkrishna, D. Exacting predictions by cybernetic model confirmed experimentally: Steady state multiplicity in the chemostat. Biotechnol. Prog. 2012, 28, 1160–1166, doi:10.1002/btpr.1583.
- Seydel, R. Practical Bifurcation and Stability Analysis; Springer Verlag: New York, NY, USA, 2009; Volume5.
- Dhooge, A.; Govaerts, W.; Kuznetsov, Y.A. MATCONT: A MATLAB package for numerical bifurcation analysis of ODEs. ACM Trans. Math. Softw. (TOMS) 2003, 29, 141–164, doi:10.1145/779359.779362.
- Dhooge, A.; Govaerts, W.; Kuznetsov, Y.A.; Meijer, H.; Sautois, B. New features of the software MatCont for bifurcation analysis of dynamical systems. Math. Comput. Model. Dyn. Syst. 2008, 14, 147–175, doi:10.1080/13873950701742754.
- Schuster, S.; Fell, D.A.; Dandekar, T. A general definition of metabolic pathways useful for systematic organization and analysis of complex metabolic networks. Nat. Biotechnol. 2000, 18, 326–332, doi:10.1038/73786.
- Kompala, D.S.; Ramkrishna, D.; Jansen, N.B.; Tsao, G.T. Investigation of bacterial-growth on mixed substrates—Experimental evaluation of cybernetic models. Biotechnol. Bioeng. 1986, 28, 1044–1055.
- Young, J.D.; Ramkrishna, D. On the matching and proportional laws of cybernetic models. Biotechnol. Prog. 2007, 23, 83–99.
- Von Kamp, A.; Schuster, S. Metatool 5.0: Fast and flexible elementary modes analysis. Bioinformatics 2006, 22, 1930–1931, doi:10.1093/bioinformatics/btl267.
- Kim, J.I. A Hybrid Cybernetic Modeling for the Growth of Escherichia coli in Glucose-Pyruvate Mixtures. Ph.D. Thesis, Purdue University, West Lafayette, IN, USA, May 2008.
- Simpson, D.J.W. Bifurcations in Piecewise-Smooth Continuous Systems; World Scientific Publishing Co.: Hackensack, NJ, USA, 2010.
© 2013 by the authors; licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution license (http://creativecommons.org/licenses/by/3.0/).