Next Article in Journal
Extracellular Vesicle as a Source of Alzheimer’s Biomarkers: Opportunities and Challenges
Previous Article in Journal
New Innovations in Wound Healing and Repair
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Precise Modeling of the Protective Effects of Quercetin against Mycotoxin via System Identification with Neural Networks

1
Division of Electronics Engineering and Research Center for Intelligent Robots, Chonbuk National University, Jeonju 54896, Korea
2
College of Pharmacy and Research Institute of Pharmaceutical Sciences, Gyeongsang National University, Jinju 52828, Korea
*
Authors to whom correspondence should be addressed.
These authors contributed equally to this work.
Int. J. Mol. Sci. 2019, 20(7), 1725; https://doi.org/10.3390/ijms20071725
Submission received: 8 March 2019 / Revised: 1 April 2019 / Accepted: 1 April 2019 / Published: 8 April 2019
(This article belongs to the Section Molecular Biophysics)

Abstract

:
Cell cytotoxicity assays, such as cell viability and lactate dehydrogenase (LDH) activity assays, play an important role in toxicological studies of pharmaceutical compounds. However, precise modeling for cytotoxicity studies is essential for successful drug discovery. The aim of our study was to develop a computational modeling that is capable of performing precise prediction, processing, and data representation of cell cytotoxicity. For this, we investigated protective effect of quercetin against various mycotoxins (MTXs), including citrinin (CTN), patulin (PAT), and zearalenol (ZEAR) in four different human cancer cell lines (HeLa, PC-3, Hep G2, and SK-N-MC) in vitro. In addition, the protective effect of quercetin (QCT) against various MTXs was verified via modeling of their nonlinear protective functions using artificial neural networks. The protective model of QCT is built precisely via learning of sparsely measured experimental data by the artificial neural networks (ANNs). The neuromodel revealed that QCT pretreatment at doses of 7.5 to 20 μg/mL significantly attenuated MTX-induced alteration of the cell viability and the LDH activity on HeLa, PC-3, Hep G2, and SK-N-MC cell lines. It has shown that the neuromodel can be used to predict the protective effect of QCT against MTX-induced cytotoxicity for the measurement of percentage (%) of inhibition, cell viability, and LDH activity of MTXs.

Graphical Abstract

1. Introduction

Cell cytotoxicity assays have a central role in toxicology studies in the assessment of the in vivo toxic potential of pharmaceutical chemical agents based on in vitro cell cytotoxicity studies [1]. In vitro cell cytotoxicity assays are generally used for drug screening to detect whether the test molecules have effects on cell proliferation or display direct cytotoxic effects. By using this concept, it is possible to measure the protective effect of pharmaceutical lead compounds as well. Two cytotoxicity assays, including cell viability and lactate dehydrogenase (LDH) leakage assays, are widely used in vitro toxicology studies. Cell viability is an important indicator for understanding the underlying mechanisms of certain genes, proteins, and pathways involved cell survival or death after exposing to toxic agents [2]. The LDH leakage assay is based on the measurement of LDH activity in the extracellular medium, where the loss of intracellular LDH and its release into the culture medium is an indicator of irreversible cell death due to cell membrane damage [3]. In vitro cell viability and LDH leakage assays play a crucial role in predictive toxicology in assessing the toxicity of chemicals. However, the quality of in vitro cytotoxicity data fluctuates dramatically due to the variation of experimental modeling, data collection, data analysis, and interpretation. In addition, there has been a remarkable increase in the amount of pharmaceutical compounds that have to assess potential cytotoxic effect for toxicological evaluation [4]. Particularly from the point of view of research laboratories and pharmaceutical industries, the role of precise modeling for cytotoxicity studies is essential for successful drug development because toxicity still remains one of the major factors for failure in the drug discovery [5].
Mycotoxins (MTXs) are toxic developing in many foodstuffs which are responsible for creating a worldwide problem in various agricultural commodities [6,7,8]. Finding out a drug candidate that can reduce or minimize MTX-induced toxicity is a great challenge for researchers because MTXs exhibit high diversified toxic effects in humans and animals [9,10].
Quercetin (QCT) (3,3′,4′,5,7-pentahydroxyflavone) is a natural dietary compound that possess strong anti-oxidant and exhibited beneficial effect against major classes of MTXs in both in vitro and in vivo experiments [11]. It has been reported that QCT inhibits MTX-induced cytotoxicity and oxidative stress in the liver of rats [12]. The effect QCT as well as other many natural compounds against MTXs still remains unknown. In this study, the effect of QCT is investigated with the help of neuro modeling about several MTXs, such as Citrinin (CTN), Patulin (PAT), and Zearalenol (ZEAR).
Artificial neural networks (ANNs) belong to a class of Artificial Intelligence (AI) tools which are inspired by neuroscience and the architecture of human brain. Similar to the biological neural networks, ANNs are capable of parallel processing using large number of neurons and the learning is conducted based on the given data [13,14,15,16,17]. ANNs have been widely used for problems in pattern detection and classification [18,19,20,21,22].
Neuromodeling is a methodology for building models of systems using ANN via learning the relationship between the inputs and their corresponding outputs. This modeling method is especially useful for applications where the relationship between the system input and output is unknown and/or highly nonlinear. The behavior of the original system can be reproduced via an ANN-based model learned using sparsely measured local data of the system. This process is also called ANN-based system identification [23].
The aim of our study is to develop a precise model for the protective effect of QCT against MTX-induced cytotoxicity in four different human cell lines (HeLa, PC-3, Hep G2, and SK-N-MC) using the ANN-based system identification method. Toward this end, two ANN models were designed to predict the protective effect of QCT against MTX-induced cytotoxicity that was evaluated with the measurement of percentage (%) of inhibition, cell viability, and LDH activity of MTXs (CTN, PAT, and ZEAR) in HeLa, PC-3, Hep G2, and SK-N-MC.

2. System Identification Using Artificial Neural Network

2.1. Neuromodeling via System Identification

System identification is a methodology for building models of a dynamic system using measurements of the system’s input and output signals. It also includes the optimal design of experiments for efficiently generating informative data for fitting such models as well as model reduction. In this study, a neural network approach has been used for system identification. Specifically, multilayer neural networks and back propagation [24] learning has been employed. Figure 1 shows a diagram to explain the concept of system identification.
The system to be modeled is placed in parallel with a neural network with nonlinear learning capability. That input signal x is given to both the system and the neural network and the output of the system is taken as the desired response d for training the neural network. The objective of system identification is then to build a neural network whose response o matches to the response y of the system for a given set of inputs x. To achieve this objective input signals are presented repeatedly to the network and the norm of the error vector d o , is minimized using back-propagation algorithm, which iteratively adjusts the weights of the neural network until its response is close to the desired system response.

2.2. Multilayer Neural Networks

A multilayer neural network (MNN), as shown in Figure 2, is a class of feed-forward artificial neural network that consists of an input layer, an output layer, and at least one hidden layer in between them [16,17]. Except for the input layer, the basic element in each layer is a node called neuron. The input layer receives inputs x from the external world. This data is weighted with different synaptic weights {wji} and feed-forwarded to the hidden layer. Each neuron in the hidden layer sums the weighted inputs it receives from its preceding layer and applies a nonlinear transfer function also called “activation function” before passing them as inputs to the output layer. The output layer neurons perform similar computation and yield the output values y of the neural network. The output of the hidden and output neurons can be expressed as follows.
z j = f h ( i x i . w j i + b j )
y k = f o ( j z j . w k j + b k )
where fh and fo are the activation functions, and bj and bk are the bias of the hidden and output layer, respectively. In this study the sigmoid activation function is used:
f ( a ) = 1 / ( 1 + e a )
The multiple layers and nonlinear activation enable the MNN to learn a mapping of any complexity. The network is learned based on repeated presentations of the training samples and iterative adjustments of the weights using back-propagation algorithm.

2.3. System Identification via Learning with Back-propagation

Assume that the error function of the network shown in Figure 2 is defined as
E = p ( y p t p ) 2
where y is the network output and t is the desired target and the error is computed over all the data points p. Using (1) and (2), (4) can be written as
E = p ( f o ( j w k j . f h ( ( X p ) ) ) t p ) 2
If all W are chosen appropriately for all the patterns, then the error E will approach close to zero. At this situation, the system can produce output values close to the target values for all the inputs. At this state the network is regarded as completely learned and we can say that the function f o ( w k j f h ( ( X p ) ) ) is the identified system of the target system.
So the goal is to find the appropriate value of the network weights W. This goal is achieved via learning which is performed by iteratively updating W such that the error E, at the output, is reduced. Different optimization techniques, like gradient-based back-propagation, genetic algorithm, and simulated annealing, are used for training neural networks. However, back-propagation [24] is the most commonly used algorithm for learning neural networks. It propagates the error backwards throughout the network layers and updates the weight by computing the gradient of the error. The derivative of the error with respect to the weights of the network is computed using the chain rule of differentiation.
The aim of our study is to model the protective effect of QCT against MTX-induced cytotoxicity in four different human cell lines (HeLa, PC-3, Hep G2, and SK-N-MC) using the above-mentioned multilayer neural network based system identification method. Toward this end, two ANN models are designed and trained to predict the protective effect of QCT against MTX-induced cytotoxicity.

3. Result

3.1. Protective Effect of QCT on MTX-Induced Cytotoxicity in HeLa, PC-3, HepG2, and SK-N-MC Cells

The experimental results revealed that % of inhibition increased with increasing dose of MTX, while QCT pretreatment significantly decreased % of inhibition in HeLa, PC-3, Hep G2, and SK-N-MC cell lines (Table 1). An increase in cell viability was observed in QCT-treated cells compared to MTX alone group (Figure 3). The result displayed that QCT at doses of 7.5 up to 20 μg/mL possessed the best protective effects. QCT alone treatment did not change the cell viability compared to the control group (Figure 3). QCT pretreatment also markedly decreased the MTX-caused LDH release (Figure 4). QCT alone treatment did not change the LDH activity compared to the control group (Figure 4).

3.2. Neuro Modeling of Protective Effect of QCT

The neuromodeling of protective effect of QCT against MTX (CTN, PAT, and ZEAR) in different cell lines (HeLa, PC-3, Hep G2, and SK-N-MC) has been performed via learning of neural networks. For this end, determination of % of inhibition and cell viability using crystal violet assay and LDH activity using LDH assay were performed.

3.2.1. Neuro Modeling of Percentage (%) of Inhibition

The cytotoxicity was evaluated by determination of % of inhibition on HeLa, PC-3, Hep G2, and SK-N-MC cells that were pretreated with QCT (0–20 μg/mL) for 6 h, followed by the incubation with MTX (0–200 µM) for 24 h. The % of inhibition was measured for discrete amounts of MTX (0.0, 0.78125, 1.5625, 3.125, 6.25, 12.5, 25, 50, 100, and 200 µM) at every QCT dose of 0.0, 5.0, 7.5, 10, 15, and 20 µg/mL for each cell lines and MTX. A total 720 data points were measured, of which 480 data points corresponding to the % inhibition for QCT values of 0.0, 5.0, 10, and 20 µg/mL, as listed in Table 1 were used to train the neural network model whereas 240 data points corresponding to the % inhibition for QCT values of 7.5 and 15 µg/mL were reserved for testing. Out of the 480 data points, Table 1, used for training the neural network, 20% samples were randomly chosen and set aside for validation.
The doses of MTX and QCT are the primary inputs to the neural network, and the target to be learned is the corresponding % of inhibition. As the % inhibition of QCT on different cell lines and different MTXs is different, a naïve way would be to learn 12 different neural network models corresponding the four different cell lines and three different MTXs. However, in this study we aim to design a single neural network that models the overall behavior on the above mentioned cell lines and MTXs. To distinguish the % inhibition corresponding to the four cell lines and the three MTXs, additional binary codes are used as input to the network. The four cell lines HeLa, PC-3, Hep G2, and SK-N-MC are encoded as 1000, 0100, 0010, and 0001, respectively, and, the three MTXs (CTN, PAT, and ZEAR) are encoded as 100, 010, and 001, respectively. For example, the input to the neural network corresponding to 10 µg/mL QCT on HeLa cell lines for 0.78125 µM CTN is (1, 0, 0, 0, 1, 0, 0, 0.78125, 10). The doses of QCT and MTXs are normalized using their corresponding maximum doses used in this study, i.e., (dose of QCT/20, dose of MTX/200). The output of the network, i.e., the % of inhibition, is expressed a real number between zero and one [25].
So the neural network to be designed should have nine input and one output nodes. The appropriate number of hidden nodes required to learn the system was determined empirically. Starting with an initial five hidden nodes in a single hidden layer, the number of hidden nodes were incremented gradually. The network was trained using the back-propagation algorithm with a learning rate of 0.05 on the training dataset for a fixed 10,000 epochs, and its performance was evaluated on the randomly selected validation dataset. The root mean square error
r m s e = 1 N i = 1 N ( y i t i ) 2
was employed to evaluate the performance on the validation dataset where N is the number of validation data points. The results of the empirical method are presented in Table 2. The network with 20 and 30 hidden nodes produced the lowest error on the validation dataset. So, keeping the number of nodes in the first hidden layer at 20, another hidden layer was added to this network. Staring with three hidden nodes, the nodes in the second hidden layer were increased in steps of three. The network was then trained and validated as described earlier. The results of the empirical method for determining the number of nodes in the second hidden layer is presented in Table 3.
From Table 3, it is seen that the neural network with two hidden layers produces the lowest error in the validation dataset. Hence, a three-layered neural network of nine input nodes, 20 hidden nodes, 15 hidden nodes, and 1 output node, namely, a 9-20-15-1 network, as shown in Figure 5, was chosen as the optimal network to learn the % of inhibition for all the combinations of cell lines and MTXs. This empirically selected network was then finally trained on the whole training dataset (including the validation dataset). Figure 6 shows the error curve obtained during the learning of this network on the training and the test dataset, and the corresponding RMSEs are given in Table 4.
After the learning was completed, the network was evaluated on the test set and the % of inhibition values were obtained from the output of the ANN. The % of inhibition surface obtained from the trained neural network for Hep G2 cell lines with MTX CTN ranging from 0 to 200 µM for different doses of QCT ranging from 0 to 20 µg/mL is presented in Figure 7. Note that the increasing directions of QCT and CTN axis are indicated by arrow heads. The experimentally measured data is superimposed on this surface with solid circles. The black solid circles are the % of inhibition values used for training the ANN and the blue and red circles are those of test data. The solid circles hidden partially in the surface indicate that the % inhibition values predicted by the ANN are close to the experimentally measured data. For better visualization of the modeling accuracy of the ANN on the test data, the % inhibition values predicted by the ANN at QCT values of 7.5 and 15 µg/mL are presented in Figure 7c. The solid lines represent the outputs of ANN, whereas the solid dots are the measured data. Observe that the output of the ANN is close to the measured data at every test point.
The results of ANN were compared with that of linear regression method which is commonly used for a rough estimation of experimental results. Figure 7b shows the surface of the % of inhibition values obtained with linear regression of Hep G2 cell, and Figure 7d shows the % of inhibition curves at QCT values of 7.5 and 15 µg/mL concentrations.
Similar figures for other MTXs, such as PAT and ZEAR, are presented in Figure 8 and Figure 9, respectively. As seen in Figure 7, Figure 8 and Figure 9, the qualitative results of modeling the system with ANN shows excellent performance for the four different cell line types and three different MTXs consistently. A quantitative evaluation of the network’s performance on the test set exhibited high correlation (R = 0.999) with the experimentally measured data, which is substantially higher than the correlation obtained from other statistical method such as partial least squares (PLS) regression (R = 0.90). Also note that separate models of linear regression or the partial least squares regression have to be built for each of the cell line and MTX combination, whereas the proposed ANN models all the cell line MTX combinations in as single model. The plot of the error between the measured % of inhibition and the predicted values using the ANN model and PLS is as shown in Figure 10.

3.2.2. Neuro-Modeling of Cell Viability and LDH Activity

Similar experiments, as those done for modeling the % of inhibition of QCT, were also conducted to model the cell viability and LDH activity. As in the case of % of inhibition, variation of cell viability and LDH activity was measured on cells treated with QCT (5, 7.5, 10, 15, and 20 μg/mL) and incubated with MTXs: CTN (100 µM), PAT (50 µM), and ZEAR (100 µM). As shown in Figure 3 and Figure 4, a total of 72 data points were measured for % of cell viability and LDH activity, respectively. Out of the total 72 data points, 48 data points were used to train the ANN, whereas the remaining 24 data points, corresponding to QCT values of 7.5 and 15 µg/mL, were reserved for testing. As before, 20% of samples chosen randomly from the training set were used for validating the neural network.
The aim of neural network in this case is to predict the cell viability and LDH activity given the doses of MTXs and QCT for all the combination of MTXs and cell lines. The architecture of the ANN for modeling this system is different from the case of % of inhibition model as the network needs to output two values. The output of the network, i.e., the cell viability and LDH activity, are normalized to real numbers between zero and one by dividing with their corresponding maximum values encountered in this study, i.e., 100 and 350, respectively. The binary encoding scheme as described in Section 3.2.1 is used to distinguish the different cell lines and the MTX combination. Hence the total number of input nodes is equal to 9. The optimal network architecture for this task was also determined by following the empirical method described in Section 3.2.1. The results of the empirical method are presented in Table 5 and Table 6.
A network with nine input nodes, 10 hidden nodes, 10 hidden nodes, and two output nodes, namely, a 9-10-10-2 network, shown in Figure 11, was determined to be the optimal network for this task. This network was then trained on the whole training dataset (including the validation dataset). Figure 12 shows the evolution of error during the learning of this network on the training and the test dataset, and the corresponding RMSEs are given in Table 7.
The trained network was evaluated on the test set and the cell viability and LDH activity values were obtained from the output of the ANN. The cell viability and the LDH activity curve obtained from the trained neural network for different cell lines pretreated with different doses of QCT ranging from 0 to 20 µg/mL and incubated with MTXs: CTN (100 µM), PAT (50 µM), and ZEAR (100 µM) is presented in Figure 13. The experimentally measured data is superimposed on this curve with markers, where ‘*’ indicates the data points used for training the ANN and ‘o’ for testing.
As seen from Figure 13, the qualitative results of modeling the system with ANN shows excellent performance for the 4 different cell line types and 3 different MTXs consistently. A quantitative evaluation of the network’s performance on the test set exhibited high correlation (Rcell_viability = 0.995 and RLDH_activity = 0.997) with the experimentally measured data.
The plot of the error between the measured cell viability and LDH activity and the corresponding values predicted using the ANN model is as shown in Figure 14.

4. Discussion

The main objective of this paper was to model the protective effect of QCT against MTXs using ANNs, and to verify the ability of the model in estimating the protective effect of QCT. Specifically, the protective effect of QCT against three different MTXs (Citrinin, Patulin, and Zearalenol) on four different cell lines (HeLa, PC-3, Hep G2, and SK-N-MC cell lines) was measured experimentally, and the data were used to model their nonlinear protective functions (% of inhibition, cell viability, and LDH activity) using multilayer neural networks.
The experimental measurements revealed that treatment with MTX significantly decreased cell viability and increased LDH activity. However, the % of inhibition of four different cells pretreated with the three MTXs was consistently decreased with the dose of QCT. Also, pretreatment with QCT attenuated MTX-induced alteration of cell viability and LDH activity that it could protect the cell lines from cytotoxicity. The effects of QCT against the MTX-induced cytotoxicity were conducted via cell viability and LDH release assays in Hela, PC-3, Hep G2, and SK-N-MC cell lines. The experimental results showed that treatment with MTX significantly decreased cell viability and increased LDH activity. However, pretreatment with QCT significantly attenuated MTX-induced alteration of cell viability and LDH activity, which suggests that it could protect the cell lines from cytotoxicity. Therefore, these results suggest that QCT may inhibit MTX-induced diseases in humans.
Two different ANN models with sizes of 9-20-15-1 and 9-10-10-2, determined empirically, were used to model the % of inhibition, the cell viability, and LDH activity, respectively. For both tasks, the experimentally measured data for the protective effects of QCT for three different MTXs in four different cells was used for training the neural network. As a result, twelve and twenty-four different models of precise protective effects of QCT were built on the two ANNs, respectively. Unlike the commonly used statistical methods, like linear regression or partial least square regression, which require separate models to be computed for each MTX and cell line combination, a single neural network was designed to model the different combinations using a special binary encoding scheme for each MTX and cell line combination. Moreover, quantitative evaluations of the network’s performance on the test sets exhibited high correlation with experimentally measured data which was substantially higher than that of individual models computed using other statistical methods.
It was observed that the additional burden for the neural network to discriminate between the different input combinations, expressed as binary codes, demands comparatively larger networks, which require more number of iterations for network convergence and hence longer training times. However, it was shown that single model for different input combination provides a unified and elegant solution with the ability to precisely model the protective effects of QCT against MTXs.

5. Material and Methods

5.1. Materials and Cell Culture

Citrinin (CTN), patulin (PAT), zearalenol (ZEAR), and quercetin (QCT) were purchased from Sigma-Aldrich (St. Louis, MO, USA). HeLa (cervical cancer cell), PC-3 (prostate cancer cell), Hep G2 (liver cancer cell), and SK-N-MC (brain cancer cell) human cell lines were obtained from the American type culture collection (Manassas, VA, USA). The cells were grown in Dulbecco’s Modified Eagle’s Medium (DMEM) and Roswell Park Memorial Institute (RPMI) 1640 supplemented with 10% fetal bovine serum (FBS), 4.5 g/L d-glucose, 2 mmol/L l-glutamine, 110 mg/L sodium pyruvate, 100 U/mL penicillin, and 100 μg/mL streptomycin at 37°C in a humidified atmosphere containing 95% air and 5% CO2.
To prevent mycoplasma effectively we followed a procedure described previously [26]. Briefly, we brought all cells and culture materials from reliable sources, used good aseptic technique, recommended antibiotic used for culture medium to eradicate all contamination and finally disinfecting the laminar flow hood after working.

5.2. Measurement of Mycotoxin-Induced Cytotoxicity

The MTX-induced cytotoxicity in different cell lines (HeLa, PC-3, Hep G2, and SK-N-MC) was measured by determination of percentage (%) of inhibition, cell viability, and LDH activity.

5.2.1. Measurement of Percentage (%) of Inhibition

At first, we measured percentage (%) of inhibition to observe the cytotoxic effect of the MTXs (Citrinin, Patulin, and Zearalenol) and MTX + QCT on HeLa, PC-3, Hep G2, and SK-N-MC. Briefly, cells were seeded in 24-well plates with 5 × 104 cells per well in culture media and allowed to attach overnight; cells were pretreated with QCT (0–20 μg/mL) at 37 °C in a humidified atmosphere of 5% CO2/95% air for 6 h followed by the incubation with mycotoxins (0–200 µM) for 24 h.

5.2.2. Cell Viability

Crystal violet assay was used to determine MTX-induced cell death. Briefly, cells were seeded in 24-well plates with 5 × 104 cells per well in culture media and allowed to attach overnight. The cells were pretreated with the doses of QCT at 5, 10, and 20 μg/mL at 37 °C in a humidified atmosphere of 5% CO2/95% air for 6 h, followed by the incubation with CTN (100 µM), PAT (50 µM), and ZEAR (100 µM) for 24 h. After 24 h of incubation, removed medium and washed the cells with phosphate buffer solution (PBS) and 0.2% crystal violet solution was added to each well. After 10 min of incubation, the crystal violet solution was removed carefully by washing with water. Finally, added 100 μL 1% sodium dodecyl sulfate (SDS) to solubilize the color solution until the color is uniform and no areas of dense coloration in bottom of wells. The samples were read at 590 nm in a microplate reader (Spectra MAX, Gemini EM, Molecular Device, Sunnyvale, CA, USA). The cell viability is expressed as the percentage of absorbance of control.

5.2.3. Lactate Dehydrogenase (LDH) Activity

Lactate dehydrogenase (LDH) activity assay was used to determine MTX-induced cytotoxicity. LDH release into the media was taken as an indicator of cell damage and the assay is based on the principle of reduction of nicotinamide adenine dinucleotide (NAD) by LDH. The reduced NAD (NADH) is utilized in the stoichiometric conversion of a tetrazolium dye which is measured spectrophotometrically using an LDH assay kit (Cat. No. 04744926001, Sigma, Saint Louis, MO, USA). Briefly, cells were seeded (5 × 104 cells/well) and cultured in 24-well culture plates. The cells were then preincubated with or without different concentrations of QCT (5, 7.5, 10, 15, and 20 μg/mL) at 37 °C for 6 h followed by incubation with CTN (100 µM), PAT (50 µM), and ZEAR (100 µM) for 24 h. After treatment was over, cells were centrifuged at 240 × g for 4 min and the culture supernatant was transferred in a new plate. The assay mixture was prepared and added to each well and the plate incubated wrapped in foil at room temperature for 30 min. Reaction was terminated by adding the stop solution to each well. The plate was read at 490 nm at a reference wavelength of 690 nm. The extent of cytotoxicity is expressed as the percentage of absorbance of control.

5.3. Statistical Data Analysis and Neural Network Training

All the data were expressed as mean ± SD and one-way ANOVA (Analysis of variance) followed by Dunnett’s test was used for the statistical analysis using SPSS software (version 16, SPSS, Inc., Chicago, IL, USA). * p < 0.05 and ** p < 0.01 were considered significant. The artificial neural network was trained using custom codes developed by the authors written in MATLAB(R) (2017b, Mathworks, Natick, MA, USA) on a standard computer station (Intel(R) Core(TM) i7-6700k 4.00 GHz, 8 cores, 8 GB RAM) machine, whereas the partial least squares method was implemented using MATLAB’s built-in plsregress function.

Author Contributions

Conceptualization: C.Y., E.B., H.K., and H.Y.; Data curation: C.Y. and E.B.; Formal Analysis: C.Y., E.B., and S.P.A.; Funding Acquisition: H.K.; Investigation: H.K. and H.Y.; Methodology, C.Y. and E.B.; Project Administration, H.K. and H.Y.; Software, C.Y.; Supervision, H.Y.; Validation, C.Y. and S.P.A.; Writing—Original Draft, C.Y. and E.B.; Writing—Review & Editing, H.K., H.Y., S.P.A., and S.-J.K.

Funding

This paper was supported by research funds of Chonbuk National University in 2017.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Pohjala, L.; Tammela, P.; Samanta, S.K.; Yli-Kauhaluoma, J.; Vuorela, P. Assessing the data quality in predictive toxicology using a panel of cell lines and cytotoxicity assays. Anal. Biochem. 2007, 362, 221–228. [Google Scholar] [CrossRef]
  2. Adan, A.; Kiraz, Y.; Baran, Y. Cell Proliferation and Cytotoxicity Assays. Curr. Pharm. Biotechnol. 2016, 17, 1213–1221. [Google Scholar] [CrossRef]
  3. Fotakis, G.; Timbrell, J.A. In vitro cytotoxicity assays: Comparison of LDH, neutral red, MTT and protein assay in hepatoma cell lines following exposure to cadmium chloride. Toxicol. Lett. 2006, 160, 171–177. [Google Scholar] [CrossRef] [PubMed]
  4. Chen, H.; Engkvist, O.; Wang, Y.; Olivecrona, M.; Blaschke, T. The rise of deep learning in drug discovery. Drug Discov. Today 2018, 23, 1241–1250. [Google Scholar] [CrossRef]
  5. Kola, I.; Landis, J. Can the pharmaceutical industry reduce attrition rates? Nature reviews. Drug Discov. 2004, 3, 711–715. [Google Scholar] [CrossRef]
  6. Torovic, L.; Dimitrov, N.; Assuncao, R.; Alvito, P. Risk assessment of patulin intake through apple-based food by infants and preschool children in Serbia. Food Addit. Contam. Part A Chem. Anal. Control Expo. Risk Assess. 2017, 34, 2023–2032. [Google Scholar] [CrossRef]
  7. Jennessen, J.; Nielsen, K.F.; Houbraken, J.; Lyhne, E.K.; Schnurer, J.; Frisvad, J.C.; Samson, R.A. Secondary metabolite and mycotoxin production by the Rhizopus microsporus group. J. Agric. Food Chem. 2005, 53, 1833–1840. [Google Scholar] [CrossRef]
  8. Pinotti, L.; Ottoboni, M.; Giromini, C.; Dell’Orto, V.; Cheli, F. Mycotoxin Contamination in the EU Feed Supply Chain: A Focus on Cereal Byproducts. Toxins 2016, 8, 45. [Google Scholar] [CrossRef] [PubMed]
  9. Liu, B.H.; Yu, F.Y.; Wu, T.S.; Li, S.Y.; Su, M.C.; Wang, M.C.; Shih, S.M. Evaluation of genotoxic risk and oxidative DNA damage in mammalian cells exposed to mycotoxins, patulin and citrinin. Toxicol. Appl. Pharmacol. 2003, 191, 255–263. [Google Scholar] [CrossRef]
  10. Gallo, A.; Giuberti, G.; Frisvad, J.C.; Bertuzzi, T.; Nielsen, K.F. Review on Mycotoxin Issues in Ruminants: Occurrence in Forages, Effects of Mycotoxin Ingestion on Health Status and Animal Performance and Practical Strategies to Counteract Their Negative Effects. Toxins 2015, 7, 3057–3111. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  11. Markham, R.J.; Erhardt, N.P.; DiNinno, V.L.; Penman, D.; Bhatti, A.R. Flavonoids protect against T-2 mycotoxins both in vitro and in vivo. J. Gen. Microbiol. 1987, 133, 1589–1592. [Google Scholar] [CrossRef]
  12. El-Nekeety, A.A.; Abdel-Azeim, S.H.; Hassan, A.M.; Hassan, N.S.; Aly, S.E.; Abdel-Wahhab, M.A. Quercetin inhibits the cytotoxicity and oxidative stress in liver of rats fed aflatoxin-contaminated diet. Toxicol. Rep. 2014, 1, 319–329. [Google Scholar] [CrossRef] [Green Version]
  13. Van Gerven, M. Computational Foundations of Natural Intelligence. Front. Comput. Neurosci. 2017, 11, 112. [Google Scholar] [CrossRef]
  14. McCulloch, W.S.; Pitts, W. A logical calculus of the ideas immanent in nervous activity. Bull. Math. Biol. 1990, 52, 99–115, discussion 73–97. [Google Scholar] [CrossRef]
  15. Hebb, D. The Organization of Behavior; Wiley: New York, NY, USA, 1949; ISBN 978-1-135-63190-1. [Google Scholar]
  16. Werbos, P.J. Beyond Regression: New Tools for Prediction and Analysis in the Behavioral Sciences; Harvard University: Cambridge, MA, USA, 1975. [Google Scholar]
  17. Rumelhart, D.E.; McClelland, J.L. Parallel Distributed Processing: Explorations in the Microstructure of Cognition; MIT Press: Cambridge, MA, USA, 1986. [Google Scholar]
  18. Hernandez-Borges, J.; Corbella-Tena, R.; Rodriguez-Delgado, M.A.; Garcia-Montelongo, F.J.; Havel, J. Content of aliphatic hydrocarbons in limpets as a new way for classification of species using artificial neural networks. Chemosphere 2004, 54, 1059–1069. [Google Scholar] [CrossRef]
  19. Fedor, P.; Malenovsky, I.; Vanhara, J.; Sierka, W.; Havel, J. Thrips (Thysanoptera) identification using artificial neural networks. Bull. Entomol. Res. 2008, 98, 437–447. [Google Scholar] [CrossRef]
  20. Ljung, L. System Identification. In Signal Analysis and Prediction. Applied and Numerical Harmonic Analysis; Procházka, A., Uhlíř, J., Rayner, P.W.J., Kingsbury, N.G., Eds.; Birkhäuser: Boston, MA, USA, 1998. [Google Scholar]
  21. Qi, Y.; Oja, M.; Weston, J.; Noble, W.S. A unified multitask architecture for predicting local protein properties. PLoS ONE 2012, 7, e32235. [Google Scholar] [CrossRef]
  22. Meng, Y.; Lin, B.L. A feed-forward artificial neural network for prediction of the aquatic ecotoxicity of alcohol ethoxylate. Ecotoxicol. Environ. Saf. 2008, 71, 172–186. [Google Scholar] [CrossRef]
  23. Hamid, A.; Chen, X.; Mohammad, B.M.; Raazesh, S. Artificial Neural Network–Based System Identification for a Single-Shaft Gas Turbine Hamid. J. Eng. Gas Turbines Power 2013, 135, 09260. [Google Scholar]
  24. Rumelhart, D.E.; Hinton, G.E.; Williams, R.J. Learning representations by back-propagating errors. Nature 1986, 323, 533–536. [Google Scholar] [CrossRef]
  25. Yang, C.; Bahar, E.; Yoon, H.; Kim, H. Accurate Modeling of Complex Antitoxin Effect of Quercetin Based on Neural Networks. Int. J. Bifurc. Chaos 2019, 29, 1950013. [Google Scholar] [CrossRef]
  26. Nikfarjam, L.; Farzaneh, P. Prevention and detection of Mycoplasma contamination in cell culture. Cell J. 2012, 13, 203–212. [Google Scholar]
Figure 1. Concept of system identification with artificial neural networks, where lines with arrow heads denote parameter adjustment via learning.
Figure 1. Concept of system identification with artificial neural networks, where lines with arrow heads denote parameter adjustment via learning.
Ijms 20 01725 g001
Figure 2. Architecture of our artificial neural network.
Figure 2. Architecture of our artificial neural network.
Ijms 20 01725 g002
Figure 3. The protective effect of QCT against MTX-induced cell death. (A) Cell viability on HeLa, PC-3, Hep G2, and SK-N-MC cells when pretreated with QCT and post-treated with various MTXs, such as (A) CTN, (B) PAT, and (C) ZEAR. Values were represented as mean ± SD. ## p < 0.01 as compared with the control group; * p < 0.05; ** p < 0.01 as compared with the MTX alone group.
Figure 3. The protective effect of QCT against MTX-induced cell death. (A) Cell viability on HeLa, PC-3, Hep G2, and SK-N-MC cells when pretreated with QCT and post-treated with various MTXs, such as (A) CTN, (B) PAT, and (C) ZEAR. Values were represented as mean ± SD. ## p < 0.01 as compared with the control group; * p < 0.05; ** p < 0.01 as compared with the MTX alone group.
Ijms 20 01725 g003
Figure 4. The protective effect of QCT against MTX-induced cytotoxicity. LDH activity on HeLa, PC-3, Hep G2, and SK-N-MC cells when pretreated with QCT and post-treated with various MTXs, such as (A) CTN, (B) PAT, and (C) ZEAR. Values were represented as mean ± SD. ## p < 0.01 as compared with the control group; * p < 0.05; ** p < 0.01 as compared with the MTX alone group.
Figure 4. The protective effect of QCT against MTX-induced cytotoxicity. LDH activity on HeLa, PC-3, Hep G2, and SK-N-MC cells when pretreated with QCT and post-treated with various MTXs, such as (A) CTN, (B) PAT, and (C) ZEAR. Values were represented as mean ± SD. ## p < 0.01 as compared with the control group; * p < 0.05; ** p < 0.01 as compared with the MTX alone group.
Ijms 20 01725 g004
Figure 5. Architecture of artificial neural network (ANN) (9-20-15-1) for learning of % of inhibition. Biases of nodes are omitted in this figure, where four input terminals are used for indicating cell lines and three input terminals are to determine MTXs and other two input terminals are for the dose of MTX and QCT, respectively. Also, the single output terminal is for % of inhibition.
Figure 5. Architecture of artificial neural network (ANN) (9-20-15-1) for learning of % of inhibition. Biases of nodes are omitted in this figure, where four input terminals are used for indicating cell lines and three input terminals are to determine MTXs and other two input terminals are for the dose of MTX and QCT, respectively. Also, the single output terminal is for % of inhibition.
Ijms 20 01725 g005
Figure 6. Error curves of learning % of inhibition on the training and the test set. Root mean square error (rmse) is employed to evaluate the performance and the network is trained for 10,000 epochs or until the rmse reaches 0.01, whichever occurs first. (The x-axis is plotted in log scale.)
Figure 6. Error curves of learning % of inhibition on the training and the test set. Root mean square error (rmse) is employed to evaluate the performance and the network is trained for 10,000 epochs or until the rmse reaches 0.01, whichever occurs first. (The x-axis is plotted in log scale.)
Ijms 20 01725 g006
Figure 7. Percentage of inhibition model of Hep G2 cell for dose of QCT and CTN. (a) Surface of % of inhibition values obtained with ANNs, where black dots indicate training data and red and blue dots are test data. (b) % of inhibition surface obtained with linear regression. Cross-sections of (c) ANN-based model and (d) the linear regression model at QCT = 7.5 μg/mL (red) and QCT = 15 μg/mL (blue), which comprise the test area. The outputs of the neuro-model are close to the experimentally measured % of inhibition values.
Figure 7. Percentage of inhibition model of Hep G2 cell for dose of QCT and CTN. (a) Surface of % of inhibition values obtained with ANNs, where black dots indicate training data and red and blue dots are test data. (b) % of inhibition surface obtained with linear regression. Cross-sections of (c) ANN-based model and (d) the linear regression model at QCT = 7.5 μg/mL (red) and QCT = 15 μg/mL (blue), which comprise the test area. The outputs of the neuro-model are close to the experimentally measured % of inhibition values.
Ijms 20 01725 g007
Figure 8. Percentage of inhibition model of QCT for Hep G2 cell with PAT. Surface of % of inhibition obtained using (a) ANN model and (b) linear regression. Cross-sections of (c) ANN-based model and (d) linear regression model at QCT = 7.5 μg/mL (red) and QCT = 15 μg/mL (blue), which comprise the test area.
Figure 8. Percentage of inhibition model of QCT for Hep G2 cell with PAT. Surface of % of inhibition obtained using (a) ANN model and (b) linear regression. Cross-sections of (c) ANN-based model and (d) linear regression model at QCT = 7.5 μg/mL (red) and QCT = 15 μg/mL (blue), which comprise the test area.
Ijms 20 01725 g008
Figure 9. Percentage of inhibition model of QCT for Hep G2 cell with ZEAR. Surface of % of inhibition obtained using (a) ANN model and (b) linear regression. Cross-sections of (c) ANN-based model and (d) linear regression model at QCT = 7.5 μg/mL (red) and QCT = 15 μg/mL (blue), which comprise the test area.
Figure 9. Percentage of inhibition model of QCT for Hep G2 cell with ZEAR. Surface of % of inhibition obtained using (a) ANN model and (b) linear regression. Cross-sections of (c) ANN-based model and (d) linear regression model at QCT = 7.5 μg/mL (red) and QCT = 15 μg/mL (blue), which comprise the test area.
Ijms 20 01725 g009
Figure 10. Comparison of error in modeling the % of inhibition on the test data using the partial least squares regression (PLS) and the artificial neural network method.
Figure 10. Comparison of error in modeling the % of inhibition on the test data using the partial least squares regression (PLS) and the artificial neural network method.
Ijms 20 01725 g010
Figure 11. Architecture of ANN which was used for the modeling of cell viability and LDH activity. The size of the ANN is 9-10-10-2. Biases of nodes are omitted in this figure.
Figure 11. Architecture of ANN which was used for the modeling of cell viability and LDH activity. The size of the ANN is 9-10-10-2. Biases of nodes are omitted in this figure.
Ijms 20 01725 g011
Figure 12. Error curves for the learning of cell viability and LDH activity on the training and the test set. Root mean square error (rmse) is employed to evaluate the performance and the network is trained for 20,000 epochs or until the rmse reaches 0.001, whichever occurs first. (x-axis is plotted in log scale.)
Figure 12. Error curves for the learning of cell viability and LDH activity on the training and the test set. Root mean square error (rmse) is employed to evaluate the performance and the network is trained for 20,000 epochs or until the rmse reaches 0.001, whichever occurs first. (x-axis is plotted in log scale.)
Ijms 20 01725 g012
Figure 13. Cell viability and LDH activity predicted by the neuro-model on different cell lines pretreated with QCT and post-treated with various MTX: CTN (100 µM), PAT (50 µM), and ZEAR (100 µM). ‘*’ marks the locations of training data whereas ‘o’ marks the location of test data.
Figure 13. Cell viability and LDH activity predicted by the neuro-model on different cell lines pretreated with QCT and post-treated with various MTX: CTN (100 µM), PAT (50 µM), and ZEAR (100 µM). ‘*’ marks the locations of training data whereas ‘o’ marks the location of test data.
Ijms 20 01725 g013
Figure 14. Error in modeling the (a) cell viability and (b) LDH activity on the test data using the artificial neural network.
Figure 14. Error in modeling the (a) cell viability and (b) LDH activity on the test data using the artificial neural network.
Ijms 20 01725 g014
Table 1. Measured % of inhibition for neural network learning.
Table 1. Measured % of inhibition for neural network learning.
Measured % of Inhibition
Types of CellTypes of MTX Dose of MTX (µM)00.781251.56253.1256.2512.52550100200
Dose of QCT (µg/mL)
HeLa [25]CTN0.00.0004.0377.14812.44218.54725.71134.77362.96073.36377.878
5.00.0002.5524.7258.74514.43621.06629.50955.72265.97672.426
10.00.0001.2072.2524.0377.14811.44217.13634.12148.01660.865
20.00.0000.6631.2072.1573.6015.6158.25119.55833.84745.154
PAT0.00.00010.39420.70230.11939.72848.26656.93166.12086.21194.497
5.00.0008.52816.42724.21231.91241.94748.99358.20779.29889.532
10.00.0003.3795.7429.74612.90019.96126.67933.08058.96373.549
20.00.0000.6301.8054.1545.93111.13416.34621.52042.28360.139
ZEAR0.00.0005.74411.02917.03325.50632.59738.32247.30868.44492.675
5.00.0004.7538.25314.07420.55127.41531.96139.87757.77680.446
10.00.0000.4672.2563.9287.27113.85118.19622.50238.72162.941
20.00.0000.3960.8292.1043.4267.43310.56914.42527.22052.217
PC-3CTN0.00.0002.7465.0318.53013.62120.01635.17644.17453.83468.469
5.00.0002.1274.1696.93110.85917.29933.88142.56151.78966.803
10.00.0001.1752.3915.3247.58812.44331.82838.84148.85863.137
20.00.0000.5951.4223.5915.4228.88826.74034.86443.50257.151
PAT0.00.0003.8717.30515.55923.05830.82041.56357.17170.44183.875
5.00.0003.5975.86111.98019.28425.78537.68355.69866.76480.874
10.00.0002.5563.8476.96411.16419.27229.08549.37958.44073.241
20.00.0001.1202.0943.4095.18612.73622.57139.81048.88466.569
ZEAR0.00.0003.3484.7547.98116.76731.56240.52351.77960.05769.167
5.00.0003.0443.9996.09713.23328.49737.27047.88656.61365.615
10.00.0002.1882.7503.9238.59321.89330.61240.49349.28557.291
20.00.0001.8021.9212.1293.30211.10920.82531.89840.54348.546
Hep G2CTN0.00.0000.3572.48011.01017.20924.66832.10841.63652.20467.657
5.00.0000.2782.2938.82414.74021.95229.43538.58249.71765.390
10.00.0000.1351.1605.59611.12317.18123.74331.51642.82259.160
20.00.0000.0220.7772.8476.23611.69418.50925.22935.64553.168
PAT0.00.0002.5715.1998.13716.76325.95537.19843.07053.06269.132
5.00.0001.6953.3275.70711.95223.02434.63940.48050.13267.178
10.00.0000.8791.5353.29510.39619.58231.22636.96046.39463.472
20.00.0000.2500.5651.3046.12216.17526.29631.88040.77956.756
ZEAR0.00.0002.4514.5558.58315.48725.16931.31040.59055.18069.852
5.00.0001.8513.5656.96313.04822.27828.30037.76551.33266.941
10.00.0001.2912.4954.8209.11016.09421.45830.61944.09059.257
20.00.0000.6821.4713.1536.55112.37917.78225.19038.59553.895
SK-N-MCCTN0.00.0005.1499.05415.03024.02033.06044.46054.86070.19089.515
5.00.0004.1167.30312.65820.80129.27341.66052.52167.79786.988
10.00.0002.5544.5788.51414.90423.24235.78844.93659.90677.792
20.00.0001.2562.7025.2809.36316.64127.45935.50649.59863.050
PAT0.00.0003.8307.51213.15722.75939.90952.70669.06978.99389.176
5.00.0003.2156.26411.38520.79336.11449.03964.79374.54285.105
10.00.0002.6804.9639.30817.37031.16344.13059.58168.83779.193
20.00.0001.5853.0996.16212.07721.91531.90848.88858.46464.169
ZEAR0.00.0006.05110.25614.70819.46926.01836.30053.84475.11380.588
5.00.0004.3597.98111.58115.74422.17032.51149.84072.06378.304
10.00.0002.2794.2246.67810.00315.09424.56840.71565.50672.174
20.00.0001.3702.4634.2626.80910.89918.94333.65555.34360.131
MTX: Mycotoxin, QCT: Quercetin, CTN: Citrinin, PAT: Patulin, ZEAR: Zearalenol.
Table 2. Performance comparison of a single hidden layer neural network by varying the number of nodes in the hidden layer.
Table 2. Performance comparison of a single hidden layer neural network by varying the number of nodes in the hidden layer.
No. of Hidden NodesTrain RMSEValidation RMSE
50.03020.0282
70.02470.0278
100.02230.0245
120.02020.0208
150.02140.0198
170.02000.0211
200.01970.0190
220.02030.0194
250.02000.0236
270.01870.0192
300.01880.0190
320.01930.0203
Table 3. Performance comparison of a two hidden layer neural network by varying the number of nodes in the last hidden layer. The first and the second elements of the No. of Hidden Nodes are node numbers of the first and the second hidden layers, respectively.
Table 3. Performance comparison of a two hidden layer neural network by varying the number of nodes in the last hidden layer. The first and the second elements of the No. of Hidden Nodes are node numbers of the first and the second hidden layers, respectively.
No. of Hidden NodesTrain RMSEValidation RMSE
(20, 3)0.01290.0150
(20, 6)0.01100.0173
(20, 9)0.01090.0162
(20, 12)0.01130.0161
(20, 15)0.01060.0147
(20, 18)0.01050.0153
(20, 21)0.01080.0151
Table 4. Performance of the final 9-20-15-1 network on the train and test dataset.
Table 4. Performance of the final 9-20-15-1 network on the train and test dataset.
NetworkTrain RMSETest RMSE
9-20-15-10.01100.0111
Table 5. Performance comparison of a single hidden layer neural network by varying the number of nodes in the hidden layer.
Table 5. Performance comparison of a single hidden layer neural network by varying the number of nodes in the hidden layer.
No. of Hidden NodesTrain RMSEValidation RMSE
50.02530.0597
70.02260.0943
100.01740.0540
120.01750.0737
150.01920.0721
170.01970.0937
200.01000.0545
220.01900.0830
250.01750.0892
270.02050.0852
300.01160.0637
320.01930.0851
Table 6. Performance comparison of a two hidden layer neural network by varying the number of nodes in the last hidden layer. The first and the second elements of the No. of Hidden Nodes are node number of the first and the second hidden layers, respectively.
Table 6. Performance comparison of a two hidden layer neural network by varying the number of nodes in the last hidden layer. The first and the second elements of the No. of Hidden Nodes are node number of the first and the second hidden layers, respectively.
No. of Hidden NodesTrain RMSEValidation RMSE
(10, 2)0.01000.0612
(10,4)0.01000.0450
(10, 6)0.01000.0384
(10, 8)0.01140.0338
(10, 10)0.01000.0337
Table 7. Performance of the final 9-10-10-2 network on the train and test dataset.
Table 7. Performance of the final 9-10-10-2 network on the train and test dataset.
NetworkTrain RMSETest RMSE
9-10-10-20.00520.0364

Share and Cite

MDPI and ACS Style

Yang, C.; Bahar, E.; Adhikari, S.P.; Kim, S.-J.; Kim, H.; Yoon, H. Precise Modeling of the Protective Effects of Quercetin against Mycotoxin via System Identification with Neural Networks. Int. J. Mol. Sci. 2019, 20, 1725. https://doi.org/10.3390/ijms20071725

AMA Style

Yang C, Bahar E, Adhikari SP, Kim S-J, Kim H, Yoon H. Precise Modeling of the Protective Effects of Quercetin against Mycotoxin via System Identification with Neural Networks. International Journal of Molecular Sciences. 2019; 20(7):1725. https://doi.org/10.3390/ijms20071725

Chicago/Turabian Style

Yang, Changju, Entaz Bahar, Shyam Prasad Adhikari, Seo-Jeong Kim, Hyongsuk Kim, and Hyonok Yoon. 2019. "Precise Modeling of the Protective Effects of Quercetin against Mycotoxin via System Identification with Neural Networks" International Journal of Molecular Sciences 20, no. 7: 1725. https://doi.org/10.3390/ijms20071725

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop