Open Access This article is
- freely available
Molecules 2017, 22(12), 2079; doi:10.3390/molecules22122079
Identification of DNA–protein Binding Sites through Multi-Scale Local Average Blocks on Sequence Information
School of Computer Science and Technology, Tianjin University, Tianjin 300350, China
Tianjin University Institute of Computational Biology, Tianjin University, Tianjin 300350, China
School of Chemical Engineering and Technology, Tianjin University, Tianjin 300350, China
Department of Computer Science and Engineering, University of South Carolina, Columbia, SC 29208, USA
Authors to whom correspondence should be addressed.
Received: 31 October 2017 / Accepted: 24 November 2017 / Published: 28 November 2017
DNA–protein interactions appear as pivotal roles in diverse biological procedures and are paramount for cell metabolism, while identifying them with computational means is a kind of prudent scenario in depleting in vitro and in vivo experimental charging. A variety of state-of-the-art investigations have been elucidated to improve the accuracy of the DNA–protein binding sites prediction. Nevertheless, structure-based approaches are limited under the condition without 3D information, and the predictive validity is still refinable. In this essay, we address a kind of competitive method called Multi-scale Local Average Blocks (MLAB) algorithm to solve this issue. Different from structure-based routes, MLAB exploits a strategy that not only extracts local evolutionary information from primary sequences, but also using predicts solvent accessibility. Moreover, the construction about predictors of DNA–protein binding sites wields an ensemble weighted sparse representation model with random under-sampling. To evaluate the performance of MLAB, we conduct comprehensive experiments of DNA–protein binding sites prediction. MLAB gives of , , and on PDNA-543, PDNA-41, PDNA-316 and PDNA-52 datasets, respectively. It shows that MLAB gains advantages by comparing with other outstanding methods. for our method is increased by at least , and on PDNA-543, PDNA-41 and PDNA-316 datasets, respectively.
Keywords:DNA–protein binding sites; ensemble classifier; feature extraction; random sub-sampling; sparse representation model
DNA–protein interactions exert a crucial influence on diverse biological processes and is primal for cell metabolism. Contemporary researchers have scrutinized a considerable number of DNA and protein sequences including DNA-binding proteins. In addition, there is no lack of time-consumption in silico methods. Furthermore, the experimental determination of binding sites is always difficult and is not readily feasible all the time. Therefore, forecasting by statistical learning, which had been riveted by a lot of academics conducting surveys on DNA–protein binding sites, established in the field of computational and molecular biology, should be taken for granted. Several computational methods, which had been developed to identify DNA-binding sites in proteins, were generally based on protein sequence, protein structure or through integrating the aforementioned information. Most of these investigations are the methods that depended on machine learning techniques.
The concomitant information of sequence-based tactics [1,2] usually comprises physical and chemical properties of amino acids, evolutionary and other sequence information, such as BindN , BindN Random Forest (BindN-RF) , BindN+ , DNABindR , DNA Binding Sites Prediction (DBS-PRED) , DNA Binding Sites based on Position Specific Scoring Matrix (DBS-PSSM) , ProteDNA , DNA Protein-Binding (DP-Bind) , DNA Interaction Sites Identified from Sequence (DISIS) , Meta DNA Binding Site (MetaDBSite) , TargetDNA , etc.
Concretely, Wang et al.  take an amino acid sequence as input and extrapolate potential DNA or RNA-binding residues with Support Vector Machine (SVM). While the SVM model is constructed with encoded instances, which come from features w.r.t. three sequences. Specifically, the features are including side chain pKa value, hydrophobicity index and molecular mass of an amino acid. Wang et al. engage in knitting another craft  that feed the above information plus evolutionary information into Random Forest (RF) to realize Machine Learning (ML). We need to make another small point that the evolutionary information is represented by Position Specific Scoring Matrix (PSSM). Yan et al.  used Relative Solvent Accessible Surface area (RASA), sequence entropy, electrostatic potential and hydrophobicity as an input of Naive Bayes classifier (NB) to forecast binding sites. Ahmad et al.  create an Artificial Neural Networks (ANNs)-based algorithm and apply PSSM of amino acid sequences to predict DNA-binding sites. Cui et al.  handcraft a sequence based predictor, which was named ProteDNA, in order to taxonomize the residues in a Transcription Factor (TF) that implicates sequence-specific binding with DNA. The category of input feature originating from PSSM also contains a method that comes from Hwang et al. . They conceive three kinds of ML methods including SVM, kernel logistic regression and penalized logistic regression to implement the prediction about binding sites. Ofran et al.  combine physicochemical features of sequence, PSSM, predicted secondary structure and Predicted Solvent Accessibility (PSA) to train a SVM model for predicting binding sites. Si et al.  consolidate the prediction results from six available online web servers: DISIS , DNABindR , BindN , BindN-RF , DP-Bind  and DBS-PRED , which only employ sequence information of proteins. Hu et al.  deploy PSSM and PSA to build a multiple SVMs model with weighted features. Georgiou et al.  use metric spaces and fuzzy sets to study entropy/clarity of genetic sequences. Buenrostro et al.  raise ATAC-seq to identify regions of open chromatin.
Structure-based knacks as a kind of classical methods usually apply structural motifs , secondary structure [17,18], Accessible Surface Area (ASA)  and Depth Index (DPX)  in DNA-binding residues identification. While several other kinds of methods collocate sequences with structure information to refine the performance of prediction . Components like PSSM, ASA and Protein Backbone Structure(PBS) [22,23] are salient for the erection of forecasting model in these studies [19,24]. SVM , RF , ANNs or Bayesian Network (BN), clustering, network feature, PCVM  and Deep Learning  also play an imperative role in constructing the prognostic paradigm about DNA-binding residues identification [29,30] and speculation of other kind of bioinformatics data classification such as drug target interactions [31,32], protein–protein interactions [33,34], RNA-disease association , protein modification sites , DNA motif elucidation  and other related themes in computational biology [38,39,40].
No matter whether they are structure-based or methods of hybrid category, their prediction accuracies are generally superior to sequence-based tactics, which resulted in part from structure-based features that reflect DNA-binding or non-binding residues in a spatial point of view rather than sequence-based features. However, it must be satisfied that both the sequence of a given target protein and 3D structures are sufficiently available. Consequently, sequence-based computational techniques for the forecast about DNA-binding sites are more efficacious under practical conditions.
In this paper, a kind of sequence-based approach with ML is depicted. Conspicuously, PSSM information of protein sequence plays an important role in predicting DNA–protein binding sites according to the state-of-the-art investigations. Hence, we use PSSM information as the primary feature. The major difference between DNA-binding and non-DNA-binding proteins is that the functional binding sites are occurring in the former, whereas they are absent at the corresponding local regions of protein space in the latter. Moreover, protein functions incline to be evolutionarily conserved in these local regions. As a result, it requires that classifiers need to capture the hints of local functional conservation as fully as possible. Based on this leitmotiv, we devise an algorithm that is called Multi-scale Local Average Blocks (MLAB) to further extract local information from PSSM. The PSA information is also utilized to ameliorate the accuracy of prediction. Due to the number of DNA-binding residues (minority class) being significantly lower than that of non-binding residues (majority class), sample rescaling as straightforward strategy is adopted to deal with the issue of imbalanced data classification. To further handle the imbalanced problem, we employ an Ensemble Classifier with Random Under-Sampling (EC-RUS). Individual predictors of ensemble classifiers are realized by means of Weighted Sparse Representation based Classifier (WSRC). To evaluate the performance of our method, it has been validated through PDNA-543, PDNA-41, PDNA-316, PDNA-335 and PDNA-52 datasets. Our approach achieves of , , and on PDNA-543, PDNA-41, PDNA-316 and PDNA-52, respectively. Experiments show that our method achieves better results than other outstanding methods. Compared with existing implementations, for our algorithm are increased by at least , and on PDNA-543, PDNA-41 and PDNA-316, respectively.
2. Materials and Methods
For the sake of delving DNA–protein binding residues with computational methods, one of the major challenges is to fully describe the salient points of knowledge about DNA–protein binding sites in an adequate and concise way. Prediction of DNA–protein binding residues could be regarded as a traditional binary classification problem from the view of machine learning. Therefore, how to effectively extract feature from protein sequences turns out to be the preoccupation. Since the binding residue is not isolated from each other, we have the convention that 11 vicinal amino acid residues as a window (), where the window specifically indicates the target residue and 5 neighbors on either side of the target residue itself. In light of this definition, an idiosyncratic multi-dimensional coding vector can be listed seriatim, which derives from the two aforementioned attributes of evolutionary conservation and predicted relative solvent accessibility. With the above information, the ML scenario is applied to build a prediction model about identifying DNA–protein binding sites.
2.1. Feature Extraction via Position Specific Scoring Matrix
By referring to the the form of Position Specific Scoring Matrix (), evolutionary conservation of protein sequence could be abstracted and generated by the de facto tool PSI-BLAST  (BLAST+  options: -num_iterations 3 -db nr -inclusion_ethresh ). The evolutionary information from is stored in a matrix of dimensions (L rows and 20 columns), formulated aswhile each element in is calculated aswhere is the frequency of k-th amino acid type at the position i; is the value of about the element in Dayhoff’s mutation matrix (substitution matrix), which corresponds to the amino acids between k-th and j-th type. The substitution matrix, which usually is wielded in DNA or protein sequence alignment, can describe the rate that certain kinds of characters in a protein sequence change to some other kind of character with time elapsing. As a supplementary, small values indicate that there is less conservatism in the corresponding areas, whereas large values indicate quite conservative zones.
These values are normalized to 0–1 range with min-max normalization. The original (see Equation(1)) is normalized aswhere represents the original score of . While the normalized () is represented as
To distinguish DNA-binding and non-DNA-binding proteins, we need to justify the functional binding sites whether they occur at the corresponding local regions of protein space. As a further step of parenthetical explanation, protein functions in these local regions are inclined to be evolutionarily conserved. Considering this, we conceive an algorithm called Multi-scale Local Average Blocks (MLAB), which is enlightened by the Average Blocks (AB) approach that was proposed by Jeong et al. . In virtue of extracting local information from normalized , Jeong et al. forecast protein function through ways that divide a protein sequence into b blocks and need not care much about the length of sequence. This idea has also been adopted in other bioinformatical issues . On the occasion of this paper, each block consists of 20 features which are derived from 20 columns in . Similar to that, we formalize the value of attributes with a target by means of a window with 11 residues, and then obtain a vector of normalized scores whose gross amount is . However, it is quite imperative that, different from the AB algorithm, fixed size is changed into multi-scale size in our scheme; thus, the matrix is split in a horizontal manner. The PSSM-based Multi-scale Local Average Blocks (PSSM-MLAB) features can describe the relationship between target residue and neighboring residues in different resolutions.
More specifically, we partition the normalized of the target residues into six segmentations with varying composition, including global zone (A), bisection (B and C) and trichotomy (D, E and F). These segments can adequately portray multiple overlapping continuous and discontinuous interaction patterns that are schematically shown in Figure 1. The mean value of each local block is calculated with the formula aswhere regards the mean value of k-th block in the column j; stands for the amount of rows in block k; and represents the value of cell in i-th row and j-th column of block k. Recapitulating the MLAB algorithm, through combining with normalized and partitioning manipulation on an entire sequence, we can gain a dimensional feature vector.
2.2. Predicted Solvent Accessibility
Solvent accessibility has profound significance because it is closely affiliated with not only the spatial assignment of configuration, but also the swathing attitude about residues during the process of protein folding. It also coincides with the fact that there is a non-negligible association between solvent accessibility and DNA–protein interactions. The post hoc actuality has been instantiated, such as research by Ahmad et al. , who has demonstrated the importance of solvent accessibility to amino acid residues in predicting DNA–protein binding. By uniting the Solvent Accessibility prediction, which has been implemented with the de facto tool Nearest Neighbor method (SANN) , we can obtain the Predicted Solvent Accessibility (PSA) characteristics of each residue for the corresponding sequence. With min-max normalization, the PSA feature can also be normalized among a range from zero to one.
2.3. Weighted Sparse Representation Based Classifier
Sparse representation  as a sharp weapon of compressed sensing has aroused lots of scholarly pursuit for several years. Sparse representation-based classifier(SRC) [48,49] was firstly proposed by Wright et al. for the purpose about image recognition. In contrast to conventional taxonomization approaches such as SVM, KNN, RF, etc., SRC is robust for both outliers and noisy situations. To discriminate the sample corpus, which needs to be verified, SRC demands to create a Sparse Representation Matrix (SRM) and makes a linear combination on the training set. The reconstructed residuals of test sample for each kind of classification are measured and calculated through SRM and linear combination. Ultimately, the corpus of samples will be assigned to the corresponding category, arbitrated by minimum reconstruction residual. A group of researchers [50,51] have deployed SRC in solving issues in the area of computational biology.
Suppose there are totally C kind of classifications involved in a sufficient dataset. The assignment is how to correctly determine the attribution of a newly added sample when we put it into the original corpus. SRC picks training samples from the c-th classification, which correspond to the volume of each raw in . can be expressed aswhere is the aggregate feature volume with regard to one sample. Thus, the training sample matrix can be written aswhere represents the amount of training samples. Then, the known test sample will approximately fall in the linear spanning region of the training samples associated with the c-th classification as
While under unknown c condition, test sample will be in line with the representation of whole training set using linear regression aswhere coefficient vector is ; vector which is associated with the c-th classification is non-zero.
could take on a kind of sparse state, whereas the size of sample about corresponding classification is huge. The critical step of SRC algorithm is selecting the vector that can both satisfy Equation (9) and minimize the -norm per se with the equations as
Unfortunately, searching the sparsest solution for equations (10) is NP (Non-deterministic Polynomial)-hard. Still, as a remedy, by means of solving -minimization problem which belongs to convex optimization, we can eschew the -minimization problem since -minimization problem can be viewed as problem that is approximately equivalent to -minimization. For the sake of resolving this occasion in , Equation (10) can be transformed into an expression aswhere reflects the tolerance of reconstruction deviation.
The SRC approach allocates the label of test pattern y w.r.t. category c according to equationswhere denotes the residuals between y and (category c). Thus, means sample y will be assigned to the category that owns minimal residuals.
To fix the problem about instability of SRC which may be aroused by noise pollution, Lu et al.  have proposed the Weighted Sparse Representation based Classification (WSRC) method, which deals with the whole training set as a vocabulary, and imposes the locality on the weighted regularization.where is a diagonal matrix about locality adaptor as
Moreover, denotes to the Euclidean distance from to , which is expressed aswhere i indicates the sample index of training set w.r.t. category c. corresponds to the Gaussian kernel width. , represents test sample and training sample, respectively. In addition, the values of Gaussian distance can be viewed as the weight of each sample in training sets.
Nevertheless, the output of WSRC just meets a straightforward preliminary mapping that each residual corresponds to a certain kind of classification (without prediction score w.r.t. each category), since there is a greater possibility for the minimum residue of the corresponding category. For the convenience of projecting the output about WSRC between , there are three types of scores for binding sites prediction, which are represented aswhere and are the deviation of reconstruction about WSRC when assigning test sample w.r.t. binding and non-binding site, respectively. The assessment about the performance with the aforementioned three types of score is shown in the experimental evaluation section. In practice from our research, and .
The accomplishment of feature extraction implies that no matter the target residue binding sites or non-binding sites, all of them have been converted to numerical feature vectors that have their own identical dimension. The feature space for every target residue binding site is comprised of two parts that are PSSM-MLAB features () and PSA features (), respectively. It needs to be reaffirmed that all of the feature vectors have been normalized by means of min-max normalization.
2.4. Ensemble Classifier and Random Under-Sampling
Imbalanced datasets, which are characterized as a larger ratio size between non-binding examples (majority category) and binding examples (minority category), always exist in the issue of classification. Exploiting a schema with ensemble classifier [53,54] is a fashionable way. Consequently, we exploit an ensemble of m classifiers with bootstrap resampling strategy [53,54]. By performing random sampling on m subsets, which also be considered with replacement, from the majority category of non-binding examples, we can make all negative subsets own the same or similar size as the minority category of binding examples. After this step, every negative subset will group with the set of binding cases and generate m new training sets. Thus, m classifiers, which are represented as , can be built according to the m training sets. Finally, the outcome is voted by arithmetic mean value of the results that come from m sub-classifiers. After calculating about every score as , we can get the final rate of voting bywhere also denotes the probabilistic factor of test sample y, and reflects the probability value of i-th base classifier.
The overview of the proposed ensemble model is shown in Figure 2, Ensemble Classifier with Random Under-Sampling (EC-RUS) as the scenario to deal with the imbalanced issue.
We test our method on several DNA–protein binding sites datasets to evaluate the performance of our proposed approach, including PDNA-543, PDNA-41 (independent test set of PDNA-543), PDNA-335, PDNA-52 (independent test set of PDNA-335) and PDNA-316. First, we independently analyze the performance of binding site representations, such as PSSM, PSSM-MLAB and PSA. Second, we compare our method with some outstanding methods on the above datasets.
3.1. Datasets of DNA–Protein Binding Sites
PDNA-543 and PDNA-41 are independent test datasets that have been constructed by Hu et al. . They collect a dataset that contains DNA-binding protein chains and has clear target annotations in PDB (Protein Data Bank) . After removing redundant sequences by wielding CD-hit software , there are totally 584 non-redundant protein sequences that can be obtained and no two sequences had more than identity. Then, they divide the non-redundant sequences into two sections, which are the training dataset (PDNA-543) and the independent test dataset (PDNA-41).
PDNA-335 and PDNA-52 are independent test datasets that have been employed by Yu et al. . In their research, all of the protein sequences are extracted, which are based on BioLip  rather than on PDB . Next, the maximal pairwise sequential identity of the extracted protein sequences are culled to a 40 percent level by using PISCES software (1.0, Wang, G. and Roland, L. Dunbrack Jr, Philadelphia, PA, USA) . The remaining sequences constitute the training dataset. Besides that, the test set is extracted in a similar process. Moreover, if a given sequence in the validation dataset shares more than 40 percent similarity to a sequence in the training dataset, then remove the sequence from the validation dataset. Training set and independent validation test sets contain 335 and 52 protein sequences, respectively.
PDNA-316 is constructed by Si et al. . The dataset embraces 316 DNA-binding protein chains, 5609 binding sites and non-binding sites. The detailed information of PDNA-543, PDNA-41, PDNA-335, PDNA-52 and PDNA-316 is summarized in Table 1. Related datasets, codes, and figures of our algorithm are available https://github.com/6gbluewind/PRODNA.
3.2. Evaluation Measurements
To test the robustness, the process of random selection about training and test sets, model-building and model-evaluating are performed repeatedly, which deals with the manner of ten-fold cross validation. Seven parameters, including overall prediction accuracy (), sensitivity (), specificity (), positive predictive value (), and Matthew’s correlation coefficient () are used in the assessing procedure. These parameters are represented aswhere true positive () is the number of true DNA–protein binding sites that are predicted correctly; false negative () is the number of true DNA–protein binding sites that are predicted to be non-binding; false positive () is the number of true non-binding sites that are predicted to be binding sites, and true negative () is the number of true non-binding sites that are predicted correctly.
The Area Under the Receiver Operating Characteristic () is a common summary statistic that can measure the goodness of a predictor in a binary classification task. It is equal to the probability that a predictor will rank a randomly chosen positive instance higher than a randomly chosen negative one. We would like to emphasize that two WSRC parameters are set to and , respectively.
3.3. Predicted Results on the PDNA-543 Dataset
3.3.1. Selecting Optimal Size of Sliding Window and Number of Base Classifiers
Different sizes of sliding window may lead to different performance. In addition, the number of base classifiers will also affect the appearance of prediction. In Hu’s work , they use two strategies for selecting Thresholds (T): (1) they selected the threshold that makes , and (2) they select the threshold that makes ( ). In virtue of that, we adjust window size from 7 to 17 residues and number of base classifiers (m) from 1 to 29, with a step size of 2, on PDNA-543 dataset over a ten-fold cross-validation with above two strategies. Hitherto, we select Equation (16) as default score function of base classifiers (WSRC, Equation (16)).
We select the optimal size by highest value, and find that 11 and 19 are the best parameters of window size, whereas number of base classifiers under . Under the condition that , the value of is also high (w = 11, m = 19). The result w.r.t. PDNA-543 is shown in Figure 3. As seen from the dotted curves, the increases when size increases from 7 to 11. However, it slightly declines when size increases from 11 up to 17. The first maximum value is achieved when (under ), and no improvement can be observed with larger values of m. Recapitulating these results, we set the optimal m as 19 in the investigation. The best is , when window size and number of base classifiers are 11 residues and 19 with under , respectively.
3.3.2. Performance of Different Features
To analyze the performance of PSSM, PSSM-MLAB and PSA features, we evaluate these features by EC-RUS on PDNA-543 dateset. Results for PSSM, PSSM + PSA, PSSM-MLAB and PSSM-MLAB + PSA are shown in Table 2 and Figure 4. In addition, Equation (16) is also selected as default score function of base classifiers (WSRC, Equation (16)). The (under ) of PSSM, PSSM + PSA, PSSM-MLAB and PSSM-MLAB + PSA are , , and , respectively. Obviously, the combinatorial approach of PSSM-MLAB + PSA achieves better performance than PSSM, PSSM + PSA or PSSM-MLAB. Furthermore, the of PSSM-MLAB () is higher than PSSM () and PSSM + PSA (). Consequently, the MLAB algorithm can reduce the dimension of PSSM and remove some noise. Because of additional solvent accessibility information, the (under ) of PSSM-MLAB + PSA () and PSSM + PSA () are all higher than single PSSM-MLAB () and single PSSM (), respectively. In Figure 4, we can see that the fusion feature of PSSM-MLAB and PSA has better performance than the other features in the PDNA-543 dataset.
3.3.3. Selecting Optimal Score Function of Base WSRC
In order to make a decision w.r.t. score function (WSRC) from Equations (16)–(18), we evaluate the above functions on PDNA-543 across a ten-fold cross-validation test with PSSM-MLAB + PSA as feature. The results of different functions on PDNA-543 are shown in Figure 5. Obviously, the performance of three different score functions are almost identical. However, the type 1 (, under ) function achieves better performance of than type 2 (, under ) and 3 (, under ). Thus, we select the Equation (16) as the score function of WSRC.
3.3.4. Comparison with Existing Predictors on PDNA-543
We also compare the prediction performance of our proposed method with Hu’s work  on this dataset, as shown in Table 3. Our method achieves under . However, Hu’s work achieves under . Moreover, our method achieves the best of under . Our method obtains better prediction results than Hu’s work on the PDNA-543 dataset.
3.4. Predicted Results on the Independent Test Set of PDNA-41
In this section, we use the PDNA-543 dataset as the training set and PDNA-41 as the independent test set. It has been compared with other previous works including BindN , ProteDNA , BindN+ , MetaDBSite , DP-Bind , DNABind  and TargetDNA  with summarizing results in Table 4. Under , our method (EC-RUS built with WSRC) achieves accuracy, sensitivity, and . Comparing with , sensitivity declines (), specificity, accuracy, and rise together (, , and , respectively). Furthermore, our method achieves the best () under . Figure 6 shows the trend (including sensitivity, specificity, accuracy, and ) on different threshold T of probability. While the threshold of probability rises, values of specificity, accuracy, and are synchronously rising. The trend of sensitivity and rate p/n are opposite.
In addition, we test different types of base classifiers to build an EC-RUS model. The base classifiers together contain SVM [25,61], RF , L1-regularized Logistic Regression (L1-LR)  and Sparse Bayesian Learning (SBL) . Under , EC-RUS (SVM), EC-RUS (RF), EC-RUS (L1-LR) and EC-RUS (SBL) achieve of , , and , respectively. The () EC-RUS (WSRC) is better than the above models. We can see that a sparse representation based classifier is suitable for the classification with PSSM-MLAB features. The best performance lies in the fact that weighted SRC further improves the performance of basic SRC and the easily adjusted parameter of WSRC can exert its effect fully in our experiments.
3.5. Predicted Results on the PDNA-316 Dataset
In order to highlight the advantage of our method, we also test on the PDNA-316 dataset, which is described by Si et al. . We compare the prediction performance of our proposed method with other previous works including DBS-PRED , BindN , DNABindR , DISIS , DP-Bind , BindN-RF , MetaDBSite  and TargetDNA . In Table 5, we can see that the average prediction performance of our method, such as sensitivity, specificity, accuracy and are , , and under , respectively. Although DISIS  achieves better values of specificity and , and , which are , , the sensitivity () and () are not high. Furthermore, our method (EC-RUS built with WSRC) achieves the best of under . It is shown that the MLAB algorithm deeply extracts the evolutional information from PSSM.
Different types of base classifiers are used to construct the EC-RUS model, and EC-RUS (SVM), EC-RUS (RF), EC-RUS (L1-LR) and EC-RUS (SBL) achieve (under ) of , , and , respectively. Extensive experiments in our study have illustrated that WSRC is better than other classifiers.
3.6. Predicted Results on PDNA-335 and PDNA-52 Datasets
PDNA-335 and PDNA-52 (independent test set of PDNA-335) are collected by Yu et al. . To further evaluate our model, we employ the PDNA-335 dataset as the training set and PDNA-52 as the independent test set. Performance comparison about our method with TargetS , MetaDBSite , DNABR , and alignment-based predictor on the independent validation dataset of PDNA-52 is listed in Table 6. At the occasion of imbalanced learning, the provides the overall measurement about the quality of binary prediction. In Yu’s work , they implement the evaluation by choosing the Threshold (T) of probability value, in order to maximize the value of prediction. Thus, we apply the same evaluation on PDNA-52. Obviously, TargetS achieves the best overall prediction performance among the nine listed predictors with the highest value of , which is about higher than that of the second-best () performer model (EC-RUS built with WSRC). The proposed method along with TargetS does not perform well on an independent PDNA-52 dataset because TargetS has equipped the residues’ 3D coordinates contained in the PDB file to spatial clustering before it probes binding sites. Results of experiments show that our model is also compatible by comparing with the rest of the methods on an independent PDNA-52 dataset.
The trends (including sensitivity, specificity, accuracy, and ) on different threshold T of probability are shown in Figure 7. EC-RUS (WSRC) achieves the highest of when .
3.7. Significance Analysis
We employ the Wilcoxon rank-sum test to analyze the statistical significance of between other methods (including MetaDBSite and TargetDNA) and our method on PDNA-543, PDNA-41, PDNA-316 and PDNA-52 datasets. The significance level is , and results of tests are shown in Table 7. The differences between other methods and our method are not significant (MetaDBSite p-value : , TargetDNA p-value : ). The main reason of this is that most of the above methods are based on sequence information. Hence, the increment of MCC is small. We would consider structure information in our further work.
3.8. Case of Prediction
Examples of 4X0PD (PDB ID: 4X0P, Chain: D) and 5BMZCD (PDB ID: 5BMZ, Chain: C and D) belong to the PDNA-41 dataset. We use the PDNA-543 dataset as the training set to predict two examples, which are shown in Figure 8. The orange object of the helix is a DNA chain, while the green object is the protein sequence (containing helix, fold and loop structure). Blue regions and red regions are the true prediction and false prediction, respectively. In addition, the results of two methods (our method and DP-Bind ) are shown in Table 8. On the 4X0P-D, the of our method (34) is less than DP-Bind (154). Furthermore, the and of our method (9, 3) are both less than DP-Bind (16, 7) on 5BMZ-D.
3.9. Running Time
The computational complexity and running time of WSRC depend on the number of training and testing samples. The Gaussian distances of testing and each training sample are calculated by the WSRC. The running time of other classifiers only depend on the number of training sets. The sizes of PDNA-543 (Training sets) and PDNA-41 (Testing sets) are 144,544 and 14,755, respectively. The PDNA-335 (Training sets) and PDNA-52 (Test sets) contain 77,781 and 17,198 samples, respectively. Although the WSRC is time-consuming, the performance is better than other classifiers on PDNA-41 and PDNA-52. The running times are listed in Table 9.
Albeit many computational approaches have been proposed to prospect DNA–protein binding sites, there still have potential enhancing space for refining the state-of-the-art prediction models. Existing methods always disregard local environments that appear neither reliable nor robust. Hence, we put forward a kind of multi-scale local average blocks idea to further leach local evolutionary information from PSSM. Compared with original PSSM, the of PSSM-MLAB rises by in a PDNA-543 dataset.
Our algorithm has been extensively validated on several datasets including PDNA-543, PDNA-41, PDNA-316, PDNA-335 and PDNA-52 datasets. Our method achieves of , , and on PDNA-543, PDNA-41, PDNA-316 and PDNA-52 datasets, respectively. Contrasted with the state-of-the-art prediction models, (under ) for our method is increased by at least , and on PDNA-543, PDNA-41 and PDNA-316 datasets, respectively. Our method has reached a desired performance that achieves comparable or even better prediction results across possessive datasets. Besides that, our method could be a de facto instrument for future proteomics studies.
In the future, we will ameliorate the forecasting performance of MLAB by refining the feature representation and classification tactics. For feature representation, we will consider the amino acid compositions and predicted secondary structures, which have been obtained as local PSSM-based features. Furthermore, well-established classifier also can be an alternative condition. Powerful classifiers such as Modified AdaBoost(MAdaBoost)  and LibD3C [65,66] can all be integrated into the clustering and dynamic selecting schema.
This research and this article’s publication expenditures are supported by a grant from the National Science Foundation of China (NSFC 61772362), the Peiyang Scholar Program of Tianjin University (no. 2016XRG-0009), and the Tianjin Research Program of Application Foundation and Advanced Technology (16JCQNJC00200).
C.S., Y.D. and F.G. conceived the study. C.S. and Y.D. performed the experiments and analyzed the data. C.S., Y.D. and F.G. drafted the manuscript. All authors read and approved the manuscript.
Conflicts of Interest
The authors declare that they have no competing interests.
- Si, J.; Zhao, R.; Wu, R. An Overview of the Prediction of Protein DNA-Binding Sites. Int. J. Mol. Sci. 2015, 16, 5194–5215. [Google Scholar] [CrossRef] [PubMed]
- Miao, Z.; Westhof, E. A Large-Scale Assessment of Nucleic Acids Binding Site Prediction Programs. PLoS Comput. Biol. 2015, 11, e1004639. [Google Scholar] [CrossRef] [PubMed]
- Wang, L.; Brown, S.J. BindN: A web-based tool for efficient prediction of DNA and RNA binding sites in amino acid sequences. Nucleic Acid Res. 2006, 34, 243–248. [Google Scholar] [CrossRef] [PubMed]
- Wang, L.; Yang, M.Q.; Yang, J.Y. Prediction of DNA-binding residues from protein sequence information using random forests. BMC Genom. 2009, 10, 961–964. [Google Scholar] [CrossRef] [PubMed]
- Wang, L.; Huang, C.; Yang, M.Q.; Yang, J.Y. BindN+ for accurate prediction of DNA and RNA-binding residues from protein sequence features. BMC Syst. Biol. 2010, 4, 1–9. [Google Scholar] [CrossRef] [PubMed]
- Yan, C.; Terribilini, M.; Wu, F.; Jernigan, R.L.; Dobbs, D.; Honavar, V. Predicting DNA-binding sites of proteins from amino acid sequence. BMC Bioinform. 2006, 7, 1–10. [Google Scholar] [CrossRef] [PubMed]
- Ahmad, S.; Gromiha, M.M.; Sarai, A. Analysis and prediction of DNA-binding proteins and their binding residues based on composition, sequence and structural information. Bioinformatics 2004, 20, 477–486. [Google Scholar] [CrossRef] [PubMed]
- Ahmad, S.; Sarai, A. PSSM-based prediction of DNA binding sites in proteins. BMC Bioinform. 2005, 6, 33–38. [Google Scholar] [CrossRef] [PubMed]
- Chu, W.-Y.; Huang, Y.-F.; Huang, C.-C.; Cheng, Y.-S.; Huang, C.-K.; Oyang, Y.-J. ProteDNA: A sequence-based predictor of sequence-specific DNA-binding residues in transcription factors. Nucleic Acid Res. 2009, 37, 396–401. [Google Scholar] [CrossRef] [PubMed]
- Hwang, S.; Gou, Z.K.; Kuznetsov, I.B. DP-Bind: A web server for sequence-based prediction of DNA-binding residues in DNA-binding proteins. Bioinformatics 2007, 23, 634–636. [Google Scholar] [CrossRef] [PubMed]
- Ofran, Y.; Mysore, V.; Rost, B. Prediction of dna-binding residues from sequence. Bioinformatics 2007, 23, i347–i353. [Google Scholar] [CrossRef] [PubMed]
- Si, J.; Zhang, Z.; Lin, B.; Huang, B. MetaDBSite: A meta approach to improve protein DNA-binding sites prediction. BMC Syst. Biol. 2011, 5, S7. [Google Scholar] [CrossRef] [PubMed]
- Hu, J.; Li, Y.; Zhang, M.; Yang, X.; Shen, H.B.; Yu, D.J. Predicting Protein-DNA Binding Residues by Weightedly Combining Sequence-based Features and Boosting Multiple SVMs. IEEE/ACM Trans. Comput. Biol. Bioinform. 2016, 99, 1–11. [Google Scholar] [CrossRef] [PubMed]
- Georgiou, D.N.; Karakasidis, T.E.; Nieto, J.J.; Torres, A. A study of entropy/clarity of genetic sequences using metric spaces and fuzzy sets. J. Theor. Biol. 2010, 267, 95–105. [Google Scholar] [CrossRef] [PubMed]
- Buenrostro, J.D.; Giresi, P.G.; Zaba, L.C. Transposition of native chromatin for fast and sensitive epigenomic profiling of open chromatin, DNA-binding proteins and nucleosome position. Nat. Methods 2013, 10, 1213–1218. [Google Scholar] [CrossRef] [PubMed]
- Shanahan, H.P.; Garcia, M.A.; Jones, S.; Thornton, J.M. Identifying DNA-binding proteins using structural motifs and the electrostatic potential. Nucleic Acid Res. 2004, 32, 4732–4741. [Google Scholar] [CrossRef] [PubMed]
- Gao, M.; Skolnick, J. DBD-Hunter: A knowledge-based method for the prediction of DNA-protein interactions. Nucleic Acid. Res. 2008, 36, 3978–3992. [Google Scholar] [CrossRef] [PubMed]
- Wong, K.C.; Yue, L.; Peng, C.B.; Moses, A.M.; Zhang, Z.L. Computational Learning on Specificity-Determining Residue-Nucleotide Interactions. Nucleic Acid Res. 2015, 43, 10180–10189. [Google Scholar] [CrossRef] [PubMed]
- Wang, D.D.; Li, T.H.; Sun, J.M.; Li, D.P.; Xiong, W.W.; Wang, W.Y.; Tang, S.N. Shape string: A new feature for prediction of DNA-binding residues. Biochimie 2013, 95, 354–358. [Google Scholar] [CrossRef] [PubMed]
- Li, B.Q.; Feng, K.Y.; Ding, J.; Cai, Y.D. Predicting DNA-binding sites of proteins based on sequential and 3D structural information. Mol. Genet. Genom. 2014, 289, 489–499. [Google Scholar] [CrossRef] [PubMed]
- Yang, X.; Song, N.Y.; Yan, H. Chapter 2: Identification of Genes and their Regulatory Regions Based on Multiple Physical and Structural Properties of a DNA Sequence. Biol. Data Min. Appl. Healthc. 2014, 33–65. [Google Scholar]
- Ison, R.E.; Hovmoller, S.; Kretsinger, R.H. Predicting DNA-binding sites of proteins based on sequential and 3D structural information. IEEE Eng. Med. Biol. Mag. 2005, 24, 41–49. [Google Scholar] [CrossRef] [PubMed]
- Sun, J.; Tang, S.; Xiong, W.; Cong, P.; Li, T. DSP: A protein shape string and its profile prediction server. Nucleic Acid Res. 2012, 40, 298–302. [Google Scholar] [CrossRef] [PubMed]
- Li, T.; Li, Q.Z.; Liu, S.; Fan, G.; Zuo, Y.C.; Peng, Y. PreDNA: Accurate prediction of DNA-binding sites in proteins by integrating sequence and geometric structure information. Bioinformatics 2013, 29, 678–685. [Google Scholar] [CrossRef] [PubMed]
- Cortes, C.; Vapnik, V. Support-vector networks. Mach. Learn. 1995, 20, 273–297. [Google Scholar] [CrossRef]
- Breiman, L. Random Forests. Mach. Learn. 2001, 45, 5–32. [Google Scholar] [CrossRef]
- Wang, Y.B.; You, Z.H.; Li, X.; Chen, X.; Jiang, T.H.; Zhang, J.T. PCVMZM: Using the Probabilistic Classification Vector Machines Model Combined with a Zernike Moments Descriptor to Predict Protein-Protein Interactions from Protein Sequences. Int. J. Mol. Sci. 2017, 18, 1029. [Google Scholar] [CrossRef] [PubMed]
- Babak, A.; Andrew, D.; Matthew, T.W.; Brendan, J.F. Predicting the sequence specificities of DNA-and RNA-binding proteins by deep learning. Nat. Biotechnol. 2015, 33, 831–838. [Google Scholar]
- Wang, Y.; Ding, Y.J.; Guo, F.; Wei, L.Y.; Tang, J.J. Improved detection of DNA-binding proteins via compression technology on PSSM information. PLoS ONE 2017, 12, e0185587. [Google Scholar] [CrossRef] [PubMed]
- Wei, L.Y.; Tang, J.J.; Zou, Q. Local-DPP: An Improved DNA-binding Protein Prediction Method by Exploring Local Evolutionary Information. Inf. Sci. 2017, 384, 135–144. [Google Scholar] [CrossRef]
- Shen, C.; Ding, Y.J.; Tang, J.J.; Xu, X.; Guo, F. An ameliorated prediction of drug-target interactions based on multi-scale discrete wavelet transform and network features. Int. Mol. Sci. 2017, 18, 1781. [Google Scholar] [CrossRef] [PubMed]
- Ding, Y.J.; Tang, J.J.; Guo, F. Identification of drug-target interactions via multiple information integration. Inf. Sci. 2017, 418, 546–560. [Google Scholar] [CrossRef]
- Ding, Y.J.; Tang, J.J.; Guo, F. Identification of Protein-Protein Interactions via a Novel Matrix-Based Sequence Representation Model with Amino Acid Contact Information. Int. J. Mol. Sci. 2017, 17, 1623. [Google Scholar] [CrossRef] [PubMed]
- Ding, Y.J.; Tang, J.J.; Fei, G. Predicting protein-protein interactions via multivariate mutual information of protein sequences. BMC Bioinform. 2017, 17, 398. [Google Scholar] [CrossRef] [PubMed]
- Zou, Q.; Li, J.J.; Hong, Q.Q.; Lin, Z.Y.; Wu, Y.; Shi, H.; Ju, Y. Prediction of microRNA-disease associations based on social network analysis methods. BioMed Res. Int. 2015, 2015, 810514. [Google Scholar] [CrossRef] [PubMed]
- Chen, Q.; Tang, J.; Du, P.F. Predicting protein lysine phosphoglycerylation sites by hybridizing many sequence based features. Mol. BioSyst. 2017, 13, 874–882. [Google Scholar] [CrossRef] [PubMed]
- Buenrostro, J.D.; Giresi, P.G.; Zaba, L.C.; Chang, H.Y.; Greenleaf, W.J. Transposition of native chromatin for fast and sensitive epigenomic profiling of open chromatin, dna-binding proteins and nucleosome position. Nat. Methods 2013, 10, e153. [Google Scholar] [CrossRef] [PubMed]
- Lei, G.C.; Tang, J.J.; Du, P.F. Predicting S-sulfenylation Sites Using Physicochemical Properties Differences. Lett. Organ. Chem. 2017, 14, 665–672. [Google Scholar] [CrossRef]
- Zou, Q.; Zeng, J.C.; Cao, L.J.; Ji, R. A Novel Features Ranking Metric with Application to Scalable Visual and Bioinformatics Data Classification. Neurocomputing 2016, 173, 346–354. [Google Scholar] [CrossRef]
- Zou, Q.; Wan, S.X.; Ju, Y.; Tang, J.J.; Zeng, X. Pretata: Predicting TATA binding proteins with novel features and dimensionality reduction strategy. BMC Syst. Biol. 2016, 10 (Suppl 4), 114. [Google Scholar] [CrossRef] [PubMed]
- Altschul, S.F.; Madden, T.L.; Schäffer, A.A.; Zhang, J.H.; Zhang, Z.; Miller, W.; Lipman, D.J. Gapped BLAST and PSI-BLAST: A new generation of protein database search programs. Nucleic Acid Res. 1997, 25, 3389–3402. [Google Scholar] [CrossRef] [PubMed]
- Camacho, C.; Coulouris, G.; Avagyan, V.; Ma, N.; Papadopoulos, J.; Bealer, K.; Madden, T.L. BLAST+: Architecture and applications. BMC Bioinform. 2009, 10, 421–429. [Google Scholar] [CrossRef] [PubMed]
- Jeong, J.C.; Lin, X.; Chen, X.W. BLAST+: Architecture and applications. IEEE/ACM Trans. Comput. Biol. Bioinform. 2011, 8, 308–315. [Google Scholar] [PubMed]
- Pan, G.F.; Tang, J.J.; Guo, F. Analysis of Co-Associated Transcription Factors via Ordered Adjacency Differences on Motif Distribution. Sci. Rep. 2017, 7, 43597. [Google Scholar] [CrossRef] [PubMed]
- Ahmad, S.; Gromiha, M.M.; Sarai, A. Real value prediction of solvent accessibility from amino acid sequence. Proteins Struct. Funct. Genet. 2003, 50, 629–635. [Google Scholar] [CrossRef] [PubMed]
- Joo, K.; Lee, S.J.; Lee, J. Sann: Solvent accessibility prediction of proteins by nearest neighbor method. Proteins Struct. Funct. Bioinform. 2012, 80, 1791–1797. [Google Scholar] [CrossRef] [PubMed]
- Wright, J.; Yang, A.Y.; Ganesh, A.; Sastry, S.S.; Ma, Y. Robust Face Recognition via Sparse Representation. IEEE Trans. Pattern Anal. Mach. Intell. 2009, 31, 210–227. [Google Scholar] [CrossRef] [PubMed]
- Wright, J.; Ganesh, A.; Zhou, Z.; Wagner, A. Demo: Robust face recognition via sparse representation. IEEE Int. Conf. Autom. Face Gesture Recognit. 2008, 31, 1–2. [Google Scholar]
- Liao, B.; Jiang, Y.; Yuan, G.; Zhu, W.; Cai, L.J.; Cao, Z. Learning a weighted meta-sample based parameter free sparse representation classification for microarray data. PLoS ONE 2014, 9, e104314. [Google Scholar] [CrossRef] [PubMed]
- Huang, Y.A.; You, Z.H.; Chen, X.; Chan, K.; Luo, X. Sequence-based prediction of protein-protein interactions using weighted sparse representation model combined with global encoding. BMC Bioinform. 2016, 17, 184–194. [Google Scholar] [CrossRef] [PubMed]
- Huang, Y.A.; You, Z.H.; Gao, X.; Wong, L.; Wang, L. Using Weighted Sparse Representation Model Combined with Discrete Cosine Transformation to Predict Protein-Protein Interactions from Protein Sequence. BioMed Res. Int. 2015, 2015, e902198. [Google Scholar] [CrossRef] [PubMed]
- Lu, C.Y.; Min, H.; Gui, J.; Zhu, L.; Lei, Y.K. Face recognition via Weighted Sparse Representation. J. Vis. Commun. Image Represent. 2013, 24, 111–116. [Google Scholar] [CrossRef]
- Efron, B. Bootstrap Methods: Another Look at the Jackknife. Ann. Stat. 1979, 7, 1–26. [Google Scholar] [CrossRef]
- Tao, D.; Tang, X.; Li, X.; Wu, X. Asymmetric Bagging and Random Subspace for Support Vector Machines-Based Relevance Feedback in Image Retrieval. IEEE Trans. Pattern Anal. Mach. Intell. 2006, 28, 1088–1099. [Google Scholar] [PubMed]
- Rose, P.W.; Prlić, A.; Bi, C.; Bluhm, W.F.; Christie, C.H.; Dutta, S.; Green, R.K.; Goodsell, D.S.; Westbrook, J.D.; Woo, J.; et al. The RCSB Protein Data Bank: views of structural biology for basic and applied research and education. Nucleic Acid Res. 2015, 43, 345–356. [Google Scholar] [CrossRef] [PubMed]
- Li, W.; Godzik, A. Cd-hit: A fast program for clustering and comparing large sets of protein or nucleotide sequences. Bioinformatics 2006, 22, 1658–1659. [Google Scholar] [CrossRef] [PubMed]
- Yu, D.J.; Hu, J.; Yang, J.; Shen, H.B.; Tang, J.H.; Yang, J.Y. Designing Template-Free Predictor for Targeting Protein-Ligand Binding Sites with Classifier Ensemble and Spatial Clustering. IEEE/ACM Trans. Comput. Biol. Bioinform. 2013, 10, 994–1008. [Google Scholar] [CrossRef] [PubMed]
- Yang, J.; Roy, A.; Zhang, Y. BioLiP: A semi-manually curated database for biologically relevant ligand-protein interactions. Nucleic Acid Res. 2013, 41, 1096–1103. [Google Scholar] [CrossRef] [PubMed]
- Wang, G.; Dunbrack, R.L. PISCES: A protein sequence culling server. Bioinformatics 2003, 19, 1589–1591. [Google Scholar] [CrossRef] [PubMed]
- Kuznetsov, I.B.; Gou, Z.K.; Li, R.; Hwang, S. Using evolutionary and structural information to predict DNA-binding sites on DNA-binding proteins. Proteins Struct. Funct. Bioinform. 2006, 64, 19–27. [Google Scholar] [CrossRef] [PubMed]
- Chang, C.C.; Lin, C.J. LIBSVM: A Library for support vector machines. ACM Trans. Intell. Syst. Technol. 2011, 2, 389–396. [Google Scholar] [CrossRef]
- Koh, K.; Kim, S.; Boyd, S. An Interior-Point Method for Large-Scale l 1 -Regularized Logistic Regression. J. Mach. Learn. Res. 2008, 1, 606–617. [Google Scholar]
- Tipping, M.E. Sparse bayesian learning and the relevance vector machine. J. Mach. Learn. Res. 2001, 1, 211–244. [Google Scholar]
- Ma, X.; Guo, J.; Liu, H.D.; Xie, J.M. Sequence-Based Prediction of DNA-Binding Residues in Proteins with Conservation and Correlation Information. IEEE/ACM Trans. Comput. Biol. Bioinform. 2012, 9, 1766–1775. [Google Scholar] [CrossRef] [PubMed]
- Lin, C.; Chen, W.; Qiu, C.; Wu, Y.; Krishnan, S.; Zou, Q. LibD3C: Ensemble classifiers with a clustering and dynamic selection strategy. Neurocomputing 2014, 123, 424–435. [Google Scholar] [CrossRef]
- Lin, C.; Zou, Y.; Qin, J.; Liu, X.; Jiang, Y.; Ke, C.; Zou, Q. Hierarchical classification of protein folds using a novel ensemble classifier. PLoS ONE 2013, 8, e56499. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Schematic diagram of PSSM (Position Specific Scoring Matrix)-MLAB (Multi-scale Local Average Blocks) feature extraction.
Figure 2. Overview of the ensemble classifier.
Figure 3. The (Matthew Correlation Coefficient) of PSSM (Position Specific Scoring Matrix)- MLAB (Multi-scale Local Average Blocks) with different sizes of sliding window and numbers of base classifiers (WSRC (Weighted Sparse Representation based Classifier), Equation(16)).
Figure 4. The (Area Under the Receiver Operating Characteristic) and (Area Under the Precision-Recall curve) of PSSM (Position Specific Scoring Matrix), PSSM + PSA (Predicted Solvent Accessibility), PSSM-MLAB (Multi-scale Local Average Blocks) and PSSM-MLAB + PSA obtained with EC-RUS (Ensemble Classifier with Random Under-Sampling) (WSRC (Weighted Sparse Representation based Classifier), Equation (16)) on PDNA (Protein and DNA)-543 dataset over a ten-fold cross-validation test. (a) receiver operating characteristic curves; (b) precision–recall curves.
Figure 6. Results for different thresholds of probability on independent test set of PDNA-41. Rate p/n means the ratio between the predictive number of binding sites and the predictive number of non-binding sites.
Figure 7. Results for different thresholds of probability on Independent test set of PDNA-52. Rate p/n means the ratio between the predictive number of binding sites and the predictive number of non-binding sites.
Figure 8. Representative protein-DNA complex: Upper is 4X0P-D (PDB ID: 4X0P, Chain: D), lower is 5BMZ-CD (PDB ID: 5BMZ, Chain: C and D).
Table 1. Four different datasets of DNA–protein binding sites.
|Dataset||No. of Sequences||No. of Binding||No. of Non-Binding||Ratio|
|PDNA(Protein and DNA)-543||543||9549|
: No. of Binding represents the number of positive samples. : No. of Non-Binding represents the number of negative samples. : Ratio = No. of Non-Binding / No. of Binding.
Table 2. The performance comparison of different features through ten-fold cross-validation by EC-RUS (Ensemble Classifier with Random Under-Sampling) (WSRC (Weighted Sparse Representation based Classifier), Equation (16)) on PDNA-543 dataset.
|PSSM + PSA ()||0.7850||0.7590||0.7607||0.1874||0.302||0.851|
|PSSM + PSA ()||0.4541||0.9494||0.9166||0.3886||0.375||0.851|
|PSSM-MLAB + PSA ()||0.7894||0.7629||0.7646||0.1907||0.307||0.855|
|PSSM-MLAB + PSA ()||0.4762||0.9492||0.9180||0.3991||0.392||0.855|
Table 3. Comparison with the TargetDNA on PDNA-543 dataset by ten-fold cross-validation.
|TargetDNA () ||0.7698||0.7705||0.7704||0.1918||0.304||0.845|
|TargetDNA () ||0.4060||0.9500||0.9140||0.3647||0.339||0.845|
|Our method ()||0.7894||0.7629||0.7646||0.1907||0.307||0.855|
|Our method ()||0.4762||0.9492||0.9180||0.3991||0.392||0.855|
Results excerpted from .
Table 4. Comparison with some state-of-the-art works on the Independent PDNA-41 dataset.
|DNABind (structure based)||0.264||0.7016||0.8028||0.7978||0.1570|
|EC-RUS (WSRC) ()||0.193||0.6104||0.7725||0.7644||0.1231|
|EC-RUS (WSRC) ()||0.315||0.2725||0.9731||0.9458||0.4292|
|EC-RUS (SVM) ()||0.261||0.6975||0.8032||0.7972||0.1567|
|EC-RUS (SVM) ()||0.302||0.3787||0.9577||0.9281||0.3092|
|EC-RUS (RF) ()||0.234||0.6785||0.7818||0.7767||0.1401|
|EC-RUS (RF) ()||0.261||0.3351||0.9524||0.9217||0.2691|
|EC-RUS (L1-LR) ()||0.228||0.6199||0.8084||0.7991||0.1449|
|EC-RUS (L1-LR) ()||0.246||0.3120||0.9541||0.9221||0.2623|
|EC-RUS (SBL) ()||0.219||0.7084||0.7434||0.7416||0.1263|
|EC-RUS (SBL) ()||0.247||0.3202||0.9521||0.9206||0.2591|
*: Results excerpted from . : The feature is PSSM-MLAB + PSA. In addition, the EC-RUS model is built with different base classifiers.
Table 5. Comparison of the prediction performance between the proposed method and some state-of-the-art works on PDNA-316 dataset.
|DBS-PRED (structure based)||0.5300||0.7600||0.7500||0.170|
|TargetDNA () ||0.7796||0.7803||0.7802||0.339|
|TargetDNA () ||0.4302||0.9500||0.9099||0.375|
|EC-RUS (WSRC) ()||0.8067||0.7818||0.7837||0.356|
|EC-RUS (WSRC) ()||0.5108||0.9499||0.9161||0.439|
|EC-RUS (SVM) ()||0.8011||0.7969||0.7973||0.369|
|EC-RUS (SVM) ()||0.4935||0.9500||0.9150||0.426|
|EC-RUS (RF) ()||0.7989||0.7542||0.7576||0.326|
|EC-RUS (RF) ()||0.4521||0.9502||0.9118||0.394|
|EC-RUS (L1-LR) ()||0.7347||0.7659||0.7635||0.300|
|EC-RUS (L1-LR) ()||0.3523||0.9498||0.9037||0.319|
|EC-RUS (SBL) ()||0.7453||0.7540||0.7533||0.295|
|EC-RUS (SBL) ()||0.3562||0.9480||0.9023||0.317|
Table 6. Comparison with some state-of-the-art works on PDNA-52 dataset under maximizing the value of .
*: Results excerpted from . : The feature is PSSM-MLAB + PSA. In addition, EC-RUS model is built with different base classifiers.
Table 7. The statistical significance of between other methods (including MetaDBSite and TargetDNA) and our method.
Table 8. Comparison with DP (DNA Protein)-Bind on 4X0P-D and 5BMZ-D.
|PDB (Protein Data Bank) ID||Method|
Table 9. The running time (seconds) of EC-RUS on PDNA-41 and PDNA-52 independent testing sets.
© 2017 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).