Next Article in Journal
South African Abietane Diterpenoids and Their Analogs as Potential Antimalarials: Novel Insights from Hybrid Computational Approaches
Previous Article in Journal
Design, Synthesis and Preliminary Biological Evaluation of Benzylsulfone Coumarin Derivatives as Anti-Cancer Agents

Molecules 2019, 24(22), 4035;

Identifying Cancer-Specific circRNA–RBP Binding Sites Based on Deep Learning
School of Computer Science, Shaanxi Normal University, Xi’an 710119, China
College of Information Science and Engineering, Guilin University of Technology, Guilin 541004, China
Department of Mechanical Engineering and Division of Biomedical Engineering, University of Saskatchewan, Saskatoon, SK S7N 5A9, Canada
Author to whom correspondence should be addressed.
Academic Editors: Leonidas A. Phylactou, Andrie Koutsoulidou and Ramon Eritja
Received: 29 September 2019 / Accepted: 6 November 2019 / Published: 7 November 2019


Circular RNAs (circRNAs) are extensively expressed in cells and tissues, and play crucial roles in human diseases and biological processes. Recent studies have reported that circRNAs could function as RNA binding protein (RBP) sponges, meanwhile RBPs can also be involved in back-splicing. The interaction with RBPs is also considered an important factor for investigating the function of circRNAs. Hence, it is necessary to understand the interaction mechanisms of circRNAs and RBPs, especially in human cancers. Here, we present a novel method based on deep learning to identify cancer-specific circRNA–RBP binding sites (CSCRSites), only using the nucleotide sequences as the input. In CSCRSites, an architecture with multiple convolution layers is utilized to detect the features of the raw circRNA sequence fragments, and further identify the binding sites through a fully connected layer with the softmax output. The experimental results show that CSCRSites outperform the conventional machine learning classifiers and some representative deep learning methods on the benchmark data. In addition, the features learnt by CSCRSites are converted to sequence motifs, some of which can match to human known RNA motifs involved in human diseases, especially cancer. Therefore, as a deep learning-based tool, CSCRSites could significantly contribute to the function analysis of cancer-associated circRNAs.
circRNA; RNA binding protein; cancer-specific; convolutional neural network

1. Introduction

Circular RNAs (circRNAs) are non-coding RNAs that have covalent and closed loop structures; thereby, they are more stable than most linear RNAs in cells [1]. Although circRNAs have been identified over twenty years, the biological functions of circRNAs remain largely unknown. For a long time, they have been generally thought to represent splicing errors and are expressed at low levels [2]. In recent years, an abundance and diversity of circRNAs were discovered in tissue and organ development by high-throughput sequencing [3,4], including many tissue-specific [5] and cell-specific [6] circRNAs, which may play a role in various human disorders and biological processes [7]. More specific functions were also discovered, such as regulating transcriptional initiation [8], affecting alternative splicing, and functioning as microRNA (miRNA) [9] or RNA binding protein (RBP) sponges [10,11].
In addition, several databases of circRNAs have been built for studying circRNAs. For instance, circBase collects and unifies data sets of circRNAs and provides scripts to identify circRNAs in sequencing data [12]. circRNADb provides detailed annotations of human circRNAs, including genomic information, exon splicing, genome sequence, internal ribosome entry site (IRES), open reading frame (ORF), and references [13]. CircR2Disease curates a database for experimentally supported associations between circRNAs and diseases, and provides a platform for investigating mechanism of the disease-related circRNAs [14]. CSCD (cancer-specific circRNAs database) is a database developed for cancer-specific circRNAs (CS-circRNAs), provides miRNA target sites, RBP binding sites, and potential open reading frames (ORFs) in CS-circRNAs [15].
With the deep understanding of circRNA regulatory functions, the control and function of circRNAs seem to largely rely on the specificity of RBPs. They participate in almost every phase of the circRNA life cycle, including formation [16], translation, post-transcriptional regulation [17], and extracellular transport [18]. In order to identify the interactions between RNAs and RBPs at the transcriptome-wide level, some CLIP (cross-linking and immunoprecipitation)-based experimental technologies in vivo were designed. Among them, RNAcompete provides binding affinities of specific RBPs to RNA probes [19]. Recently, CLIP-seq [20] has become the standard experimental procedure, with several variants including HITS-CLIP [20], PAR-CLIP [21], and iCLIP [22]. Additionally, it can also be applied to detect potential binding sites on unreported sequences.
Considering the cost-heavy and labor-intensive aspects of these biological experimental technologies, some computational methods [23,24], in particular, deep learning-based approaches, have been designed for identifying interactions between RNAs/DNAs and RBPs. Convolutional neural networks (CNNs) have been proven to be very successful in solving sequence-based problems [25,26]; they are usually employed to learn comprehensive features from the raw input data, and especially, the kernels in a CNN can be regarded as a motif scanner to detect the motifs in genomics. The recent application of CNN-based methods in genomics indicates its effectiveness in computational biology. For instance, DeepBind predicts the sequence specificities of DNA- and RNA-binding proteins based on CNNs [27], and is enhancing the prediction of sequence specificities of DNA binding proteins [28]. Zeng et al. present a CNN-based deep learning architecture for predicting DNA sequence binding sites using the ChIP-seq dataset [29]. iDeep [30], iDeepE [31], and iDeepS [32] were designed to identify RBP binding preferences on RNA sequences using CNNs and RNNs (recurrent neural networks). In addition, GraphProt is also a computational framework that can find RBP sequence- and structure-binding preferences from the high-throughput experimental data [33]. However, there is still no computational method for identifying the cancer-specific RBP binding sites on circRNAs.
In this study, we present a deep learning-based method to detect the cancer-specific RBP binding sites on circRNAs utilizing the RBP binding sites on CS-circRNAs data, which is driven by a concatenate convolutional neural network model. This method is compared with the conventional classifiers and other representative deep learning-based methods using sequences alone, and the results show its better prediction accuracy. In addition, the features learnt by CSCRSites are converted to sequence motifs and are compared with known human RNA motifs involved in human cancer diseases. In conclusion, CSCRSites is the first deep learning-based method for identifying cancer-specific RBP binding sites, which could contribute to the function analysis of cancer-associated circRNAs.

2. Results

In this section, in order to evaluate the performance of CSCRSites, it was compared with conventional machine learning classifiers and some existing representative deep learning-based methods for detecting RBP binding sites using the benchmark dataset CSCRBS (cancer-specific circRNA-RBP Binding sites).

2.1. Implementation of the Parameterized CSCRSites

CSCRSites was implemented in Python 3.7 using the Keras 2.2.4 library. Since the hyper-parameters of a deep learning model have a significant impact on its performance, we studied the different combinations of model settings and selected the model parameters with the best performance. After testing different kernel numbers in the range 128–1024, and various kernel sizes in the range from 8 to 50, we selected 1024 kernels with 8, 20, and 38 kernel sizes, respectively. In particular, test results show that deploying more convolutional kernels was always beneficial while the computation load is also increasing. Interestingly, in the max-pooling layer, the simple global pooling was superior than the local pooling strategy in each kernel.
In the training phase, the cross-entropy was used as the loss function, and the standard error back-propagation algorithm and Adam [34] method were adopted during the model training with the batch size of 512. Passing all training samples through the model and completing a back-propagation process once is an epoch. We trained our model till convergence and validated it after each epoch. In our tests, we found that 50 epochs were usually enough. Finally, the best model parameters were obtained according to the accuracy on the validation dataset using an early stopping strategy.

2.2. Performance of Different Combinations of CSCRSites Settings

In this study, the area under the receiver operating characteristics curve (ROC_AUC) was used as a metric for model evaluation and comparison [35]. Different kernels can capture the variant features of sequences, such as motif variants in the motif discovery task. As shown in Figure 1, the 1024 kernels have the higher AUC values by testing different kernel numbers with 10-fold cross validation [36], indicating that more convolution kernels improve the performance of our model. However, the performance improvement of the model seems to be close to saturation when more than 1024 kernels were employed, while the computation load was also increasing. Thus, 1024 kernels were adopted in CSCRSites.
As determined in Section 2.1, the kernel sizes of 8, 20, and 38 were employed through the concatenate strategy. Among them, the kernel size of 20 achieves the highest AUC value, as shown in Figure 2. Thus, in our model, the larger the convolution kernel size does not mean the better.
In general, local max-pooling is a common strategy in the deep learning-based model [26,27,32]. Global max-pooling was adopted in this study because the higher AUC values are obtained this way. As shown in Figure 2, the max-pooling sizes as Zeng’s method described [29] were experimented, and the result shows that the local max-pooling strategy achieves the worst performance.

2.3. Comparing CSCRSites with Conventional Machine Learning Methods

To utilize the sequences information in the conventional machine learning models, such as MLP (multilayer perception), SVM (support vector machine), and RF (random forest), k-mer compositional features are usually employed to encode RNA sequences as the inputs of models, in which each feature represents the normalized frequency of the corresponding k-mer appearing in an RNA sequence [37,38,39,40]. Here, the above-mentioned machine learning methods were implemented by adopting normalized 3-mer frequency representation of circRNA sequence fragments; it was a 4 × 4 × 4 or 64-dimensional vector, which was tested for the best performance. They were compared with the CSCRSites on the benchmark dataset CSCRBS.
As shown in Figure 3, CSCRSites obviously outperforms MLP, SVM, and RF according to the ROC curves; the AUC of CSCRSites is 0.8326, which is nearly 10% higher than that of the MLP (0.7249), which is the best performance in the conventional machine learning-based method, indicating the advantages of our model against conventional learning methods on the benchmark dataset CSCRBS.

2.4. Comparing CSCRSites with Existing Deep Learning Methods

In order to further verify the performance of CSCRSites, we compared it with some existing representative deep learning-based methods on dataset CSCRBS with the same evaluation criteria including accuracy (Acc.), precision (Prec.), and AUC. DeepBind [27] is the first deep learning based method for predicting the sequence specificities of DNA- and RNA-binding proteins. Zeng et al. [29] successfully apply the convolutional neural network architectures for predicting DNA-protein binding. iDeepS [32] was also developed to predict RBP binding sites on RNAs and have better performance than other existing methods, such as DeeperBind [28] and GraphProt [33]. Thus, we compared CSCRSites with DeepBind, Zeng’s method, and iDeepS on the dataset CSCRBS. The result is shown in Table 1 and Figure 4.
As shown in Table 1 and Figure 4, all methods have higher AUCs than a random guess (0.5). CSCRSites shows the best results, indicating its superior ability in predicting cancer-specific RBP binding sites on circRNAs. Specifically, CSCRSites achieves the highest AUC of 0.832. The Acc. and Prec. of CSCRSites are also higher than those of iDeepS, Zeng’s method, and DeepBind. In addition, the reason for iDeepS’ poor performance may be the lack of circRNA secondary structure information. These experimental results demonstrate that CSCRSites has superior ability in predicting cancer-specific RBP binding sites.

2.5. Performance of CSCRSites in Motif Discovery

As described in Section 4.4, the motifs learnt by CSCRSites were compared with the existing motifs using TOMTOM with an E value ≤0.05. All Species [41] was selected as the alignment database, as it is an RNA-binding motif database having 244 motifs between 7 and 8 in length, in which 102 motifs are Homo sapiens RNA-binding motifs. CSCRSites can learn the motifs of different lengths of 8, 20, and 38. Considering the length of motifs in the RNA-binding motifs database, the motifs with the length of 8 learnt by all kernels were aligned with the Homo sapiens RNA-binding motif database, and 65 motifs were significantly matched with 29 known motifs involving 23 genes. Some of the alignment results are shown in Table 2.
According to records in the database DisGeNET [42], some associated genes in Table 2 are encoding RNA-binding proteins that affect human diseases, especially human cancer. As shown in Figure 5, some sequence logos of matched motifs are associated with genes involving human cancer. For instance, HNRNPK overexpression is related to tumorigenesis in several cancers [43], whose binding motif RNCMPT00026 is matched with KER_959 learnt by CSCRSites. Similarly, in cutaneous melanoma, brain metastasis is predetermined by CD44 splicing variant 6 (CD44v6), whose expression correlates with PTBP1 and U2AF2 splicing factors, and especially, PTBP1 knockdown significantly decreases CD44v6 expression in advanced melanomas [44]; their binding motifs match to KER_269 and KER_842, respectively. TIA1, whose binding motif matched with KER_842, has an isoform expression that is measured in colorectal cancers [45]. RNA-binding protein HNRNPL has been previously shown to associate with tumorigenesis in liver and lung cancer [46], and results show that KER_793 matches with its binding motif RNCMPT00027. Splicing factor SRSF1 is an associated gene binding motif that matches with KER_37, which is upregulated in human breast tumors, and its overexpression promotes transformation of mammary cells [47].

3. Discussion

The experimental results show that CSCRSites, as the first model to predict cancer-specific RBP binding sites on circRNAs, is an effective computation method that outperforms the other methods for identifying the cancer-specific RBP binding sites on circRNAs. The application, merit, and demerits etc. of comparative methods are listed in Table 3. The better performance of CSCRSites is mainly attributed to the following aspects. Firstly, the application of a CNN provides the basic guarantee for the effectiveness of CSCRSites. A CNN can automatically obtain high-level features from nucleotide sequences and succeed in identifying RBP binding sites. Secondly, the reliable benchmark datasets of cancer-specific RBP binding sites on circRNAs are constructed while the circRNAs sequences are encoded to one-hot vectors that are order-preserving, which is more suitable for the motif discovery task compared with traditional k-mer feature extraction. Furthermore, employing multiple convolutional neural networks enhances the performance of our model, and is beneficial to various motif discovery tasks. Hence, CSCRSites is a flexible method of identifying cancer-specific RBP binding sites on circRNAs.
Recent studies have reported that circRNAs could play their regulatory functions via sponging RBPs, therefore, it is necessary to understand the interaction mechanisms of circRNAs and RBPs, especially in human cancers. We trained the CSCRSites model to identify whether a given circRNA fragment was a cancer-specific RBP binding sites by using abundant binding sites data. Moreover, our model can detect the various length binding site motifs on circRNAs and provide reference for further researching on circRNA regulatory functions.
Despite the effectiveness of the CSCRSites model, it should be noted that CSCRSites still has some limitations. The model requires fixed-length binding sites as input data, as the binding sites are extended to 100 nt by centering at the point called for each peak, which may cause possible bias by abandoning length information. In future works, we plan to solve the problem of variable length input, try to collect more binding sites data, and integrate more circRNA information to improve the prediction accuracy of the model. Finally, we will develop a web tool for identifying the cancer-specific RBP binding sites.

4. Materials and Methods

In this study, CSCRSites, a method based on the CNN architecture, was constructed to identify the cancer-specific RBP binding sites on circRNAs. As shown in Figure 6, given a sequence fragment on circRNAs, and after converting it into a vector as the input, CSCRSites identifies whether the fragment is a cancer-specific RBP binding site. For this purpose, the cancer-specific RBP binding sites are collected from CSCD, which form the dataset for training and testing CSCRSites, respectively.

4.1. Datasets

In order to build the CSCRSites model for the RBP binding site prediction, we constructed a dataset of cancer-specific RBP binding sites on circRNAs. The RBP binding site information was extracted from the cancer-specific circRNAs database (CSCD, It contains 15,719,824 RBP binding sites in cancer-specific circRNAs, 66,182,210 in normal circRNAs, and 22,025,003 in common circRNAs [15]. In the first place, cancer-specific RBP binding sites on circRNAs were downloaded from CSCD and treated as positive samples. Here, to obtain the determined RBP binding sites, 3026 cancer-specific circRNAs recorded by circBase [12] were selected, and 486,060 RBP binding sites were preserved after removing the redundant sites. Secondly, note that our model identifies the binding sites only based on circRNAs sequences. For the shorter sequences whose lengths were less than 50 nt, the features for distinguishing sequences were difficult to extract, and thus the sequences with lengths more than 50 nt and less than 100 nt were retained. In fact, for the longer sequences, nearly 80% of the binding sites were in this range. Finally, the sequences were extended to 100 nt by centering at the point called for each peak, and 43,118 cancer-specific RBP binding sites on circRNAs were obtained. The negative samples were obtained by shuffling positive sequences with matching dinucleotide composition [29]. The same strategy for creating negative samples is used in DeepBind [27]. The shuffling was implemented using the ‘fasta-dinucleotide-shuffle’ package in MEME [48]. The whole dataset was randomly divided into training and testing sets in the ratio of 4:1. The dataset was named CSCRBS.
In addition, the RBP binding sites sequences were collected according to the human GRCH37 genome from the UCSC Genome at

4.2. Sequence Encoding

On the numerical descriptor of the sequences, k-mer compositional features were widely used, in which each sequence was encoded using a 4K-dimensional vector, and each feature represents the normalized frequency of the corresponding k-mer appearing in an RNA sequence [37]. This type of feature has difficultly in capturing the sequence order information, especially in the task of detecting motifs.
In this study, each sequence of the RBP binding sites on circRNAs was denoted as a numerical sparse matrix, and is an order-preserving transformation. Suppose that a circRNA sequence fragment S = s 1 s 2 s 3 s L , where L is the length of a circRNA sequence fragment, s j { A , U , C , G } , j = 1 , 2 , 3 , , L , which are denoted as one-hot vectors [1,0,0,0], [0,1,0,0], [0,0,1,0], and [0,0,0,1], respectively. Then, the circRNA sequence fragment S can be represented as follows:
M = ( m i , j ) 4 × L ,   m i , j = { 1 , s j = h ( i ) 0 ,   o t h e r w i s e i = 1 , 2 , 3 , 4 ; j = 1 , 2 , 3 , L ,   h ( i ) = [ A , U , C , G ] .
Finally, through the one-hot encoding, the circRNA sequence fragment S is characterized by a 4 × L numerical sparse matrix M .
In our study, all RBP binding sites on circRNAs were encoded to a corresponding 4 × L matrix M as the input of the model. This encoding strategy can not only obtain low dimension data, but also maximize the retention of the sequence original information, and thus it is conducive to extract features using the deep learning-based method. Especially, it is beneficial to the task for motif discovery.

4.3. Model Construction

A CNN is a neural network that uses convolution in place of general matrix multiplication in at least one of its layers [49]. In recent years, the CNN was applied to model sentences [50] to detect features of the raw input data by the convolution operation. By this inspiration, a CNN was applied to extract the features of genomic sequences, and the kernels or filters in a CNN were used for motif discovery [27,51]. In this study, we constructed our parameterized model based on a CNN to learn the sequence features of cancer-specific RBP binding sites on circRNAs, and to further identify whether a new circRNA sequence fragment was a cancer-specific RBP binding site.
The structure of our model is shown in Figure 6; it is a slight variant of the TextCNN [52], and contains an input layer, a convolution layer, a pooling layer, and a fully connected layer. Suppose that x i is the 4-dimensional binary vector corresponding to the i - t h nucleotide S i on a circRNA sequence fragment as described in Section 4.2, and a circRNA sequence fragment of length L is expressed as follows:
M = x 1 x 2 x L
where is the concatenation operator.
The convolution layer is used to learn the features of different levels. Considering c i is a new feature generated by the convolution operation on matrix M, it can be described as follows:
c i = f ( w x i : i + h 1 + b )
where f ( x ) denotes a non-linear activation function, such as the rectified linear unit (ReLU), operator represents the convolution operation, b is a bias term, w is the weight matrix of the convolution kernel, and x i : i + h 1 refers to the concatenation of nucleotide x i , x i + 1 ,   ,   x i + h 1 . Here, h is the kernel size (the width of matrix w ). The kernel is applied to different fragments of a sequence with a fixed window h   { x 1 : h , x 2 : h + 1 ,   ,   x L h + 1 : L } in turn, then produces a feature map:
c = [ c 1 , c 2 , , c L h + 1 ] .
In this study, our model employs multiple convolution layers with different kernel sizes to extract diverse features. In addition, multiple kernels were employed to extract the features in each convolution layer. As shown in Figure 6, three different kernel sizes were applied to detect diverse features of circRNA sequence fragments, while 1024 kernels were employed with each kernel size by testing for the best performance.
The pooling layer is used to compress data and reduce over-fitting. To obtain the most important feature on a feature map c , a max-pooling operation is applied to each feature map [53]:
c ^ = max { c } .
That is, the maximum value of a feature map denotes the feature of the corresponding kernel, in this study, as shown in Equation (5), a simple global max-pooling strategy is adopted. Then, outputs are concatenated together to form a single feature vector and are fed into a fully connected layer.
The fully connected layer with the non-linear softmax activation function is used to classify the extracted features, and the outputs are the probability distribution over labels. Deserving to be mentioned, to avoid over-fitting, a dropout layer was implemented before this layer. The CSCRSites can be summarized as follows:
O u t = f F c _ s o f t m a x f C o n c a t e n a t e f G l o b a l M a x P o o l f C o n v 2 _ R e L U ( M )
where the M is the input sparse matrix in Section 4.2, and the O u t is the probability whether a sequence fragment is a cancer-specific RBP binding site.

4.4. Motifs Discovery

As described in the previous study [54,55], the convolution layers of CSCRSites are akin to motif scanners. As described in Section 4.3, given an input sequence, a feature map c could be produced for each kernel via the convolution layer with the non-linear ReLU function. Here, the position of the maximum value c i in the feature map c is regarded as the start position of a motif. The motif position information matrix is calculated using the Python API (keras.K.function), which is defined as follows:
f _ m a t r i x = K . f u n c t i o n ( M , [ K . a r g m a x ( c ) , K . max ( c ) ] )
where the matrix M is the model input, c is the feature map in each kernel, that is, the output of the convolution layer. The function K . a r g m a x and K . m a x are keras backend functions returned the position and value of maximum value c i , respectively. Finally, matrix f _ m a t r i x is converted to motifs with the MEME motif format, and afterwards, compared with the existing motifs by submitting to the TOMTOM [56] webserver.

5. Conclusions

In this study, we have developed CSCRSites as the first model to identify cancer-specific RBP binding sites on circRNAs based on convolutional neural network architecture. To obtain the initial sequence information for the motif discovery task, circRNA sequences were represented by one-hot encoding, then relevant features were automatically extracted from nucleotide sequences by concatenating multiple convolutional neural networks. The achieved high-level features were fed to a fully connected layer with a non-linear softmax activation function for the classification. In addition, CSCRSites also can be used as a motif discovery tool to discover three kinds of different motifs using the features learnt by CNN layers. The goal of using multiple convolutional neural networks is to obtain various high-level features for the softmax classifier and identify the different length motifs in the motif discovery task. Compared with existing deep learning-based models and the conventional machine learning methods, our model has an advantage in identifying cancer-specific RBP binding sites. In addition, it can be extended to identify the tissue-specific and cell-specific circRNA expression patterns. We hope that our method presented in this study can contribute to further models and understanding of the functions of circRNAs.

Author Contributions

Z.W. and X.L. conceived and designed the experiments; Z.W., X.L., and F.-X.W. performed the experiments and discussed the results; Z.W. and X.L. wrote the paper.


We thank the financial support which comes from National Natural Science Foundation of China (61672334, 61972451, 61902230) and the Fundamental Research Funds for the Central Universities (No. GK201901010).

Conflicts of Interest

The authors declare no conflict of interest.


  1. Jeck, W.R.; Sorrentino, J.A.; Wang, K.; Slevin, M.K.; Burd, C.E.; Liu, J.Z.; Marzluff, W.F.; Sharpless, N.E. Circular RNAs are abundant, conserved, and associated with ALU repeats. RNA 2013, 19, 141–157. [Google Scholar] [CrossRef] [PubMed]
  2. Sanger, H.L.; Klotz, G.; Riesner, D.; Gross, H.J.; Kleinschmidt, A.K. Viroids are single-stranded covalently closed circular RNA molecules existing as highly base-paired rod-like structures. Proc. Natl. Acad. Sci. USA 1976, 73, 3852–3856. [Google Scholar] [CrossRef] [PubMed]
  3. Chen, Y.H.; Li, C.; Tan, C.L.; Liu, X.B. Circular RNAs: A new frontier in the study of human diseases. J. Med. Genet. 2016, 53, 359–365. [Google Scholar] [CrossRef] [PubMed]
  4. Du, W.W.; Yang, W.; Liu, E.; Yang, Z.; Dhaliwal, P.; Yang, B.B. Foxo3 circular RNA retards cell cycle progression via forming ternary complexes with p21 and CDK2. Nucleic Acids Res. 2016, 44, 2846–2858. [Google Scholar] [CrossRef] [PubMed]
  5. Xia, S.Y.; Feng, J.; Lei, L.J.; Hu, J.; Xia, L.J.; Wang, J.; Xiang, Y.; Liu, L.J.; Zhong, S.; Han, L.; et al. Comprehensive characterization of tissue-specific circular RNAs in the human and mouse genomes. Brief. Bioinf. 2017, 18, 984–992. [Google Scholar] [CrossRef]
  6. Salzman, J.; Chen, R.E.; Olsen, M.N.; Wang, P.L.; Brown, P.O. Cell-type specific features of circular RNA expression. PLoS Genet. 2013, 9, e1003777. [Google Scholar] [CrossRef]
  7. Lu, D.; Xu, A.D. Mini Review: Circular RNAs as Potential Clinical Biomarkers for Disorders in the Central Nervous System. Front. Genet. 2016, 7, 53. [Google Scholar] [CrossRef]
  8. Holdt, M.L.; Kohlmaier, A.; Teupser, D. Molecular roles and function of circular RNAs in eukaryotic cells. Cell. Mol. Life Sci. 2018, 75, 1071–1098. [Google Scholar] [CrossRef]
  9. Hansen, T.B.; Jensen, T.I.; Clausen, B.H.; Bramsen, J.B.; Finsen, B.; Damgaard, C.K.; Kjems, J. Natural RNA circles function as efficient microRNA sponges. Nature 2013, 495, 384–388. [Google Scholar] [CrossRef]
  10. Qu, S.; Yang, X.; Li, X.; Wang, J.; Gao, Y.; Shang, R.; Sun, W.; Dou, K.; Li, H. Circular RNA: A new star of noncoding RNAs. Cancer Lett. 2015, 365, 141–148. [Google Scholar] [CrossRef]
  11. Ebbesen, K.K.; Kjems, J.; Hansen, T.B. Circular RNAs: Identification, biogenesis and function. Biochim. Biophys. Acta 2016, 1859, 163–168. [Google Scholar] [CrossRef] [PubMed]
  12. Glazar, P.; Papavasileiou, P.; Rajewsky, N. circBase: A database for circular RNAs. RNA 2014, 20, 1666–1670. [Google Scholar] [CrossRef]
  13. Chen, X.; Han, P.; Zhou, T.; Guo, X.; Song, X.; Li, Y. circRNADb: A comprehensive database for human circular RNAs with protein-coding annotations. Sci. Rep. 2016, 6, 34985. [Google Scholar] [CrossRef] [PubMed]
  14. Fan, C.; Lei, X.; Fang, Z.; Jiang, Q.; Wu, F.-X. CircR2Disease: A manually curated database for experimentally supported circular RNAs associated with various diseases. Database 2018, 2018, bay044. [Google Scholar] [CrossRef] [PubMed]
  15. Xia, S.; Feng, J.; Chen, K.; Ma, Y.; Gong, J.; Cai, F.; Jin, Y.; Gao, Y.; Xia, L.; Chang, H.; et al. CSCD: A database for cancer-specific circular RNAs. Nucleic Acids Res. 2017, 46, D925–D929. [Google Scholar] [CrossRef] [PubMed]
  16. Lyu, D.; Huang, S. The emerging role and clinical implication of human exonic circular RNA. RNA Biol. 2017, 14, 1000–1006. [Google Scholar] [CrossRef]
  17. Abdelmohsen, K.; Panda, A.C.; Munk, R.; Grammatikakis, I.; Dudekula, D.B.; De, S.; Kim, J.; Noh, J.H.; Kim, K.M.; Martindale, J.L.; et al. Identification of HuR target circular RNAs uncovers suppression of PABPN1 translation by CircPABPN1. RNA Biol. 2017, 14, 361–369. [Google Scholar] [CrossRef]
  18. Janas, T.; Janas, M.M.; Sapoń, K.; Janas, T. Mechanisms of RNA loading into exosomes. FEBS Lett. 2015, 589, 1391–1398. [Google Scholar] [CrossRef]
  19. Ray, D.; Kazan, H.; Chan, E.T.; Pena Castillo, L.; Chaudhry, S.; Talukder, S.; Blencowe, B.J.; Morris, Q.; Hughes, T.R. Rapid and systematic analysis of the RNA recognition specificities of RNA-binding proteins. Nat. Biotechnol. 2009, 27, 667–670. [Google Scholar] [CrossRef]
  20. Licatalosi, D.D.; Mele, A.; Fak, J.J.; Ule, J.; Kayikci, M.; Chi, S.W.; Clark, T.A.; Schweitzer, A.C.; Blume, J.E.; Wang, X.; et al. HITS-CLIP yields genome-wide insights into brain alternative RNA processing. Nature 2008, 456, 464–469. [Google Scholar] [CrossRef]
  21. Hafner, M.; Landthaler, M.; Burger, L.; Khorshid, M.; Hausser, J.; Berninger, P.; Rothballer, A.; Ascano, M.; Jungkamp, A.-C.; Munschauer, M.; et al. Transcriptome-wide Identification of RNA-Binding Protein and MicroRNA Target Sites by PAR-CLIP. Cell 2010, 141, 129–141. [Google Scholar] [CrossRef] [PubMed]
  22. Konig, J.; Zarnack, K.; Rot, G.; Curk, T.; Kayikci, M.; Zupan, B.; Turner, D.J.; Luscombe, N.M.; Ule, J. iCLIP reveals the function of hnRNP particles in splicing at individual nucleotide resolution. Nat. Struct. Mol. Biol. 2010, 17, 909–915. [Google Scholar] [CrossRef]
  23. Adjeroh, D.; Allaga, M.; Tan, J.; Lin, J.; Jiang, Y.; Abbasi, A.; Zhou, X. Feature-Based and String-Based Models for Predicting RNA-Protein Interaction. Molecules 2018, 23, 697. [Google Scholar] [CrossRef] [PubMed]
  24. Shen, W.J.; Cui, W.; Chen, D.; Zhang, J.; Xu, J. RPiRLS: Quantitative Predictions of RNA Interacting with Any Protein of Known Sequence. Molecules 2018, 23, 540. [Google Scholar] [CrossRef] [PubMed]
  25. Sainath, T.N.; Kingsbury, B.; Saon, G.; Soltau, H.; Mohamed, A.R.; Dahl, G.; Ramabhadran, B. Deep Convolutional Neural Networks for large-scale speech tasks. Neural Netw. 2015, 64, 39–48. [Google Scholar] [CrossRef] [PubMed]
  26. LeCun, Y.; Bengio, Y.; Hinton, G. Deep learning. Nature 2015, 521, 436–444. [Google Scholar] [CrossRef]
  27. Alipanahi, B.; Delong, A.; Weirauch, M.T.; Frey, B.J. Predicting the sequence specificities of DNA- and RNA-binding proteins by deep learning. Nat. Biotechnol. 2015, 33, 831–838. [Google Scholar] [CrossRef]
  28. Hassanzadeh, H.R.; Wang, M.D. DeeperBind: Enhancing prediction of sequence specificities of DNA binding proteins. In Proceedings of the 2016 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), Shenzhen, China, 15–18 December 2016. [Google Scholar]
  29. Zeng, H.; Edwards, M.D.; Liu, G.; Gifford, D.K. Convolutional neural network architectures for predicting DNA-protein binding. Bioinformatics 2016, 32, i121–i127. [Google Scholar] [CrossRef]
  30. Pan, X.; Shen, H.-B. RNA-protein binding motifs mining with a new hybrid deep learning based cross-domain knowledge integration approach. BMC Bioinf. 2017, 18, 136. [Google Scholar] [CrossRef]
  31. Pan, X.; Shen, H.-B. Predicting RNA—Protein binding sites and motifs through combining local and global deep convolutional neural networks. Bioinformatics 2018, 34, 3427–3436. [Google Scholar] [CrossRef]
  32. Pan, X.; Rijnbeek, P.; Yan, J.; Shen, H.-B. Prediction of RNA-protein sequence and structure binding preferences using deep convolutional and recurrent neural networks. BMC Genom. 2018, 19, 511. [Google Scholar] [CrossRef] [PubMed]
  33. Maticzka, D.; Lange, S.J.; Costa, F.; Backofen, R. GraphProt: Modeling binding preferences of RNA-binding proteins. Genome Biol. 2014, 15, R17. [Google Scholar] [CrossRef] [PubMed]
  34. Kingma, D.P.; Ba, J. Adam: A method for stochastic optimization. arXiv 2014, arXiv:1412.6980. [Google Scholar]
  35. Bradley, A.P. The use of the area under the ROC curve in the evaluation of machine learning algorithms. Pattern Recognit. 1997, 30, 1145–1159. [Google Scholar] [CrossRef]
  36. Kohavi, R. A study of cross-validation and bootstrap for accuracy estimation and model selection. In Proceedings of the International Joint Conference on Artificial Intelligence, Montreal, QC, Canada, 20–25 August 1995. [Google Scholar]
  37. Muppirala, U.K.; Honavar, V.G.; Dobbs, D. Predicting RNA-protein interactions using only sequence information. BMC Bioinf. 2011, 12, 489. [Google Scholar] [CrossRef]
  38. Dai, Q.; Guo, M.; Duan, X.; Teng, Z.; Fu, Y. Construction of Complex Features for Computational Predicting ncRNA-Protein Interaction. Front. Genet. 2019, 10, 18. [Google Scholar] [CrossRef]
  39. Shen, J.; Zhang, J.; Luo, X.; Zhu, W.; Yu, K.; Chen, K.; Li, Y.; Jiang, H. Predicting protein-protein interactions based only on sequences information. Proc. Natl. Acad. Sci. USA 2007, 104, 4337–4341. [Google Scholar] [CrossRef]
  40. Wang, J.; Wang, L. Prediction of back-splicing sites reveals sequence compositional features of human circular RNAs. In Proceedings of the 2017 IEEE 7th International Conference on Computational Advances in Bio and Medical Sciences (ICCABS), Orlando, FL, USA, 19–21 October 2017. [Google Scholar]
  41. Ray, D.; Kazan, H.; Cook, K.B.; Weirauch, M.T.; Najafabadi, H.S.; Li, X.; Gueroussov, S.; Albu, M.; Zheng, H.; Yang, A.; et al. A compendium of RNA-binding motifs for decoding gene regulation. Nature 2013, 499, 172–177. [Google Scholar] [CrossRef]
  42. Pinero, J.; Bravo, A.; Queralt-Rosinach, N.; Gutierrez-Sacristan, A.; Deu-Pons, J.; Centeno, E.; Garcia-Garcia, J.; Sanz, F.; Furlong, L.I. DisGeNET: A comprehensive platform integrating information on human disease-associated genes and variants. Nucleic Acids Res. 2017, 45, D833–D839. [Google Scholar]
  43. Chen, X.; Gu, P.; Xie, R.; Han, J.; Liu, H.; Wang, B.; Xie, W.; Xie, W.; Zhong, G.; Chen, C.; et al. Heterogeneous nuclear ribonucleoprotein K is associated with poor prognosis and regulates proliferation and apoptosis in bladder cancer. J. Cell. Mol. Med. 2017, 21, 1266–1279. [Google Scholar] [CrossRef]
  44. Marzese, D.M.; Liu, M.; Huynh, J.L.; Hirose, H.; Donovan, N.C.; Huynh, K.T.; Kiyohara, E.; Chong, K.; Cheng, D.; Tanaka, R.; et al. Brain metastasis is predetermined in early stages of cutaneous melanoma by CD44v6 expression through epigenetic regulation of the spliceosome. Pigment Cell Melanoma Res. 2015, 28, 82–93. [Google Scholar] [CrossRef]
  45. Hamdollah Zadeh, M.A.; Amin, E.M.; Hoareau-Aveilla, C.; Domingo, E.; Symonds, K.E.; Ye, X.; Heesom, K.J.; Salmon, A.; D’Silva, O.; Betteridge, K.B.; et al. Alternative splicing of TIA-1 in human colon cancer regulates VEGF isoform expression, angiogenesis, tumour growth and bevacizumab resistance. Mol. Oncol. 2015, 9, 167–178. [Google Scholar] [CrossRef] [PubMed]
  46. Zhou, X.; Li, Q.; He, J.; Zhong, L.; Shu, F.; Xing, R.; Lv, D.; Lei, B.; Wan, B.; Yang, Y.; et al. HnRNP-L promotes prostate cancer progression by enhancing cell cycling and inhibiting apoptosis. Oncotarget 2017, 8, 19342–19353. [Google Scholar] [CrossRef] [PubMed]
  47. Anczukow, O.; Akerman, M.; Clery, A.; Wu, J.; Shen, C.; Shirole, N.H.; Raimer, A.; Sun, S.; Jensen, M.A.; Hua, Y.; et al. SRSF1-Regulated Alternative Splicing in Breast Cancer. Mol. Cell 2015, 60, 105–117. [Google Scholar] [CrossRef] [PubMed]
  48. Bailey, T.L.; Boden, M.; Buske, F.A.; Frith, M.; Grant, C.E.; Clementi, L.; Ren, J.; Li, W.W.; Noble, W.S. MEME SUITE: Tools for motif discovery and searching. Nucleic Acids Res. 2009, 37, W202–W208. [Google Scholar] [CrossRef]
  49. Goodfellow, I.; Bengio, Y.; Courville, A. Deep Learning; MIT Press: Cambridge, MA, USA, 2016; p. 326. [Google Scholar]
  50. Kalchbrenner, N.; Grefenstette, E.; Blunsom, P. A convolutional neural network for modelling sentences. arXiv 2014, arXiv:1404.2188. [Google Scholar]
  51. Zhou, J.; Troyanskaya, O.G. Predicting effects of noncoding variants with deep learning-based sequence model. Nat. Methods 2015, 12, 931–934. [Google Scholar] [CrossRef]
  52. Kim, Y. Convolutional neural networks for sentence classification. arXiv 2014, arXiv:1408.5882. [Google Scholar]
  53. Collobert, R.; Weston, J.; Bottou, L.; Karlen, M.; Kavukcuoglu, K.; Kuksa, P. Natural language processing (almost) from scratch. J. Mach. Learn. Res. 2011, 12, 2493–2537. [Google Scholar]
  54. Quang, D.; Xie, X. DanQ: A hybrid convolutional and recurrent deep neural network for quantifying the function of DNA sequences. Nucleic Acids Res. 2016, 44, e107. [Google Scholar] [CrossRef]
  55. Wang, J.; Wang, L. Deep Learning of the Back-splicing Code for Circular RNA Formation. Bioinformatics 2019, btz382. [Google Scholar] [CrossRef]
  56. Gupta, S.; Stamatoyannopoulos, J.A.; Bailey, T.L.; Noble, W.S. Quantifying similarity between motifs. Genome Biol. 2007, 8, R24. [Google Scholar] [CrossRef] [PubMed]
Sample Availability: Samples are not available from the authors.
Figure 1. The distribution of AUCs across various kernels.
Figure 1. The distribution of AUCs across various kernels.
Molecules 24 04035 g001
Figure 2. The distribution of AUCs across various parameters and structures.
Figure 2. The distribution of AUCs across various parameters and structures.
Molecules 24 04035 g002
Figure 3. Receiver operating characteristics (ROC) curves to show the superior performance of CSCRSites (cancer-specific circRNA–RBP binding sites) over multilayer perception (MLP), support vector machine (SVM), and random forest (RF) on the test dataset. RBP, RNA binding protein.
Figure 3. Receiver operating characteristics (ROC) curves to show the superior performance of CSCRSites (cancer-specific circRNA–RBP binding sites) over multilayer perception (MLP), support vector machine (SVM), and random forest (RF) on the test dataset. RBP, RNA binding protein.
Molecules 24 04035 g003
Figure 4. ROC curves to show the superior performance of CSCRSites over other deep learning-based methods on the test dataset.
Figure 4. ROC curves to show the superior performance of CSCRSites over other deep learning-based methods on the test dataset.
Molecules 24 04035 g004
Figure 5. Some sequence logos of matched motifs whose associated genes are involved in human cancer. For each plot, the motifs learnt by CSCRSites (bottom) is aligned with the known motif (top) from Homo sapiens database by TOMTOM. The gene name associated with the known motif is shown in Table 2.
Figure 5. Some sequence logos of matched motifs whose associated genes are involved in human cancer. For each plot, the motifs learnt by CSCRSites (bottom) is aligned with the known motif (top) from Homo sapiens database by TOMTOM. The gene name associated with the known motif is shown in Table 2.
Molecules 24 04035 g005
Figure 6. Schematic diagram of CSCRSites model construction.
Figure 6. Schematic diagram of CSCRSites model construction.
Molecules 24 04035 g006
Table 1. CSCRSites outperforms other deep learning-based models on the test dataset. Accuracy, Acc.; precision, Prec.
Table 1. CSCRSites outperforms other deep learning-based models on the test dataset. Accuracy, Acc.; precision, Prec.
Zeng’s method0.590.590.62
Table 2. Some motifs learnt by CSCRSites are aligned with the known motifs and the associated genes.
Table 2. Some motifs learnt by CSCRSites are aligned with the known motifs and the associated genes.
Associated GenesKnown Motifs IDKnown SequenceLearnt Motifs IDLearnt SequenceOverlapE-Value
Table 3. Application, merit, and demerit of comparative methods.
Table 3. Application, merit, and demerit of comparative methods.
MethodsApplicationMotifs MeritDemerit
CSCRSitescircRNA binding sitesYESDiscovery of various length motifs
High prediction accuracy
The rate of convergence is relatively slow
DeepBindDNA/RNA binding sitesYESScales well to ChIP-seq and HT-SELEX data setsLow prediction accuracy on circRNA data sets
binding sites
YESIntegrates RNA secondary structurePredict binding targets for specific RBP
Zeng’s methodDNA
binding sites
YESMotif occupancy taskMotif length is fixed

© 2019 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (
Back to TopTop