- freely available
Molecules 2014, 19(5), 6282-6293; doi:10.3390/molecules19056282
Published: 16 May 2014
Abstract: The objective of this meta-analysis was to determine the diagnostic accuracy of circulating microRNA-155 (miR-155) for breast cancer (BC). PubMed, Embase, EBSCO (ASP/BSP), Cochrane Library and China National Knowledge Infrastructure (CNKI) were searched up to 30 January 2014 for eligible studies. Quality Assessment of Diagnostic Accuracy Studies (QUADAS) was employed to assess the quality of the included studies. Meta-analysis were performed in Meta-Disc 1.4 and Stata 12.0. Three studies with total 184 BC patients and 75 control individuals were included in this meta-analysis. All of the included studies are of high quality (QUADAS scores 12 or 13). The summary estimates revealed that the pooled sensitivity is 79% (95% confidence interval (CI): 72%–84%) and the specificity is 85% (95% CI: 75%–92%), for the diagnosis of breast cancer. In addition, the area under the summary ROC curve (AUC) is 0.9217. The current evidence suggests that circulating miR-155 has the potential diagnostic value with a high sensitivity and specificity for BC. More prospective studies on the diagnostic value of circulating miR-155 for BC are needed in the future.
Breast cancer (BC) remains the top cancer and the principle cause of death from cancer in women globally, accounting for 28.84% of all cancer cases and 14.49% of cancer-related deaths, respectively . In 2013, an estimated 232,340 new cases of invasive BC and 39,620 BC deaths were expected among American women [1,2]. Since the prognosis of BC is closely related to the extent that how early the disease is diagnosed, efficient and convenient diagnostic methods are urgently needed in the clinical management of BC. Currently, the most efficacious screening tool for BC is mammography. However, it is too expensive to be feasible in most developing countries . Serum-based screening is easier, less invasive and more affordable than mammography. Thus, large part of the efforts focuses on identification of serum-based biomarkers for the diagnosis of BC. At present, the most promising serum markers, CEA and CA15-3, are not sensitive enough for accurate BC diagnosis.
MicroRNAs (miRNAs) are a class of 21–24 nucleotide nonprotein-coding RNAs working as post-transcriptional regulators of gene expression [4,5]. They play important roles in the regulation of target genes by either inducing mRNA degradation or inhibiting translation [6,7]. Numerous studies have shown that aberrant miRNA expression is associated with cancer development and can be detected in serum or plasma and other body fluids [8,9]. There is increasing evidence showing that some circulating miRNAs originated from cancer tissues can be quantitatively measured with established methodology [10,11]. Compared to normal individuals, distinguishable circulating miRNAs expression pattern is observed in BC patients. Therefore, microRNAs in serum and plasma gradually show their advantages in the diagnosis and prognosis prediction of BC [12,13].
MicroRNA-155 (miR-155) is one of the most frequently studied oncomiRNAs. It was reported that miR-155 downregulates SOCS1 in breast cancer, in turn leading to persistent activation of STAT3 signaling and inflammatory cascades. This indicates the communicative role of miR-155 between inflammation and cancer . In breast cancer tissue, the overexpression of miR-155 was observed . Recently, several studies have shown that miR-155 is detected at a high level in the serum of patients with BC [16,17,18,19]. However, the value of miR-155 in the application for BC diagnosis varied in the different studies. Therefore, systematic analysis of these data may be valuable to finally confirm the application potential of miR-155 as a biomarker for BC. The aim of this meta-analysis is to explore the potential value of miR-155 in the diagnosis of BC which, to the best of our knowledge, has not been previously performed.
The initial search returned a total of 135 manuscripts, among which 29 duplicated hits and 13 reviews were excluded. The left 93 research articles are subject to the next step evaluation. Thirty two manuscripts were excluded from analysis as the carcinoma was not BC, leaving 61 studies available for further full text review. After carefully reading the text, 36 manuscripts were excluded as other miRNAs rather than miR-155 were focused. Of the remaining 25 manuscripts, samples of nine studies were not from peripheral blood, 11 studies were not diagnostic research, and one study failed to publish detailed information. In the remaining four studies, there were two studies with duplicated data. Thus, the meta-analysis was performed on the final three studies [17,18,20] (Figure 1).
2.1. Characteristics of Included Studies
In these eligible articles, all of the 184 BC patients had been histopathologically confirmed. Additionally, all patients were classified by TNM stage. All 75 control individuals were healthy volunteers who had never been diagnosed with a malignant tumor. Therefore, the three studies including 184 patients and 75 control samples reported the quantity of miR-155 in peripheral blood were used in this meta-analysis. All the studies were published from 2012 to 2013. In these researches, miR-155 was detected by reverse transcription Polymerase Chain Reaction (RT-PCR). The fold changes in miR-155 expression were calculated using the 2−ΔΔCt method. These results were summarized in Table 1.
|Table 1. Summary of studies using miR-155 as a biomarker of BC and study quality assessment.|
|Authors [ref]||Year||Patients (Control)||QUADAS Scores||Stage I, II%||Mean Age||AUC||Endogenous Control||Cut-off||Sen%||Spe%|
|Zhao et al. ||2012||20(10)||12||100||53||0.97||RNU6B||0.95||100||90|
|Sun et al. ||2012||103(55)||13||63.1||51||0.801||cel-mir-39||1.911||65.0||81.8|
|Mar-Aguilar et al. ||2013||61(10)||12||44.3||53||0.9944||18S RNA||7.92||94.40||100.00|
2.2. Quality of Included Studies
The three studies were scored by QUADAS by two independent reviewers (F.L.W and J.C.H). The QUADAS analysis showed that all studies got scores of 13 or 12, indicating the high quality of included studies (Table S1).
2.3. Description of Outcomes
Sensitivity, specificity, positive LR, negative LR, SROC and DOR were evaluated among the included studies.
2.4. Data Analysis
2.4.1. Sensitivity and Specificity
Considering that a common effect size was shared among studies and significant heterogeneity existed for sensitivity and specificity (I2 = 93.8% and 48.4%, respectively), the random effect model was employed. As displayed in Figure 2A,B, the results showed that the pooled sensitivity and specificity were 0.79 (95% CI = 0.72–0.84) and 0.85 (95% CI = 0.75–0.92), respectively.
2.4.2. Positive LR and Negative LR
Since common effect size was shared among studies and significant heterogeneity existed (I2 = 20.4% and 89.0%, respectively), random effect model was used. The results revealed that the combined PLR was 4.75 (95% CI = 2.20–10.26), indicating that patients with BC had a nearly 5-fold higher chance of being miR-155 test-positive compared with others without BC (Figure 2C). In respect to NLR, the pooled NLR is 0.11 (95% CI = 0.02–0.72) (Figure 2D).
2.4.3. SROC and DOR
The SROC curve for the included studies was shown in Figure 3. The pooled area under curve (AUC) of SROC was 0.9217 (95% CI = 0.896–0.987) and the DOR is 65.591 (95% CI: 3.669–1172.6).
2.5. Publication Bias
To assess the publication bias in this study, funnel plots was used in the meta-analysis. The funnel plot demonstrates a somehow asymmetric curve which can be explained by the limited number of included studies (Figure 4). The p-value of the test was 0.124. Therefore, there was no evidence showing that publication bias existed.
2.6. Threshold Effect
The threshold effect is due to differences in the sensitivity and specificity, and Spearman correlation coefficient of sensitivity and specificity is a good approach to evaluate the threshold effect . In this meta-analysis, the Spearman correlation coefficient of sensitivity and 1-specificity was −0.500 with a p value of 0.667, suggesting that there is no heterogeneity from threshold effect. The number of patients, the representation of the participants (stage I, II%) and the endogenous control might contribute to the heterogeneity in this meta-analysis.
CEA and/or CA15-3 are currently used as serum markers for BC. Unfortunately, these markers have low sensitivity and specificity for BC screening. MicoRNAs are small non-coding RNA molecules with 21–24 nucleotides in length. Some miRNAs are closely related to the development, invasion and metastasis of tumors [22,23,24,25,26,27]. Calin et al.  showed that half of the known miRNAs are in cancer-associated genomic regions or fragile sites, suggesting they may be involved in the initiation and progression of human malignancies. MicoRNAs are thus potential markers to detect BC and monitor treatment response of BC patients.
Studies have been showing that miRNAs derived from epithelial tumors are rapidly released into the blood stream [11,29]. More and more attention has been paid to the circulating miRNAs including miR-155 as the early diagnostic biomarker for BC [17,18,19,30]. We conduct this meta-analysis to provide an up-to-date and comprehensive analysis of the feasibility and accuracy of circulating miR-155 for the diagnosis of BC. As far as we know, this is the first meta-analysis about the diagnostic value of miR-155 for BC.
In this meta-analysis, we show that the pooled sensitivity and specificity are 0.79 (95% CI: 0.72–0.84) and 0.85 (95% CI: 0.75–0.92), respectively. Sun et al.  found that the optimal sensitivity and specificity were 4.9% and 99.1% for CA15-3, 7.8% and 98.2% for CEA, 48.5% and 56.4% for TPS. Thus, circulating miR-155 is more suitable for screening BC compared to conventional serum biomarkers. The diagnostic odds ratio (DOR) defined as the ratio of the odds of a true-positive to the odds of a false-positive, is a single indicator of diagnostic test accuracy that combines the sensitivity and specificity data into a single indicator . The value of DOR ranges from 0 to infinity with higher values indicating better discriminatory test performance. The DOR value of 65.591 indicates that the circulating miR-155 could be a useful biomarker for BC patients’ diagnosis. SROC is usually used to summarize overall test performance, and AUC is calculated to evaluate accuracy of the selected indicator. To demonstrate excellent accuracy, the valve of AUC should be more than 0.97. An AUC of 0.93 to 0.96 is considered to be very good and 0.75 to 0.92 is good. However, a value of less than 0.75 can be still reasonable, while the test will have obvious deficiency in its diagnostic accuracy, approaching a random test [32,33]. In this meta-analysis, we show that circulating miR-155 demonstrates good accuracy in the diagnosis of BC, with an AUC of 0.92. Overall, circulating miR-155 has good sensitivity and specificity in the diagnosis of BC.
Heterogeneity should be analyzed when interpreting the results for meta-analysis. One of the primary causes of heterogeneity in test accuracy studies is threshold effect, which arises when differences in sensitivities and specificities occur due to different cut-offs or thresholds used in different studies to define a positive or negative test result. For different cut-off values were used among the three studies, we used the Spearman correlation coefficient to analyze the threshold. The Spearman correlation coefficient of sensitivity and 1-specificity is −0.500 (p = 0.667), indicating that there is no heterogeneity in the threshold. Although the detecting methods for circulating miR-155 are all based on reverse transcriptional PCR (RT-PCR), there are no unified primers and endogenous controls for qPCR analysis. Therefore, different laboratories take different measures to quantify the circulating miR-155, which may contribute to sources of heterogeneity. In addition, the number of patients and the representation of the participants (stage I, II%) in different studies may also involved in forming heterogeneity.
Although we tried to avoid the biases in the meta-analysis process, there are still several limitations to our study. Firstly, the evaluation of circulating miR-155 as a novel marker in BC diagnosis just appeared in recent years, so this meta-analysis only included three studies. Secondly, two of the three included studies have small sample sizes [18,20]. Due to the two points, the study size obtained in this meta-analysis is relatively small. This may result in an unstable result and decrease the significance of this meta-analysis. Thirdly, only one study focus on early-stage breast cancer (stage I and II), while the other two both have advanced-stage breast cancer (stage III and IV). This may undermine the value of circulating miR-155 used for screening early-stage breast cancer. Fourthly, the index test results were not interpreted without knowledge of the results of the reference standard in all the three studies. This may affect the determination of the index test results. Fifthly, North American and northern European countries have the highest incidence rates of BC . However, no relevant studies from these areas could be included in this meta-analysis. Lastly, except for breast cancer, miR-155 is related to haematopoietic lineage differentiation, immunity, inflammation and cardiovascular diseases . So when we apply circulating miR-155 in the screening or diagnosis of breast cancer, the related disease should be considered seriously. In conclusion, despite of the limitations mentioned above, the current evidence suggests that circulating miR-155 has a potential diagnostic value in the diagnosis of BC. Certainly, large-scale prospective studies are needed in the future.
4. Materials and Methods
4.1. Search Strategy
We carried out a comprehensive search strategy in various databases including PubMed, Embase, EBSCO (ASP/BSP), Cochrane Library and China National Knowledge Infrastructure (CNKI) to seek out the articles studying the association between the level of circulating miR-155 and BC diagnosis up to 30 January 2014. The key words employed for literature retrieval are “microRNA-155” or “miR-155” or “miRNA-155” and “breast cancer” or “breast tumor” or “breast carcinoma” or “breast neoplasm” and “serum” or “sera” or “blood” or “plasma”. To obtain additional relevant articles, we scanned conference summaries and reference lists of articles identified in the initial search and even contacted authors to get additional information if necessary.
4.2. Eligibility Criteria
All publications identified by our search strategy were independently assessed by two reviewers (F.L.W and J.C.H). Any disagreement on controversial studies was resolved by fully discussion to consensus. Studies were included if they meet the following inclusion criteria: (1) the diagnosis of BC was made based on histopathological confirmation, which is widely regarded as the gold standard for BC diagnosis; (2) studies detecting miR-155 concentration must be in peripheral blood; (3) peripheral blood must have been collected for miR-155 analysis before any treatment; (4) studies presenting sufficient data to allow construction of two-by-two tables; and (5) patients with benign disease or healthy people served as the control group. Additionally, study exclusion criteria were: (1) duplicate publications; (2) unqualified data; and (3) studies with fewer than 20 patients; All of the literatures in line with the above criteria are considered to be qualified studies.
4.3. Data Abstraction
Two reviewers (F.L.W and J.C.H) independently extracted data and reached consensus on all the terms. We recorded the following information about each eligible trial: description of study population (mean age and clinical stage), study details (first author, year of publication and endogenous control), data for two-by-two table (cut-off, sensitivity and specificity) and study design.
4.4. Quality Assessment
The quality of each study was scored independently by two reviewers (F.L.W and J.C.H) with the Quality Assessment of Diagnostic Accuracy Studies (QUADAS) tool which features 14 questions and demonstrated to be efficient for the quality assessment of diagnostic accuracy (Table S1) . Each question should be answered with “yes”, “no”, or “unclear”. An answer of “yes” will get one score, while the “no” or “unclear” will gain a score of zero.
4.5. Statistical Analysis
Standard methods recommended for diagnostic accuracy meta-analysis were used . The sensitivity and specificity of each study were used to construct a 2 × 2 contingency table, and the patient numbers were used to calculate the overall diagnostic accuracy. The bivariate meta-analysis model was employed to summarize the sensitivity, specificity, positive likelihood ratio (PLR), negative likelihood ratio (NLR), diagnostic odds ratio (DOR) and generate the bivariate summary receiver operator characteristic (SROC) curve . The pooled sensitivity, specificity and other related indexes across studies were calculated using a random-effects model . Chi-square and I2 test were used to assess the heterogeneity in studies. A value of p less than 0.05 and I2 more than 50% indicated the existence of significant heterogeneity [40,41].
The publication bias of selected studies was assessed using linear regression test of funnel plot asymmetry. To detect cut-off threshold effects, the relationship between sensitivity and specificity was evaluated by the Spearman correlation coefficient. All analyses were performed using two statistical software programs: Stata, version 12 (Stata Corporation, College Station, TX, USA) and Meta-Disc 1.4 for Windows (XI Cochrane Colloquium, Barcelona, Spain) . All statistical tests were two sided, and significance was set at p < 0.05.
Our meta-analysis suggests that circulating miR-155 has the potential diagnostic value with a high sensitivity and specificity for BC. More prospective studies on the diagnostic value of circulating miR-155 for BC are needed in the future.
Supplementary materials can be accessed at: http://www.mdpi.com/1420-3049/19/5/6282/s1.
This work was supported by key scientific and technological project in Zhejiang Province (No. 2012C13014-4) and Department of Health in Zhejiang Province (No. 2010KYA116; 2013RCA029; WKJ2012-029).
H.J., X.W. and F.W. designed the research; F.W. and J.H. collected and analyzed the data; F.W. wrote the manuscript; W.J., J.L. and Y.Y. contributed to the discussion and revised the manuscript.
Conflicts of Interest
The authors declare no conflict of interest.
- Siegel, R.; Naishadham, D.; Jemal, A. Cancer statistics, 2013. CA: Cancer J. Clin. 2013, 63, 11–30, doi:10.3322/caac.21166.
- DeSantis, C.; Ma, J.; Bryan, L.; Jemal, A. Breast cancer statistics, 2013. CA: Cancer J. Clin. 2014, 64, 52–62, doi:10.3322/caac.21203.
- Siegel, R.; Ward, E.; Brawley, O.; Jemal, A. The impact of eliminating socioeconomic and racial disparities on premature cancer deaths. CA: Cancer J. Clin. 2011, 61, 212–236, doi:10.3322/caac.20121.
- Flynt, A.S.; Lai, E.C. Biological principles of microRNA-mediated regulation: Shared themes amid diversity. Nat. Rev. Genet. 2008, 9, 831–842, doi:10.1038/nrg2455.
- Carthew, R.W.; Sontheimer, E.J. Origins and mechanisms of miRNAs and siRNAs. Cell 2009, 136, 642–655, doi:10.1016/j.cell.2009.01.035.
- Wu, L.; Fan, J.; Belasco, J.G. MicroRNAs direct rapid deadenylation of mRNA. Proc. Natl. Acad. Sci. USA 2006, 103, 4034–4039, doi:10.1073/pnas.0510928103.
- Lewis, B.P.; Burge, C.B.; Bartel, D.P. Conserved seed pairing, often flanked by adenosines, indicates that thousands of human genes are microRNA targets. Cell 2005, 120, 15–20, doi:10.1016/j.cell.2004.12.035.
- Calin, G.A.; Croce, C.M. MicroRNA signatures in human cancers. Nat. Rev. Cancer 2006, 6, 857–866, doi:10.1038/nrc1997.
- Chen, X.; Ba, Y.; Ma, L.; Cai, X.; Yin, Y.; Wang, K.; Guo, J.; Zhang, Y.; Chen, J.; Guo, X. Characterization of microRNAs in serum: A novel class of biomarkers for diagnosis of cancer and other diseases. Cell Res. 2008, 18, 997–1006, doi:10.1038/cr.2008.282.
- Iguchi, H.; Kosaka, N.; Ochiya, T. Secretory microRNAs as a versatile communication tool. Commun. Integr. Biol. 2010, 3, 478–481, doi:10.4161/cib.3.5.12693.
- Mitchell, P.S.; Parkin, R.K.; Kroh, E.M.; Fritz, B.R.; Wyman, S.K.; Pogosova-Agadjanyan, E.L.; Peterson, A.; Noteboom, J.; O’Briant, K.C.; Allen, A. Circulating microRNAs as stable blood-based markers for cancer detection. Proc. Natl. Acad. Sci. USA 2008, 105, 10513–10518, doi:10.1073/pnas.0804549105.
- Heneghan, H.M.; Miller, N.; Lowery, A.J.; Sweeney, K.J.; Newell, J.; Kerin, M.J. Circulating microRNAs as novel minimally invasive biomarkers for breast cancer. Ann. Surg. 2010, 251, 499–505, doi:10.1097/SLA.0b013e3181cc939f.
- Kosaka, N.; Iguchi, H.; Ochiya, T. Circulating microRNA in body fluid: A new potential biomarker for cancer diagnosis and prognosis. Cancer Sci. 2010, 101, 2087–2092, doi:10.1111/j.1349-7006.2010.01650.x.
- Jiang, S.; Zhang, H.-W.; Lu, M.-H.; He, X.-H.; Li, Y.; Gu, H.; Liu, M.-F.; Wang, E.-D. MicroRNA-155 functions as an OncomiR in breast cancer by targeting the suppressor of cytokine signaling 1 gene. Cancer Res. 2010, 70, 3119–3127, doi:10.1158/0008-5472.CAN-09-4250.
- Iorio, M.V.; Ferracin, M.; Liu, C.-G.; Veronese, A.; Spizzo, R.; Sabbioni, S.; Magri, E.; Pedriali, M.; Fabbri, M.; Campiglio, M. MicroRNA gene expression deregulation in human breast cancer. Cancer Res. 2005, 65, 7065–7070, doi:10.1158/0008-5472.CAN-05-1783.
- Lu, Z.; Ye, Y.; Jiao, D.; Qiao, J.; Cui, S.; Liu, Z. miR-155 and miR-31 are differentially expressed in breast cancer patients and are correlated with the estrogen receptor and progesterone receptor status. Oncol. Lett. 2012, 4, 1027–1032.
- Sun, Y.; Wang, M.; Lin, G.; Sun, S.; Li, X.; Qi, J.; Li, J. Serum microRNA-155 as a potential biomarker to track disease in breast cancer. PLoS One 2012, 7, e47003.
- Mar-Aguilar, F.; Mendoza-Ramirez, J.A.; Malagon-Santiago, I.; Espino-Silva, P.K.; Santuario-Facio, S.K.; Ruiz-Flores, P.; Rodriguez-Padilla, C.; Resendez-Perez, D. Serum circulating microRNA profiling for identification of potential breast cancer biomarkers. Dis. Markers 2013, 34, 163–169, doi:10.1155/2013/259454.
- Zhu, W.; Qin, W.; Atasoy, U.; Sauter, E.R. Circulating microRNAs in breast cancer and healthy subjects. BMC Res. Notes 2009, doi:10.1186/1756-0500-2-89.
- Zhao, S.Y.; Wu, Q.; Gao, F.; Zhang, C.B.; Yang, X.W. Serum microRNA-155 as a potential biomarker for breast cancer screening. Chin. Sci. Bull. 2012, 57, 3466–3468, doi:10.1007/s11434-012-5362-1.
- Zamora, J.; Abraira, V.; Muriel, A.; Khan, K.; Coomarasamy, A. Meta-DiSc: A software for meta-analysis of test accuracy data. BMC Med. Res. Methodol. 2006, 6, 31, doi:10.1186/1471-2288-6-31.
- Esquela-Kerscher, A.; Slack, F.J. Oncomirs—MicroRNAs with a role in cancer. Nat. Rev. Cancer 2006, 6, 259–269, doi:10.1038/nrc1840.
- Le Quesne, J.; Caldas, C. Micro-RNAs and breast cancer. Mol. Oncol. 2010, 4, 230–241, doi:10.1016/j.molonc.2010.04.009.
- Yu, Z.; Baserga, R.; Chen, L.; Wang, C.; Lisanti, M.P.; Pestell, R.G. microRNA, cell cycle, and human breast cancer. Breast Cancer Res. Treat. 2010, 176, 1058–1064.
- Blenkiron, C.; Goldstein, L.D.; Thorne, N.P.; Spiteri, I.; Chin, S.-F.; Dunning, M.J.; Barbosa-Morais, N.L.; Teschendorff, A.E.; Green, A.R.; Ellis, I.O. MicroRNA expression profiling of human breast cancer identifies new markers of tumor subtype. Genome Biol. 2007, 8, R214, doi:10.1186/gb-2007-8-10-r214.
- Kastl, L.; Brown, I.; Schofield, A. miRNA-34a is associated with docetaxel resistance in human breast cancer cells. Breast Cancer Res. Treat. 2012, 131, 445–454, doi:10.1007/s10549-011-1424-3.
- Zhu, Y.; Yu, F.; Jiao, Y.; Feng, J.; Tang, W.; Yao, H.; Gong, C.; Chen, J.; Su, F.; Zhang, Y. Reduced miR-128 in breast tumor–initiating cells induces chemotherapeutic resistance via Bmi-1 and ABCC5. Clin. Cancer Res. 2011, 17, 7105–7115.
- Calin, G.A.; Sevignani, C.; Dumitru, C.D.; Hyslop, T.; Noch, E.; Yendamuri, S.; Shimizu, M.; Rattan, S.; Bullrich, F.; Negrini, M. Human microRNA genes are frequently located at fragile sites and genomic regions involved in cancers. Proc. Natl. Acad. Sci. USA 2004, 101, 2999–3004, doi:10.1073/pnas.0307323101.
- Huang, Z.; Huang, D.; Ni, S.; Peng, Z.; Sheng, W.; Du, X. Plasma microRNAs are promising novel biomarkers for early detection of colorectal cancer. Int. J. Cancer 2010, 127, 118–126, doi:10.1002/ijc.25007.
- Roth, C.; Rack, B.; Muller, V.; Janni, W.; Pantel, K.; Schwarzenbach, H. Circulating microRNAs as blood-based markers for patients with primary and metastatic breast cancer. Breast Cancer Res. 2010, 12, R90.
- Glas, A.S.; Lijmer, J.G.; Prins, M.H.; Bonsel, G.J.; Bossuyt, P.M. The diagnostic odds ratio: A single indicator of test performance. J. Clin. Epidemiol. 2003, 56, 1129–1135.
- Jones, C.M.; Athanasiou, T. Summary receiver operating characteristic curve analysis techniques in the evaluation of diagnostic tests. Ann. Thorac. Surg. 2005, 79, 16–20, doi:10.1016/j.athoracsur.2004.09.040.
- Walter, S. Properties of the summary receiver operating characteristic (SROC) curve for diagnostic test data. Stat. Med. 2002, 21, 1237–1256, doi:10.1002/sim.1099.
- Althuis, M.D.; Dozier, J.M.; Anderson, W.F.; Devesa, S.S.; Brinton, L.A. Global trends in breast cancer incidence and mortality 1973–1997. Int. J. Epidemiol. 2005, 34, 405–412, doi:10.1093/ije/dyh414.
- Faraoni, I.; Antonetti, F.R.; Cardone, J.; Bonmassar, E. miR-155 gene: A typical multifunctional microRNA. Biochim. Biophys. Acta 2009, 1792, 497–505.
- Whiting, P.; Rutjes, A.W.; Reitsma, J.B.; Bossuyt, P.M.; Kleijnen, J. The development of QUADAS: A tool for the quality assessment of studies of diagnostic accuracy included in systematic reviews. BMC Med. Res. Methodol. 2003, 3, 25, doi:10.1186/1471-2288-3-25.
- Devillé, W.L.; Buntinx, F.; Bouter, L.M.; Montori, V.M.; de Vet, H.C.; van der Windt, D.A.; Bezemer, P.D. Conducting systematic reviews of diagnostic studies: Didactic guidelines. BMC Med. Res. Methodol. 2002, 2, 9, doi:10.1186/1471-2288-2-9.
- Mitchell, A.J.; Vaze, A.; Rao, S. Clinical diagnosis of depression in primary care: A meta-analysis. Lancet 2009, 374, 609–619, doi:10.1016/S0140-6736(09)60879-5.
- Vamvakas, E.C. Meta-analyses of studies of the diagnostic accuracy of laboratory tests: A review of the concepts and methods. Arch. Pathol. Lab. Med. 1998, 122, 675–686.
- Higgins, J.P.; Thompson, S.G.; Deeks, J.J.; Altman, D.G. Measuring inconsistency in meta-analyses. BMJ 2003, 327, 557–560, doi:10.1136/bmj.327.7414.557.
- Dinnes, J.; Deeks, J.; Kirby, J.; Roderick, P. A methodological review of how heterogeneity has been examined in systematic reviews of diagnostic test accuracy. Health Technol. Assess. 2005, 9, 1–113.
- Sample Availability: Not available.
© 2014 by the authors; licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution license (http://creativecommons.org/licenses/by/3.0/).