Abstract
In 2020, a global pandemic caused by SARS-CoV-2 was declared. Different institutes proposed diagnostic molecular methods to detect the virus in clinical samples. This study aims to validate and standardize the use of a loop-mediated isothermal amplification (LAMP)-based methodology targeting the viral RP gene, as a faster and low-cost diagnostic method for SARS-CoV-2 infections. The results obtained with RT-LAMP (Reverse Transcriptase) were compared to the results of real-time polymerase chain reaction (RT-PCR) to assess its sensitivity and specificity. In total, 115 samples (nasopharyngeal samples) were used for detecting SARS-CoV-2 by RT-LAMP, with 43 positives and 72 negatives. The study showed a positive predictive value (PPV) of 90.7% and a negative predictive value (VPN) of 100%. The LAMP assay also demonstrated a high sensitivity of 90.7% and a specificity of 100% (confidence interval 77.9–97.4%) when using the lower detection limit of 40 copies/µL. The RT-LAMP described here has the potential to detect even the new variants of SARS-CoV-2, suggesting that it may not be significantly affected by gene mutations. The RT-LAMP targeting the RP viral region is faster and less expensive than other molecular approaches, making it an alternative for developing countries.
1. Introduction
At the beginning of the SARS-CoV-2 pandemic, the virus was initially imported into Brazil from Europe, where it quickly found a vulnerable environment due to the lack of proper protective measures. This allowed the virus to spread rapidly within the country, resulting in a devastating outcome. Consequently, multiple variants of concern, such as the P.1 variant, emerged and contributed to the already alarming death toll, which currently stands at over 687 thousand people [1]. The number of COVID-19 cases in Brazil has reached a staggering 35 million to date.
To combat the widespread dissemination of the virus, various measures were suggested, including social isolation and other containment protocols. However, as reports from countries across the globe started pouring in, it became evident that the viral spread and severe respiratory diseases were not limited to Brazil alone. As a result, the total number of COVID-19 cases worldwide has climbed to a startling 657 million, with an alarming death toll of 6.9 million (as of May 2023).
Numerous diagnostic methods have been proposed by different institutions in various countries, each striving to tackle the challenges posed by SARS-CoV-2. The Centers for Disease Control and Prevention (CDC) in the United States, among others, initially advocated for molecular methods such as PCR-based assays, which were later followed by immunological assays as the pandemic progressed [2].
Among the diagnostic techniques, reverse transcription real-time polymerase chain reaction (RT-qPCR) emerged as the primary method for detecting SARS-CoV-2 due to its exceptional sensitivity and ability to identify even minute amounts of viral genetic material in clinical samples. Nonetheless, RT-qPCR does have its drawbacks. It is a time-consuming and expensive technique, making its implementation challenging in certain diagnostic centers, particularly those in low- and mid-income countries.
In an effort to address these limitations, an alternative method called loop-mediated isothermal amplification (LAMP) gained attention. LAMP is an isothermal amplification technique developed by Notomi and colleagues in 2000 [3]. One of its key advantages is the ability to generate billions of DNA copies at a constant temperature, eliminating the need for complex thermocyclers and significantly reducing the overall cost of the test. Additionally, LAMP demonstrates high specificity by targeting up to eight distinct regions of the DNA, making it a reliable and accurate diagnostic method. Furthermore, LAMP can be combined with a reverse transcription step, allowing it to be applied to RNA-based pathogens such as SARS-CoV-2. This suggests the possibility of using LAMP alongside RT-qPCR to enhance diagnostic capabilities [4].
The objective of this study was to develop a colorimetric loop-mediated isothermal amplification assay preceded by a reverse transcription step (RT-LAMP). The target for amplification in this assay was the SARS-CoV-2 polymerase gene. To evaluate the performance of the proposed method, the sensitivity and specificity, as well as the negative and positive predictive values, were calculated using RT-qPCR as the reference method.
2. Results and Discussion
In total, 115 nasopharyngeal samples were used for the detection by RT-LAMP. Among the samples tested, a total of 43 samples were determined to be positive for SARS-CoV-2, while 72 samples yielded negative results. These findings were previously established through the utilization of a validated RT-qPCR method targeting the N1 and N2 viral regions. When comparing the results obtained from the RT-LAMP assay with those obtained from RT-qPCR, a total agreement exceeding 96.5% was observed. Furthermore, the RT-LAMP method exhibited a remarkable specificity of 100% and a sensitivity of 90.7%. These values were calculated based on a limit of detection (LOD) of 40 copies/µL.
The negative predictive value (NPV) of the RT-LAMP assay was determined to be 94.7%, indicating a high degree of confidence in identifying true negative cases. Conversely, the positive predictive value (PPV) was found to be 100%, underscoring the reliability of the RT-LAMP assay in accurately detecting positive cases. Notably, the LOD observed for this particular method was 40 RNA copies/µL, which consistently yielded positive results in over 95% of the test runs (as depicted in Figure 1). To ensure robust test validation, these runs were performed in triplicate over 3 days.
Figure 1.
Determination of lower detection limit using RT-LAMP in nasopharyngeal samples. Legend: NTC = No template control. The numbers at the top are copies/µL. Red/pinkish color is a negative reaction. Positive reactions in yellow color.
It is worth mentioning that the LOD observed with the RT-LAMP assay corresponded to an RT-PCR CT value of less than 27, emphasizing the comparable sensitivity and accuracy of the two diagnostic methods in detecting SARS-CoV-2 infections.
The RT-LAMP assay was employed to analyze a set of positive samples, each with a CT value below 30 in the RT-PCR analysis. These samples encompassed the predominant SARS-CoV-2 variants that were circulating in the specific region under investigation, including the gamma (P.1), delta, and omicron variants. Each variant was represented by five nasopharyngeal samples previously genotyped by a reference laboratory, which were collected in February 2021 and subsequently subjected to the RT-LAMP assay. Notably, the assay successfully and accurately detected all tested variants, implying that the selected primers remained effective even in the presence of potential gene mutations.
This observation provides valuable insight into the robustness and reliability of the RT-LAMP assay, suggesting that the primer sequences employed in the assay were not compromised by the presence of genetic variations within the targeted regions of the SARS-CoV-2 genome. The ability to detect and identify the different variants using the RT-LAMP assay strengthens its applicability as a valuable diagnostic tool capable of accommodating the dynamic nature of the virus. In our setting, the calculated cost of the RT-LAMP is USD 2.5 compared to USD 10 for the current RT-qPCR assay used in our lab.
The RT-LAMP proposed in this study has emerged as a promising alternative to RT-PCR for the detection of SARS-CoV-2 directly from nasopharyngeal swabs, offering numerous advantages and potential applications. One notable advantage is the simplicity of the reaction, which can be performed using a water bath maintained at a fixed temperature of 63 °C. This eliminates the need for expensive equipment, making the RT-LAMP assay a more cost-effective solution compared to RT-PCR, which typically requires specialized thermal cyclers [1].
A significant bottleneck in molecular testing lies in the nucleic acid extraction step, which is not only time-consuming, but also adds to the overall cost of testing. Extraction-free molecular methods, such as the RT-LAMP assay described here, have the potential to significantly reduce the time and costs associated with testing procedures [5]. By bypassing the extraction step, the RT-LAMP assay not only streamlines the workflow, but also minimizes the impact on test sensitivity, further contributing to its cost-effectiveness [6,7].
In the specific setting of this study, the RT-LAMP assay demonstrated robust performance, as indicated by its calculated negative predictive value (NPV) of 100% and a positive predictive value (PPV) of 90.7% (as presented in Table 1. These findings underscore the potential of the RT-LAMP assay as a reliable diagnostic tool for SARS-CoV-2 detection.
Table 1.
Sensitivity and specificity of LAMP compared to RT-PCR.
Numerous studies investigating the application of RT-LAMP for SARS-CoV-2 detection have consistently reported high sensitivity, with a range of 91% to 100%, even when using different genetic targets and detection strategies [6,7,8,9,10,11,12,13,14,15,16]. While the RT-LAMP assay may occasionally yield false-negative results, especially in cases of extremely low viral loads near the limit of detection (LOD), it is unlikely that such false negatives in this study resulted from Bst enzyme inhibition. Bst polymerase, the key enzyme used in the RT-LAMP assay, exhibits tolerance to various inhibitors that could potentially impact the performance of RT-PCR assays [17]. It is important to note that low viral loads, particularly during the early or late stages of the symptomatic phase of COVID-19, pose a challenge for all detection methods, including RT-PCR, and may result in missed detections [17].
Recent meta-analyses encompassing large-scale studies involving thousands of SARS-CoV-2-infected patients have revealed that initial false-negative results via RT-PCR can be prevalent, with rates reaching up to 58% [18]. Rapid antigen tests, which have been utilized as an alternative to RT-PCR, also exhibit reduced sensitivity during the earlier stages of COVID-19, with an overall reported sensitivity of approximately 68% [19]. In contrast, the RT-LAMP assay described in this study demonstrates high specificity (100%), which can be attributed to the utilization of six specific primers targeting the selected region, as supported by previous studies [10,13,15,16,20]. This multiple-primer approach enhances the assay’s specificity and further reinforces its reliability for SARS-CoV-2 detection.
According to OPAS [2], one potential drawback of colorimetric LAMP methods, including the RT-LAMP assay, is their susceptibility to acidic samples, such as saliva, which can lead to false-positive results due to the color change of the pH indicator [2]. However, it is crucial to note that in such cases, the appearance of a yellow color upon sample addition to the LAMP mix should prompt the interpretation of the reaction as invalid, mitigating the impact of false positive results. Therefore, as an alternative, turbidity or fluorescence-based tests could be utilized. This emphasizes the importance of following proper protocols and recognizing the limitations of the assay when interpreting the results, particularly in the presence of acidic samples.
In summary, the RT-LAMP assay presented in this study offers a simple, efficient, and cost-effective method for the detection of SARS-CoV-2 in nasopharyngeal samples. By eliminating the need for nucleic acid extraction and utilizing a water bath at a fixed temperature, the assay not only reduces the time and cost associated with testing, but also demonstrates comparable sensitivity to RT-PCR and superior specificity. The ability to complete the assay within 45 min further enhances its appeal, allowing for a rapid and timely detection of the virus [2].
The RT-LAMP assay holds great promise as a valuable tool in resource-limited settings, where access to sophisticated laboratory infrastructure and equipment may be limited. Its user-friendly nature and minimal requirements make it accessible to a broader range of healthcare facilities, facilitating the confirmation of COVID-19 infections in a timely and cost-effective manner.
However, it is essential to acknowledge that the field of SARS-CoV-2 research is continuously evolving, with new viral variants emerging. Further studies are necessary to evaluate the performance of the RT-LAMP assay in the context of these evolving viral genomes. Additionally, expanding the sample size and conducting comparative studies against established diagnostic methods would provide additional validation and strengthen the evidence supporting the efficacy of the RT-LAMP assay for SARS-CoV-2 detection.
In conclusion, the RT-LAMP assay described in this study represents a significant advancement in the field of molecular diagnostics for SARS-CoV-2. Its ability to detect the virus directly from nasopharyngeal swabs, without the need for nucleic acid extraction, coupled with its cost-effectiveness, rapidity, and accuracy, positions it as a valuable alternative to conventional RT-PCR methods. As the global battle against COVID-19 continues, the RT-LAMP assay holds immense potential for widespread implementation, especially in resource-limited settings, contributing to improved patient management and disease control.
3. Materials and Methods
3.1. Nasopharyngeal Samples
Nasopharyngeal samples employed in this investigation were obtained utilizing a sterile swab and transferred into a tube containing 2 mL of saline solution. The samples were collected at a private laboratory, located in Novo Hamburgo, Brazil, in response to medical requests for RT-qPCR to diagnose COVID-19. The collection period spanned from June 2020 to August 2020, and the samples were promptly frozen and preserved until the time of testing, with a maximum storage time of 24 h. Subsequently, after undergoing RT-qPCR analysis (Promega Corporation, Madison WI, USA) an aliquot of approximately 1 mL of the remaining sample was transferred to a new sterile tube and then stored at a temperature of −20 °C for a maximum of 48 h prior to RT-LAMP testing. It should be noted that during the thawing process, the aliquots were promptly processed to minimize any potential degradation of viral RNA. All samples utilized in this study were handled anonymously and exclusively identified by an internal numerical code, thereby ensuring the confidentiality of patient information, which remained inaccessible and unused throughout the study (as depicted in Figure 2).
Figure 2.
Schematic view of sample collection, transportation, and RT-LAMP analysis. (A)—Nasopharyngeal sample collection. (B)—Sample is transferred to a tube containing 2 ml of sterile saline. (C)—A 1 mL aliquot was transferred to a cryotube and kept frozen until RT-LAMP analysis. (D)—Thawed sample added directly to the RT-LAMP mix (New England Biolabs®, Ipswich, MA, USA). (E)—Tubes were incubated at 63 °C for 45 min. (F)—After incubation, the yellow color indicates positivity for SARS-CoV2, while the red color indicates a negative test.
In total, the study encompassed a comprehensive set of 115 nasopharyngeal samples. Among these, 43 samples exhibited positive results (with a CT value below 30) for SARS-CoV-2, as determined by RT-qPCR, which served as the benchmark methodology for method comparison [16].
This project was approved by the Ethical Committee of Universidade Federal de Ciências da Saúde de Porto Alegre (UFCSPA-Porto Alegre-Brazil) under the identification number 4,769,584.
3.2. Primers for RT-LAMP
Oligonucleotide primers were designed using the online software PrimerExplorer version 5 (https://primerexplorer.jp/e/ (accessed on 22 February 2020)) using the consensus RNA polymerase (RP) gene sequence from SARS-CoV-2 as the template. Table 2 shows the chosen primer set designed for this study.
Table 2.
LAMP primer set used in this study (in bold) and their properties.
3.3. RT-LAMP
The RT-LAMP reaction was carried out utilizing the WarmStart® Colorimetric LAMP Kit, a product manufactured by New England Biolabs® (Ipswich, MA, USA). The laboratory had previously validated the following protocol for the detection of other pathogens, ensuring its reliability and effectiveness. The final reaction volume was set at 10 µL, comprising 5 µL of WarmStart® Colorimetric LAMP MIX, 1 µL of RP primers MIX (with a final concentration of 200 nM for F3/B3 primers, 1600 nM for FIP/BIP primers, and 400 nM for LF/LB primers), 2.0 µL of nuclease-free water, and 2 µL of the sample or controls.
Upon preparing the reaction mixtures, the tubes were promptly subjected to an isothermal reaction at a temperature of 63 °C for a duration of 45 min. Following the incubation period, the reactions were visually examined, and a discernible change from the original red/pinkish color to a distinct yellow color was deemed indicative of a positive result. To ensure the validity of the results, positive controls (known positive samples) and non-template controls (NTCs) were included in each new run, serving as reference points for comparison.
It is important to note that for the sample preparation, a brief vortex homogenization step was employed to ensure proper mixing. Subsequently, 2 µL of the homogenized sample was directly used without undergoing any nucleic acid extraction procedures, simplifying the workflow and reducing processing time.
To determine the limit of detection (LOD) for the RT-LAMP assay, a series of 10-fold dilutions were prepared from a pooled positive sample, which had previously been quantified using RT-qPCR. These dilutions were tested in triplicate on multiple occasions. The lowest viral load that consistently produced a clear and repeatedly positive result in the RT-LAMP runs was considered the LOD for this assay. For the concordance analysis, the acceptance criterion was used as a global concordance greater than or equal to 95%.
Author Contributions
Conceptualization: E.d.R.H. and V.V.C.; methodology: E.d.R.H., E.I. and L.R.P., software: V.V.C. validation, E.d.R.H., E.I. and L.R.P., and L.d.R.B.; formal analysis: E.d.R.H. and G.G., investigation:, E.d.R.H., E.I. and L.R.P.; resources: E.d.R.H., E.I. and L.R.P.; data curation, E.d.R.H. and G.G., writing—original draft preparation: E.d.R.H. and G.G.; writing—review and editing: E.d.R.H. and G.G.; visualization: E.d.R.H. and V.V.C.; supervision, V.V.C.; project administration: E.d.R.H. and V.V.C.; funding acquisition: E.I. and L.R.P. All authors have read and agreed to the published version of the manuscript.
Funding
This research received no external funding.
Institutional Review Board Statement
The study was conducted in accordance with the Declaration of Helsinki, and approved by the Institutional Review Board of the Universidade Federal de Ciências da Saúde de Porto Alegre (UFCSPA Porto Alegre Brazil) under the identification number 4,769,584.
Informed Consent Statement
Not applicable.
Data Availability Statement
Not applicable.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Giovanetti, M.; Slavov, S.N.; Fonseca, V.; Wilkinson, E.; Tegally, H.; Patané, J.S.L.; Viala, V.L.; San, E.J.; Rodrigues, E.S.; Santos, E.V.; et al. Genomic epidemiology of the SARS-CoV-2 epidemic in Brazil. Nat. Microbiol. 2022, 7, 1490–1500. [Google Scholar] [CrossRef] [PubMed]
- OPAS. Histórico da pandemia de COVID-19—OPAS/OMS|Organização Pan-Americana da Saúde. 2020. Available online: https://www.paho.org/pt/covid19/historico-da-pandemia-covid-19 (accessed on 3 December 2022).
- Notomi, T.; Okayama, H.; Masubuchi, H.; Yonekawa, T.; Watanabe, K.; Amino, N.; Hase, T. Loop-mediated isothermal amplification of DNA. Nucleic Acids Res. 2000, 28, e63. [Google Scholar] [CrossRef]
- Soroka, M.; Wasowicz, B.; Rymaszewska, A. Loop-Mediated Isothermal Amplification (LAMP): The Better Sibling of PCR? Cells 2021, 10, 1931. [Google Scholar] [CrossRef]
- Smyrlaki, I.; Ekman, M.; Lentini, A.; Rufino de Sousa, N.; Papanicolaou, N.; Vondracek, M.; Aarum, J.; Safari, H.; Muradrasoli, S.; Rothfuchs, A.G.; et al. Massive and rapid COVID-19 testing is feasible by extraction-free SARS-CoV-2 RT-PCR. Nat. Commun. 2020, 11, 4812. [Google Scholar] [CrossRef]
- Alvarez, C.U.; Lam, Q.; Baldwin, D.A.; Chernoff, J. Low saliva pH can yield false positives results in simple RT-LAMP-based SARS-CoV-2 diagnostic tests. PLoS ONE 2021, 16, e0250202. [Google Scholar]
- Zhang, C.; Zheng, T.; Wang, H.; Chen, W.; Huang, X.; Liang, J.; Qiu, L.; Han, D.; Tan, W. Rapid One-Pot Detection of SARS-CoV-2 Based on a Lateral Flow Assay in Clinical Samples. Anal. Chem. 2021, 93, 3325–3330. [Google Scholar] [CrossRef]
- Baek, Y.H.; Um, J.; Antigua, K.J.C.; Park, J.-H.; Kim, Y.; Oh, S.; Kim, Y.-I.; Choi, W.-S.; Kim, S.G.; Jeong, J.J.; et al. Development of a reverse transcription-loop-mediated isothermal amplification as a rapid early-detection method for novel SARS-CoV-2. Emerg. Microbes Infect. 2020, 9, 998–1007. [Google Scholar] [CrossRef]
- Haq, F.; Sharif, S.; Khurshid, A.; Ikram, A.; Shabbir, I.; Salman, M.; Ahad, A.; Rana, M.S.; Raja, A.; Badar, N.; et al. Reverse transcriptase loop-mediated isothermal amplification (RT-LAMP)-based diagnosis: A potential alternative to quantitative real-time PCR based detection of the novel SARS-CoV-2 virus. Saudi J. Biol. Sci. 2021, 28, 942–947. [Google Scholar] [CrossRef]
- Jang, W.S.; Lim, D.H.; Yoon, J.; Kim, A.; Lim, M.; Nam, J.; Yanagihara, R.; Ryu, S.-W.; Jung, B.K.; Ryoo, N.-H.; et al. Development of a multiplex Loop-Mediated Isothermal Amplification (LAMP) assay for on-site diagnosis of SARS-CoV-2. PLoS ONE 2021, 16, e0248042. [Google Scholar] [CrossRef] [PubMed]
- Jiang, M.; Pan, W.; Arasthfer, A.; Fang, W.; Ling, L.; Fang, H.; Daneshnia, F.; Yu, J.; Liao, W.; Pei, H.; et al. Development and validation of a rapid, single-step reverse transcriptase loop-mediated isothermal amplification (RT-LAMP) system potentially to be used for reliable and high-throughput screening of COVID-19. Front. Cell. Infect. Microbiol. 2020, 10, 331. [Google Scholar] [CrossRef] [PubMed]
- Kitagawa, Y.; Orihara, Y.; Kawamura, R.; Imai, K.; Sakai, J.; Tarumoto, N.; Matsuoka, M.; Takeuchi, S.; Maesaki, S.; Maeda, T. Evaluation of rapid diagnosis of novel coronavirus disease (COVID-19) using loop-mediated isothermal amplification. J. Clin. Virol. 2020, 129, 104446. [Google Scholar] [CrossRef]
- Li, J.; Hu, X.; Wang, X.; Yang, J.; Zhang, L.; Deng, Q.; Zhang, X.; Wang, Z.; Hou, T.; Li, S. A novel One-pot rapid diagnostic technology for COVID-19. Anal. Chim. Acta 2021, 1154, 338310. [Google Scholar] [CrossRef] [PubMed]
- Lu, R.; Wu, X.; Wan, Z.; Li, Y.; Jin, X.; Zhang, C. A novel reverse transcription loop-mediated isothermal amplification method for rapid detection of SARS-CoV-2. Int. J. Mol. Sci. 2020, 21, 2826. [Google Scholar] [CrossRef] [PubMed]
- Manzano, J.R.; Malpartida-Cardenas, K.; Moser, N.; Pennisi, I.; Cavuto, M.; Miglietta, L.; Moniri, A.; Penn, R.; Satta, G.; Randell, P.; et al. Handheld point-of-care system for rapid detection of SARS-CoV-2 extracted RNA in under 20 min. ACS Cent. Sci. 2021, 7, 307–317. [Google Scholar] [CrossRef] [PubMed]
- Ganguli, A.; Mostafa, A.; Berger, J.; Aydin, M.Y.; Sun, F.; de Ramirez, S.A.S.; Valera, E.; Cunningham, B.T.; King, W.P.; Bashir, R.; et al. Rapid isothermal amplification and portable detection system for SARS-CoV-2. Proc. Natl. Acad. Sci. USA 2020, 117, 22727–22735. [Google Scholar] [CrossRef] [PubMed]
- Wikramaratna, P.S.; Paton, R.S.; Ghafari, M.; Lourenço, J. Estimating the false-negative test probability of SARS-CoV-2 by RT-PCR. Eurosurveillance 2020, 25, 2000568. [Google Scholar] [CrossRef] [PubMed]
- Pecoraro, V.; Negro, A.; Pirotti, T.; Trenti, T. Estimate false-negative RT-PCR rates for SARS-CoV-2. A systematic review and meta-analysis. Eur. J. Clin. Investig. 2022, 52, e13706. [Google Scholar] [CrossRef] [PubMed]
- Khandker, S.S.; Nik Hashim, N.H.H.; Deris, Z.Z.; Shueb, R.H.; Islam, M.A. Diagnostic accuracy of rapid antigen test kits for detecting SARS-CoV-2: A systematic review and meta-analysis of 17,171 suspected COVID-19 patients. J. Clin. Med. 2021, 10, 3493. [Google Scholar] [CrossRef] [PubMed]
- Lee, J.Y.; Best, N.; McAuley, J.; Porter, J.L.; Seemann, T.; Schultz, M.B.; Sait, M.; Orlando, N.; Mercoulia, K.; Ballard, S.A.; et al. Validation of a single-step, single-tube reverse transcription loop-mediated isothermal amplification assay for rapid detection of SARS-CoV-2 RNA. J. Med. Microbiol. 2020, 69, 1169. [Google Scholar] [CrossRef] [PubMed]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).