Next Article in Journal
How Did COVID-19 Affect Suicidality? Data from a Multicentric Study in Lombardy
Next Article in Special Issue
Diagnostic Accuracy of Rapid Antigen Test Kits for Detecting SARS-CoV-2: A Systematic Review and Meta-Analysis of 17,171 Suspected COVID-19 Patients
Previous Article in Journal
Subcutaneous Bupivacaine Infiltration Is Not Effective to Support Control of Postoperative Pain in Paediatric Patients Undergoing Spinal Surgery
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
JCM
Volume 10
Issue 11
10.3390/jcm10112404
jcm-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Diagnosing SARS-CoV-2 with Antigen Testing, Transcription-Mediated Amplification and Real-Time PCR

by
Sascha Dierks
1,†,
Oliver Bader
2,†,
Julian Schwanbeck
2,
Uwe Groß
2,
Michael S. Weig
2,
Kemal Mese
2,
Raimond Lugert
2,
Wolfgang Bohne
2,
Andreas Hahn
3,
Nicolas Feltgen
4,
Setare Torkieh
4,
Fenja R. Denker
4,
Peer Lauermann
4,
Marcus W. Storch
4,
Hagen Frickmann
3,5,‡ and
Andreas Erich Zautner
2,*,‡
1
Institute for Clinical Chemistry, University Medical Center Göttingen, 37075 Göttingen, Germany
2
Institute for Medical Microbiology, University Medical Center Göttingen, 37075 Göttingen, Germany
3
Institute for Medical Microbiology, Virology and Hygiene, University Medicine Rostock, 18057 Rostock, Germany
4
Department of Ophthalmology, University Medical Center Göttingen, 37075 Göttingen, Germany
5
Department of Microbiology and Hospital Hygiene, Bundeswehr Hospital Hamburg, 20359 Hamburg, Germany
*
Author to whom correspondence should be addressed.
†
Sascha Dierks and Oliver Bader contributed equally to this work.
‡
Hagen Frickmann and Andreas E. Zautner contributed equally to this work.
J. Clin. Med. 2021, 10(11), 2404; https://doi.org/10.3390/jcm10112404
Submission received: 23 April 2021 / Revised: 21 May 2021 / Accepted: 27 May 2021 / Published: 29 May 2021
(This article belongs to the Special Issue New Diagnostic Assays for COVID-19)
Versions Notes

Abstract

:
This study was performed as a head-to-head comparison of the performance characteristics of (1) two SARS-CoV-2-specific rapid antigen assays with real-time PCR as gold standard as well as (2) a fully automated high-throughput transcription-mediated amplification (TMA) assay and real-time PCR in a latent class analysis-based test comparison without a gold standard with several hundred samples in a low prevalence “real world” setting. Recorded sensitivity and specificity of the NADAL and the LumiraDx antigen assays and the Hologic Aptima SARS-CoV-2 TMA assay were 0.1429 (0.0194, 0.5835), 0.7644 (0.7016, 0.8174), and 0.7157 (0, 1) as well as 0.4545 (0.2022, 0.7326), 0.9954 (0.9817, 0.9988), and 0.9997 (not estimable), respectively. Agreement kappa between the positive results of the two antigen-based assays was 0.060 (0.002, 0.167) and 0.659 (0.492, 0.825) for TMA and real-time PCR. Samples with low viral load as indicated by cycle threshold (Ct) values > 30 were generally missed by both antigen assays, while 1:10 pooling suggested higher sensitivity of TMA compared to real-time PCR. In conclusion, both sensitivity and specificity speak in favor of the use of the LumiraDx rather than the NADAL antigen assay, while TMA results are comparably as accurate as PCR, when applied in a low prevalence setting.

1. Introduction

The Severe Acute Respiratory Syndrome Corona Virus 2 (SARS-CoV-2), causing the Corona Virus Disease 2019 (COVID-19) pandemic, was first reported in Wuhan, China, in 2019 [1]. Due to the subsequent rapid global spread, the availability of both rapid and reliable diagnostic approaches became an issue of concern. To match this need, the first in-house real-time PCR protocols were soon provided [2].
However, as traditional real-time PCR requires sophisticated laboratory infrastructure and skilled technical laboratory assistance, there was considerable demand for cartridge-based or otherwise fully-automated, point-of-care-testing (POCT) like devices for the molecular detection of SARS-CoV-2 RNA. Cepheid’s (Sunnyvale, CA, USA) GeneXpert system and Abbott’s (Chicago, IL, USA) ID Now system were the first broadly available assays showing good performance characteristics in a Cochrane analysis published as early as in August 2020 [3,4,5,6,7,8,9,10,11,12,13]. Additionally, Luminex’s (Austin, TX, USA) cartridge-based ARIES PCR system allowed fully automated testing comparably early [14,15]. Another fully automated CE certified and FDA cleared approach for the detection of SARS-CoV-2 nucleic acids from upper respiratory tract specimens is the Hologic Aptima SARS-CoV-2 TMA assay on the Hologic Panther platform [16,17,18,19,20,21,22,23,24]. The “Panther” assay is based on transcription-mediated amplification (TMA) of two targets and provides qualitative results only, without the possibility to gain further information on the virus load of positive samples, unlike with standard real-time PCR-based SARS-CoV2 assays based on Ct (cycle threshold) value assessment.
Although easy to apply with little training effort for laboratory personnel, such fully-automated POCT-like molecular approaches still have considerable limitations. Firstly, many of them [3,4,5,6,7,8,9,10,11,12,13,14,15] are poorly suited for large scale assessments. Secondly, there has been a shortage of consumables from the beginning of the SARS-CoV-2 pandemic. Thirdly, traditional immunochromatographic antigen-based rapid tests were less expensive, and finally, highly sensitive molecular assays tend to detect prolonged residual shedding of SARS-CoV-2 RNA with questionable relevance in terms of transmission risk [25,26,27,28]. Although, accordingly, development efforts were soon directed towards traditional antigen-based rapid tests, performance characteristics of first respective approaches left a lot of room for improvement. In the above-mentioned Cochrane analysis from August 2020 [3], sensitivity of available SARS-CoV-2 antigen tests ranged from 0% to 94% with average sensitivity of 56.2% (95% confidence interval (0.95 CI) 29.5% to 79.8%) and average specificity of 99.5% (0.95 CI 98.1% to 99.9%). Despite the comparably good specificity, according to Bayes’ theorem [29], application in low prevalence settings can lead to both problems regarding the positive as well as the negative predictive value [30], thus limiting the practical application of such early designs for public health interventions.
To identify optimized strategies of antigen-based rapid testing for SARS-CoV-2, numerous studies [31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46] have been performed and partly summarized in additional reviews [47,48,49,50,51,52,53,54,55,56] after those first, quite disillusioning trials [3]. Despite persisting sensitivity issues and resulting in quite variable diagnostic reliability [57], antigen-testing was broadly used in the reaction to the second SARS-CoV-2 wave in many countries [58]. In case of implementation outside laboratory infrastructure under tropical conditions, environmental conditions such as room temperature and air moisture have also been described to potentially interfere with test reliability [59].
For gradual improvement of the diagnostic quality of rapid SARS-CoV-2 tests, head-to-head comparisons have been suggested in order to optimize diagnostic solutions [36]. In times of increasing spread of virus mutants, it is of further interest to assess effects of mutations on the reliability of antigen testing similar to the S gene target failure, as observed in real-time PCR for the B1.1.7 lineage [60].
In the study conducted here, we sought to individually evaluate the NADAL COVID-19 Ag Test (Nal von Minden GmbH, Regensburg, Germany) and a microfluidic immunofluorescence assay (SARS-CoV-2 Ag Test, LumiraDx GmbH, Cologne, Germany) as well as a head-to-head assessment against real-time PCR. Individual [38,61] and combined [62] assessments of these assays had yielded promising yet still imperfect results in previous preliminary studies [62]. However, the quoted study [62] had been performed with a small sample number of just 74 PCR-positive and 26 PCR-negative specimens yet the resulting preliminary results suggested specificity close to 100% for both rapid assays. While sensitivity of the LumiraDx assay was 50.0% in total and 100% in samples with RNA copy numbers > 106 copies/mL, the values were 24.3% and 76.2% for the NADAL assay, respectively [62].
Further, the fully automated “Panther” TMA assay, for which high sensitivity had been reported in previous studies [16,17,18,19,20,21,22,23,24], was also included in the assessment. While real-time PCR was considered as a reference standard or “gold standard” for the comparison with the antigen assays [29], indirect accuracy estimation by latent class analysis (LCA) [29,63] was chosen for the evaluation of the TMA assay, for which similar or higher sensitivity in comparison to real-time PCR could be expected [16,17,18,19,20,21,22,23,24]. A larger number of several hundred non-preselected samples were analyzed in a low-prevalence setting for both the gold standard-based assessment of the antigen tests and the LCA-based assessment of the TMA platform, to assess the performance of the assays in a diagnostic “real world” scenario.

2. Materials and Methods

2.1. Samples Population, Inclusion and Exclusion Criteria

A total of 444 employees of the University Medical Center Göttingen were assessed by rapid antigen testing and PCR for respiratory carriage of SARS-CoV-2. Samples were included if they had been analyzed in parallel by at least one antigen test and at least one real-time PCR assay as described below. If these minimum requirements were not fulfilled, the sample was excluded from the assessment. Real-time PCR was considered as the diagnostic reference standard or “gold standard” for this assessment [29].
Further, the Hologic Aptima SARS-CoV-2 TMA assay was validated with 322 diagnostic nasopharyngeal swabs from patients of the University Medical Center Göttingen in comparison to the Genesig COVID-19 Real-Time PCR assay as detailed below in a test comparison without a gold standard [29,63]. Both assays were run in parallel in order to avoid a bias due to loss of sensitivity after sample storage. In order to assess the effects of pooling, 1:10 pools of 18 samples with low viral load (Ct values > 30 in Genesig real-time PCR) were comparatively assessed by both the Genesig real-time PCR and TMA assessment.
For both test comparison approaches, cycle threshold (Ct) values of the real-time PCR assays were included in the assessments.
No data on the participating individuals were collected in the course of this surveillance screening for organizational reasons, an admitted violation of the Standards for Reporting of Diagnostic Accuracy Studies (STARD) [64].

2.2. Applied Test Assays

The applied rapid antigen-based or automated molecular SARS-CoV-2 tests comprised the NADAL COVID-19 Ag Test (Nal von Minden GmbH, Regensburg, Germany), the microfluidic immunofluorescence assay LumiraDx SARS-CoV-2 Ag Test (LumiraDx GmbH, Cologne, Germany), and the Hologic Aptima SARS-CoV-2 TMA assay (Hologic Deutschland GmbH, Wiesbaden-Nordenstadt, Germany). All these assays were applied according to the manufacturers’ guidelines [16,17,18,19,20,21,22,23,24,38,61,62]. Comparative PCR testing as gold standard for the antigen test assessment was performed either by the Roche Cobas SARS-CoV-2 PCR (Roche, Basel, Switzerland) [13,65], the Genesig Real-Time PCR Coronavirus (COVID-19) assay (Primerdesign Ltd., Chandlers Ford, UK) [66], or the Cepheid Xpert Xpress SARS-CoV-2 PCR (Cepheid, Sunnyvale, CA, USA) [13,14]. The choice of the PCR assay depended on availability in the diagnostic routine. For the assessment of the Hologic Aptima SARS-CoV-2 TMA assay [16,17,18,19,20,21,22,23,24] in a test comparison without a gold standard [29,63], the Genesig Real-Time PCR Coronavirus (COVID-19) assay (Primerdesign Ltd., Chandlers Ford, UK) [66] was applied only as competing assay.

2.3. Statistics

In a descriptive approach, sensitivity and specificity of the rapid test assays was calculated applying the PCR results as gold standard for the antigen test and applying latent class analysis (LCA) [29,63] for the comparison of the TMA assay with real-time PCR. Predictive values were provided based on calculated sensitivity, specificity and prevalence. The software Stata/IC 15.1 for macOS 64-bit Intel (College Station, TX, USA) was used. For the assessment of the agreement between antigen as well as TMA testing results and real-time PCR results, Cohen’s kappa was calculated with the categories poor (below 0.00), slight (0.00–0.20), fair (0.21–0.40), moderate (0.41–0.60), substantial (0.61–0.80) and almost perfect (0.81–1.00) as described [67]. Matching of positive and negative results with Ct-values of real-time PCR was descriptively assessed.

2.4. Ethical Clearance

The study was ethically approved by the institutional ethics board of the University Medical Center Göttingen (Application number/project identification code 21/05/20 from 21 May 2020), allowing the fully anonymized use of residual sample materials for test comparison purposes.

3. Results

3.1. Sensitivity and Specificity of the SARS-CoV-2 Antigen Testing Approaches

The LumiraDx SARS-CoV-2 Ag Test was applied with 444 individuals. Of these, 437 tested negative, and 7 tested positive. Sensitivity and specificity with 0.95 confidence intervals and PCR as gold standard were calculated as 0.4545 (0.2022, 0.7326) and 0.9954 (0.9817, 0.9988), respectively (Table 1).
Additionally, the NADAL COVID-19 Ag Test was applied with 215 individuals. Of these, 164 of them tested negative, 8 tested positive, and for 43 individuals there was no clear test result. Sensitivity and specificity with 0.95 confidence intervals were calculated as 0.1429 (0.0194, 0.5835) and 0.7644 (0.7016, 0.8174), respectively, with PCR as gold standard (Table 1).

3.2. Agreement According to Cohen’s Kappa between the Antigen Assays and Real-Time PCR

The kappa coefficient with 0.95 confidence interval between the two rapid tests was calculated as 0.060 (0.002, 0.167) (Table 1).

3.3. Cycle Threshold (Ct) Values of Real-Time PCR in Samples with Positive and Negative Antigen Test Results

Low numbers of positive samples allowed a superficial assessment of Ct values only. However, as indicated in Table 2, Ct values ≥ 30 were associated with falsely negative results in the assessed antigen tests.

3.4. Sensitivity and Specificity of the Hologic Aptima SARS-CoV-2 TMA Assay and the Genesig Real-Time PCR Assay as Calculated by LCA and Agreement According to Cohen’s Kappa between the TMA Assay and Real-Time PCR

When comparing the TMA assay with the Genesig real-time PCR assay using LCA, both assays showed excellent specificity close to 100%. Agreement of positive results as indicated by Cohen’s kappa was substantial [67]. Calculated sensitivity of the TMA assays (71.6%) was slightly better than the sensitivity of the real-time PCR assay (65.4%) with the sample population assessed (Table 3).

3.5. Cycle Threshold (Ct) Values of Genesig Real-Time PCR in Samples with Positive and Negative TMA Test Results

The mean value of Ct values of the Genesig real-time PCR for samples concordantly positive in the TMA assay and the real-time PCR assay was 30.8. For samples positive in real-time PCR but negative in the TMA assay, this mean value was 38.8 and thus close to the detection threshold (Table 4).

3.6. Sensitivity of TMA and Genesig Real-Time PCR in Case of 1:10 Pooling of Samples with Low Viral Loads and Comparison with Genesig Real-Time PCR Ct Values

In case of 1:10 pooling of 18 samples with low viral loads (Ct > 30 in the Genesig real-time PCR), TMA was considerably more sensitive (83.3%) than Genesig real-time PCR (33.3%) with only slight concordance [67] (Table 5). Samples with positive results in Genesig real-time PCR after pooling showed Ct values smaller than 36 without exemption, resulting in a mean Ct value of 38.2 after pooling (Table 6).

3.7. Predictive Value as Calculated Based on Sensitivity, Specificity of the Test as Well as the Prevalence in the Assessed Population

By applying LCA with the data from the test comparison of TMA and Genesig real-time PCR testing, a prevalence of 9.95% was calculated. Based on the sensitivities and specificities as estimated for the different compared test assays, reduced positive but high negative predictive values of the antigen tests were observed, as expected for a low prevalence setting. Additionally, due to the calculated high specificity, the positive predictive values were high for the molecular assays (Table 7).

4. Discussion

In this study we assessed the diagnostic performance of the antigen-based rapid test assays NADAL and LumiraDx under “real-world” conditions. As expected from previous assessments [38,62,63], the applied antigen test assays were more likely to identify samples with higher pathogen load, as indicated by Ct values < 30, while samples with higher Ct values were missed. This result is not surprising and confirms the suitability of rapid antigen testing for the identification of individuals with high pathogens loads and, therefore an associated high likeliness of transmission only.
More interesting is the merely slight agreement between the positive antigen testing results when directly comparing the two antigen test assays. Certainly, this result is affected by the low number of positive results in the population assessed, nevertheless, it suggests a high variance regarding the positive results that can be expected in a low prevalence community, depending on the antigen test applied.
The recorded sensitivities of the antigen tests were slightly lower in this “real-world” assessment but nevertheless in a similar range with previous evaluation studies [38,62,63]. Regarding specificity however, only the LumiraDx approach showed similar values compared with previous evaluation studies [62,63]. The NADAL assay, in contrast, scored considerably worse [38,63], with specificity as low as 76.4% in the low prevalence population assessed. Due to Bayes’ theorem [29], this will lead to a considerable proportion of falsely positive test results and thus to a poor positive predictive value when applied in a low prevalence setting. So, based on both sensitivity and specificity results, the use of the LumiraDx assay is preferable compared to the NADAL assay.
Furthermore, comparable diagnostic accuracy of Genesig real-time PCR and Hologic Aptima TMA assay, both targeting ORF-1 sequences of SARS-CoV-2 [16,17,18,19,20,21,22,23,24,66], was demonstrated with clinical samples of patients of the University Medical Center Göttingen. The results are in line with previous studies [16,17,18,19,20,21,22,23,24,66] and confirm the suitability of the Hologic Panther TMA platform for fully automated, high-throughput SARS-CoV-2 screening. The low sensitivity of both assays within the assessed sample population is most likely due to the high proportion of samples with low viral loads close to the diagnostic detection threshold. In case of pooling of samples with low viral loads, moderately better sensitivity of the TMA approach compared to the Genesig real-time PCR assay was demonstrated. Despite this better sensitivity, the limitation of lacking semi-quantification when applying the TMA technology remains, as no Ct values are provided. So, TMA assessment may be a powerful tool for high-throughput initial screening for SARS-CoV-2 but is unsuitable for follow-up assessments.
The study has a number of limitations. Firstly, although several hundred individuals could be included in the assessment, the proportion of positives was quite low, making any calculations regarding sensitivity doubtful. As expected for the antigen tests due to the low prevalence, lower positive than negative predictive values were calculated. For the molecular assays, positive predictive values were good due to their high specificity. Furthermore, the combination of low sample count and low prevalence prevented a more sophisticated comparison of rapid test positivity with semi-quantification, as indicated by Ct values in PCR. Secondly, not all samples could be tested with all assays for logistical reasons, which limits their comparability. Thirdly, ethical clearance allowed fully anonymized use of patient samples for the applied test comparison purposes only, so patient-specific features can neither be shown nor assessed.

5. Conclusions

Despite the above-mentioned limitations, the presented “real world” assessment suggests superiority of the LumiraDx assay compared to the NADAL assay when applied in a low prevalence setting, based on both sensitivity and specificity considerations. Infections with low viral load, however, will be missed by both of them. In contrast, acceptable sensitivity and diagnostic accuracy similar to real-time PCR, even in the case of 1:10 pooling, could be shown for the Hologic Aptima SARS-CoV-2 TMA assay for high- throughput screenings.
Other than in previous assessments with pre-selected positive and negative samples [63], our assessment provides a “real-life experience” in a low prevalence setting, suggesting that test accuracy might vary under such conditions compared to the results of standardized study settings. Large confidence intervals, which admittedly limit the interpretability of the data, are due to financial restrictions of investigator-initiated studies such as the one presented here. Of course, generously funded studies have the advantage of larger sample sizes, which in turn will result in lower 0.95 CI-intervals as suggested recently [63].
Cross-reactions due to usually unknown co-infections are always possible in assessments in real-life situations, which describe the diagnostic performance of test assays that can actually be expected in contrast to possible performance under idealized, standardized study conditions. Accordingly, real-world studies are indispensable because they show how unstable standardized performance results may be. Because there are no standardized conditions under real-world conditions, real-world data are very much needed in order to recognize the limits of applied diagnostic assays. Therefore, they provide an indispensable addition to standardized evaluation studies rather than just an acceptable weakness. Because low prevalence is the standard in the COVID-19 pandemic due to preventive countermeasures, it makes sense to accept a small number of positive samples in the interest of a realistic assessment. This is the only way to make realistic conclusions about the reliability of the test results.

Author Contributions

Conceptualization, O.B., U.G., M.S.W. and A.E.Z.; methodology, S.D., J.S., O.B., K.M., R.L., W.B., N.F., S.T., F.R.D., P.L., M.W.S., A.E.Z.; software, J.S., O.B., A.H.; validation, J.S., O.B., A.H. and A.E.Z.; formal analysis, H.F., O.B., A.E.Z.; investigation, S.D., K.M., S.T., F.R.D., P.L., M.W.S., A.E.Z.; resources, U.G.; data curation, O.B., A.E.Z., J.S.; writing—original draft preparation, H.F., A.E.Z., O.B.; writing—review and editing, S.D., J.S., O.B., U.G., M.S.W., K.M., R.L., W.B., A.H., N.F., S.T., F.R.D., P.L., M.W.S., H.F., A.E.Z.; visualization, J.S., O.B.; supervision, O.B., A.E.Z.; project administration, U.G.; funding acquisition, U.G. All authors have read and agreed to the published version of the manuscript.

Funding

The APC was funded by the Open Access Support Program of the Deutsche Forschungsgemeinschaft and the publication fund of the Georg-August-Universität Göttingen.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki and ethically approved by the institutional ethics board of the University Medical Center Göttingen (Application number/project identification code 21/05/20 from 21 May 2020), allowing the fully anonymized use of residual sample materials for test comparison purposes.

Informed Consent Statement

Written informed consent was obtained from the volunteers.

Data Availability Statement

All relevant data are provided in the manuscript text.

Acknowledgments

We are grateful to Yvonne Laukat and Svenja Schiegl for their excellent technical assistance.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Zhou, P.; Yang, X.L.; Wang, X.G.; Hu, B.; Zhang, L.; Zhang, W.; Si, H.R.; Zhu, Y.; Li, B.; Huang, C.L.; et al. A pneumonia outbreak associated with a new coronavirus of probable bat origin. Nature 2020, 579, 270–273. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Corman, V.M.; Landt, O.; Kaiser, M.; Molenkamp, R.; Meijer, A.; Chu, D.K.; Bleicker, T.; Brünink, S.; Schneider, J.; Schmidt, M.L.; et al. Detection of 2019 novel coronavirus (2019-nCoV) by real-time RT-PCR. Eurosurveillance 2020, 25, 2000045. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Dinnes, J.; Deeks, J.J.; Adriano, A.; Berhane, S.; Davenport, C.; Dittrich, S.; Emperador, D.; Takwoingi, Y.; Cunningham, J.; Beese, S.; et al. Rapid, point-of-care antigen and molecular-based tests for diagnosis of SARS-CoV-2 infection. Cochrane Database Syst. Rev. 2020, 8, CD013705. [Google Scholar] [PubMed]
  4. Harrington, A.; Cox, B.; Snowdon, J.; Bakst, J.; Ley, E.; Grajales, P.; Maggiore, J.; Kahn, S. Comparison of Abbott ID Now and Abbott m2000 Methods for the Detection of SARS-CoV-2 from Nasopharyngeal and Nasal Swabs from Symptomatic Patients. J. Clin. Microbiol. 2020, 58, e00798-20. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Rhoads, D.D.; Cherian, S.S.; Roman, K.; Stempak, L.M.; Schmotzer, C.L.; Sadri, N. Comparison of Abbott ID Now, DiaSorin Simplexa, and CDC FDA Emergency Use Authorization Methods for the Detection of SARS-CoV-2 from Nasopharyngeal and Nasal Swabs from Individuals Diagnosed with COVID-19. J. Clin. Microbiol. 2020, 58, e00760-20. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Zhen, W.; Smith, E.; Manji, R.; Schron, D.; Berry, G.J. Clinical Evaluation of Three Sample-to-Answer Platforms for Detection of SARS-CoV-2. J. Clin. Microbiol. 2020, 58, e00783-20. [Google Scholar] [CrossRef] [Green Version]
  7. Basu, A.; Zinger, T.; Inglima, K.; Woo, K.M.; Atie, O.; Yurasits, L.; See, B.; Aguero-Rosenfeld, M.E. Performance of Abbott ID Now COVID-19 Rapid Nucleic Acid Amplification Test Using Nasopharyngeal Swabs Transported in Viral Transport Media and Dry Nasal Swabs in a New York City Academic Institution. J. Clin. Microbiol. 2020, 58, e01136-20. [Google Scholar] [CrossRef]
  8. Moran, A.; Beavis, K.G.; Matushek, S.M.; Ciaglia, C.; Francois, N.; Tesic, V.; Love, N. Detection of SARS-CoV-2 by Use of the Cepheid Xpert Xpress SARS-CoV-2 and Roche cobas SARS-CoV-2 Assays. J. Clin. Microbiol. 2020, 58, e00772-20. [Google Scholar] [CrossRef] [Green Version]
  9. Broder, K.; Babiker, A.; Myers, C.; White, T.; Jones, H.; Cardella, J.; Burd, E.M.; Hill, C.E.; Kraft, C.S. Test Agreement between Roche Cobas 6800 and Cepheid GeneXpert Xpress SARS-CoV-2 Assays at High Cycle Threshold Ranges. J. Clin. Microbiol. 2020, 58, e01187-20. [Google Scholar] [CrossRef] [PubMed]
  10. Loeffelholz, M.J.; Alland, D.; Butler-Wu, S.M.; Pandey, U.; Perno, C.F.; Nava, A.; Carroll, K.C.; Mostafa, H.; Davies, E.; McEwan, A.; et al. Multicenter Evaluation of the Cepheid Xpert Xpress SARS-CoV-2 Test. J. Clin. Microbiol. 2020, 58, e00926-20. [Google Scholar] [CrossRef]
  11. Wolters, F.; van de Bovenkamp, J.; van den Bosch, B.; van den Brink, S.; Broeders, M.; Chung, N.H.; Favié, B.; Goderski, G.; Kuijpers, J.; Overdevest, I.; et al. Multi-center evaluation of cepheid xpert® xpress SARS-CoV-2 point-of-care test during the SARS-CoV-2 pandemic. J. Clin. Virol. 2020, 128, 104426. [Google Scholar] [CrossRef] [PubMed]
  12. Lowe, C.F.; Matic, N.; Ritchie, G.; Lawson, T.; Stefanovic, A.; Champagne, S.; Leung, V.; Romney, M.G. Detection of low levels of SARS-CoV-2 RNA from nasopharyngeal swabs using three commercial molecular assays. J. Clin. Virol. 2020, 128, 104387. [Google Scholar] [CrossRef]
  13. Smithgall, M.C.; Scherberkova, I.; Whittier, S.; Green, D.A. Comparison of Cepheid Xpert Xpress and Abbott ID Now to Roche cobas for the Rapid Detection of SARS-CoV-2. J. Clin. Virol. 2020, 128, 104428. [Google Scholar] [CrossRef] [PubMed]
  14. Tanida, K.; Koste, L.; Koenig, C.; Wenzel, W.; Fritsch, A.; Frickmann, H. Evaluation of the automated cartridge-based ARIES SARS-CoV-2 Assay (RUO) against automated Cepheid Xpert Xpress SARS-CoV-2 PCR as gold standard. Eur. J. Microbiol. Immunol. 2020, 10, 156–164. [Google Scholar] [CrossRef] [PubMed]
  15. Lee, C.K.; Tham, J.W.M.; Png, S.; Chai, C.N.; Ng, S.C.; Tan, E.J.M.; Ng, L.J.; Chua, R.P.; Sani, M.; Seow, Y.; et al. Clinical performance of Roche cobas 6800, Luminex ARIES, MiRXES Fortitude Kit 2.1, Altona RealStar, and Applied Biosystems TaqPath for SARS-CoV-2 detection in nasopharyngeal swabs. J. Med. Virol. 2021, 93, 4603–4607. [Google Scholar] [CrossRef] [PubMed]
  16. Beck, E.T.; Paar, W.; Fojut, L.; Serwe, J.; Jahnke, R.R. Comparison of the Quidel Sofia SARS FIA Test to the Hologic Aptima SARS-CoV-2 TMA Test for Diagnosis of COVID-19 in Symptomatic Outpatients. J. Clin. Microbiol. 2021, 59, e02727-20. [Google Scholar] [CrossRef]
  17. Cordes, A.K.; Rehrauer, W.M.; Accola, M.A.; Wölk, B.; Hilfrich, B.; Heim, A. Fully automated detection and differentiation of pandemic and endemic coronaviruses (NL63, 229E, HKU1, OC43 and SARS-CoV-2) on the Hologic Panther Fusion. J. Med. Virol. 2021, 93, 4438–4445. [Google Scholar] [CrossRef]
  18. Gorzalski, A.J.; Tian, H.; Laverdure, C.; Morzunov, S.; Verma, S.C.; VanHooser, S.; Pandori, M.W. High-Throughput Transcription-mediated amplification on the Hologic Panther is a highly sensitive method of detection for SARS-CoV-2. J. Clin. Virol. 2020, 129, 104501. [Google Scholar] [CrossRef]
  19. Mitchell, S.L.; Ventura, S.E. Evaluation and Comparison of the Hologic Aptima SARS-CoV-2 Assay and the CDC 2019-nCoV Real-Time Reverse Transcription-PCR Diagnostic Panel Using a Four-Sample Pooling Approach. J. Clin. Microbiol. 2020, 58, e02241-20. [Google Scholar] [CrossRef]
  20. Mostafa, H.H.; Hardick, J.; Morehead, E.; Miller, J.A.; Gaydos, C.A.; Manabe, Y.C. Comparison of the analytical sensitivity of seven commonly used commercial SARS-CoV-2 automated molecular assays. J. Clin. Virol. 2020, 130, 104578. [Google Scholar] [CrossRef]
  21. Pham, J.; Meyer, S.; Nguyen, C.; Williams, A.; Hunsicker, M.; McHardy, I.; Gendlina, I.; Goldstein, D.Y.; Fox, A.S.; Hudson, A.; et al. Performance Characteristics of a High-Throughput Automated Transcription-Mediated Amplification Test for SARS-CoV-2 Detection. J. Clin. Microbiol. 2020, 58, e01669-20. [Google Scholar] [CrossRef]
  22. Skittrall, J.P.; Wilson, M.; Smielewska, A.A.; Parmar, S.; Fortune, M.D.; Sparkes, D.; Curran, M.D.; Zhang, H.; Jalal, H. Specificity and positive predictive value of SARS-CoV-2 nucleic acid amplification testing in a low-prevalence setting. Clin. Microbiol. Infect. 2021, 27, 469.e9–469.e15. [Google Scholar] [CrossRef]
  23. Smith, E.; Zhen, W.; Manji, R.; Schron, D.; Duong, S.; Berry, G.J. Analytical and Clinical Comparison of Three Nucleic Acid Amplification Tests for SARS-CoV-2 Detection. J. Clin. Microbiol. 2020, 58, e01134-20. [Google Scholar] [CrossRef] [PubMed]
  24. Trémeaux, P.; Lhomme, S.; Abravanel, F.; Raymond, S.; Mengelle, C.; Mansuy, J.M.; Izopet, J. Evaluation of the Aptima™ transcription-mediated amplification assay (Hologic®) for detecting SARS-CoV-2 in clinical specimens. J. Clin. Virol. 2020, 129, 104541. [Google Scholar] [CrossRef]
  25. Park, A.; Iwasaki, A. Type I and Type III Interferons—Induction, Signaling, Evasion, and Application to Combat COVID-19. Cell Host Microbe 2020, 27, 870–878. [Google Scholar] [CrossRef] [PubMed]
  26. Li, N.; Wang, X.; Lv, T. Prolonged SARS-CoV-2 RNA shedding: Not a rare phenomenon. J. Med. Virol. 2020, 92, 2286–2287. [Google Scholar] [CrossRef]
  27. Xu, K.; Chen, Y.; Yuan, J.; Yi, P.; Ding, C.; Wu, W.; Li, Y.; Ni, Q.; Zou, R.; Li, X.; et al. Factors Associated With Prolonged Viral RNA Shedding in Patients with Coronavirus Disease 2019 (COVID-19). Clin. Infect. Dis. 2020, 71, 799–806. [Google Scholar] [CrossRef] [PubMed]
  28. Wang, K.; Zhang, X.; Sun, J.; Ye, J.; Wang, F.; Hua, J.; Zhang, H.; Shi, T.; Li, Q.; Wu, X. Differences of Severe Acute Respiratory Syndrome Coronavirus 2 Shedding Duration in Sputum and Nasopharyngeal Swab Specimens Among Adult Inpatients with Coronavirus Disease 2019. Chest 2020, 158, 1876–1884. [Google Scholar] [CrossRef]
  29. Hahn, A.; Podbielski, A.; Meyer, T.; Zautner, A.E.; Loderstädt, U.; Schwarz, N.G.; Krüger, A.; Cadar, D.; Frickmann, H. On detection thresholds-a review on diagnostic approaches in the infectious disease laboratory and the interpretation of their results. Acta Trop. 2020, 205, 105377. [Google Scholar] [CrossRef] [PubMed]
  30. Lein, I.; Leuker, C.; Antão, E.M.; von Kleist, M.; Jenny, M.A. SARS-CoV-2: Testergebnisse richtig einordnen. Dtsch. Ärzteblatt 2020, 117, A-2304/B-1944. [Google Scholar]
  31. Krüttgen, A.; Cornelissen, C.G.; Dreher, M.; Hornef, M.W.; Imöhl, M.; Kleines, M. Comparison of the SARS-CoV-2 Rapid antigen test to the real star Sars-CoV-2 RT PCR kit. J. Virol. Methods 2021, 288, 114024. [Google Scholar] [CrossRef] [PubMed]
  32. Scohy, A.; Anantharajah, A.; Bodéus, M.; Kabamba-Mukadi, B.; Verroken, A.; Rodriguez-Villalobos, H. Low performance of rapid antigen detection test as frontline testing for COVID-19 diagnosis. J. Clin. Virol. 2020, 129, 104455. [Google Scholar] [CrossRef]
  33. Hirotsu, Y.; Maejima, M.; Shibusawa, M.; Nagakubo, Y.; Hosaka, K.; Amemiya, K.; Sueki, H.; Hayakawa, M.; Mochizuki, H.; Tsutsui, T.; et al. Comparison of automated SARS-CoV-2 antigen test for COVID-19 infection with quantitative RT-PCR using 313 nasopharyngeal swabs, including from seven serially followed patients. Int. J. Infect. Dis. 2020, 99, 397–402. [Google Scholar] [CrossRef] [PubMed]
  34. Porte, L.; Legarraga, P.; Vollrath, V.; Aguilera, X.; Munita, J.M.; Araos, R.; Pizarro, G.; Vial, P.; Iruretagoyena, M.; Dittrich, S.; et al. Evaluation of a novel antigen-based rapid detection test for the diagnosis of SARS-CoV-2 in respiratory samples. Int. J. Infect. Dis. 2020, 99, 328–333. [Google Scholar] [CrossRef] [PubMed]
  35. Chaimayo, C.; Kaewnaphan, B.; Tanlieng, N.; Athipanyasilp, N.; Sirijatuphat, R.; Chayakulkeeree, M.; Angkasekwinai, N.; Sutthent, R.; Puangpunngam, N.; Tharmviboonsri, T.; et al. Rapid SARS-CoV-2 antigen detection assay in comparison with real-time RT-PCR assay for laboratory diagnosis of COVID-19 in Thailand. Virol. J. 2020, 17, 177. [Google Scholar] [CrossRef]
  36. Toptan, T.; Eckermann, L.; Pfeiffer, A.E.; Hoehl, S.; Ciesek, S.; Drosten, C.; Corman, V.M. Evaluation of a SARS-CoV-2 rapid antigen test: Potential to help reduce community spread? J. Clin. Virol. 2021, 135, 104713. [Google Scholar] [CrossRef]
  37. Lindner, A.K.; Nikolai, O.; Kausch, F.; Wintel, M.; Hommes, F.; Gertler, M.; Krüger, L.J.; Gaeddert, M.; Tobian, F.; Lainati, F.; et al. Head-to-head comparison of SARS-CoV-2 antigen-detecting rapid test with self-collected nasal swab versus professional-collected nasopharyngeal swab. Eur. Respir. J. 2021, 57, 2003961. [Google Scholar] [CrossRef] [PubMed]
  38. Strömer, A.; Rose, R.; Schäfer, M.; Schön, F.; Vollersen, A.; Lorentz, T.; Fickenscher, H.; Krumbholz, A. Performance of a Point-of-Care Test for the Rapid Detection of SARS-CoV-2 Antigen. Microorganisms 2020, 9, 58. [Google Scholar] [CrossRef] [PubMed]
  39. Yamayoshi, S.; Sakai-Tagawa, Y.; Koga, M.; Akasaka, O.; Nakachi, I.; Koh, H.; Maeda, K.; Adachi, E.; Saito, M.; Nagai, H.; et al. Comparison of Rapid Antigen Tests for COVID-19. Viruses 2020, 12, 1420. [Google Scholar] [CrossRef]
  40. Abdelrazik, A.M.; Elshafie, S.M.; Abdelaziz, H.M. Potential Use of Antigen-Based Rapid Test for SARS-CoV-2 in Respiratory Specimens in Low-Resource Settings in Egypt for Symptomatic Patients and High-Risk Contacts. Lab. Med. 2021, 52, e46–e69. [Google Scholar] [CrossRef]
  41. Favresse, J.; Gillot, C.; Oliveira, M.; Cadrobbi, J.; Elsen, M.; Eucher, C.; Laffineur, K.; Rosseels, C.; Van Eeckhoudt, S.; Nicolas, J.B.; et al. Head-to-Head Comparison of Rapid and Automated Antigen Detection Tests for the Diagnosis of SARS-CoV-2 Infection. J. Clin. Med. 2021, 10, 265. [Google Scholar] [CrossRef] [PubMed]
  42. Gremmels, H.; Winkel, B.M.F.; Schuurman, R.; Rosingh, A.; Rigter, N.A.M.; Rodriguez, O.; Ubijaan, J.; Wensing, A.M.J.; Bonten, M.J.M.; Hofstra, L.M. Real-life validation of the Panbio™ COVID-19 antigen rapid test (Abbott) in community-dwelling subjects with symptoms of potential SARS-CoV-2 infection. EClinicalMedicine 2021, 31, 100677. [Google Scholar] [CrossRef] [PubMed]
  43. Ciotti, M.; Maurici, M.; Pieri, M.; Andreoni, M.; Bernardini, S. Performance of a rapid antigen test in the diagnosis of SARS-CoV-2 infection. J. Med. Virol. 2021, 93, 2988–2991. [Google Scholar] [CrossRef]
  44. González-Donapetry, P.; García-Clemente, P.; Bloise, I.; García-Sánchez, C.; Sánchez Castellano, M.Á.; Romero, M.P.; Gutiérrez Arroyo, A.; Mingorance, J.; de Ceano-Vivas La Calle, M.; García-Rodriguez, J.; et al. Think of the Children: Evaluation of SARS-CoV-2 Rapid Antigen Test in Pediatric Population. Pediatr. Infect. Dis. J. 2021, 40, 385–388. [Google Scholar] [CrossRef] [PubMed]
  45. Lindner, A.K.; Nikolai, O.; Rohardt, C.; Burock, S.; Hülso, C.; Bölke, A.; Gertler, M.; Krüger, L.J.; Gaeddert, M.; Tobian, F.; et al. Head-to-head comparison of SARS-CoV-2 antigen-detecting rapid test with professional-collected nasal versus nasopharyngeal swab. Eur. Respir. J. 2021, 57, 2004430. [Google Scholar] [CrossRef]
  46. Eshghifar, N.; Busheri, A.; Shrestha, R.; Beqaj, S. Evaluation of Analytical Performance of Seven Rapid Antigen Detection Kits for Detection of SARS-CoV-2 Virus. Int. J. Gen. Med. 2021, 14, 435–440. [Google Scholar] [CrossRef]
  47. La Marca, A.; Capuzzo, M.; Paglia, T.; Roli, L.; Trenti, T.; Nelson, S.M. Testing for SARS-CoV-2 (COVID-19): A systematic review and clinical guide to molecular and serological in-vitro diagnostic assays. Reprod. Biomed. Online 2020, 41, 483–499. [Google Scholar] [CrossRef] [PubMed]
  48. Ji, T.; Liu, Z.; Wang, G.; Guo, X.; Akbar Khan, S.; Lai, C.; Chen, H.; Huang, S.; Xia, S.; Chen, B.; et al. Detection of COVID-19: A review of the current literature and future perspectives. Biosens. Bioelectron. 2020, 166, 112455. [Google Scholar] [CrossRef] [PubMed]
  49. Cheng, M.P.; Papenburg, J.; Desjardins, M.; Kanjilal, S.; Quach, C.; Libman, M.; Dittrich, S.; Yansouni, C.P. Diagnostic Testing for Severe Acute Respiratory Syndrome-Related Coronavirus 2: A Narrative Review. Ann. Intern. Med. 2020, 172, 726–734. [Google Scholar] [CrossRef] [Green Version]
  50. D’Cruz, R.J.; Currier, A.W.; Sampson, V.B. Laboratory Testing Methods for Novel Severe Acute Respiratory Syndrome-Coronavirus-2 (SARS-CoV-2). Front. Cell Dev. Biol. 2020, 8, 468. [Google Scholar] [CrossRef]
  51. Abduljalil, J.M. Laboratory diagnosis of SARS-CoV-2: Available approaches and limitations. New Microbes New Infect. 2020, 36, 100713. [Google Scholar] [CrossRef]
  52. Weissleder, R.; Lee, H.; Ko, J.; Pittet, M.J. COVID-19 diagnostics in context. Sci. Transl. Med. 2020, 12, eabc1931. [Google Scholar] [CrossRef]
  53. Samson, R.; Navale, G.R.; Dharne, M.S. Biosensors: Frontiers in rapid detection of COVID-19. 3 Biotech 2020, 10, 385. [Google Scholar] [CrossRef] [PubMed]
  54. Rai, P.; Kumar, B.K.; Deekshit, V.K.; Karunasagar, I.; Karunasagar, I. Detection technologies and recent developments in the diagnosis of COVID-19 infection. Appl. Microbiol. Biotechnol. 2021, 105, 441–455. [Google Scholar] [CrossRef]
  55. Heiss, K.; Heidepriem, J.; Fischer, N.; Weber, L.K.; Dahlke, C.; Jaenisch, T.; Loeffler, F.F. Rapid Response to Pandemic Threats: Immunogenic Epitope Detection of Pandemic Pathogens for Diagnostics and Vaccine Development Using Peptide Microarrays. J. Proteome Res. 2020, 19, 4339–4354. [Google Scholar] [CrossRef] [PubMed]
  56. Umakanthan, S.; Chattu, V.K.; Ranade, A.V.; Das, D.; Basavarajegowda, A.; Bukelo, M. A rapid review of recent advances in diagnosis, treatment and vaccination for COVID-19. AIMS Public Health 2021, 8, 137–153. [Google Scholar] [CrossRef] [PubMed]
  57. Ndwandwe, D.; Mathebula, L.; Kamadjeu, R.; Wiysonge, C.S. Cochrane corner: Rapid point-of-care antigen and molecular-based tests for the diagnosis of COVID-19 infection. Pan Afr. Med. J. 2020, 37 (Suppl. 1), 10. [Google Scholar] [CrossRef]
  58. Candel, F.J.; Barreiro, P.; San Román, J.; Abanades, J.C.; Barba, R.; Barberán, J.; Bibiano, C.; Canora, J.; Cantón, R.; Calvo, C.; et al. Recommendations for use of antigenic tests in the diagnosis of acute SARS-CoV-2 infection in the second pandemic wave: Attitude in different clinical settings. Rev. Esp. Quimioter. 2020, 33, 466–484. [Google Scholar] [CrossRef] [PubMed]
  59. Jacobs, J.; Kühne, V.; Lunguya, O.; Affolabi, D.; Hardy, L.; Vandenberg, O. Implementing COVID-19 (SARS-CoV-2) Rapid Diagnostic Tests in Sub-Saharan Africa: A Review. Front. Med. 2020, 7, 557797. [Google Scholar] [CrossRef]
  60. Kidd, M.; Richter, A.; Best, A.; Cumley, N.; Mirza, J.; Percival, B.; Mayhew, M.; Megram, O.; Ashford, F.; White, T.; et al. S-variant SARS-CoV-2 lineage B1.1.7 is associated with significantly higher viral loads in samples tested by ThermoFisher TaqPath RT-qPCR. J. Infect. Dis. 2021. [Google Scholar] [CrossRef] [PubMed]
  61. Drain, P.K.; Ampajwala, M.; Chappel, C.; Gvozden, A.B.; Hoppers, M.; Wang, M.; Rosen, R.; Young, S.; Zissman, E.; Montano, M. A Rapid, High-Sensitivity SARS-CoV-2 Nucleocapsid Immunoassay to Aid Diagnosis of Acute COVID-19 at the Point of Care: A Clinical Performance Study. Infect. Dis. Ther. 2021, 10, 753–761. [Google Scholar] [CrossRef]
  62. Kohmer, N.; Toptan, T.; Pallas, C.; Karaca, O.; Pfeiffer, A.; Westhaus, S.; Widera, M.; Berger, A.; Hoehl, S.; Kammel, M.; et al. Comparative Clinical Performance of Four SARS-CoV-2 Rapid Antigen Tests and Their Correlation to Infectivity In Vitro. J. Clin. Med. 2021, 10, 328. [Google Scholar] [CrossRef] [PubMed]
  63. Qu, Y.; Tan, M.; Kutner, M.H. Random effects models in latent class analysis for evaluating accuracy of diagnostic tests. Biometrics 1996, 52, 797–810. [Google Scholar] [CrossRef] [PubMed]
  64. Cohen, J.F.; Korevaar, D.A.; Altman, D.G.; Bruns, D.E.; Gatsonis, C.A.; Hooft, L.; Irwig, L.; Levine, D.; Reitsma, J.B.; De Vet, H.C.; et al. STARD 2015 guidelines for reporting diagnostic accuracy studies: Explanation and elaboration. BMJ Open 2016, 6, e012799. [Google Scholar] [CrossRef] [PubMed]
  65. Pujadas, E.; Ibeh, N.; Hernandez, M.M.; Waluszko, A.; Sidorenko, T.; Flores, V.; Shiffrin, B.; Chiu, N.; Young-Francois, A.; Nowak, M.D.; et al. Comparison of SARS-CoV-2 detection from nasopharyngeal swab samples by the Roche cobas 6800 SARS-CoV-2 test and a laboratory-developed real-time RT-PCR test. J. Med. Virol. 2020, 92, 1695–1698. [Google Scholar] [CrossRef] [PubMed]
  66. Dumache, R.; Daescu, E.; Ciocan, V.; Mureşan, C.; Talida, C.; Gavrilita, D.; Enache, A. Molecular Testing of SARS-CoV-2 Infection from Blood Samples in Disseminated Intravascular Coagulation (DIC) and Elevated D-Dimer Levels. Clin. Lab. 2021, 67, 187–192. [Google Scholar] [CrossRef] [PubMed]
  67. Landis, J.R.; Koch, G.G. The measurement of observer agreement for categorical data. Biometrics 1977, 33, 159–174. [Google Scholar] [CrossRef] [PubMed] [Green Version]
Table
Table 1. Sensitivity, specificity and agreement between the two assessed antigen tests.
Table 1. Sensitivity, specificity and agreement between the two assessed antigen tests.
PCR (N = 444)NADAL (N = 215 *)LumiraDx (N = 444)
Positives (%)11 (2.5%)8 (3.7%)7 (1.6%)
Negatives (%)433 (97.5%))164 (76.3%)437 (98.4%)
Sensitivity
(0.95 CI)		10.1429 **
(0.0194, 0.5835)		0.4545
(0.2022, 0.7326)
Specificity
(0.95 CI)		10.7644 **
(0.7016, 0.8174		0.9954
(0.9817, 0.9988)
Cohen’s kappa (0.95 CI) (N = 202)0.060 (0.002, 0.167)
* Forty-three samples were neither positive nor negative (borderline), ** estimation of sensitivity and specificity is based on all tested samples including borderline samples that were neither positive nor negative and therefore decreased diagnostic performance.
Table
Table 2. Assessment of the matching of positive and negative tests with PCR Ct values.
Table 2. Assessment of the matching of positive and negative tests with PCR Ct values.
PCR TargetMean (SD), Median (Min, Max)Mean (SD), Median (Min, Max)
NADALLumiraDx
nPositivenNegativenPositivenNegative
T1 (Roche)0 226.745 (8.14), 26.75 (20.99, 32.5)422.44 (2.98), 21.04 (20.79, 26.91)331.38 (1.1), 31.33 (30.31, 32.5)
T2 (Roche)0 227.15 (8.56), 27.15 (21.09, 33.2)421.89 (3.59), 21.05 (18.5, 26.97)332.26 (1.3), 32.81 (30.78, 33.2)
ORF-1 (Genesig)121.4 (-), 21.4 (21.4, 21.4)235.18 (1.97), 35.18 (33.79, 36.57)221.35 (0.07), 21.35 (21.3, 21.4)433 (2.79), 32.56 (30.31, 36.57)
E-gene (Cepheid)0 332.28 (2.58),
32.3 (29.7, 34.85)		0 532.09 (1.98), 32.3 (29.7, 34.85)
N2-target (Cepheid)0 233.8 (1.84), 33.8 (32.5, 35.1)0 233.8 (1.84), 33.8 (32.5, 35.1)
Table
Table 3. Test characteristics as calculated by LCA and agreement of the TMA assay and the Genesig real-time PCR assay.
Table 3. Test characteristics as calculated by LCA and agreement of the TMA assay and the Genesig real-time PCR assay.
TMA (n = 322)Genesig Real Time PCR (n = 322)
Positives (%)23 (7.1%)21 (6.5%)
Negatives (%)299 (92.9%)301 (93.5%)
Sensitivity
(0.95 CI)		0.7157
(0, 1)		0.6544
(0.4439, 0.8179)
Specificity
(0.95 CI)		0.9997
(n.e.)		0.9999
(0, 1)
Cohen’s kappa (0.95 CI) (n = 322)0.659 (0.492, 0.825)
n.e. = not estimable. n = number. 0.95 CI = 95% confidence interval. TMA = transcription-mediated amplification.
Table
Table 4. Ct values of the Genesig real-time PCRs for samples concordantly positive by TMA and real-time PCR as well as positive by real-time PCR only.
Table 4. Ct values of the Genesig real-time PCRs for samples concordantly positive by TMA and real-time PCR as well as positive by real-time PCR only.
ParameterMean (SD), Median (Min, Max)
nTMA PositivenTMA Negative
Genesig Ct value Mean (SD), Median (Min, Max)1530.808 (4.913), 31.8 (22.98, 37.91)638.787 (0.944), 38.26 (38.07, 40.00)
SD = standard deviation. Min = minimum. Max = maximum. n = number. Ct = cycle threshold. TMA = transcription-mediated amplification.
Table
Table 5. Sensitivity of TMA and Genesig real-time PCR of samples with low viral loads (Genesig Ct > 30) after 1:10 pooling.
Table 5. Sensitivity of TMA and Genesig real-time PCR of samples with low viral loads (Genesig Ct > 30) after 1:10 pooling.
TMA (n = 18)Genesig (n = 18)
Positives (%)15 (83.33%)6 (33.33%)
Negatives (%)3 (16.67%)12 (66.67%)
Sensitivity
(0.95 CI)		0.8333
(0.568, 0.950)		0.3333
(0.148, 0.589)
Cohen’s kappa (0.95 CI) (N = 322)0.182 (−0.036, 0.399)
n = number. 0.95 CI = 95% confidence interval. TMA = transcription-mediated amplification.
Table
Table 6. Ct values of the Genesig real-time PCRs still positive after pooling before and after the pooling step.
Table 6. Ct values of the Genesig real-time PCRs still positive after pooling before and after the pooling step.
ParameterMean (SD), Median (Min, Max)
nWith 1:10 PoolingnWithout Pooling
Genesig Ct value Mean (SD), Median (Min, Max)638.223 (1.951), 38.555 (34.78, 40.00)634.025 (1.980), 34.535 (31.44, 35.98)
SD = standard deviation. Min = minimum. Max = maximum. n = number. Ct = cycle threshold. TMA = transcription-mediated amplification.
Table
Table 7. Predictive values as calculated for the assessed assays in the low prevalence setting in which they were evaluated.
Table 7. Predictive values as calculated for the assessed assays in the low prevalence setting in which they were evaluated.
AssayPositive Predictive Value (0.95 CI)Negative Predictive Value (0.95 CI)
NADAL0.0966 (0.0131, 0.3943)0.9768 (0.8965, 1)
LumiraDx0.7102 (0.3159, 1)0.9863 (0.9727, 0.9897)
TMA1 (0, 1)0.9690 (n.e.)
Genesig real-time PCR1 (0.6488, 1)0.9630 (0, 1)
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Dierks, S.; Bader, O.; Schwanbeck, J.; Groß, U.; Weig, M.S.; Mese, K.; Lugert, R.; Bohne, W.; Hahn, A.; Feltgen, N.; et al. Diagnosing SARS-CoV-2 with Antigen Testing, Transcription-Mediated Amplification and Real-Time PCR. J. Clin. Med. 2021, 10, 2404. https://doi.org/10.3390/jcm10112404

AMA Style

Dierks S, Bader O, Schwanbeck J, Groß U, Weig MS, Mese K, Lugert R, Bohne W, Hahn A, Feltgen N, et al. Diagnosing SARS-CoV-2 with Antigen Testing, Transcription-Mediated Amplification and Real-Time PCR. Journal of Clinical Medicine. 2021; 10(11):2404. https://doi.org/10.3390/jcm10112404

Chicago/Turabian Style

Dierks, Sascha, Oliver Bader, Julian Schwanbeck, Uwe Groß, Michael S. Weig, Kemal Mese, Raimond Lugert, Wolfgang Bohne, Andreas Hahn, Nicolas Feltgen, and et al. 2021. "Diagnosing SARS-CoV-2 with Antigen Testing, Transcription-Mediated Amplification and Real-Time PCR" Journal of Clinical Medicine 10, no. 11: 2404. https://doi.org/10.3390/jcm10112404

APA Style

Dierks, S., Bader, O., Schwanbeck, J., Groß, U., Weig, M. S., Mese, K., Lugert, R., Bohne, W., Hahn, A., Feltgen, N., Torkieh, S., Denker, F. R., Lauermann, P., Storch, M. W., Frickmann, H., & Zautner, A. E. (2021). Diagnosing SARS-CoV-2 with Antigen Testing, Transcription-Mediated Amplification and Real-Time PCR. Journal of Clinical Medicine, 10(11), 2404. https://doi.org/10.3390/jcm10112404

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop