Next Article in Journal
Digital Pathology Workflow Implementation at IPATIMUP
Next Article in Special Issue
Performance Evaluation of the BZ COVID-19 Neutralizing Antibody Test for the Culture-Free and Rapid Detection of SARS-CoV-2 Neutralizing Antibodies
Previous Article in Journal
Ten Fast Transfer Learning Models for Carotid Ultrasound Plaque Tissue Characterization in Augmentation Framework Embedded with Heatmaps for Stroke Risk Stratification
Previous Article in Special Issue
Diagnostic Approaches for COVID-19 and Its Associated Complications
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Diagnostics
Volume 11
Issue 11
10.3390/diagnostics11112110
diagnostics-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Diagnostic Performance of Automated SARS-CoV-2 Antigen Assay in Nasal Swab during COVID-19 Vaccination Campaign

by
Haya Altawalah
1,2,*,
Wadha Alfouzan
1,3,
Talal Al-Fadalah
4 and
Sayeh Ezzikouri
5,*
1
Department of Microbiology, Faculty of Medicine, Kuwait University, Safat 24923, Kuwait
2
Virology Unit, Yacoub Behbehani Center, Sabah Hospital, Ministry of Health, Safat 24923, Kuwait
3
Laboratory Medicine, Farwania Hospital, Ministry of Health, Farwania 85000, Kuwait
4
Qualities and Accreditation Directorate, Ministry of Health, Safat 13001, Kuwait
5
Virology Unit, Viral Hepatitis Laboratory, Institut Pasteur du Maroc, Casablanca 20250, Morocco
*
Authors to whom correspondence should be addressed.
Diagnostics 2021, 11(11), 2110; https://doi.org/10.3390/diagnostics11112110
Submission received: 21 October 2021 / Revised: 5 November 2021 / Accepted: 11 November 2021 / Published: 15 November 2021
(This article belongs to the Special Issue Multidisciplinary Approaches to Manage COVID-19: From Surveillance to Diagnosis)
Browse Figures
Versions Notes

Abstract

:
Background: To control the spread of the pandemic brought about by the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection, it is necessary to have an automated reliable diagnostic assay. To date, the RT-PCR (RT-qPCR) has been the recommended laboratory method to diagnose SARS-CoV-2 infection, but there is a need for more automated and reliable tests. The aim of this real-life study was to assess the diagnostic performance of DiaSorin’s LIAISON SARS-CoV-2 antigen (Ag) chemiluminescence immunoassay in detecting SARS-CoV-2 in vaccinated and unvaccinated individuals. Methods: A prospective study was performed on 300 nasopharyngeal swabs randomly collected from 31 May to 6 July 2021. Nasopharyngeal samples were assayed with DiaSorin’s LIAISON SARS-CoV-2 Ag and TaqPath™ COVID-19 multiplex RT-qPCR. Results: Of 300 participants, 150 had a RT-qPCR confirmed SARS-CoV-2 infection of whom 113 (75.33%) were also detected by the DiaSorin LIAISON SARS-CoV-2 Ag. Taking RT-qPCR as a reference, the sensitivity and specificity of the DiaSorin LIAISON SARS-CoV-2 Ag assay were evaluated as 75.33% (95% CI = 67.64–82) and 100% (95% CI = 97.57–100), respectively. When a viral load cut-off was applied for high viral load (median cycle threshold (Ct) < 18.57), the overall sensitivity was increased to 96.55% (95% CI = 88.09–99.58). Interestingly, median RT-qPCR Ct and SARS-CoV-2 Ag values were similar between fully vaccinated and unvaccinated subjects. Conclusions: Automated, quantitative LIAISON SARS-CoV-2 Ag assay shows good performance to identify SARS-CoV-2-infected individuals with moderate to high viral loads. LIAISON SARS-CoV-2 Ag testing could be used as frontline testing for COVID-19 diagnosis and be more suitable for large utilization.

1. Introduction

Mass testing for the early identification and isolation of infectious coronavirus-19 disease (COVID-19) individuals is efficacious for reducing the disease spread [1]. In the ongoing pandemic context of COVID-19, diagnostic testing for SARS-CoV-2 is crucial in order to limit the spread of the virus as well as to appropriately manage infected patients [2]. To date, the gold standard test for severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) is the real-time RT-PCR (RT-qPCR) [3,4]. Moreover, RT-qPCR requires nasopharyngeal swabs (NPS) to be sent off to a special laboratory with specialist equipment, analyzed by competent laboratory staff and is time consuming (4–6 h), not including the time to transport the specimens to the laboratory [3]. Simpler and less expensive antigen-based tests have been developed to address these issues. However, antigen-detecting rapid diagnostic tests (Ag-RDT) require a visual readout and lack proper internal quality control, making them more prone to errors [5,6,7]. However, a number of automated antigen-detecting diagnostic assays for SARS-CoV-2 detection are now commercially available and can result in rapid decisions on patient care, isolation and contact tracing at the point of care [8]. As a part of the surveillance program for pandemic control in Kuwait, the local government launched nucleic acid amplification test-based systematic screenings and several other tools in the country in order to rapidly mitigate and manage COVID-19 patients [9].
To date, comparative studies have almost been completed for Ag-RDT with RT-qPCR testing and have shown high reliability before the vaccination campaign against COVID-19 [8,10,11,12]. COVID-19 vaccines reduce severe disease and death from SARS-CoV-2 infection [13,14] but breakthrough cases occur [15,16]. Several reports have shown no difference in terms of viral loads between vaccinated and unvaccinated subjects. However, other studies have found that COVID-19 vaccines reduce viral loads [17,18]. This situation emphasizes the importance to replicate other investigations in other populations. Moreover, the general application of antigen testing deserves to be further investigated and validated on larger cohorts, taking into account also the current spreading of the novel more infectious SARS-CoV-2 variants [19,20]. The SARS-CoV-2 variants may present important diagnostic challenges in the future. The rapid implementation of a COVID-19 antigen assay requires critical assessment. Thus, the objective of this real-life study was to evaluate a quantitative antigen assay in detecting SARS-CoV-2 in vaccinated and unvaccinated individuals. The first part of the study was to evaluate the performance of the DiaSorin LIAISON SARS-CoV-2 Ag test in detecting SARS-CoV-2 compared to RT-qPCR. The second part of the study was to assess the limit of detection between SARS-CoV-2 Ag and RT-qPCR assays. The third part of the investigation was to analyze the viral loads between vaccinated and unvaccinated subjects.

2. Materials and Methods

2.1. Clinical Specimens

To collect nasopharyngeal swab specimens (NPS), the swab was passed through the nostril until reaching the posterior nasopharynx and removed while rotating as previously described [9]. NPS were collected by health-care professionals from individuals at the AnaSalbi laboratory, a certified COVID-19 testing laboratory in Kuwait. After swabbing, each absorbent swab was placed immediately into a sterile tube with copan universal transport media (UTM). We conducted a cross-sectional study from 31 May to 6 July 2021, with a nested sampling from positive and negative samples. One hundred and fifty negative and 150 positive specimens were randomly sampled from the different NPS stored in the laboratory. Metadata including demographic data, vaccination status, asymptomatic, symptomatic were collected. The study protocol was approved by the permanent Committee for Coordination of Medical and Health Research, Ministry of Health, Kuwait, and the study was conducted in accordance with the ethical guidelines of the 1975 Declaration of Helsinki as reflected in a priori approval by the institution’s human research committee.

2.2. SARS-CoV-2 RT-q PCR

Viral RNA was automatically extracted from 200 μL of the NPS specimens using the MagMAXTM Viral/Pathogen II Nucleic Acid Isolation Kit (Thermo Fisher Scientific, Vilnius, Lithuania) on KingFisher (Thermo Fisher Scientific, Waltham, MA, USA) according to the manufacturer’s instructions. RT-qPCR was performed using TaqPath™ COVID-19 multiplex real-time RT-PCR test (the Orf1ab, N and S genes) (Thermo Fisher Scientific, Waltham, MA, USA) according to the manufacturer’s instructions. Negative and positive controls were run simultaneously with samples [2]. The assay was performed using a QuantStudio 5 real-time PCR detection system (Thermo Fisher Scientific, Waltham, MA, USA). Test results were reported quantitatively as cycle threshold (Ct) value of the ORF1ab, the N and the S genes, while qualitative data were reported as positive/negative at test cut-off (i.e., Ct < 37 for positive or ≥ 37 for negative samples). The Ct values used to classify specimens as ‘high viral load’, ‘medium viral load’ and ‘low viral load’ defined as previously described [7,21], they were <18.57, 18.57–28.67 and >28.67, respectively.

2.3. LIAISON SARS-CoV-2 Ag

The DiaSorin LIAISON SARS-CoV-2 Ag assay is a two-step sandwich fully automated chemiluminescence immunoassay (CLIA) for the quantitative determination of SARS-CoV-2 nucleocapsid (N) antigen protein in nasopharyngeal swabs on the LIAISON®XL Analyzer (DiaSorin, Saluggia, Italy). The assay was performed according to the manufacturer’s recommendations. The light signal, and hence the amount of isoluminol-antibody conjugate, is measured by a photomultiplier in relative light units (RLU) (TCID50/mL) and indicates the presence or absence of the SARS-CoV-2 Ag in samples.

2.4. Statistical Analysis

RT-qPCR was considered as the gold standard for this evaluation, therefore, positive and negative samples by molecular techniques were considered to be true positive and true negative samples, respectively. Sensitivity, specificity, positive and negative predictive values with corresponding 95% confidence intervals (CI) were calculated to assess diagnostic performance. Student t and Mann–Whitney U tests were used to assess differences between groups. Categorical variable was compared using Chi-square test. The area under the receiver operating characteristics curves (AUC of ROC) and their 95% confidence intervals (CIs), were used to evaluate the diagnostic value of the LIAISON SARS-CoV-2 Ag assay. A simple linear regression was performed to assess the potential correlation between antigen level obtained on the automated LIAISON® SARS-CoV-2 antigen test and RT-qPCR Ct values. All p-values were two-sided and p less than 0.05 was considered significant. Statistical analyses were performed using GraphPad PRISM version 6.0e (GraphPad Software, San Diego, CA, USA) or MedCalc statistical software.

3. Results

3.1. Sensitivity and Specificity of the Automated LIAISON® SARS-CoV-2 Antigen Test

We randomly sampled 300 nasopharyngeal specimens. According to RT-qPCR results, 150 specimens were positive collected from asymptomatic and symptomatic patients and 150 were negative. The demographic and clinical characteristics of the study subjects are shown in Table 1. Vaccinated persons received two doses of Pfizer–BioNTech’s messenger RNA-based vaccine (BNT162b2), or ChAdOx1 nCoV-19 vaccine, Oxford/AstraZeneca’s non-replicating viral-vectored vaccine. There was no significant difference between the proportions of vaccinated people (53.3%) with symptoms and unvaccinated patients (46.7%) (p = 0.766).
Among the 150 positive samples by RT-qPCR, 113 were positive for SARS-CoV-2 Ag according to the manufacturer interpretation rules (<100 TCID50/mL for negative, 100–199.99 TCID50/mL for equivocal, and ≥200 TCID50/mL for positive sample). The diagnostic accuracy of COVID-19 using SARS-CoV-2 Ag was performed (Table 2). Using NPS RT-qPCR as the reference method, the sensitivity of SARS-CoV-2 Ag for the diagnosis of COVID-19 in nasopharyngeal swabs was 75.33% (95% CI: 67.64–82). Among the 39 false negative samples, ten were located in the 100–199.99 TCID50/mL range defined by the manufacturer as equivocal, while 29 were negative (<100 TCID50/mL). Among the 150 negative samples by RT-qPCR, 150 were negative for SARS-CoV-2 antigen detection, meaning an overall specificity of 100% (95% CI: 97.57–100). A deep assessment was performed and summarized in Table 2.
The mean level of SARS-CoV-2 Ag among the RT-qPCR positive samples was significantly higher (34,202 ± 3395 TCID50/mL) than that of the RT-qPCR negative samples (41.44 ± 2.08 TCID50/mL) (p< 0.0001) (Figure 1a). ROC curve analysis was performed to determine the area under the curve (AUC) of the antigen level allowing the distinction of SARS-CoV-2 infection status. The AUC of the assay was 0.94 (95% CI, 0.91–0.96; p < 0.0001) indicating a very good performance (Figure 1b).

3.2. Antigen Detection According to the RT-qPCR Ct Values

Data analysis showed a good correlation between the antigen level and RT-qPCR Ct values (Figure 2).
The sensitivity was evaluated according to the Ct value. The viral load cut-off was applied to classify specimens as high viral load (Ct < 18.57), medium viral load (18.57 < Ct < 28.67) and low viral load (Ct > 28.67) (based on the average Ct SARS-CoV-2 genes) (Table 3). The sensitivity of the SARS-CoV-2 Ag detection was 96.55% when considering samples with high viral load. The median level of SARS-CoV-2 Ag was 100,000 TCID50/mL (range 1800–100,000 TCID50/mL). However, the sensitivity of the DiaSorin LIAISON SARS-CoV-2 Ag assay dropped to 6.67% for samples with low viral load (Table 3).

3.3. RT-qPCR, Antigen Detection and COVID-19 Vaccination

The samples were classified according to the COVID-19 vaccination status (Table 1). The Ct values were analyzed in fully vaccinated and unvaccinated subjects according to viral loads (Figure 3a) and antigen quantification comparisons (Figure 3b). Interestingly, fully vaccinated individuals had relatively similar viral loads (Median PCR Ct = 19.60) as unvaccinated individuals (Median PCR Ct = 19.70) (p = 0.4215) (Figure 3a). Notably, the 113 positive subjects using automated LIAISON® SARS-CoV-2 antigen assay (TCID50/mL ≥ 200) were stratified according to their vaccination status and data revealed no significant difference between fully vaccinated and unvaccinated subjects regarding the level of SARS-CoV-2 Ag values (Figure 3b). In addition, stratification according to vaccine type showed no significant differences between Pfizer/BioNTech and ChAdOx1 nCoV-19 vaccines (Figure 3).

4. Discussion

Viral nucleic acid detection using an RT-qPCR assay remains the standard diagnosis tool of COVID-19. While this detects a large number of the suspected and contact cases with typical clinical COVID-19 features, other alternative diagnostic approaches are needed. The SARS-CoV-2 antigen diagnostic assays have been widely used to help diagnosis virus infection. Compared to the RT-qPCR assay, the automated LIAISON SARS-CoV-2 Ag is often faster (around 42 min), less expensive, easier to use and accessible to staff without laboratory training. In addition, the detection ability of the N antigen by the DiaSorin LIAISON SARS-CoV-2 Ag is not theoretically impacted by the recently emerged variants of concern, which harbor different mutations in the spike protein [22,23]. Here, we evaluated the performance characteristics of the DiaSorin LIAISON SARS-CoV-2 Ag assay for detecting SARS-CoV-2 in respiratory specimens and compared the results with RT-qPCR (the gold standard assay). The sensitivity and specificity of this assay for the detection of SARS-CoV-2 were presented and the clinical application of this assay for the diagnosis of COVID-19 was discussed.
The overall sensitivity of DiaSorin LIAISON SARS-CoV-2 Ag assay was evaluated to be 75.33% and the specificity reached 100%. Previous investigations of the LIAISON SARS-CoV-2 Ag test showed an overall sensitivity ranging from 31 to 84.8% and specificity of ≈100% at the 200 TCID50/mL manufacturer’s cut-off [5,24,25,26], whereas, when applying the cut-off at 82 TCID50/mL, a previous report showed that the sensitivity of the DiaSorin LIAISON SARS-CoV-2 Ag test yielded 73% sensitivity [26]. Moreover, similar automated antigenic assays have previously been evaluated and exhibited sensitivity ranging from 70% to 97% [21,22,27,28,29,30,31,32,33].
In this study, the diagnostic performance of the novel DiaSorin LIAISON SARS-CoV-2 Ag chemiluminescence immunoassay suggests a higher performance in samples collected in the early phase of infection with high viral loads (i.e., Ct values Ct < 18.57) and displaying 96.55% sensitivity. These data seem to be in line with previous studies [7,21,24,26,31,34].
A major finding in our study is a comparison of Ct values and LIAISON SARS-CoV-2 Ag levels highlighting no significant differences between vaccinated and unvaccinated individuals in term of viral RNA loads and SARS-CoV-2 Ag levels, suggesting the same transmission potential. These data seem to be in line with several previous investigations showing no significant differences between vaccinated and unvaccinated groups, with significant breakthrough infections of SARS-CoV-2 variants in fully vaccinated people [33,35,36,37,38,39,40,41]. However, previous studies showed that COVID-19 vaccines attenuated the SARS-CoV-2 RNA loads, indicating a reduced infectiousness and virus transmissibility [17,18,42].

5. Conclusions

This study showed that the automated DiaSorin LIAISON SARS-CoV-2 antigen test has good sensitivity and specificity for identifying patients with high SARS-CoV-2 viral load and at high risk of being active sources of contagion. However, the sensitivity level does not allow for exclusion of the risk that subjects testing negative may still carry the active SARS-CoV-2 virus. Thus, more investigations are warranted by companies to improve its sensitivity in order to reduce false negative results regarding samples with low viral loads. Notably, no significant differences were observed between vaccinated and unvaccinated subjects in terms of viral loads and SARS-CoV-2 Ag levels. Thus, booster vaccinations in groups at high risk of severe COVID-19 should be recommended to help reduce the burden of COVID-19 and to improve vaccination responses.
In summary, DiaSorin’s LIAISON SARS-CoV-2 antigen is an inexpensive assay and an ideal test for high-throughput and decentralized screening of subjects with high SARS-CoV-2 viral loads for the early identification and isolation of COVID-19 patients.

Author Contributions

Conceptualization, H.A. and S.E.; methodology, H.A., W.A. and T.A.-F.; validation and data curation, H.A., S.E. and W.A.; formal analysis, H.A. and S.E.; writing—original draft preparation and writing—review and editing, H.A.; project administration and funding acquisition. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the AnaSalbi laboratory and the Ministry of Health, Kuwait.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the permanent Committee for Coordination of Medical and Health Research, Ministry of Health, Kuwait.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Data supporting reported results are available from the corresponding author on reasonable request.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Kucharski, A.J.; Klepac, P.; Conlan, A.J.K.; Kissler, S.M.; Tang, M.L.; Fry, H.; Gog, J.R.; Edmunds, W.J.; Emery, J.C.; Medley, G.; et al. Effectiveness of isolation, testing, contact tracing, and physical distancing on reducing transmission of SARS-CoV-2 in different settings: A mathematical modelling study. Lancet Infect. Dis. 2020, 20, 1151–1160. [Google Scholar] [CrossRef]
  2. Phua, J.; Weng, L.; Ling, L.; Egi, M.; Lim, C.M.; Divatia, J.V.; Shrestha, B.R.; Arabi, Y.M.; Ng, J.; Gomersall, C.D.; et al. Intensive care management of coronavirus disease 2019 (COVID-19): Challenges and recommendations. Lancet Respir. Med. 2020, 8, 506–517. [Google Scholar] [CrossRef]
  3. Kevadiya, B.D.; Machhi, J.; Herskovitz, J.; Oleynikov, M.D.; Blomberg, W.R.; Bajwa, N.; Soni, D.; Das, S.; Hasan, M.; Patel, M.; et al. Diagnostics for SARS-CoV-2 infections. Nat. Mater. 2021, 20, 593–605. [Google Scholar] [CrossRef] [PubMed]
  4. Ezzikouri, S.; Nourlil, J.; Benjelloun, S.; Kohara, M.; Tsukiyama-Kohara, K. Coronavirus disease 2019-Historical context, virology, pathogenesis, immunotherapy, and vaccine development. Hum. Vaccin Immunother. 2020, 16, 2992–3000. [Google Scholar] [CrossRef] [PubMed]
  5. Lefever, S.; Indevuyst, C.; Cuypers, L.; Dewaele, K.; Yin, N.; Cotton, F.; Padalko, E.; Oyaert, M.; Descy, J.; Cavalier, E.; et al. Comparison of the Quantitative DiaSorin Liaison Antigen Test to Reverse Transcription-PCR for the Diagnosis of COVID-19 in Symptomatic and Asymptomatic Outpatients. J. Clin. Microbiol. 2021, 59, e0037421. [Google Scholar] [CrossRef] [PubMed]
  6. Haage, V.C.; de Ferreira Oliveira-Filho, E.; Moreira-Soto, A.; Kühne, A.; Fischer, C.; Sacks, J.A.; Corman, V.M.; Müller, M.A.; Drosten, C.; Drexler, J.F. Impaired performance of SARS-CoV-2 antigen-detecting rapid diagnostic tests at elevated and low temperatures. J. Clin. Virol. 2021, 138, 104796. [Google Scholar] [CrossRef] [PubMed]
  7. Mak, G.C.; Lau, S.S.; Wong, K.K.; Chow, N.L.; Lau, C.S.; Lam, E.T.; Chan, R.C.; Tsang, D.N. Analytical sensitivity and clinical sensitivity of the three rapid antigen detection kits for detection of SARS-CoV-2 virus. J. Clin. Virol. 2020, 133, 104684. [Google Scholar] [CrossRef]
  8. Lindner, A.K.; Nikolai, O.; Kausch, F.; Wintel, M.; Hommes, F.; Gertler, M.; Krüger, L.J.; Gaeddert, M.; Tobian, F.; Lainati, F.; et al. Head-to-head comparison of SARS-CoV-2 antigen-detecting rapid test with self-collected nasal swab versus professional-collected nasopharyngeal swab. Eur. Respir. J. 2021, 57, 2003961. [Google Scholar] [CrossRef]
  9. Altawalah, H.; AlHuraish, F.; Alkandari, W.A.; Ezzikouri, S. Saliva specimens for detection of severe acute respiratory syndrome coronavirus 2 in Kuwait: A cross-sectional study. J. Clin. Virol. 2020, 132, 104652. [Google Scholar] [CrossRef]
  10. Corman, V.M.; Haage, V.C.; Bleicker, T.; Schmidt, M.L.; Mühlemann, B.; Zuchowski, M.; Jo, W.K.; Tscheak, P.; Möncke-Buchner, E.; Müller, M.A.; et al. Comparison of seven commercial SARS-CoV-2 rapid point-of-care antigen tests: A single-centre laboratory evaluation study. Lancet Microbe 2021, 2, e311–e319. [Google Scholar] [CrossRef]
  11. Baro, B.; Rodo, P.; Ouchi, D.; Bordoy, A.E.; Saya Amaro, E.N.; Salsench, S.V.; Molinos, S.; Alemany, A.; Ubals, M.; Corbacho-Monné, M.; et al. Performance characteristics of five antigen-detecting rapid diagnostic test (Ag-RDT) for SARS-CoV-2 asymptomatic infection: A head-to-head benchmark comparison. J. Infect. 2021, 82, 269–275. [Google Scholar] [CrossRef] [PubMed]
  12. Dinnes, J.; Deeks, J.J.; Berhane, S.; Taylor, M.; Adriano, A.; Davenport, C.; Dittrich, S.; Emperador, D.; Takwoingi, Y.; Cunningham, J.; et al. Rapid, point-of-care antigen and molecular-based tests for diagnosis of SARS-CoV-2 infection. Cochrane Database Syst. Rev. 2021, 3, CD013705. [Google Scholar]
  13. Polack, F.P.; Thomas, S.J.; Kitchin, N.; Absalon, J.; Gurtman, A.; Lockhart, S.; Perez, J.L.; Pérez Marc, G.; Moreira, E.D.; Zerbini, C.; et al. Safety and Efficacy of the BNT162b2 mRNA Covid-19 Vaccine. N. Engl. J. Med. 2020, 383, 2603–2615. [Google Scholar] [CrossRef] [PubMed]
  14. Voysey, M.; Clemens, S.A.C.; Madhi, S.A.; Weckx, L.Y.; Folegatti, P.M.; Aley, P.K.; Angus, B.; Baillie, V.L.; Barnabas, S.L.; Bhorat, Q.E.; et al. Safety and efficacy of the ChAdOx1 nCoV-19 vaccine (AZD1222) against SARS-CoV-2: An interim analysis of four randomised controlled trials in Brazil, South Africa, and the UK. Lancet 2021, 397, 99–111. [Google Scholar] [CrossRef]
  15. Bergwerk, M.; Gonen, T.; Lustig, Y.; Amit, S.; Lipsitch, M.; Cohen, C.; Mandelboim, M.; Levin, E.G.; Rubin, C.; Indenbaum, V.; et al. Covid-19 Breakthrough Infections in Vaccinated Health Care Workers. N. Engl. J. Med. 2021, 385, 1474–1484. [Google Scholar] [CrossRef] [PubMed]
  16. Rovida, F.; Cassaniti, I.; Paolucci, S.; Percivalle, E.; Sarasini, A.; Piralla, A.; Giardina, F.; Sammartino, J.C.; Ferrari, A.; Bergami, F.; et al. SARS-CoV-2 vaccine breakthrough infections with the alpha variant are asymptomatic or mildly symptomatic among health care workers. Nat. Commun. 2021, 12, 6032. [Google Scholar] [CrossRef] [PubMed]
  17. Thompson, M.G.; Burgess, J.L.; Naleway, A.L.; Tyner, H.; Yoon, S.K.; Meece, J.; Olsho, L.E.W.; Caban-Martinez, A.J.; Fowlkes, A.L.; Lutrick, K.; et al. Prevention and Attenuation of Covid-19 with the BNT162b2 and mRNA-1273 Vaccines. N. Engl. J. Med. 2021, 385, 320–329. [Google Scholar] [CrossRef] [PubMed]
  18. Levine-Tiefenbrun, M.; Yelin, I.; Katz, R.; Herzel, E.; Golan, Z.; Schreiber, L.; Wolf, T.; Nadler, V.; Ben-Tov, A.; Kuint, J.; et al. Initial report of decreased SARS-CoV-2 viral load after inoculation with the BNT162b2 vaccine. Nat. Med. 2021, 27, 790–792. [Google Scholar] [CrossRef] [PubMed]
  19. Despres, H.W.; Mills, M.G.; Shirley, D.J.; Schmidt, M.M.; Huang, M.L.; Jerome, K.R.; Greninger, A.L.; Bruce, E.A. Quantitative measurement of infectious virus in SARS-CoV-2 Alpha, Delta and Epsilon variants reveals higher infectivity (viral titer:RNA ratio) in clinical samples containing the Delta and Epsilon variants. medRxiv 2021. [Google Scholar] [CrossRef]
  20. Hirotsu, Y.; Omata, M. SARS-CoV-2 B.1.1.7 lineage rapidly spreads and replaces R.1 lineage in Japan: Serial and stationary observation in a community. Infect. Genet. Evol. 2021, 95, 105088. [Google Scholar] [CrossRef]
  21. Mak, G.C.K.; Lau, S.S.Y.; Wong, K.K.Y.; Chow, N.L.S.; Lau, C.S.; Ng, K.H.L.; Lam, E.T.K.; Chan, R.C.W.; Tsang, D.N.C. Evaluation of automated antigen detection test for detection of SARS-CoV-2. Diagn. Microbiol. Infect. Dis. 2021, 101, 115490. [Google Scholar] [CrossRef] [PubMed]
  22. Gili, A.; Paggi, R.; Russo, C.; Cenci, E.; Pietrella, D.; Graziani, A.; Stracci, F.; Mencacci, A. Evaluation of Lumipulse® G SARS-CoV-2 antigen assay automated test for detecting SARS-CoV-2 nucleocapsid protein (NP) in nasopharyngeal swabs for community and population screening. Int. J. Infect. Dis. 2021, 105, 391–396. [Google Scholar] [CrossRef] [PubMed]
  23. Altawalah, H. Antibody Responses to Natural SARS-CoV-2 Infection or after COVID-19 Vaccination. Vaccines 2021, 9, 910. [Google Scholar] [CrossRef]
  24. Hartard, C.; Berger, S.; Josse, T.; Schvoerer, E.; Jeulin, H. Performance evaluation of an automated SARS-CoV-2 Ag test for the diagnosis of COVID-19 infection on nasopharyngeal swabs. Clin. Chem. Lab. Med. 2021, 59, 2003–2009. [Google Scholar] [CrossRef] [PubMed]
  25. Häuser, F.; Sprinzl, M.F.; Dreis, K.J.; Renzaho, A.; Youhanen, S.; Kremer, W.M.; Podlech, J.; Galle, P.R.; Lackner, K.J.; Rossmann, H.; et al. Evaluation of a laboratory-based high-throughput SARS-CoV-2 antigen assay for non-COVID-19 patient screening at hospital admission. Med. Microbiol. Immunol. 2021, 210, 165–171. [Google Scholar] [CrossRef] [PubMed]
  26. Salvagno, G.L.; Gianfilippi, G.; Fiorio, G.; Pighi, L.; De Nitto, S.; Henry, B.M.; Lippi, G. Clinical Assessment of the DiaSorin LIAISON SARS-CoV-2 Ag Chemiluminescence Immunoassay. EJIFCC Electron. J. Int. Fed. Clin. Chem. Lab. Med. 2021, 32, 216–223. [Google Scholar] [CrossRef]
  27. Aoki, K.; Nagasawa, T.; Ishii, Y.; Yagi, S.; Okuma, S.; Kashiwagi, K.; Maeda, T.; Miyazaki, T.; Yoshizawa, S.; Tateda, K. Clinical validation of quantitative SARS-CoV-2 antigen assays to estimate SARS-CoV-2 viral loads in nasopharyngeal swabs. J. Infect. Chemother. 2021, 27, 613–616. [Google Scholar] [CrossRef] [PubMed]
  28. Iqbal, B.; Khan, M.; Shah, N.; Dawood, M.M.; Jehanzeb, V.; Shafi, M. Comparison of SARS-CoV-2 antigen electrochemiluminescence immunoassay to RT-PCR assay for laboratory diagnosis of COVID-19 in Peshawar. Diagnosis 2021, in press. [Google Scholar] [CrossRef]
  29. Matsuzaki, N.; Orihara, Y.; Kodana, M.; Kitagawa, Y.; Matsuoka, M.; Kawamura, R.; Takeuchi, S.; Imai, K.; Tarumoto, N.; Maesaki, S.; et al. Evaluation of a chemiluminescent enzyme immunoassay-based high-throughput SARS-CoV-2 antigen assay for the diagnosis of COVID-19: The VITROS® SARS-CoV-2 Antigen Test. J. Med. Virol. 2021, 93, 6778–6781. [Google Scholar] [CrossRef] [PubMed]
  30. Hirotsu, Y.; Sugiura, H.; Maejima, M.; Hayakawa, M.; Mochizuki, H.; Tsutsui, T.; Kakizaki, Y.; Miyashita, Y.; Omata, M. Comparison of Roche and Lumipulse quantitative SARS-CoV-2 antigen test performance using automated systems for the diagnosis of COVID-19. Int. J. Infect. Dis. 2021, 108, 263–269. [Google Scholar] [CrossRef] [PubMed]
  31. Favresse, J.; Gillot, C.; Oliveira, M.; Cadrobbi, J.; Elsen, M.; Eucher, C.; Laffineur, K.; Rosseels, C.; Van Eeckhoudt, S.; Nicolas, J.B.; et al. Head-to-Head Comparison of Rapid and Automated Antigen Detection Tests for the Diagnosis of SARS-CoV-2 Infection. J. Clin. Med. 2021, 10, 265. [Google Scholar] [CrossRef]
  32. Sberna, G.; Basile, F.; Guarino, M.L.; Capobianchi, M.R.; Bordi, L.; Parisi, G. Comparison of Allplex™ SARS-CoV-2 Assay, Easy SARS-CoV-2 WE and Lumipulse quantitative SARS-CoV-2 antigen test performance using automated systems for the diagnosis of COVID-19. Int. J. Infect. Dis. 2021, S1201-9712, 00781–00785. [Google Scholar] [CrossRef] [PubMed]
  33. Vignier, N.; Bérot, V.; Bonnave, N.; Peugny, S.; Ballet, M.; Jacoud, E.; Michaud, C.; Gaillet, M.; Djossou, F.; Blanchet, D.; et al. Breakthrough Infections of SARS-CoV-2 Gamma Variant in Fully Vaccinated Gold Miners, French Guiana, 2021. Emerg. Infect. Dis. 2021, 27, 2673–2676. [Google Scholar] [CrossRef] [PubMed]
  34. Paul, D.; Gupta, A.; Rooge, S.; Gupta, E. Performance evaluation of automated chemiluminescence immunoassay based antigen detection—Moving towards more reliable ways to predict SARS-CoV-2 infection. J. Virol. Methods 2021, 298, 114299. [Google Scholar] [CrossRef] [PubMed]
  35. Luo, C.H.; Morris, C.P.; Sachithanandham, J.; Amadi, A.; Gaston, D.; Li, M.; Swanson, N.J.; Schwartz, M.; Klein, E.Y.; Pekosz, A.; et al. Infection with the SARS-CoV-2 Delta Variant is Associated with Higher Infectious Virus Loads Compared to the Alpha Variant in both Unvaccinated and Vaccinated Individuals. medRxiv 2021. [Google Scholar] [CrossRef]
  36. Chau, N.V.V.; Ngoc, N.M.; Nguyet, L.A.; Quang, V.M.; Ny, N.T.H.; Khoa, D.B.; Phong, N.T.; Toan, L.M.; Hong, N.T.T.; Tuyen, N.T.K.; et al. An observational study of breakthrough SARS-CoV-2 Delta variant infections among vaccinated healthcare workers in Vietnam. EClinicalMedicine 2021, 41, 101143. [Google Scholar] [CrossRef]
  37. Dash, G.C.; Subhadra, S.; Turuk, J.; Parai, D.; Rath, S.; Sabat, J.; Rout, U.K.; Kanungo, S.; Choudhary, H.R.; Nanda, R.R.; et al. Breakthrough SARS-CoV-2 infections among BBV-152 (COVAXIN®) and AZD1222 (COVISHIELDT M ) recipients: Report from eastern state of India. J. Med. Virol. 2021, in press. [Google Scholar] [CrossRef]
  38. Naito, T.; Yan, Y.; Tabe, Y.; Seyama, K.; Deshpande, G.A. Real-world evidence for the effectiveness and breakthrough of BNT162b2 mRNA COVID-19 vaccine at a medical center in Japan. Hum. Vaccin Immunother. 2021, 17, 1–2. [Google Scholar] [CrossRef]
  39. Farinholt, T.; Doddapaneni, H.; Qin, X.; Menon, V.; Meng, Q.; Metcalf, G.; Chao, H.; Gingras, M.C.; Avadhanula, V.; Farinholt, P.; et al. Transmission event of SARS-CoV-2 delta variant reveals multiple vaccine breakthrough infections. BMC Med. 2021, 19, 255. [Google Scholar] [CrossRef]
  40. Blanquart, F.; Abad, C.; Ambroise, J.; Bernard, M.; Cosentino, G.; Giannoli, J.M.; Débarre, F. Characterisation of vaccine breakthrough infections of SARS-CoV-2 Delta and Alpha variants and within-host viral load dynamics in the community, France, June to July 2021. Eurosurveillance 2021, 26, 2100824. [Google Scholar] [CrossRef]
  41. Singanayagam, A.; Hakki, S.; Dunning, J.; Madon, J.K.; Crone, M.A.; Koycheva, A.; Derqui-Fernandez, N.; Barnett, L.J.; Whitfield, G.M.; Varro, R.; et al. Community transmission and viral load kinetics of the SARS-CoV-2 delta (B.1.617.2) variant in vaccinated and unvaccinated individuals in the UK: A prospective, longitudinal, cohort study. Lancet Infect. Dis. 2021. [Google Scholar] [CrossRef]
  42. Singanayagam, A.; Patel, M.; Charlett, A.; Lopez Bernal, J.; Saliba, V.; Ellis, J.; Ladhani, S.; Zambon, M.; Gopal, R. Duration of infectiousness and correlation with RT-PCR cycle threshold values in cases of COVID-19, England, January to May 2020. Eurosurveillance 2020, 25, 2001483. [Google Scholar] [CrossRef] [PubMed]
Diagnostics 11 02110 g001 550
Figure 1. SARS-CoV-2 antigen detection according to RT-qPCR results. (a) The level of SARS-CoV-2 Ag among the RT-qPCR positive and negative samples. (b) Receiver operating characteristic (ROC) curve analysis to evaluate the diagnostic value of the LIAISON SARS-CoV-2 Ag assay. Data are presented as mean ± SD.
Figure 1. SARS-CoV-2 antigen detection according to RT-qPCR results. (a) The level of SARS-CoV-2 Ag among the RT-qPCR positive and negative samples. (b) Receiver operating characteristic (ROC) curve analysis to evaluate the diagnostic value of the LIAISON SARS-CoV-2 Ag assay. Data are presented as mean ± SD.
Diagnostics 11 02110 g001
Diagnostics 11 02110 g002 550
Figure 2. Linear regression of RT-qPCR Ct values versus the level of antigen (log10 transformed TCID50/mL results) obtained on the DiaSorin LIAISON SARS-CoV-2 Ag assay.
Figure 2. Linear regression of RT-qPCR Ct values versus the level of antigen (log10 transformed TCID50/mL results) obtained on the DiaSorin LIAISON SARS-CoV-2 Ag assay.
Diagnostics 11 02110 g002
Diagnostics 11 02110 g003 550
Figure 3. Cycle threshold (Ct) values for PCR-positive infections by vaccination status and type of vaccine. (a) Data are presented as RT-qPCR Ct values. (b) Data are presented as SARS-CoV-2 antigen levels obtained on the DiaSorin LIAISON SARS-CoV-2 Ag assay. Data are presented as median with range.
Figure 3. Cycle threshold (Ct) values for PCR-positive infections by vaccination status and type of vaccine. (a) Data are presented as RT-qPCR Ct values. (b) Data are presented as SARS-CoV-2 antigen levels obtained on the DiaSorin LIAISON SARS-CoV-2 Ag assay. Data are presented as median with range.
Diagnostics 11 02110 g003
Table
Table 1. Demographic and clinical characteristics of subjects.
Table 1. Demographic and clinical characteristics of subjects.
RT-qPCR Positive Patients
(N = 150)		RT-qPCR Negative Subjects
(N = 150)
Median age (range), year34 (4–74)43 (7–79)
Sex, no. (%)
Male54 (36)84 (56)
Female96 (64)66 (44)
Presenting symptoms and signs, no. (%)
Fever12 (8)6 (4)
Headache10 (6.7)1 (0.7)
Cough14 (9.3)4 (2.7)
Generalised weakness12 (8)3 (2)
Nasal congestion9 (6)-
Sore throat5 (3.3)2 (1.3)
Ageusia/Anosmia10 (6.7)3 (2)
Diarrhea3 (2)2 (1.3)
Shortness of breath7 (4.7)2 (1.3)
COVID-19 vaccine, no. (%)
Pfizer–BioNTech30 (20)44 (29.3)
ChAdOx1 nCoV-1929 (19.3)47 (31.3)
Table
Table 2. Assessment of the diagnostic accuracy of the automated LIAISON® SARS-CoV-2 antigen test in nasopharyngeal swabs.
Table 2. Assessment of the diagnostic accuracy of the automated LIAISON® SARS-CoV-2 antigen test in nasopharyngeal swabs.
Value (%)(95% CI)
Sensitivity75.33(67.64–82.00)
Specificity100.00(97.57–100.00)
Negative likelihood ratio0.25(0.19–0.3)
Positive predictive value100(92.32–99.13)
Negative predictive value80.21(75.40–84.28)
Accuracy87.67(83.40–91.17)
Table
Table 3. Performance of the diagnostic accuracy of antigen detection according to the RT-qPCR Ct values.
Table 3. Performance of the diagnostic accuracy of antigen detection according to the RT-qPCR Ct values.
SARS-CoV-2 Antigen Detection
Viral LoadMedian Ct Value
(Range)		nPositiveMedian SARS-CoV-2 Ag Value
TCID50/mL (Range)		Sensitivity
High15.94 (10.65–18.53)5856100,000 (1800–100,000)96.55%
Medium22.29 (18.64–28.52)77565736 (220–100,000)72.73%
Low30.07 (28.79–31.67)1513366.67%
All19.90 (10.65–31.67)15011325,353 (220–100,000)75.33%
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Altawalah, H.; Alfouzan, W.; Al-Fadalah, T.; Ezzikouri, S. Diagnostic Performance of Automated SARS-CoV-2 Antigen Assay in Nasal Swab during COVID-19 Vaccination Campaign. Diagnostics 2021, 11, 2110. https://doi.org/10.3390/diagnostics11112110

AMA Style

Altawalah H, Alfouzan W, Al-Fadalah T, Ezzikouri S. Diagnostic Performance of Automated SARS-CoV-2 Antigen Assay in Nasal Swab during COVID-19 Vaccination Campaign. Diagnostics. 2021; 11(11):2110. https://doi.org/10.3390/diagnostics11112110

Chicago/Turabian Style

Altawalah, Haya, Wadha Alfouzan, Talal Al-Fadalah, and Sayeh Ezzikouri. 2021. "Diagnostic Performance of Automated SARS-CoV-2 Antigen Assay in Nasal Swab during COVID-19 Vaccination Campaign" Diagnostics 11, no. 11: 2110. https://doi.org/10.3390/diagnostics11112110

APA Style

Altawalah, H., Alfouzan, W., Al-Fadalah, T., & Ezzikouri, S. (2021). Diagnostic Performance of Automated SARS-CoV-2 Antigen Assay in Nasal Swab during COVID-19 Vaccination Campaign. Diagnostics, 11(11), 2110. https://doi.org/10.3390/diagnostics11112110

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop