Next Article in Journal
Investigational Treatments in Phase I and II Clinical Trials: A Systematic Review in Asthma
Next Article in Special Issue
Detection of SARS-CoV-2 Using Reverse Transcription Helicase Dependent Amplification and Reverse Transcription Loop-Mediated Amplification Combined with Lateral Flow Assay
Previous Article in Journal
Dexamethasone-Induced Adipose Tissue Redistribution and Metabolic Changes: Is Gene Expression the Main Factor? An Animal Model of Chronic Hypercortisolism
Previous Article in Special Issue
Development of a Fully Automated Desktop Analyzer and Ultrahigh Sensitivity Digital Immunoassay for SARS-CoV-2 Nucleocapsid Antigen Detection
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Clinical Performance of Self-Collected Nasal Swabs and Antigen Rapid Tests for SARS-CoV-2 Detection in Resource-Poor Settings

1
Instituto Nacional de Saúde, Marracuene 3943, Mozambique
2
Clinton Health Access Initiative, Maputo City 592, Mozambique
3
World Health Organization, 1211 Geneva, Switzerland
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Biomedicines 2022, 10(9), 2327; https://doi.org/10.3390/biomedicines10092327
Submission received: 27 August 2022 / Revised: 13 September 2022 / Accepted: 16 September 2022 / Published: 19 September 2022

Abstract

:
Background: In resource-poor countries, antigen-based rapid tests (Ag-RDTs) performed at primary healthcare and community settings improved access to SARS-CoV-2 diagnostics. However, the technical skills and biosafety requirements inherent to nasopharyngeal and oropharyngeal (OP) specimens limit the scale-up of SARS-CoV-2 testing. The collection of nasal-swabs is programmatically viable, but its performance has not been evaluated in resource-poor settings. Methods: We first evaluated the performance of SteriPack self-collected nasal swabs for the detection of SARS-CoV-2 by real-time PCR in 1498 consecutively enrolled patients with suspected infection. Next, we evaluated the clinical performance of three nasal swab-based Ag-RDTs against real-time PCR on OP specimens. Results: The sensitivity of nasal swabs was 80.6% [95% CI: 75.3–85.2%] compared to OP specimens. There was a good correlation (r = 0.58; p < 0.0001) between Ct values of 213 positive cases obtained using nasal and OP swabs. Our findings show sensitivities of 79.7% [95% CI: 73.3–85.1%] for Panbio COVID-19 Ag-RDT, 59.6% [95% CI: 55.2–63.8%] for COVIOS Ag-RDT, and 78.0% [95% CI: 73.5–82.0%] for the LumiraDx SARS-CoV-2 Ag-RDT. Conclusions: In our setting, the COVIOS Ag-RDT did not meet WHO requirements. Nasal swab-based Ag-RDTs for SARS-CoV-2 detection constitute a viable and accurate diagnostic option in resource-poor settings.

1. Introduction

Accurate and rapid diagnosis remains a key strategy to control the COVID-19 pandemic [1,2]. In resource-limited settings, the impact of diagnosis on reducing the spread of SARS-CoV-2 is reliant on wide access to testing in primary healthcare and community settings [1,3,4]. The deployment of antigen rapid diagnostic tests (Ag-RDTs) for SARS-CoV-2 dramatically changed the availability of testing [5] during the second year of the pandemic, and for the first time in resource-limited settings, allowed the timely diagnosis of SARS-CoV-2 infection [6] outside the main urban centers.
Most SARS-CoV-2 Ag-RDTs require the use of nasopharyngeal or oropharyngeal specimens [7,8,9]. The collection of these biological samples requires invasive procedures, trained personnel, and complex biosafety protocols [10,11,12]. These factors can hamper the scale-up of testing as a public health strategy due to operational challenges and high programmatic costs [10,11,12].
Nasal swabs constitute viable biological specimens for SARS-CoV-2 testing, for both RNA amplification and antigen detection [13,14]. The collection of swabs from nostrils is easier to perform, does not involve aerosol-generating [15] procedures, and is suitable to be conducted by lay personnel [16]. Therefore, the adoption of nasal swab-based SARS-CoV-2 diagnosis can be catalytical for the implementation of mass testing in resource-limited settings [10,11].
We first evaluated the performance of nasal swabs as an alternative sample for detecting SARS-CoV-2 by real-time PCR. Subsequently, we determined the diagnostic performance of nasal swab-based Ag-RDTs under health system conditions in Mozambique.

2. Materials and Methods

2.1. Study Setting and Participants

Cross sectional prospective studies were conducted between April 2021 and January 2022. Study participants were recruited at five public health facilities in the Maputo area, namely Centro de Saúde de Marracuene (CSM), Hospital Provincial da Matola (HPM), Hospital Geral de Chamanculo (HGC), Hospital Geral de Mavalane (HGM), and Hospital Central de Maputo (HCM).
Participants aged 18 years old and above suspected of SARS-CoV-2 infection and contacts of confirmed cases were enrolled in the study. Definitions of suspected cases and their contacts were based on the World Health Organization (WHO) guidelines [9].
An electronic standardized case investigation form (CIF) was completed for each participant to collect the demographic, clinical, epidemiological, and testing data. Electronic forms in mobile tablets (Samsung, Suwon-si, South Korea, model: TAB A 8”) were used for this purpose. The quality of data entered was randomly verified as part of quality control procedures.

2.2. Sample Collection

For the evaluation of the self-collected Sterile Polyester Nasal Swabs (SteriPack, Lakeland, FL, USA, REF. 60,564 RevA), the technology under evaluation, each participant self-collected one nasal sample by inserting the swab into both nostrils until the level of the turbinates. Participants were instructed to rotate the swab a few times against the nasal wall in each nostril. Subsequently, study staff collected an oropharyngeal swab that was used for the routine diagnosis.
Nasal and oropharyngeal swabs were placed into sterile tubes containing 3 mL of viral transport media (iClean, Shenzhen, China, REF. CY-F005-20) with antibiotics (Gentamicin, Streptomycin, Penicillin, Amphotericin B), transported and stored at 2–8 °C in the testing laboratory for a maximum of 24 h before testing. All samples were referred for RT-PCR testing at the Instituto Nacional de Saúde. Testing of paired swabs was blinded to laboratory technicians performing the assay and only results obtained on oropharyngeal swabs were issued to participants.
For the evaluation of nasal swab-based Ag-RDTs, the collection of nasal swabs for Ag-RDT testing (technologies under evaluation) and the oropharyngeal swab for RT-PCR testing (gold standard) were performed by the study staff. Study staff performed the Ag-RDTs at health facilities, while oropharyngeal swabs were referred to the Instituto Nacional de Saúde for RT-PCR by blinded laboratory technicians.

2.3. Sample Size

Sample size was determined considering a minimum positivity rate for SARS-CoV-2 of 4.5%, 95% sensitivity and specificity, and 95% confidence interval to detect at least 85 positive cases in each evaluation, among the symptomatic cases and their contacts. A total of 1498 subjects (269 positive cases) consecutively participated in the evaluation of nasal swabs samples for RT-PCR: 696 subjects (386 positive cases) in the LumiraDx SARS-CoV-2 Ag Test, 1123 subjects (520 positive cases) participated in COVIOS Ag Rapid Test Device, and 400 subjects (214 positive cases) participated in Panbio COVID-19 Ag evaluations.

2.4. Antigen Rapid Test (Ag-RDT) Testing

Three nasal swab-based SARS-CoV-2 Ag-RDTs were evaluated, namely: (i) PanbioTM COVID-19 Ag rapid diagnostic test device nasal (Abbott, Jena, Germany, Ref: 41FK11); (ii) COVIOS® Ag COVID-19 Rapid Antigen Test (Global Access Diagnostics, United Kingdom, Ref: 11811125, Lot: CA25K-121-2); and (iii) LumiraDx SARS-CoV-2 Ag Test (LumiraDx, London, UK, Ref.: L016000109048, Lot.: GM2000390). Each test was performed according to the manufacturer’s instructions. The LumiraDx test is an automated process assay while the other two are manual tests. The samples for all evaluated tests were collected according to specifications from each manufacturer.
PanbioTM COVID-19 Ag rapid diagnostic test: A nasal swab with the specimen was inserted into an extraction buffer tube provided by the manufacturer. The swab was swirled at least five times. The swab was removed from the tube squeezing the sides to extract absorbed liquid. Three to five drops of the liquid in the tube were applied to the specimen well of the test device and the test result was read between 15 and 20 min according to the manufacturer’s procedures. The limit of detection of this Ag-RDT was 2.5 × 101.8 TCID50/mL of SARS-CoV-2.
COVIOS® Ag COVID-19 Rapid Antigen Test: A nasal swab was collected and inserted into an extraction buffer tube provided by the manufacturer. The swab was stirred at least five to ten times, and then removed while squeezing the sides to extract liquid from swab. Five drops were applied to the test device and the result was read in 10 min. The limit of detection of this Ag-RDT was 3.5 × 102 TCID50/mL of SARS-CoV-2.
LumiraDx SARS-CoV-2 antigen test: A nasal swab was collected and then placed into 0.7 mL of extraction buffer. One whole drop of the sample was then applied onto the Test Strip Sample Application Area when prompted by the instrument. The result was read by the LumiraDx equipment (LumiraDx, London, United Kingdom) within 12 min. The results appeared on the touchscreen as Negative (–) SARS-CoV-2, Positive (+) SARS-CoV-2, or invalid results. The limit of detection of this Ag-RDT was 2.5 × 105 TCID50/mL of SARS-CoV-2.

2.5. Real-Time PCR Testing

Automated SARS-CoV-2 RNA extraction and detection were executed on the Abbott m2000 sp/rt platforms (Abbott Molecular Inc., Taipei city, Taiwan). The RT-PCR assay uses two sets of primers to amplify regions within the highly conserved RNA-dependent RNA polymerase (RdRp) and N genes. The limit of detection of the kit was 100 copies/mL of SARS-CoV-2. Results were considered positive if both genes were detected. If only one gene was detected, then the result was considered indeterminate. If this occurred, an additional oropharyngeal specimen collection was requested to ensure that the participants had their test results, but the final result was not included in the evaluation.

2.6. Data Analysis

Results generated by the evaluated technologies were compared to those yielded by oropharyngeal swabs tested by RT-PCR. The performance of self-collected nasal swabs and Ag-RDTs was determined by their sensitivity, specificity, positive and negative predictive values [17], observed agreement, and kappa agreement. Wilcoxon signed rank tests for paired samples were used to compare the Ct values obtained in self-collected nasal and oropharyngeal swabs. The Spearman coefficient determined the correlation and p < 0.05 was considered significant. Statistical analysis was performed using Microsoft Excel 360 (Microsoft Co., Redmond, WA, USA).

3. Results

3.1. Characteristics of Study Population

A total of 3717 participants were enrolled in the evaluations, of which 54.3% (2017/3717) were female (Table 1). The median age of participants was 35 years (Min-Max: 18–91 years). The overall SARS-CoV-2 positivity rate by RT-PCR was 37.6%. Most of the participants (3443/3717; 92.6%) were symptomatic and 83.1% (3089/3717) reported having symptoms for less than seven days. The median Ct value in oropharyngeal swabs was 24.7 (Min-Max: 5.7–36.5) and 25.7 (Min-Max: 3.7–39.0) during the evaluations of nasal swabs and Ag-RDTs, respectively.

3.2. Performance of Nasal Swabs for SARS-CoV-2 Detection

We first evaluated the performance of self-collected SteriPack nasal swabs when compared to oropharyngeal swabs in 1498 patients with suspected SARS-CoV-2 infection (Table 2). The overall sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) were 80.6% (95% CI: 75.3–85.2%), 96.4% (95% CI: 95.2–97.4%), 83.1% (95% CI: 78.0–87.4%), and 95.8% (95% CI: 94.5–96.8%), respectively. The observed result agreement between the two types of swabs was 93.5% (95% CI: 34.7–94.7%). Among the 213 patients with SARS-CoV-2 positive results on paired swabs, there was good correlation (r = 0.58; p < 0.0001) of the amount of virus detected as measured by the Ct value (Figure 1). The median Ct value in the evaluation of nasal swabs was 22.41 (Min-Max: 4.4–36.9) for self-collected nasal swabs and 23.67 (Min-Max: 5.7–34.7) for oropharyngeal swabs (p = 0.068).

3.3. Performance of Nasal Swab-Based Antigen Rapid Tests for SARS-CoV-2 Detection

Having shown good performance of nasal swabs for detecting SARS-CoV-2 genetic material, we next assessed the clinical performance of three nasal swab-based SARS-CoV-2 Ag-RDTs (Table 2). The overall sensitivity, specificity, PPV, and NPV observed for the Panbio COVID-19 Ag Rapid Test Device were 79.7% (95% CI: 73.3–85.1%), 97.2% (95% CI: 93.5–99.1%), 96.8% (95% CI: 92.8–99.0%), and 81.4% (95% CI: 75.5–86.4%), respectively. The agreement observed between results generated by the Panbio device and those yielded by RT-PCR was 88.0% (95% CI: 41.9–91.2%). The overall Cohen’s kappa was 0.71 (95% CI: 0.70–0.72). The performance of the nasal swabs was similar in both symptomatic and non-symptomatic individuals.
The overall sensitivity, specificity, PPV, and NPV observed for the COVIOS Ag COVID-19 Rapid Antigen Test were 59.6% (95% CI: 55.2–63.8%), 94.9% (95% CI: 92.8–96.5%), 91.1% (95% CI: 87.6–93.9%), and 72.6% (95% CI: 69.3–75.8%), respectively. The agreement observed between results generated by the COVIOS device and those yielded by RT-PCR was 78.3% (95% CI: 37.0–80.7%). The overall Cohen’s kappa was 0.556 (95% CI: 0.551–0.560). There were few positive individuals without symptoms in the evaluation of this test (n = 8), which did not allow for meaningful comparison of the performance of the test according to presence or absence of symptoms.
For the LumiraDx SARS-CoV-2 Ag Test, the overall sensitivity, specificity, PPV, and NPV observed were 78.0% (95% CI:73.5–82.0%), 95.8% (95% CI: 92.9–97.7%), 95.9% (95% CI: 93.0–97.8%), and 77.6% (95% CI: 73.0–81.7%), respectively. The agreement observed between results generated by the LumiraDx device and those yielded by RT-PCR was 85.9% (95% CI: 43.7–88.4%). The overall Cohen’s kappa was 0.72 (95% CI: 0.72–0.73). The performance of the nasal swabs was similar in both symptomatic and non-symptomatic individuals. The sensitivity of the LumiraDx test was higher among symptomatic (79.9%; 95% CI: 75.4–83.9%) than among non-symptomatic individuals (47.8%; 95% CI:26.8–69.4%), with Cohen’s kappa of 0.71 (95% CI: 0.70–0.72) and 0.50 (95% CI: 0.36–0.65), respectively.

4. Discussion

During the onset of the COVID-19 pandemic, PCR-based assays performed on oropharyngeal and nasopharyngeal swabs were the only option available to diagnose SARS-CoV-2 infections [9,18,19], severely limiting the availability of testing in LMICs. Although the later arrival of Ag-RDTs increased the volume of testing in these countries, the need for oropharyngeal and nasopharyngeal swabs continued to pose programmatic challenges [15].
In this study, we showed that nasal swabs constitute an accurate alternative to oropharyngeal swabs for the detection of SARS-CoV-2 in the upper respiratory tract. Although the sensitivity of nasal swabs was lower than the gold standard, the method met the WHO requirements [20], and results were in line with the sensitivities of 82–88% reported in a recent meta-analysis [21]. We performed the evaluation during the third and fourth waves of SARS-CoV-2 in Southern Africa and in a mostly unvaccinated population. This epidemiological context of our study setting and population immunity resulting from previous infections can justify the lower sensitivity observed. It has been reported that the sensitivity of diagnostic tests can be negatively affected by lower concentrations of the virus [22] in nasal secretions. Additionally, it is documented that immunity from previous infections reduces the replication of SARS-CoV-2 in the nasal mucosa [23]. It has been suggested that combining nasal swabs and saliva collection may increase the sensitivity of SARS-CoV-2 detection [13], however this is impractical in real-life settings.
After demonstrating good accuracy of nasal swabs for detecting SARS-CoV-2 genetic material, we evaluated three Ag-RDTs based on nasal swabs. Two of these, Panbio and LumiraDx, met the WHO requirements for selection of essential in vitro diagnostics for SARS-CoV-2 [20]. Nevertheless, the sensitivities documented here were lower than the >90% reported by the manufacturers. The third assay evaluated, COVIOS® Ag COVID-19 RDT, had a sensitivity of 59.6%, lower than what was found in other evaluations in developed countries or reported by the manufacturer. This assay has a higher limit of detection when compared to Panbio and LumiraDx, which could justify the lower sensitivity observed in this evaluation. Differences in study settings, population immunity, epidemiological context, and workload at health facilities could have caused some of the differences in assay performance observed in our study. Evaluations performed in clinical settings and populations from Canada, United Kingdom, United States, and Germany reported discrepant sensitivities [24,25,26,27]. For example, in United Kingdom, in ambulance services and walk-through testing settings, Cubas-Attienzar et al. (2021) evaluated the COVIOS nasal antigen SARS-CoV-2 rapid tests and found a higher sensitivity and specificity, of 85.0% and 97.8%, respectively [26].
The genetic variants of SARS-CoV-2 prevalent at the time of the study are also a factor of possible importance in the performance of the evaluated assays. Our study was performed during high-transmission waves when the delta and omicron variants were predominant in Mozambique. Test manufactures have reported that emerging variants do not influence the performance of Ag-RDTs, because these detect nucleocapsid virus proteins while genetic variation of SARS-CoV-2 is mainly concentrated on the S gene [28]. Nevertheless, it has also been described that mutations affecting the spike protein can interfere with the binding of anti-nucleocapsid antibodies [28]. Although with no statistical significance, a study conducted by Bayart et al. (2022) found differences in Ag-RDTs sensitivity for delta and omicron variants, with sensitivity varying from 70.0 to 92.9% for delta and from 69.9 to 78.8% for omicron variant [29,30].
The nasal swab-based Ag-RDTs evaluated here had better performance than what we previously observed for nasopharyngeal swab-based Ag-RDTs [31]. Our results suggest that the simpler procedure of specimen collection positively impacts the clinical performance of assays. Additionally, our findings support the notion that self-sampling approaches for nasal swabs are feasible in LMICs, which could potentially increase access to SARS-CoV-2 testing. High-income countries have been successfully implementing self-testing in schools, offices, and universities [32]. Goggolidou et al. (2021) found that 79% of interviewers reported the willingness to perform home-based self-testing using easy-to-sample biological specimens [33]. The acceptability of self-collected nasal Ag-RDTs needs further investigation in the context of LMICs.
Primary healthcare is the main entry point to the health system for an estimated 80% of patients in LMICs [6]. The effective scaling-up of testing, for both endemic and epidemic diseases, can only be attained if using diagnostic procedures that are simple and do not require specialized biosafety conditions. Nasal swab-based rapid assays constitute a feasible and accurate alternative to more complex sampling and testing methods, especially in resource-poor settings.

Author Contributions

Conceptualization, N.S., I.C., O.L. and I.J.; methodology, N.S., J.S. (Jillian Sacks), I.C. and I.J.; validation, N.S., J.S. (Júlia Sambo), S.V. and I.J.; formal analysis, O.L.; investigation, N.N., J.C., A.M. and J.S. (Júlia Sambo); data curation, J.R. and O.L.; writing—original draft preparation, N.S., N.N., J.C. and J.S. (Jillian Sacks); writing—review and editing, C.M., N.M., S.V., J.C., O.L., N.N., J.S. (Jillian Sacks) and I.J.; supervision, J.S. (Júlia Sambo), N.N., J.C. and A.M.; project administration, J.S. (Júlia Sambo); funding acquisition, N.S., I.J. and C.M. All authors have read and agreed to the published version of the manuscript.

Funding

This study was financially supported by World Health Organization, through the SARS-CoV-2 Antigen detecting rapid diagnostic test implementation projects, Global Affairs Canada, through the SARS-CoV-2 response, project number P009134. The Bill and Melinda Gates Foundation #OPP1214435 also supported the study. Under the grant conditions of the Foundation, a Creative Commons Attribution 4.0 Generic License has already been assigned to the Author Accepted Manuscript version that might arise from this submission.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the Institutional and National Health Bioethics Committees, with approval reference numbers 107/CIBS-INS/2020 of 20 December 2020 and 719/CNBS/2020 of 8 December 2020, respectively.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study. Written informed consent has been obtained from the patient to publish this paper.

Data Availability Statement

MDPI Research Data Policies.

Acknowledgments

We would like to acknowledge the Virology laboratory staff, study teams at the health facilities for the patient recruitment, specimen collection, and sample testing, and the study sites through to the provincial Health Services and Directorates.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Scohy, A.; Anantharajah, A.; Bodéus, M.; Kabamba-Mukadi, B.; Verroken, A.; Rodriguez-Villalobos, H. Low Performance of Rapid Antigen Detection Test as Frontline Testing for COVID-19 Diagnosis. J. Clin. Virol. 2020, 129, 104455. [Google Scholar] [CrossRef] [PubMed]
  2. Abdullahi, I.N.; Emeribe, A.U.; Akande, A.O.; Ghamba, P.E.; Adekola, H.A.; Ibrahim, Y.; Dangana, A. Roles and Challenges of Coordinated Public Health Laboratory Response against COVID-19 Pandemic in Africa. J. Infect Dev. Ctries 2020, 14, 691–695. [Google Scholar] [CrossRef] [PubMed]
  3. Favresse, J.; Gillot, C.; Oliveira, M.; Cadrobbi, J.; Elsen, M.; Eucher, C.; Laffineur, K.; Rosseels, C.; Van Eeckhoudt, S.; Nicolas, J.-B.; et al. Head-to-Head Comparison of Rapid and Automated Antigen Detection Tests for the Diagnosis of SARS-CoV-2 Infection. JCM 2021, 10, 265. [Google Scholar] [CrossRef] [PubMed]
  4. Bohn, M.K.; Loh, T.P.; Wang, C.-B.; Mueller, R.; Koch, D.; Sethi, S.; Rawlinson, W.D.; Clementi, M.; Erasmus, R.; Leportier, M.; et al. IFCC Interim Guidelines on Serological Testing of Antibodies against SARS-CoV-2. Clin. Chem. Lab. Med. 2020, 58, 2001–2008. [Google Scholar] [CrossRef]
  5. Pollock, N.R.; Lee, F.; Ginocchio, C.C.; Yao, J.D.; Humphries, R.M. Considerations for Assessment and Deployment of Rapid Antigen Tests for Diagnosis of Coronavirus Disease 2019. Open Forum Infect. Dis. 2021, 8, ofab110. [Google Scholar] [CrossRef]
  6. Jani, I.V.; Peter, T.F. Nucleic Acid Point-of-Care Testing to Improve Diagnostic Preparedness. Clin. Infect. Dis. 2022, 75, 723–728. [Google Scholar] [CrossRef]
  7. Hanson, K.E.; Barker, A.P.; Hillyard, D.R.; Gilmore, N.; Barrett, J.W.; Orlandi, R.R.; Shakir, S.M. Self-Collected Anterior Nasal and Saliva Specimens versus Health Care Worker-Collected Nasopharyngeal Swabs for the Molecular Detection of SARS-CoV-2. J. Clin. Microbiol. 2020, 58, e01824-20. [Google Scholar] [CrossRef]
  8. CDC Interim Guidelines for Collecting and Handling of Clinical Specimens for COVID-19 Testing. Available online: https://www.cdc.gov/coronavirus/2019-ncov/lab/guidelines-clinical-specimens.html (accessed on 20 June 2022).
  9. WHO WHO COVID-19: Case Definitions. WHO 2019-NCoV Surveillance Case Definition 2020.2. Available online: https://www.who.int/publications/i/item/WHO-2019-nCoV-Surveillance_Case_Definition-2020.2 (accessed on 25 April 2021).
  10. Gaur, R.; Verma, D.K.; Mohindra, R.; Goyal, K.; Gupta, S.; Singla, V.; Sahni, V.; Ghosh, A.; Soni, R.K.; Bhalla, A.; et al. Buccal Swabs as Non-Invasive Specimens for Detection of Severe Acute Respiratory Syndrome Coronavirus-2. J. Int. Med. Res. 2021, 49, 030006052110169. [Google Scholar] [CrossRef]
  11. Vlek, A.L.M.; Wesselius, T.S.; Achterberg, R.; Thijsen, S.F.T. Combined Throat/Nasal Swab Sampling for SARS-CoV-2 Is Equivalent to Nasopharyngeal Sampling. Eur. J. Clin. Microbiol. Infect Dis. 2021, 40, 193–195. [Google Scholar] [CrossRef]
  12. Wang, X.; Tan, L.; Wang, X.; Liu, W.; Lu, Y.; Cheng, L.; Sun, Z. Comparison of Nasopharyngeal and Oropharyngeal Swabs for SARS-CoV-2 Detection in 353 Patients Received Tests with Both Specimens Simultaneously. Int. J. Infect. Dis. 2020, 94, 107–109. [Google Scholar] [CrossRef]
  13. Jamal, A.J.; Mozafarihashjin, M.; Coomes, E.; Anceva-Sami, S.; Barati, S.; Crowl, G.; Faheem, A.; Farooqi, L.; Kandel, C.E.; Khan, S.; et al. Sensitivity of Midturbinate versus Nasopharyngeal Swabs for the Detection of Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2). Infect. Control Hosp. Epidemiol. 2021, 42, 1001–1003. [Google Scholar] [CrossRef] [PubMed]
  14. Abdulrahman, A.; Mustafa, F.; AlAwadhi, A.I.; Alansari, Q.; AlAlawi, B.; AlQahtani, M. Comparison of SARS-CoV-2 Nasal Antigen Test to Nasopharyngeal RT-PCR in Mildly Symptomatic Patients; Infectious Diseases (except HIV/AIDS). medRxiv 2020. [Google Scholar] [CrossRef]
  15. Palmas, G.; Moriondo, M.; Trapani, S.; Ricci, S.; Calistri, E.; Pisano, L.; Perferi, G.; Galli, L.; Venturini, E.; Indolfi, G.; et al. Nasal Swab as Preferred Clinical Specimen for COVID-19 Testing in Children. Pediatric Infect. Dis. J. 2020, 39, e267–e270. [Google Scholar] [CrossRef] [PubMed]
  16. Abongo, T.; Ulo, B.; Karanja, S. Community Health Volunteers’ Contribution to Tuberculosis Patients Notified to National Tuberculosis Program through Contact Investigation in Kenya. BMC Public Health 2020, 20, 1184. [Google Scholar] [CrossRef] [PubMed]
  17. U.S. Food and Drug Administration Guidance for Industry and FDA Staff—Statistical Guidance on Reporting Results from Studies Evaluating Diagnostic Tests 2007. Available online: https://www.fda.gov/regulatory-information/search-fda-guidance-documents/statistical-guidance-reporting-results-studies-evaluating-diagnostic-tests-guidance-industry-and-fda (accessed on 15 August 2022).
  18. WHO Global Influenza Surveillance Network: Manual for the Laboratory Diagnosis and Virological Surveillance of Influenza; World Health Organization: Geneva, Switzerland, 2011.
  19. Kohmer, N.; Eckermann, L.; Böddinghaus, B.; Götsch, U.; Berger, A.; Herrmann, E.; Kortenbusch, M.; Tinnemann, P.; Gottschalk, R.; Hoehl, S.; et al. Self-Collected Samples to Detect SARS-CoV-2: Direct Comparison of Saliva, Tongue Swab, Nasal Swab, Chewed Cotton Pads and Gargle Lavage. JCM 2021, 10, 5751. [Google Scholar] [CrossRef]
  20. WHO Technical Specifications for Selection of Essential in Vitro Diagnostics for SARS-CoV-2. Available online: https://www.who.int/publications/m/item/technical-specifications-for-selection-of-essential-in-vitro-diagnostics-for-sars-cov-2 (accessed on 12 April 2022).
  21. Zhou, Y.; O’Leary, T.J. Relative Sensitivity of Anterior Nares and Nasopharyngeal Swabs for Initial Detection of SARS-CoV-2 in Ambulatory Patients: Rapid Review and Meta-Analysis. PLoS ONE 2021, 16, e0254559. [Google Scholar] [CrossRef]
  22. Pan, Y.; Long, L.; Zhang, D.; Yuan, T.; Cui, S.; Yang, P.; Wang, Q.; Ren, S. Potential False-Negative Nucleic Acid Testing Results for Severe Acute Respiratory Syndrome Coronavirus 2 from Thermal Inactivation of Samples with Low Viral Loads. Clin. Chem. 2020, 66, 794–801. [Google Scholar] [CrossRef]
  23. Matuchansky Protection against SARS-CoV-2 after Vaccination and Previous Infection. N. Engl. J. Med. 2022, 386, 2534–2535. [CrossRef]
  24. Drain, P.K.; Ampajwala, M.; Chappel, C.; Gvozden, A.B.; Hoppers, M.; Wang, M.; Rosen, R.; Young, S.; Zissman, E.; Montano, M. A Rapid, High-Sensitivity SARS-CoV-2 Nucleocapsid Immunoassay to Aid Diagnosis of Acute COVID-19 at the Point of Care: A clinical performance study. Infect. Dis. Ther. 2021, 10, 753–761. [Google Scholar] [CrossRef]
  25. Stokes, W.; Berenger, B.M.; Scott, B.; Szelewicki, J.; Singh, T.; Portnoy, D.; Turnbull, L.; Pabbaraju, K.; Shokoples, S.; Wong, A.A.; et al. One Swab Fits All: Performance of a Rapid, Antigen-Based SARS-CoV-2 Test Using a Nasal Swab, Nasopharyngeal Swab for Nasal Collection, and RT–PCR Confirmation from Residual Extraction Buffer. J. Appl. Lab. Med. 2022, 7, 834–841. [Google Scholar] [CrossRef]
  26. Cubas-Atienzar, A.I.; Bell, F.; Byrne, R.L.; Buist, K.; Clark, D.J.; Cocozza, M.; Collins, A.M.; Cuevas, L.E.; Duvoix, A.; Easom, N.; et al. Accuracy of the Mologic COVID-19 Rapid Antigen Test: A Prospective Multi-Centre Analytical and Clinical Evaluation. Wellcome Open Res. 2021, 6, 132. [Google Scholar] [CrossRef]
  27. Krüger, L.J.; Tanuri, A.; Lindner, A.K.; Gaeddert, M.; Köppel, L.; Tobian, F.; Brümmer, L.E.; Klein, J.A.F.; Lainati, F.; Schnitzler, P.; et al. Accuracy and Ease-of-Use of Seven Point-of-Care SARS-CoV-2 Antigen-Detecting Tests: A Multi-Centre Clinical Evaluation. eBioMedicine 2022, 75, 103774. [Google Scholar] [CrossRef] [PubMed]
  28. Galliez, R.M.; Bomfim, L.; Mariani, D.; Leitão, I.d.C.; Castiñeiras, A.C.P.; Gonçalves, C.C.A.; Ortiz da Silva, B.; Cardoso, P.H.; Arruda, M.B.; Alvarez, P.; et al. Evaluation of the Panbio COVID-19 Antigen Rapid Diagnostic Test in Subjects Infected with Omicron Using Different Specimens. Microbiol. Spectr. 2022, 10, e0125022. [Google Scholar] [CrossRef] [PubMed]
  29. Bayart, J.-L.; Degosserie, J.; Favresse, J.; Gillot, C.; Didembourg, M.; Djokoto, H.P.; Verbelen, V.; Roussel, G.; Maschietto, C.; Mullier, F.; et al. Analytical Sensitivity of Six SARS-CoV-2 Rapid Antigen Tests for Omicron versus Delta Variant. Viruses 2022, 14, 654. [Google Scholar] [CrossRef]
  30. Samsunder, N.; de Vos, M.; Ngcapu, S.; Giandhari, J.; Lewis, L.; Kharsany, A.B.M.; Cawood, C.; de Oliveira, T.; Karim, Q.A.; Karim, S.A.; et al. Clinical Evaluation of Severe Acute Respiratory Syndrome Coronavirus 2 Rapid Antigen Tests During the Omicron Wave in South Africa. J. Infect. Dis. 2022, jiac333. [Google Scholar] [CrossRef]
  31. Sitoe, N.; Sambo, J.; Nguenha, N.; Chilaule, J.; Chelene, I.; Loquiha, O.; Mudenyanga, C.; Viegas, S.; Cunningham, J.; Jani, I. Performance Evaluation of the STANDARDTM Q COVID-19 and PanbioTM COVID-19 Antigen Tests in Detecting SARS-CoV-2 during High Transmission Period in Mozambique. Diagnostics 2022, 12, 475. [Google Scholar] [CrossRef] [PubMed]
  32. Velavan, T.P.; Pallerla, S.R.; Kremsner, P.G. How to (Ab)Use a COVID-19 Antigen Rapid Test with Soft Drinks? Int. J. Infect. Dis. 2021, 111, 28–30. [Google Scholar] [CrossRef]
  33. Goggolidou, P.; Hodges-Mameletzis, I.; Purewal, S.; Karakoula, A.; Warr, T. Self-Testing as an Invaluable Tool in Fighting the COVID-19 Pandemic. J. Prim. Care Community Health 2021, 12, 215013272110477. [Google Scholar] [CrossRef]
Figure 1. Correlation of Ct value of the positive cases (n = 213) in paired self-collected SteriPack nasal and oropharyngeal swab evaluation.
Figure 1. Correlation of Ct value of the positive cases (n = 213) in paired self-collected SteriPack nasal and oropharyngeal swab evaluation.
Biomedicines 10 02327 g001
Table 1. Demographic characteristics of study participants.
Table 1. Demographic characteristics of study participants.
Nasal Swabs Self-Collection 1Abbott Panbio 2Covios 3Lumira Dx 4
N = 1498%N = 400%N = 1123%N = 696%
Gold standard 5 (RT-PCR or OP 6 swabs)Negative122982.0418646.558653.031044.54
Positive26917.9621453.552047.038655.46
Invalid-- 7--------------
Indeterminate----------------
Technology under evaluation 8Negative122781.9122857.077368.837954.45
Positive26017.3617243.034630.831445.11
Invalid--------40.430.43
Indeterminate110.73------------
Study sitesCSM 920013.35--------25636.78
HGM 1022515.02----34330.530043.10
HGC 1138425.6340010039535.2----
HPM 1257738.52----38534.314020.11
HCM 131127.48------------
AgeMedian in years35.0--38.02--33.0--36.23--
SexFemale76452.0422857.064457.438154.74
Male73448.917243.047942.631545.26
SymptomsYes135690.5239799.25111599.357582.61
No1419.4830.7580.712117.39
Onset symptoms≤7 days116886.1336992.95103392.051990.26
>7 days18813.87287.05827.3569.74
Ct Value of PCR in OP samples, median (min-max) 24.7 (5.7–36.5)NA 1426.7 (9.0–37.3)NA25.2 (5.1–39.0)NA25.1 (3.7–35.9)NA
1 SteriPack Sterile Polyester Nasal Swabs, 2 PanbioTM COVID-19 Ag rapid diagnostic test device nasal, 3 LumiraDx SARS-CoV-2 Ag Test, 4 COVIOS® Ag COVID-19 Rapid Antigen Test, 5 RT-PCR was gold standard for Ag-RDTs and Oropharyngeal swabs was gold standard for self-collected nasal swabs, 6 Oropharyngeal swabs, 7 Not available, 8 Technologies under evaluation are self-collected nasal swabs and Ag-RDTs., 9 Centro de Saúde de Marracuene, 10 Hospital Geral de Mavalane, 11 Hospital Geral de Chamanculo, 12 Hospital Provincial da Matola, 13 Hospital Central de Maputo. 14 Not Applicable.
Table 2. Performance of a self-collected nasal swab and three nasal swab-based antigen rapid tests for SARS-CoV-2 detection.
Table 2. Performance of a self-collected nasal swab and three nasal swab-based antigen rapid tests for SARS-CoV-2 detection.
Diagnostic TestPatient TypeSensitivitySpecificityPPVNPVObserved AgreementCohen’s Kappa
Self-collected nasal swabOverall
N = 1498
80.6%
[75.3–85.2%]
96.4%
[95.2–97.4%]
83.1%
[78.0–87.4%]
95.8%
[94.5–96.8%]
93.5%
[34.7–94.7%]
0.78
[0.77–0.79]
Symptomatic
N = 1356
81.0%
[75.5–85.7%]
96.7%
[95.5–97.7%]
84.5%
[79.2–88.9%]
95.9%
[94.5–97.0%]
93.9%
[34.7–95.1%]
0.79
[0.78–0.79]
Asymptomatic
N = 141
90.5%
[69.6–98.8%]
93.1%
[86.9–97.0%]
70.4%
[49.8–86.2%]
98.2%
[93.8–99.8%]
92.7%
[31.0–96.4%]
0.75
[0.67–0.83]
Symptoms ≤ 7 d 1
N = 1168
81.1%
[75.2–86.2%]
96.5%
[95.1–97.6%]
83.9%
[78.1–88.7%]
95.8%
[94.3–97.0%]
93.7%
[34.6–95.0%]
0.79
[0.78–0.80]
Symptoms > 7 d
N = 188
93.3%
[68.1–99.8]
98.1%
[93.4–99.8%]
87.5%
[61.7–98.4%]
99.0%
[94.8–100.0%]
97.5%
[30.7–99.5%]
0.89
[0.78–0.99]
Abbott Panbio Nasal RDTOverall
N = 400
79.7%
[73.3–85.1%]
97.2%
[93.5–99.1%]
96.8%
[92.8–99.0%]
81.4%
[75.5–86.4%]
88.0%
[41.9–91.2%]
0.71
[0.70–0.72]
Symptomatic
N = 397
79.9%
[73.3–85.1%]
97.1%
[93.4–99.1%]
96.8%
[92.8–99.0%]
81.2%
[75.2–86.2%]
87.9%
[42.1–91.1%]
0.71
[0.70–0.72]
Asymptomatic
N = 3
NANANANANANA
Symptoms ≤ 7 d
N = 369
80.0%
[73.3–85.7%]
96.9%
[93.0–99.0%]
96.6%
[92.1–98.9%]
81.9%
[75.7–87.0%]
88.2%
[41.7–91.4%]
0.71
[0.70–0.72]
Symptoms > 7 d
N = 28
76.5%
[50.1–93.1%]
100.0%
[69.2–NA]
100.0%
[75.3–NA]
71.4%
[41.9–91.6%]
85.2%
[34.1–95.8%]
0.72
[0.59–0.85]
Overall
N= 1102
59.6%
[55.2–63.8%]
94.9%
[92.8–96.5%]
91.1%
[87.6–93.9%]
72.6%
[69.3–75.8%]
78.3%
[37.0–80.7%]
0.56
[0.551–0.560]
Symptomatic
N= 1094
59.7%
[55.3–64.0%]
94.8%
[92.7–96.5%]
91.1%
[87.5–93.9%]
72.7%
[69.3–75.8%]
78.3%
[37.0–80.7%]
0.56
[0.552–0.561]
COVIOS Ag
COVID-19
Asymptomatic
N= 8
33.3%
[0.8–90.6%]
100.0%
[47.8–NA]
100.0%
[2.5–NA]
71.4%
[29.0–96.3%]
75.0%
[13.3–96.8%]
0.38
[-0.628–1.397]
Symptoms ≤ 7 d
N= 1013
60.9%
[56.5–65.2%]
94.6%
[92.2–96.4%]
91.6%
[88.0–94.3%]
71.4%
[67.8–74.7%]
78.0%
[37.6–80.5%]
0.56
[0.553–0.562]
Symptoms > 7 d
N= 81
20.0%
[4.3–48.1%]
97.0%
[89.5–99.6%]
60.0%
[14.7–94.7%]
84.2%
[74.0–91.6%]
82.7%
[25.8–90.2%]
0.23
[-0.156–0.613]
LumiraDx SARS-CoV-2 Ag TestOverall
N = 696
78.0%
[73.5–82.0%]
95.8%
[92.9–97.7%]
95.9%
[93.0–97.8%]
77.6%
[73.0–81.7%]
85.9%
[43.7–88.4%]
0.72
[0.72–0.73]
Symptomatic
N = 575
79.9%
[75.4–83.9%]
95.7%
[92.0–98.0%]
97.0%
[94.4–98.6%]
73.4%
[67.7–78.5%]
85.7%
[47.2–88.5%]
0.71
[0.70–0.72]
Asymptomatic
N = 121
47.8%
[26.8–69.4%]
95.9%
[89.8–98.9%]
73.3%
[44.9–92.2%]
88.6%
[80.9–94.0%]
86.7%
[28.7–92.2%]
0.50
[0.36–0.65]
Symptoms ≤ 7 d
N = 519
81.6%
[77.0–85.6%]
96.2%
[92.4–98.5%]
97.5%
[94.9–99.0%]
74.6%
[68.6–80.0%]
86.8%
[47.9–89.6%]
0.73
[0.72–0.74]
Symptoms > 7 d
N = 56
62.5%
[43.7–78.9%]
91.7%
[73.0–99.0%]
90.9%
[70.8–98.9%]
64.7%
[46.5–80.3%]
75.0%
[32.2–85.6%]
0.52
[0.44–0.59]
1 days.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Sitoe, N.; Sambo, J.; Mabunda, N.; Nguenha, N.; Chilaúle, J.; Rafael, J.; Macicame, A.; Chelene, I.; Mudenyanga, C.; Sacks, J.; et al. Clinical Performance of Self-Collected Nasal Swabs and Antigen Rapid Tests for SARS-CoV-2 Detection in Resource-Poor Settings. Biomedicines 2022, 10, 2327. https://doi.org/10.3390/biomedicines10092327

AMA Style

Sitoe N, Sambo J, Mabunda N, Nguenha N, Chilaúle J, Rafael J, Macicame A, Chelene I, Mudenyanga C, Sacks J, et al. Clinical Performance of Self-Collected Nasal Swabs and Antigen Rapid Tests for SARS-CoV-2 Detection in Resource-Poor Settings. Biomedicines. 2022; 10(9):2327. https://doi.org/10.3390/biomedicines10092327

Chicago/Turabian Style

Sitoe, Nádia, Júlia Sambo, Nédio Mabunda, Neuza Nguenha, Jorfélia Chilaúle, Júlio Rafael, Anésio Macicame, Imelda Chelene, Chishamiso Mudenyanga, Jillian Sacks, and et al. 2022. "Clinical Performance of Self-Collected Nasal Swabs and Antigen Rapid Tests for SARS-CoV-2 Detection in Resource-Poor Settings" Biomedicines 10, no. 9: 2327. https://doi.org/10.3390/biomedicines10092327

APA Style

Sitoe, N., Sambo, J., Mabunda, N., Nguenha, N., Chilaúle, J., Rafael, J., Macicame, A., Chelene, I., Mudenyanga, C., Sacks, J., Viegas, S., Loquiha, O., & Jani, I. (2022). Clinical Performance of Self-Collected Nasal Swabs and Antigen Rapid Tests for SARS-CoV-2 Detection in Resource-Poor Settings. Biomedicines, 10(9), 2327. https://doi.org/10.3390/biomedicines10092327

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop