Next Article in Journal
Myosin Transducer Inter-Strand Communication Is Critical for Normal ATPase Activity and Myofibril Structure
Previous Article in Journal
Intrinsically Fluorescent Anti-Cancer Drugs
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Sensitivity and Specificity of Patient-Reported Clinical Manifestations to Diagnose COVID-19 in Adults from a National Database in Chile: A Cross-Sectional Study

by
Felipe Martinez
1,2,3,*,
Sergio Muñoz
4,
Camilo Guerrero-Nancuante
5 and
Carla Taramasco
6
1
Unidad de Cuidados Intensivos, Hospital Naval Almirante Nef, Viña del Mar 2520000, Chile
2
Facultad de Medicina, Escuela de Medicina, Universidad Andrés Bello, Viña del Mar 2531015, Chile
3
Concentra Educación e Investigación Biomédica, Viña del Mar 2552906, Chile
4
Departamento de Salud Pública-CIGES, Facultad de Medicina, Universidad de La Frontera, Francisco Salazar 1145, Temuco 4811230, Chile
5
Escuela de Enfermería, Universidad de Valparaíso, Valparaíso 2500000, Chile
6
Facultad de Ingeniería, Universidad Andrés Bello, Millennium Nucleus on Sociomedicine, Viña del Mar 2520000, Chile
*
Author to whom correspondence should be addressed.
Biology 2022, 11(8), 1136; https://doi.org/10.3390/biology11081136
Submission received: 6 May 2022 / Revised: 2 July 2022 / Accepted: 7 July 2022 / Published: 29 July 2022
(This article belongs to the Section Medical Biology)

Abstract

:

Simple Summary

COVID-19 is frequently suspected based on clinical features, such as fever, cough, headache, or loss of taste. However, it remains unclear whether these manifestations are reliable indicators of disease. We sought to evaluate the diagnostic accuracy of clinical manifestations in identifying patients with COVID-19. Data from a nationwide database comprising of 2,187,962 patients who sought medical care in Chile were analysed. Information regarding age, gender, type of insurance, a history of a close contact with COVID-19, and several clinical features was obtained. The most common complaints were headache, muscle aches, and cough. No single clinical feature was precise enough to fully confirm or exclude COVID-19. The combination of several of these manifestations with epidemiological risk factors into a model showed a reasonable accuracy in detecting cases of COVID-19.

Abstract

(1) Background: The diagnosis of COVID-19 is frequently made on the basis of a suggestive clinical history and the detection of SARS-CoV-2 RNA in respiratory secretions. However, the diagnostic accuracy of clinical features is unknown. (2) Objective: To assess the diagnostic accuracy of patient-reported clinical manifestations to identify cases of COVID-19. (3) Methodology: Cross-sectional study using data from a national registry in Chile. Infection by SARS-CoV-2 was confirmed using RT-PCR in all cases. Anonymised information regarding demographic characteristics and clinical features were assessed using sensitivity, specificity, and diagnostic odds ratios. A multivariable logistic regression model was constructed to combine epidemiological risk factors and clinical features. (4) Results: A total of 2,187,962 observations were available for analyses. Male participants had a mean age of 43.1 ± 17.5 years. The most common complaints within the study were headache (39%), myalgia (32.7%), cough (31.6%), and sore throat (25.7%). The most sensitive features of disease were headache, myalgia, and cough, and the most specific were anosmia and dysgeusia/ageusia. A multivariable model showed a fair diagnostic accuracy, with a ROC AUC of 0.744 (95% CI 0.743–0.746). (5) Discussion: No single clinical feature was able to fully confirm or exclude an infection by SARS-CoV-2. The combination of several demographic and clinical factors had a fair diagnostic accuracy in identifying patients with the disease. This model can help clinicians tailor the probability of COVID-19 and select diagnostic tests appropriate to their setting.

1. Introduction

In December 2019, a novel respiratory disease named COVID-19 was reported in the city of Wuhan, China [1,2]. The disease occurs due to infection with a novel coronavirus (SARS-CoV-2), which in some cases can induce respiratory failure, multiorgan dysfunction, and death [3]. In early January 2020, the virus was sequenced, allowing for the development of diagnostic testing based on the detection of viral nucleic acid, such as real-time reverse transcription polymerase chain reaction (RT-PCR). As of October 2021, the disease had affected more than 240 million people worldwide, causing more than 4.5 million deaths [4]. The rapid spread of the disease has been explained by the high transmissibility of the virus, especially amongst new variants such as delta and omicron, the apparent absence of any cross-protective immunity from related viral infections, and delayed public health response measures [5,6,7,8,9]. Several health institutions reported shortages of required materials for pharyngeal specimen collection, sample extraction, and RT-PCR materials [10]. This led to a recommendation to urgently develop alternative methods to diagnose the disease, especially in countries where the growth of the pandemic had rapidly outpaced the capacity to test for it.
Several reviews have suggested that the diagnosis of COVID-19 can be established on the basis of a suggestive clinical history and the detection of SARS-CoV-2 RNA in respiratory secretions [1,11]. Observational reports have been heterogeneous regarding the frequency of specific manifestations of the disease. Symptoms such as fever, dry cough, shortness of breath, fatigue, nausea/vomiting, diarrhoea, and myalgia are common amongst hospitalised patients [2,12,13]. Anosmia and gustatory dysfunctions (dysgeusia or ageusia) have been also cited as standalone markers of disease [14,15,16]. However, it should be considered that many of these disease manifestations are of a non-specific nature, and other reports have pointed out that their frequency might be overestimated due to a high proportion of oligosymptomatic patients [17,18]. Given the uncertainty regarding the diagnostic accuracy of clinical features to identify patients with COVID-19, we conducted this study to address this issue.

2. Methodology

A cross-sectional study was undertaken using data available in a national registry in Chile from March 2020 to January 2021. This registry holds data of each patient that sought medical attention due to symptoms of COVID-19 and of persons that were screened for the disease within national territories. The study protocol was approved by the Ethics Committee of the Faculty of Medicine at the University of Valparaiso. Its approval number is 15-2020.

2.1. Participants

Eligible participants included adult patients (>18 years of age) who sought medical attention due to clinical complaints in whom COVID-19 was suspected by the attending physician, irrespective of their health insurance. Patients were consecutively enrolled within the database. Those who were asymptomatic and were diagnosed by active surveillance campaigns or close-contact screening programmes were excluded.
A basic clinical profile for every included participant was obtained from a registry named EPIVIGILA (Trademark N° 2020-A-7079) [19]. This registry has been endorsed by the Chilean Ministry of Health to hold every suspected and confirmed case of COVID-19 in Chile. This database holds information from the first patient that was diagnosed with a SARS-CoV-2 infection within national boundaries and is currently used by the Ministry of Health to monitor the pandemic course in Chile. Notification of suspected cases is mandated by law within 24 hours of first contact with a physician. The registry includes data on sex, age, nationality, current residence, recent travel, occupation, clinical features, context of testing (active screening vs. spontaneous consultation) and several comorbidities. In addition, contacts of confirmed cases of COVID-19 are paired within the database, thus facilitating surveillance of the pandemic. All data were prospectively collected during the patient’s initial contact with the healthcare provider.

2.2. Clinical Features

Relevant clinical manifestations included fever, cough, headache, malaise, sore throat, chest pain, abdominal pain, diarrhoea, dyspnea, cyanosis, tachypnea, dysgeusia/ageusia, anosmia, prostration, and myalgia. These manifestations were self-reported by the patient at first consult, or a proxy in cases where a detailed clinical history was not obtainable (i.e., dementia, delirium, or other forms of disturbances in cognition). No standardised procedure for obtaining these data was used within the registry. Clinical information was not made available for technicians performing RT-PCR tests.

2.3. Reference Standard

National guidelines have established RT-PCR tests from respiratory samples (i.e., nasopharyngeal swabs) as the reference standard to confirm COVID-19. Therefore, we used this test as a reference standard in our study. However, it has also been recognised that several factors might modify this test’s diagnostic performance, including sample collection issues and time from first exposure. To minimise diagnostic errors, the Ministry of Health established national standards for public and private laboratories conducting RT-PCR tests early within the course of the pandemic. Centres were required to obtain certification to offer these tests to the community, and RT-PCR tests registered within EPIVIGILA had to have been conducted in one of these centres. A second RT-PCR test was conducted amongst patients with indeterminate test results and then classified, based on the second test, as positives or negatives. Cases with an indeterminate result in the second test were excluded from analyses, but the number of events was registered within the database.

2.4. Statistical Analyses

Descriptive statistics, including medians, means, standard deviations, interquartile ranges (IQR), and absolute and relative frequencies, were used first to describe the characteristics of the study participants. Bivariate comparisons between groups were performed using the Chi-square test for categorical variables and Student’s t test for continuous variables. The observed diagnostic accuracy was summarised using sensitivity, specificity, diagnostic odds ratios and both positive and negative likelihood ratios. Ninety-five percent confidence intervals were calculated for these estimators as well. In addition to bivariate analyses, multivariable logistic regression was used to combine individual clinical manifestations with the highest diagnostic accuracy in bivariate comparisons. Briefly, these models considered any variable that showed a two-tailed p-value of less than 0.15 as a candidate variable to be included in a multivariable index. All candidate models considered the possibility of interactions between independent variables during their construction. In order to control for potential differences in sociodemographic factors, data on gender, age, and health insurance were kept for all candidate models. The diagnostic accuracy of individual models was quantified using receiver–operator characteristics (ROC) curves. These curves were, in turn, compared using 95% confidence intervals. Overall goodness of fit was assessed using Hosmer and Lemeshow’s statistic. Analyses were undertaken by an independent statistician using anonymised data with STATA 17.0 MP® (StataCorp LLC, College Station, TX, USA). A two-sided p-value of less than 5% was considered to be statistically significant.

3. Results

3.1. Participant Characteristics

The database contained a total of 5,789,289 cases (Figure 1). Of these, 3,291,135 belonged to active screening programmes, which left 2,498,154 eligible observations for analyses. A total of 310,192 samples belonged to patients younger than 18 years of age and 17,428 (0.53%) patients received an initial indeterminate RT-PCR result. In most cases, COVID-19 was excluded in the second test (73.0%), but 101 patients continued to show indeterminate results. This left 2,187,962 patients available for analyses.
Male participants had a mean age of 43.1 ± 17.5 years. Ninety-two percent were Chilean and 2.7% belonged to an indigenous Chilean population. Most patients resided within the Metropolitan region in central Chile (39.8%). The most common comorbidities were arterial hypertension (11.7%), which was followed by diabetes mellitus (5.9%) and asthma (2.8%). A history of recent travel was described by 1.93% of included participants. International travel was the most frequently reported (1.18%). A close contact was reported by 13% of the study participants, and 10.5% corresponded to confirmed cases of COVID-19.
Due to the large sample size, statistical tests showed significant differences in almost every clinical and sociodemographic characteristic when patients with positive SARS-CoV-2 RT-PCR were contrasted with those in whom the disease was not confirmed. Patients with confirmed COVID-19 tended to have more comorbidities, including arterial hypertension (15.2 vs. 11.2%, p < 0.001) and diabetes mellitus (8.3 vs. 5.5%, p < 0.001); a confirmed contact was more frequently described in this group as well (18.3 vs. 9.3%, p < 0.001). The frequency of suspected cases of COVID-19 was similar between study groups (2.29 vs. 2.01%, p < 0.001). A higher frequency of indigenous Chilean populations was noted in this group as well (3.9 vs. 2.5%, p < 0.001). National and international travel was less common amongst patients with confirmed COVID-19 (0.28 vs. 1.3% and 0.35% vs. 0.81%, p < 0.001 for both comparisons). A complete description of patient characteristics is shown in Table 1.

3.2. Diagnostic Accuracy of Clinical Features

The most common complaints within the study were headache (39%), myalgia (32.7%), cough (31.6%), and sore throat (25.7%). Dyspnea or tachypnea were uncommon presenting symptoms, with a relative frequency of 8.7 and 1.2%, respectively. Anosmia or dysgeusia/ageusia were rarely described by included participants, with an overall prevalence of 5.0 and 4.1%, respectively. Gastrointestinal symptoms such as diarrhoea or abdominal pain were uncommon as well, with relative frequencies of 7.0 and 8.9%.
Overall, most clinical features tended to have a low diagnostic accuracy for differentiating COVID-19 from other clinical entities. The most sensitive disease manifestation was headache, with a sensitivity of 56.5% (95% CI 56.4–56.7%), and was followed by myalgia (sensitivity of 53.3%, 95% CI 53.1–53.5%) and cough (sensitivity of 51.1%, 95% CI 51.0–51.3%). On the other hand, the most specific clinical features were cyanosis (specificity of 99%, 95% CI 99.8–99.9%), tachypnea (specificity of 98.9%, 95% CI 98.9–98.9%), anosmia (specificity of 97.5%, 95% CI 97.5–97.5%), and dysgeusia/ageusia (specificity of 97.0%, 95% CI 97.0–97.0%). The latter two manifestations also showed the highest diagnostic odds ratios, with 6.95 (95% CI 6.86–7.04) and 6.19 (95% CI 6.11–6.28), and were followed by myalgia (2.74, 95% CI 2.71–2.76), cough (2.62, 95% CI 2.60–2.64), fever (2.34, 95% CI 2.88–2.92), and headache (2.30, 95% CI 2.27–2.31). A complete description of the observed diagnostic accuracy of these clinical manifestations is shown in Table 2.

3.3. Multivariable Models

In order to establish a pre-test probability of COVID-19, a model was constructed using a multivariate logistic regression. The full model consisted of 21 variables that included every clinical manifestation and several epidemiological characteristics of the study sample. When these features were combined, the most relevant elements that increased the overall probability of confirming an infection by SARS-CoV-2 were a history of a confirmed contact with COVID-19 (aOR 2.27, 95% CI 2.24–2.30, p < 0.001), anosmia (aOR 3.72, 95% CI 3.66–3.79, p < 0.001), fever (aOR 2.23, 95% CI 2.21–2.24, p < 0.001), myalgia (aOR 1.68, 95% CI 1.67–1.70, p < 0.001), cough (aOR 1.88, 95% CI 1.86–1.90, p < 0.001), and dysgeusia/ageusia (aOR 1.81, IC95% 1.77–1.84, p < 0.001). The most important clinical feature that reduced the probability of COVID-19 was abdominal pain (aOR 0.61, 95% CI 0.60–0.62, p < 0.001). The complete model is shown in Table 3, and its overall accuracy was fair, with an area under the ROC curve of 0.753 (95% CI 0.752–0.754).
In order to facilitate the clinical use of these equations, a simplified model that considered four demographic characteristics (age, sex, type of insurance (private vs. other), and a history of belonging to an indigenous Chilean population) and the six most important clinical manifestations was estimated as well. These factors tended to maintain their strength of association that was calculated in the full model, as shown in Table 4. This simplified model showed a similar diagnostic accuracy when contrasted to the full model, with an AUC of 0.744 (95% CI 0.743–0.746). The comparative accuracy of both models is shown in Figure 2.

4. Discussion

This is the largest cross-sectional study addressing risk factors and frequently reported clinical manifestations of disease regarding their diagnostic accuracy to identify patients infected with SARS-CoV-2. One of the key findings is that no single clinical feature showed sufficient precision to be deemed a standalone marker of disease, which is in agreement with the results from a recent systematic review [20]. This highlights the need to combine clinical features with epidemiological risk factors in order to improve the evaluation of a pre-test probability of COVID-19. Our data further accentuates the relevance of active surveillance programmes to obtain reliable estimates of the pandemic burden, given the apparent lack of accuracy of clinical symptoms and the significant proportion of cases that were detected by screening strategies.
The combination of several epidemiological and clinical elements had a fair discrimination capacity to identify patients with COVID-19. Although the 95% confidence intervals did not overlap because of the large sample size, the reduction in the number of variables to contain four key demographic characteristics and the six diagnostic features with the most discrimination capacity did not reduce the overall classification ability of our model. This fact is likely to facilitate implementation in clinical practice. Data from other studies have shown better diagnostic estimators for several of the clinical features that were included in this study, either in isolation or when integrated within multivariable models [21,22,23]. Estimators of precision well over 85% and ROC AUCs of 0.85–0.91 have been previously reported in the literature, findings that contrast with the more conservative AUC of roughly 0.75 that was found in both our simplified and full multivariable model [24,25,26]. It is likely that methodological differences explain these contrasts in accuracy, such as the retrospective nature of the aforementioned studies and the inclusion of non-clinical variables within models, such as computer tomography scans or laboratory data; in addition, the non-use of protective means may increase the predictive properties of the model. However, it seems less likely that general laboratory information could result in an increase in diagnostic accuracy given the results from a recent systematic review [27]. We sought to develop a model that could aid in the diagnosis of COVID-19 in settings of restricted access to RT-PCR. Given the nature of the pandemic, it is likely that restrictions to other laboratory tests and imaging modalities could happen as well and, therefore, we chose not to add these sources of information to our calculations.
This study found associations with several demographic factors that modified the probability of COVID-19. The most relevant risk factor was a history of having a close contact with a confirmed infection by SARS-CoV-2, which had an adjusted odds ratio of 2.27 (95% CI 2.24–2.30, p < 0.001). This finding is in agreement with previous studies on the subject [28] and could be of even greater importance with the emergence of newer variants, such as omicron [29]. Having a private insurance provider decreased the probability of a SARS-CoV-2 infection, while identifying oneself as belonging to an indigenous Chilean population increased the risk of COVID-19. Rather than representing independent risk factors, it is likely that these associations stem from their link with other socioeconomic determinants of health. In Chile, persons with higher income tend to receive healthcare in the private sector, a well-known fact that has led to the use of this variable as a proxy of socioeconomic status in Chile [30]. On the other hand, native Chileans tend to have a lower income [31,32], which in turn translates into living conditions that facilitate viral spread, such as overcrowding, less access to barrier equipment and, a reduced capacity to comply with quarantines due to greater economic needs.

5. Strengths and Limitations

One of the most important strengths of this study is its sample size, which was achieved thanks to a concerted effort of the Chilean Ministry of Health and clinical researchers to improve the quality of epidemiological surveillance using a centralised system named EPIVIGILA. Given the nationwide nature of the data, a representative sample of Chilean patients has been obtained, including participants from different socioeconomic status, native Chileans, and travellers. This sample size has allowed the conduction of multivariable models with sufficient power to also integrate key epidemiological features that can also modify the probability of an infection by SARS-CoV-2. However, there are also several limitations that need to be taken into account as well. The most important one stems from the nature of the data. Although a national registry whose completion is enforced by law seems like a reliable source of information, the possibility of missing data cannot be fully excluded. It is possible that registries completed by physicians working in settings with a high demand for medical care omitted relevant data. Clinical features were reported by the patient, thus adding a subjective component that is inherent to self-reported data. No standardised procedure was established to gather information, which could also hamper the reliability of some key features such as dysgeusia or anosmia, in which some elements of the physical examination might increase their overall accuracy. In cases where obtaining a detailed history was not possible, such as cognitive decline or a severe respiratory failure, data was gathered from a proxy, which adds uncertainty to the assessment. Another relevant consideration is in the use of RT-PCR as the sole reference standard to confirm COVID-19 cases. Although the use of this test has been widely enforced by clinical guidelines, its diagnostic accuracy is suboptimal for a reference standard, with relatively low sensitivity that increases as the disease progresses, peaking roughly during the fifth day of symptoms.

6. Conclusions

No single clinical feature can fully confirm or exclude an infection by SARS-CoV-2. However, the combination of several demographic and clinical factors had a fair to high diagnostic accuracy in identifying patients with the disease. This model can help clinicians tailor the probability of COVID-19 and select diagnostic tests appropriate to their setting. The properties of the built model can be further validated in a recent set of PCR-tested patients.

Author Contributions

Investigation, F.M. and S.M.; Methodology, S.M.; Project administration, C.T.; Software, C.T.; Supervision, C.T.; Validation, C.G.-N. and C.T.; Writing—original draft, F.M.; Writing—review & editing, C.T. All authors have read and agreed to the published version of the manuscript.

Funding

This work was funded by the Chilean Agencia Nacional de Investigación y Desarrollo (ANID). Project COVID0739 and Millennium Science Initiative NCS2021_013. The funding source did not have any role in the study’s design, conduct, or reporting.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Institutional Review Board of the Faculty of Medicine at the University of Valparaiso, Chile (Approval N° 15/2020, 19 November 2020).

Informed Consent Statement

The need for informed consent was waived because the study only accessed previously anonymised data contained in a national database, as allowed by current Chilean legislation.

Data Availability Statement

The data used in this study are available on request made to the Chilean Ministry of Health.

Acknowledgments

We would like to thank Johanna Acevedo for her constant support while conducting this research. This article was supported by Millennium Nucleus on Sociomedicine No. NCS2021_013 and FONDECYT Regular 1201787: “Multimodal Machine Learning approach for detecting pathological activity patterns in elderlies” financed by the Agencia Nacional de Investigación (ANID).

Conflicts of Interest

The authors have no relevant financial or non-financial interest to disclose.

References

  1. Hu, B.; Guo, H.; Zhou, P.; Shi, Z.L. Characteristics of SARS-CoV-2 and COVID-19. Nat. Rev. Microbiol. 2021, 19, 141–154. [Google Scholar] [CrossRef] [PubMed]
  2. Guan, W.J.; Ni, Z.Y.; Hu, Y.; Liang, W.H.; Qu, C.Q.; He, J.X.; Liu, L.; Shan, H.; Lei, C.L.; Hui, D.S.C.; et al. Clinical Characteristics of Coronavirus Disease 2019 in China. N. Engl. J. Med. 2020, 19, 14–15. [Google Scholar] [CrossRef]
  3. Hozhabri, H.; Piceci Sparascio, F.; Sohrabi, H.; Mousavifar, L.; Roy, R.; Scribano, D.; De Luca, A.; Ambrosi, C.; Sarshar, M. The Global Emergency of Novel Coronavirus (SARS-CoV-2): An Update of the Current Status and Forecasting. Int. J. Environ. Res. Public Health 2020, 17, 5648. [Google Scholar] [CrossRef] [PubMed]
  4. World Health Organization. Weekly Epidemiological Update on COVID-19—26 October 2021. Edition 63 [Internet]. 2021. Available online: https://www.who.int/publications/m/item/weekly-epidemiological-update-on-covid-19 (accessed on 26 October 2021).
  5. Cheng, M.P.; Papenburg, J.; Desjardins, M.; Kanjilal, S.; Quach, C.; Libman, M.; Dittrich, S.; Yansouni, C.P. Diagnostic Testing for Severe Acute Respiratory Syndrome-Related Coronavirus 2: A Narrative Review. Ann. Intern. Med. 2020, 172, 726–734. [Google Scholar] [CrossRef] [Green Version]
  6. Mlcochova, P.; Kemp, S.A.; Dhar, M.S.; Papa, G.; Meng, B.; Ferreira, I.A.T.M.; Datir, R.; Collier, D.A.; Albecka, A.; Singh, S.; et al. SARS-CoV-2 B.1.617.2 Delta variant replication and immune evasion. Nature 2021, 599, 114–119. [Google Scholar] [CrossRef] [PubMed]
  7. Tao, K.; Tzou, P.L.; Nouhin, J.; Gupta, R.K.; de Oliveira, T.; Kosakovsky Pond, S.L.; Fera, D.; Shafer, R.W. The biological and clinical significance of emerging SARS-CoV-2 variants. Nat. Rev. Genet. 2021, 22, 757–773. [Google Scholar] [CrossRef]
  8. Dong, R.; Hu, T.; Zhang, Y.; Li, Y.; Zhou, X.H. Assessing the Transmissibility of the New SARS-CoV-2 Variants: From Delta to Omicron. Vaccines 2022, 10, 496. [Google Scholar] [CrossRef]
  9. Viana, R.; Moyo, S.; Amoako, D.G.; Tegally, H.; Scheepers, C.; Althaus, C.L.; Anyaneji, U.J.; Bester, P.A.; Boni, M.F.; Chand, M.; et al. Rapid epidemic expansion of the SARS-CoV-2 Omicron variant in southern Africa. Nature 2022, 603, 679–686. [Google Scholar] [CrossRef] [PubMed]
  10. Sandri, T.L.; Inoue, J.; Geiger, J.; Griesbaum, J.M.; Heinzel, C.; Burnet, M.; Fendel, R.; Kremsner, P.G.; Held, J.; Kreidenweiss, A. Complementary methods for SARS-CoV-2 diagnosis in times of material shortage. Sci. Rep. 2021, 11, 11899. [Google Scholar] [CrossRef] [PubMed]
  11. Wiersinga, W.J.; Rhodes, A.; Cheng, A.C.; Peacock, S.J.; Prescott, H.C. Pathophysiology, Transmission, Diagnosis, and Treatment of Coronavirus Disease 2019 (COVID-19): A Review. JAMA 2020, 324, 782–793. [Google Scholar] [CrossRef]
  12. Zhou, F.; Yu, T.; Du, R.; Fan, G.; Liu, Y.; Liu, Z.; Xiang, J.; Wang, Y.; Song, B.; Gu, X.; et al. Clinical course and risk factors for mortality of adult inpatients with COVID-19 in Wuhan, China: A retrospective cohort study. Lancet 2020, 395, 1054–1062. [Google Scholar] [CrossRef]
  13. Zhou, M.; Zhang, X.; Qu, J. Coronavirus disease 2019 (COVID-19): A clinical update. Front. Med. 2020, 14, 126–135. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Hornuss, D.; Lange, B.; Schröter, N.; Rieg, S.; Kern, W.V.; Wagner, D. Anosmia in COVID-19 patients. Clin. Microbiol. Infect. 2020, 26, 1426–1427. [Google Scholar] [CrossRef] [PubMed]
  15. Vaira, L.A.; Salzano, G.; Deiana, G.; De Riu, G. Anosmia and Ageusia: Common Findings in COVID-19 Patients. Laryngoscope 2020, 130, 1787. [Google Scholar] [CrossRef] [Green Version]
  16. Lechien, J.R.; Chiesa-Estomba, C.M.; De Siati, D.R.; Horoi, M.; Le Bon, S.D.; Rodriguez, A.; Dequanter, D.; Blecic, S.; El Afia, F.; Distinguin, L.; et al. Olfactory and gustatory dysfunctions as a clinical presentation of mild-to-moderate forms of the coronavirus disease (COVID-19): A multicenter European study. Eur. Arch. Otorhinolaryngol. 2020, 277, 2251–2261. [Google Scholar] [CrossRef] [PubMed]
  17. Rosenberg, E.S.; Dufort, E.M.; Blog, D.S.; Hall, E.W.; Hoefer, D.; Backenson, B.P.; Muse, A.T.; Kirkwood, J.N.; St George, K.; Holtgrave, D.R.; et al. COVID-19 Testing, Epidemic Features, Hospital Outcomes, and Household Prevalence, New York State-March 2020. Clin. Infect. Dis. 2020, 71, 1953–1959. [Google Scholar] [CrossRef] [PubMed]
  18. Jolobe, O.M.P. Oligosymptomatic COVID-19 infection also needs to be recognised. Am. J. Emerg. Med. 2021, 50, 800. [Google Scholar] [CrossRef] [PubMed]
  19. Taramasco, C.; Rimassa, C.; Romo, J.A.; Zavando, A.C.; Bravo, R.F. Epidemiological surveillance in COVID-19 pandemic: EPIVIGILA system. Medwave 2022, 22, e8741. [Google Scholar] [CrossRef]
  20. Struyf, T.; Deeks, J.J.; Dinnes, J.; Takwoingi, Y.; Davenport, C.; Leeflang, M.M.; Spijker, R.; Hooft, L.; Emperador, D.; Domen, J.; et al. Signs and symptoms to determine if a patient presenting in primary care or hospital outpatient settings has COVID-19. Cochrane Database Syst. Rev. 2022, 5, CD013665. [Google Scholar] [PubMed]
  21. Wynants, L.; Van Calster, B.; Collins, G.S.; Riley, R.D.; Heinze, G.; Schuit, E.; Bonten, M.M.J.; Dahly, D.L.; Damen, J.A.; Debray, T.P.A.; et al. Prediction models for diagnosis and prognosis of COVID-19: Systematic review and critical appraisal. BMJ 2020, 369, m1328. [Google Scholar] [CrossRef] [Green Version]
  22. Xia, Y.; Chen, W.; Ren, H.; Zhao, J.; Wang, L.; Jin, R.; Zhou, J.; Wang, Q.; Yan, F.; Zhang, B.; et al. A rapid screening classifier for diagnosing COVID-19. Int. J. Biol. Sci. 2021, 17, 539–548. [Google Scholar] [CrossRef]
  23. Shanbehzadeh, M.; Kazemi-Arpanahi, H.; Orooji, A.; Mobarak, S.; Jelvay, S. Performance evaluation of selected machine learning algorithms for COVID-19 prediction using routine clinical data: With versus Without CT scan features. J. Educ. Health Promot. 2021, 10, 285. [Google Scholar]
  24. Li, J.; Li, S.; Qiu, X.; Zhu, W.; Li, L.; Qin, B. Performance of Diagnostic Model for Differentiating Between COVID-19 and Influenza: A 2-Center Retrospective Study. Med. Sci. Monit. 2021, 27, e932361. [Google Scholar] [CrossRef] [PubMed]
  25. Arpaci, I.; Huang, S.; Al-Emran, M.; Al-Kabi, M.N.; Peng, M. Predicting the COVID-19 infection with fourteen clinical features using machine learning classification algorithms. Multimed. Tools Appl. 2021, 80, 11943–11957. [Google Scholar] [CrossRef]
  26. Nie, Y.; Li, J.; Huang, X.; Guo, W.; Zhang, X.; Ma, Y.; Wang, H.; Qi, M.; Tang, X.; Shen, X.; et al. Epidemiological and clinical characteristics of 671 COVID-19 patients in Henan Province, China. Int. J. Epidemiol. 2020, 49, 1085–1095. [Google Scholar] [CrossRef]
  27. Stegeman, I.; Ochodo, E.A.; Guleid, F.; Holtman, G.A.; Yang, B.; Davenport, C.; Deeks, J.J.; Dinnes, J.; Dittrich, S.; Emperador, D.; et al. Routine laboratory testing to determine if a patient has COVID-19. Cochrane Database Syst. Rev. 2020, 11, CD013787. [Google Scholar]
  28. Ge, Y.; Martinez, L.; Sun, S.; Chen, Z.; Zhang, F.; Li, F.; Sun, W.; Chen, E.; Pan, J.; Li, C.; et al. COVID-19 Transmission Dynamics Among Close Contacts of Index Patients With COVID-19: A Population-Based Cohort Study in Zhejiang Province, China. JAMA Intern. Med. 2021, 181, 1343–1350. [Google Scholar] [CrossRef] [PubMed]
  29. Madewell, Z.J.; Yang, Y.; Longini, I.M., Jr.; Halloran, M.E.; Dean, N.E. Household Secondary Attack Rates of SARS-CoV-2 by Variant and Vaccination Status: An Updated Systematic Review and Meta-analysis. JAMA Netw. Open 2022, 5, e229317. [Google Scholar] [CrossRef]
  30. Cid Pedraza, C.; Herrera, C.A.; Prieto Toledo, L.; Oyarzún, F. Mortality outcomes in hospitals with public, private not-for-profit and private for-profit ownership in Chile 2001–2010. Health Policy Plan. 2015, 30 (Suppl. S1), i75–i81. [Google Scholar] [CrossRef] [Green Version]
  31. Valenzuela, M.S.; Toro, S.Y.; Rojo-Mendoza, F. Equal in poverty, unequal in wealth: Ethnic stratification in Chile, the mapuche case. Bull. Lat. Am. Res. 2017, 36, 526–541. [Google Scholar] [CrossRef]
  32. Agostini, C.A.; Brown, P.H.; Roman, A.C. Poverty and Inequality Among Ethnic Groups in Chile. World Dev. 2010, 38, 1036–1046. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Epivigila is the national system to notify transmissible diseases. COVID-19 cases come in 3 ways: (1) health establishment (public and private) through health attention (confirmed, suspect, and probable); (2) laboratory: people that voluntarily realize the PCR; (3) active screening program: active search for cases in the community. (1) Suspected and probable cases in health facilities are registered on the platform and once the laboratory results (PCR) are available, they are updated; (2) the laboratory results of patients who voluntarily underwent the PCR are sent to Epivigila; (3) “active screening program” cases are recorded in Epivigila and updated with the results of the PCR examination.
Figure 1. Epivigila is the national system to notify transmissible diseases. COVID-19 cases come in 3 ways: (1) health establishment (public and private) through health attention (confirmed, suspect, and probable); (2) laboratory: people that voluntarily realize the PCR; (3) active screening program: active search for cases in the community. (1) Suspected and probable cases in health facilities are registered on the platform and once the laboratory results (PCR) are available, they are updated; (2) the laboratory results of patients who voluntarily underwent the PCR are sent to Epivigila; (3) “active screening program” cases are recorded in Epivigila and updated with the results of the PCR examination.
Biology 11 01136 g001
Figure 2. Receiver operating characteristics (ROC) curves depicting the overall diagnostic accuracy of complete (left) and simplified (right) models. As shown in the graph, the overall diagnostic accuracy is very similar.
Figure 2. Receiver operating characteristics (ROC) curves depicting the overall diagnostic accuracy of complete (left) and simplified (right) models. As shown in the graph, the overall diagnostic accuracy is very similar.
Biology 11 01136 g002
Table 1. Participant characteristics.
Table 1. Participant characteristics.
CharacteristicPersons without COVID-19
(n = 1,889,890)
Persons with COVID-19 (n = 297,180)Total
(n = 2,187,070)
p-Value
Mean Age (years, SD)43.0 ± 17.543.8 ± 17.043.1 ± 17.5<0.001 1
Female Gender (%)52.8%49.7%52.4%<0.001 2
Nationality (%)
Chilean92.1%91.4%92.0%<0.001 2
Not-Chilean7.9%8.6%8.0%
Indigenous Chilean (%)2.5%3.9%2.7%<0.001 2
Site of Residence (%)
Metropolitan Region40.2%37.4%39.8%<0.001 2
Northern Chile8.9%12.4%9.3%
Central Chile10.4%9.3%10.2%
South-Central Chile24.5%24.2%24.4%
Southern Chile13.6%12.4%13.4%
Austral Chile2.6%4.3%2.8%
Health Insurance (%)
Public (FONASA)75.1%77.8%75.5%<0.001 2
Private (ISAPRE)19.6%15.3%19.0%
Other5.3%6.9%5.5%
Arterial Hypertension (%)11.2%15.2%11.7%<0.001 2
Diabetes Mellitus (%)5.5%8.3%5.9%<0.001 2
Asthma (%)2.8%2.8%2.8%0.675 2
Cardiovascular Disease (%)1.1%1.0%1.1%<0.001 2
Immunosupression (%)0.84%0.62%0.81%<0.001 2
Liver Disease (%)0.30%0.21%0.29%<0.001 2
Kidney Disease (%)1.0%0.97%1.01%0.013 2
Chronic Lung Disease (%)1.5%1.2%1.5%<0.001 2
Chronic Neurologic Disease (%)0.64%0.51%0.62%<0.001 2
Suspected Contact (%) 2.01%2.29%2.05%<0.001 2
Confirmed Contact (%)9.32%18.3%10.5%<0.001 2
International Travel (%)1.3%0.28%1.18%<0.001 2
National Travel0.81%0.35%0.75%<0.001 2
FONASA: Fondo Nacional de Salud. ISAPRE: Institución de Salud Previsional; 1 Student’s t-Test; 2 Pearson Chi2.
Table 2. Diagnostic accuracy of clinical manifestations.
Table 2. Diagnostic accuracy of clinical manifestations.
Clinical FeaturePrevalenceSensitivity
(95% CI)
Specificity (95% CI)LR (+)
(95% CI)
LR (−)
(95% CI)
DOR
(95% CI)
Headache39.0%56.5%
(56.4–56.7%)
63.8%
(63.7–63.8%)
1.56
(1.55–1.57)
0.60
(0.601–0.602)
2.30
(2.27–2.31)
Myalgia32.7%53.3%
(53.1–53.5%)
70.6%
(70.5–70.6%)
1.81
(1.80–1.82)
0.66
(0.659–0.664)
2.74
(2.71–2.76)
Cough31.6%51.1%
(51.0–51.3%
71.5%
(71.4–71.5%
1.79
(1.78–1.80)
0.684
(0.681–0.686)
2.62
(2.60–2.64)
Sore Throat25.7%33.2%
(33.0–33.4%)
75.5%
(75.4–75.5%)
1.35
(1.35–1.36)
0.885
(0.883–0.888)
1.53
(1.52–1.54)
Fever15.5%30.6%
(30.4–30.7%)
86.9%
(86.9–87.0%)
2.34
(2.32–2.35)
0.80
(0.799–0.801)
2.34
(2.32–2.35)
Diarrhea8.9%9.18%
(9.07–9.28%)
91.0%
(91.0–91.1%)
1.02
(1.01–1.04)
0.998
(0.996–0.999)
1.03
(1.01–1.04)
Dyspnea8.7%11.1%
(11–11.2%)
91.6%
(91.6–91.7%)
1.33
(1.31–1.34)
0.97
(0.960–0.972)
1.37
(1.35–1.38)
Abdominal Pain7.0%5.66%
(5.58–5.75%)
92.8%
(92.7–92.8%)
0.783
(0.77–0.795)
1.02
(1.02–1.02)
0.77
(0.757–0.782)
Chest Pain5.1%7.15%
(7.05–7.24%)
95.2%
(95.1–95.2%)
1.48
(1.46–1.50)
0.976
(0.975–0.977)
1.52
(1.50–1.54)
Anosmia5.0%17.7%
(17.6–17.9%)
97.0%
(97.0–97.0%)
5.89
(5.83–5.96)
0.85
(0.847–0.850)
6.95
(6.86–7.04)
Dysgeusia/Ageusia4.1%13.9%
(13.8–14.0%)
97.5%
(97.4–97.5%
5.47
(5.44–5.54)
0.883
(0.882–0.885)
6.19
(6.11–6.28)
Tachypnea1.2%1.71%
(1.66–1.75%)
98.9%
(98.9–98.9%)
1.55
(1.51–1.60)
0.994
(0.993–0.994)
1.56
(1.51–1.61)
Prostration0.4%0.59%
(0.56–0.61%)
99.5%
(99.5–99.5%)
1.24
(1.18–1.3)
0.99
(0.99–0.99)
1.24
(1.18–1.31)
Cyanosis0.16%0.23%
(0.21–0.25%)
99.9%
(99.8–99.9%
1.57
(1.44–1.7)
0.999
(0.999–0.999)
1.57
(1.44–1.70)
LR: likelihood ratio; DOR: diagnostic odds ratio.
Table 3. Multivariable logistic regression: complete model.
Table 3. Multivariable logistic regression: complete model.
CharacteristicAdjusted Odds
Ratio (aOR)
95% CIp-Value
Demographic Characteristics
Male Sex1.211.20–1.22<0.001
Age > 65 Years1.181.16–1.19<0.001
Site of Residence
Northern Chile1.521.50–1.54<0.001
Central Chile0.820.81–0.83<0.001
South-Central Chile1.081.07–1.09<0.001
Southern Chile0.980.97–0.990.022
Austral Chile2.082.04–2.13<0.001
Private Insurance0.900.89–0.91<0.001
Indigenous Chilean1.441.41–0.148<0.001
Suspected Contact1.241.21–1.28<0.001
Confirmed Contact2.272.24–2.30<0.001
Clinical Symptoms
Headache1.291.28–1.30<0.001
Myalgia1.681.67–1.70<0.001
Dyspnea0.960.95–0.98<0.001
Anosmia3.723.66–3.79<0.001
Dysgeusia/Ageusia1.811.77–1.84<0.001
Cough1.881.86–1.90<0.001
Fever2.232.21–2.26<0.001
Chest Pain0.970.95–0.98<0.001
Sore Throat0.870.86–0.88<0.001
Abdominal Pain0.610.60–0.62<0.001
Prostration0.970.91–1.020.30
Diarrhea0.750.74–0.76<0.001
Tachypnea1.251.21–1.29<0.001
Cyanosis1.371.25–1.50<0.001
Constant0.0560.056–0.057<0.001
CI: confidence interval.
Table 4. Multivariable logistic regression: simplified model.
Table 4. Multivariable logistic regression: simplified model.
CharacteristicAdjusted Odds
Ratio
(aOR)
95% CIp-Value
Demographic Characteristics
Male Sex1.211.20–1.22<0.001
Age > 65 Years1.131.11–1.14<0.001
Indigenous Chilean1.521.48–1.56<0.001
Private Insurance (ISAPRE)0.910.90–0.92<0.001
Confirmed Contact2.302.28–2.33<0.001
Clinical Symptoms
Myalgia1.781.76–1.80<0.001
Anosmia3.803.72–3.86<0.001
Dysgeusia/Ageusia1.801.76–1.83<0.001
Cough1.861.85–1.88<0.001
Fever2.232.20–2.25<0.001
Abdominal Pain0.540.53–0.55<0.001
Constant0.060.06–0.062<0.001
CI: confidence interval.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Martinez, F.; Muñoz, S.; Guerrero-Nancuante, C.; Taramasco, C. Sensitivity and Specificity of Patient-Reported Clinical Manifestations to Diagnose COVID-19 in Adults from a National Database in Chile: A Cross-Sectional Study. Biology 2022, 11, 1136. https://doi.org/10.3390/biology11081136

AMA Style

Martinez F, Muñoz S, Guerrero-Nancuante C, Taramasco C. Sensitivity and Specificity of Patient-Reported Clinical Manifestations to Diagnose COVID-19 in Adults from a National Database in Chile: A Cross-Sectional Study. Biology. 2022; 11(8):1136. https://doi.org/10.3390/biology11081136

Chicago/Turabian Style

Martinez, Felipe, Sergio Muñoz, Camilo Guerrero-Nancuante, and Carla Taramasco. 2022. "Sensitivity and Specificity of Patient-Reported Clinical Manifestations to Diagnose COVID-19 in Adults from a National Database in Chile: A Cross-Sectional Study" Biology 11, no. 8: 1136. https://doi.org/10.3390/biology11081136

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop