Next Article in Journal
Indol-3-Carbinol and Quercetin Ameliorate Chronic DSS-Induced Colitis in C57BL/6 Mice by AhR-Mediated Anti-Inflammatory Mechanisms
Previous Article in Journal
Association between Urinary Phthalate Metabolite Concentration and Atopic Dermatitis in Korean Adolescents Participating in the Third Korean National Environmental Health Survey, 2015–2017
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Assessing the Quality of Reporting to China’s National TB Surveillance Systems

1
National Center for TB Control and Prevention, Chinese Center for Disease Control and Prevention, Beijing 102206, China
2
Division of Global HIV and Tuberculosis, US Centers for Disease Control and Prevention, Atlanta, GA 30333, USA
3
Beijing Office, US Centers for Disease Control and Prevention, Beijing 100600, China
*
Authors to whom correspondence should be addressed.
Contributed equally as first authors.
Int. J. Environ. Res. Public Health 2021, 18(5), 2264; https://doi.org/10.3390/ijerph18052264
Submission received: 31 January 2021 / Revised: 17 February 2021 / Accepted: 19 February 2021 / Published: 25 February 2021
(This article belongs to the Section Public Health Statistics and Risk Assessment)

Abstract

:
(1) Background: The reliability of disease surveillance may be restricted by sensitivity or ability to capture all disease. Objective: To quantify under-reporting and concordance of recording persons with tuberculosis (TB) in national TB surveillance systems: the Infectious Disease Reporting System (IDRS) and Tuberculosis Information Management System (TBIMS). (2) Methods: This retrospective review includes 4698 patients identified in 2016 in China. County staff linked TB patients identified from facility-specific health and laboratory information systems with records in IDRS and TBIMS. Under-reporting was calculated, and timeliness, concordance, accuracy, and completeness were analyzed. Multivariable logistic regression was used to examine factors associated with under-reporting. (3) Results: We found that 505 (10.7%) patients were missing within IDRS and 1451 (30.9%) patients were missing within TBIMS. Of 171 patient records reviewed in IDRS and 170 patient records in TBIMS, 12.3% and 6.5% were found to be untimely, and 10.7% and 7.1% were found to have an inconsistent home address. The risk of under-reporting to both IDRS and TBIMS was greatest at tertiary health facilities and among non-residents; the risk of under-reporting to TBIMS was greatest with patients aged 65 or older and with extrapulmonary TB (EPTB). (4) Conclusions: It is important to improve the reporting and recording of TB patients. Local TB programs that focus on training, and mentoring high-burden hospitals, facilities that cater to EPTB, and migrant patients may improve reporting and recording.

1. Background

Disease surveillance data are a vital source of information for national and international policymakers, and can be used to evaluate the burden and time trends of diseases [1]. However, the reliability of disease surveillance may be limited by sensitivity, or the ability of the system to capture all persons with disease. Many national disease surveillance systems may provide an incomplete picture due to under-reporting diseases of public health importance [2,3,4,5,6].
Tuberculosis (TB) is a disease that has existed for millennia in the world [7]. TB is the leading cause of death from a single infectious disease [8]. The World Health Organization (WHO) indicated that 7 million persons with TB were reported globally in 2018, representing 70% of the estimated 10 million new persons with TB [8]. Thus, 30% of new persons with TB were unknown to national authorities [8]. The gap is mainly due to a combination of under-diagnosis (persons with TB are not diagnosed with TB) and under-reporting (persons with TB are diagnosed with TB, but not reported in the surveillance system). Under-diagnosis can result in anti-TB treatment initiation delay, which can lead to increased morbidity and mortality and increased duration of TB transmission [9]. Under-reporting can lead to a misinterpretation of TB disease burden. Consequently, resources may not be allocated appropriately.
Although the number of new persons with TB has significantly decreased since 2009 [10], China still suffers a high TB burden. In 2018, the WHO estimated that 866,000 people developed TB disease in China, representing 9% of all new persons with TB worldwide and placing China second in absolute number of persons with TB in the world [8]. In China, pulmonary tuberculosis (PTB) patients (both clinically diagnosed and laboratory-confirmed) should be reported to the web-based Infectious Disease Reporting System (IDRS) and recorded in the Tuberculosis Information Management System (TBIMS). Extrapulmonary TB patients can also be reported, but unlike PTB, extrapulmonary TB is not mandatory to report. IDRS, managed by the Chinese Center for Disease Control and Prevention (CDC), contains patient information of 39 infectious diseases including PTB and monitors the epidemic conditions of these infectious diseases. In a report published in 2015, IDRS covered all provincial, prefectural, and county CDCs, 98% of medical institutions at or above the county administrative level, and 94% of community medical institutions [11]. TBIMS is the surveillance system for the national TB program (NTP) and is used for managing the full course of treatment of PTB patients; it does not capture information on TB presumptive patients [12]. TBIMS is accessible by all government-appointed TB-designated facilities, which could be local CDCs, TB dispensaries, or TB-designated hospitals [12]. These two systems are independent, but there is a function within the systems to link information about patients diagnosed with TB. In 2018, the WHO estimated that 71,000 (8.2%) TB patients in China were unknown to the NTP [8].
Multiple countries, including Kenya, Spain, Korea, Cape Verde, and Egypt, have conducted inventory studies to assess TB under-reporting [13,14,15,16,17]. In 2015, China implemented a study in nine counties to identify TB under-reporting to TBIMS [12]. We developed the present study to further quantify under-reporting to both IDRS and TBIMS in six other counties and to investigate the factors associated with under-reporting of patients diagnosed with TB to the two surveillance systems. Additionally, we assessed concordance and timeliness of reported patients diagnosed with TB to the two systems. This study may complement our previous study [12] and help us improve our national surveillance strategies and, furthermore, to improve TB prevention, diagnosis, and treatment services [18].

2. Methods

2.1. Study Setting

China has the largest population of any one country, with 1.39 billion people. It is divided into 34 provincial-level administrative divisions (PLADs), which are further divided into 334 prefectures and almost 3000 counties [12,19]. We assigned 31 mainland provinces into three regions: eastern region, central region, and western region. Generally, regions decrease in socioeconomic status and increase in TB notification rate as you go from east to west [20].
In China, health facilities are divided into three levels according to their workload, diagnosis and treatment capacity, and responsibilities. Primary health facilities provide prevention, medical treatment, healthcare, and rehabilitation services directly to a single community. Secondary health facilities are regional hospitals that provide comprehensive medical and health services to multiple communities. Tertiary health facilities are hospitals that provide highly specialized medical and health services. A reporting card is used by physicians to collect patient information; the reporting card may be checked by health workers in the same facility, and then this information is entered by either the physician or health worker into IDRS or TBIMS ideally within 24 h.

2.2. Study Design

We conducted a retrospective inventory study to quantify under-reporting and identify the sociodemographic factors and other characteristics associated with under-reporting. We matched patient records diagnosed with TB from health facilities in 2016 with TB patient records within IDRS and TBIMS. We also assessed concordance, data accuracy, and completeness of key variables within patient medical records, and timeliness, defined as recording within 24 h after diagnosis, of matched patients.

2.3. Sampling Method

We adopted stratified purposive sampling to select six provinces—Guangdong and Jiangsu in eastern China, Heilongjiang and Henan in central China, and Yunnan and Sichuan in western China. In each of the provinces, we selected one county with a high TB burden (more than 200 notified patients in 2016) and capacity (at least 2 local staff members in charge of NTP work) to implement the study. The six counties are Nanshan in Guangdong, Xingyang in Jiangsu, Yilan in Heilongjiang, Liyang in Henan, Simao in Yunnan, and Lu in Sichuan. Within each county, three facilities participated: the county-level TB-designated hospital, the general hospital with the greatest patient load, and one township hospital with chest x-ray capability. Designated hospitals are the largest general hospitals and the only NTP-appointed treatment centers in each county. There are not many hospitals at the county level that can diagnose TB, and according to China’s infectious disease control law, all presumptive or confirmed TB patients should be referred to designated hospitals. Additionally, to thoroughly cover diagnosed patients in selected counties, a general hospital and a township-level hospital were also included in this study to explore the missing patients. All patients diagnosed with TB were included to quantify under-reporting to IDRS and TBIMS.
To assess concordance and timeliness of reporting diagnosed TB patients to IDRS and TBIMS, we included county-level designated TB hospitals. If fewer than 30 TB patients were diagnosed at the designated TB hospital, the largest county-level general hospital was included. If more than 30 TB patients were diagnosed in the sampled health facilities during the project period, we employed a simple random sampling method to select 30 TB patients diagnosed in the sampled health facilities from IDRS and TBIMS, respectively. If not, we included all TB patients.

2.4. Eligibility Criteria

We included patients diagnosed with PTB, TB pleurisy, and other extra-pulmonary TB (EPTB) according to national TB diagnosis guidelines [21,22] from 1 January 2016 to 31 December 2016. Briefly, TB is categorized into the following categories: (1) primary PTB; (2) hematogenous disseminated PTB; (3) secondary PTB; (4) tuberculosis pleuritis; and (5) extrapulmonary TB. PTB patients are classified as (a) lab-confirmed; (b) clinically diagnosed; or (c) presumptive. All presumptive TB patients were excluded.

2.5. Data Collection

We collected TB patient medical records in health facilities, TB surveillance records in IDRS, and TB patient treatment register records in TBIMS.
From IDRS, we exported name, age, gender, national ID number, report number and date of diagnosis, and other relevant patient characteristics for all TB patients reported in 2016 into a CSV file. From TBIMS, we also exported the same variables for all reported patients in 2016 into a CSV file, along with additional register number and sputum status.
We collected medical records of diagnosed TB patients in selected health facilities. If the health facility had an electronic hospital information system or laboratory information system, we exported records with a TB diagnosis to a CSV file. If electronic data were not available, we reviewed paper medical records from outpatient departments, inpatient wards, and laboratory reports for a TB diagnosis and added these records meeting the eligibility criteria to an MS Excel® (Microsoft Corporation, Redmond, WA, USA) spreadsheet. The Excel spreadsheet included the following information: name, age, gender, national ID number, home address, date of diagnosis, health facility, department of diagnosis, data source (outpatient/inpatient/laboratory), initial diagnosis, type of TB (PTB clinically diagnosed/PTB laboratory-confirmed/pleurisy or other EPTB), and result of TB laboratory examination. We also investigated whether TB patients reviewed were residents, which was defined as someone recorded in the county or who had lived in the county for more than six months, which is usually indicated via self-report in medical records and confirmed based on the type of medical insurance, since non-residents have different insurance categories.

2.6. Data Deduplication

A duplicate record was defined as a record with the same national ID number, name (a different character was permitted), gender, and age (+/− 2 years was allowed) as another record. Name was use as the key index to compare, and other variables were used as supplemental values. The final deduplicated database was determined by local study implementers.

2.7. Record Linkage

We linked the medical records dataset (from general hospitals) and health facilities dataset (from dispensaries and clinics) based on the name of the health facilities, and renamed the new dataset DX-DATASET. This was done in order to capture data on patients treated at both general hospitals and health facilities. We used a proprietary software to match deduplicated DX-DATASET and IDRS datasets by national ID number, name, age, gender, and home address. The software provides a score demonstrating the probability of a match and a health worker reviews results for a final determination of a match. A match was defined as records from the facility dataset and IDRS with the same national ID number and at least one of the same of name, age, and gender. If the national ID number of a record was missing from either the DX-DATASET or IDRS dataset, we defined a match as records with the same name, age (+/− 2 years), gender, and home address. If a record from DX-DATASET did not match with a record in IDRS, the patient was defined as under-reported in IDRS. We used the same variables and applied the same definitions to match records from TBIMS with DX-DATASET. If a record in the DX-DATASET was not matched to a record in TBIMS, the record was defined as under-reported in TBIMS.

2.8. Data Analysis

We used descriptive statistics to describe the characteristics of patients diagnosed with TB at participating health facilities and determined the number of TB patients identified in IDRS and TBIMS. We calculated under-reporting as the number of patients diagnosed with TB, but not reported to IDRS or TBIMS after diagnosis. Percent under-reporting was calculated as the number of under-reported TB patients divided by the total number of TB patients diagnosed in the health facility. We described the number and percentage of TB patients by characteristics such as age group, gender, and type of TB. We conducted chi-square tests to assess the association of patient and health facility characteristics with under-reporting. Associations with a p-value < 0.2 were included in the multivariable logistic regression model. Crude and adjusted odds ratios (ORs) were calculated to assess odds of under-reporting; 95% confidence intervals of crude OR and adjusted OR, and p-value in multivariable logistic regression model were used to evaluate statistical significance of examined characteristics. As EPTB was not mandatorily required to be reported in IDRS, the preliminary results showed an oversized OR value because of “complete separation error” influenced by the variable “Type of TB”. We decided to remove it from the IDRS model after confirming unchanged directions of other variables.
To analyze timeliness and concordance of reporting, we compared the records sampled with corresponding records in health facilities. We defined delayed reporting and recording as the number and percentage of patients diagnosed with TB at the facility but not reported or recorded to IDRS or TBIMS within a day after diagnosis. All analyses were performed in SAS (SAS Institute Inc., Cary, NC, USA).

3. Results

In our study, we identified a total of 4698 TB patients (702 from primary health facilities, 1479 from secondary health facilities, and 2517 from tertiary health facilities), of which 4327 were PTB patients (3028 patients diagnosed clinically and 1299 patients confirmed in laboratory) and 371 pleurisy or other EPTB patients. Two thirds (n = 3179) of the patients had national ID recorded. The number of TB patients per county ranged from 320 to 1807. Of all the TB patients, 3658 (77.9%) patients were 15 to 64 years of age, 1000 (21.3%) patients were 65 years or older, and only 40 (0.9%) patients were under 15 years old (Table 1). There were 3127 (66.6%) males and 4117 (87.6%) residents. Most TB patients were selected from the outpatient clinic records (3419; 72.8%), 919 (19.6%) were identified from the inpatient records, and 360 (7.7%) were identified from the laboratory records.
After data matching, we found that 505 (10.8%) patients diagnosed with TB were missing from IDRS, and 1451 (30.9%) patients were missing from TBIMS (Table 2, Figure 1). Compared with the other five counties, Simao county had the largest under-reporting to IDRS and TBIMS (n = 360, 19.9%; n = 919, 50.9%, respectively).
The data source, health facility level, residence, and county were statistically significant factors associated with under-reporting to IDRS in the multivariable analysis (Table 3). The odds of under-reporting to IDRS for a non-resident are 2 times that of a resident. The odds of under-reporting to IDRS for the outpatient data source are about 3 times that of the laboratory data source. The odds of under-reporting to IDRS for tertiary health facilities are about 13 times that of primary health facilities. The risk of under-reporting to IDRS was greatest in Simao, Liyang, and Xingyang counties.
All variables except gender were statistically significant factors associated with under-reporting to TBIMS in the multivariable logistic regression (Table 4). The odds of under-reporting to TBIMS for patients over 65 years of age are almost 2 times that of patients aged 15–64. The odds of under-reporting to TBIMS for clinically diagnosed PTB are about 3 times that of laboratory-confirmed PTB, while the odds of under-reporting for TB pleurisy or other EPTB are 9 times that of laboratory-confirmed PTB. The odds of under-reporting to TBIMS for diagnosis in tertiary health facilities are 10 times that of diagnosis in primary health facilities. The odds of under-reporting to TBIMS for non-residents are 19 times that of residents. The risk of under-reporting to TBIMS is highest in Simao, Nanshan, and Liyang counties. The risk of under-reporting to TBIMS was lower with factors such as outpatients, inpatients, and diagnosis in Xingyang, Yilan, and Lu counties.
In our assessment of concordance and timeliness of reporting to IDRS and TBIMS, 171 records in IDRS and 170 records in TBIMS were included. In IDRS, 18 (10.6%) records of home address and 14 (8.2%) records of diagnosis date were discordant with those in medical records (Table 5). In TBIMS, among demographic variables, the discordant entry of home address was the lowest (12, 7.1%); of all clinical variables, variables about dates, including diagnosis date (5, 2.9%), date of follow-up examination at the end of 2nd month (6, 3.9%), and date of end course examination (22, 14.0%), were the most discordant with medical records. A total of 21 patients (12.3%) were not reported to IDRS and 11 patients (6.5%) were not reported to TBIMS within a day after reporting TB diagnosis.

4. Discussion

Our study is an expansion and reinforcement of a previous under-reporting study in China [12]. Both studies explore the possibilities of carrying out the inventory study methodology in China to assess China’s TB surveillance systems. In this study, we performed the assessment in both TBIMS and IDRS and expanded the evaluation involving timeliness, concordance, accuracy, and completeness to conduct a more comprehensive assessment. Additionally, we found and documented some risk factors (high-level hospital and non-resident, etc.) not reported in the previous study.
Our results show that 10.7% and 30.9% of TB patients in the six participating counties were under-reported to IDRS and not recorded for treatment in TBIMS, respectively. The discrepancy in the under-reporting rate between the two systems is mainly because the systems play different roles in the field of public health. Patients diagnosed with PTB in all health facilities should be reported to IDRS, while only patients referred and verified in TB-designated health facilities are recorded in TBIMS. There is value in both vertical (TBIMS) and integrated (IDSR) surveillance systems for capturing data; however, there are potential implications for double reporting or discordance of variables when both surveillance systems are utilized to capture information for the same disease. For example, patients who were misdiagnosed in non-designated health facilities and those who were not traced by TB designated health facilities could be reported to IDRS, but not recorded in TBIMS. This could account for the difference in the under-reporting rate between the two surveillance systems. The under-reporting rate in both IDRS and TBIMS suggests China’s TB surveillance systems may still miss some TB patients. An under-reporting rate to TBIMS of more than one fourth reminds us that there may exist greater risks of under-reporting in certain settings than the WHO estimated national level [8,23]. The under-reported patients, who may not have received proper treatment and support by NTP management, may continue to contribute to TB transmission within their communities.
Our findings are similar to some studies conducted in other countries in which the under-reporting rate of TB ranged from 6% to 68% [14,16,17,24,25,26,27,28,29]. Fatima et al. estimated that almost 68% of persons with TB were not notified to the NTP in Pakistan, in many cases because a large private sector did not report to the NTP [27]. A study conducted in the Republic of Korea estimated that 6% of persons with TB were not reported to the national surveillance system [28]. Our current study shows that the under-reporting rate to TBIMS of the six counties is 30.9%, while a previous study conducted in other areas in China reported the under-reporting rate was 19.3%. The difference between the results of the two studies was mainly because the previous study did not include EPTB except TB pleurisy [12].
Though type of TB was removed from the IDRS model, type of TB was found to be significant for under-reporting to TBIMS. Compared with patients with laboratory-confirmed and clinically diagnosed PTB, patients with TB pleurisy or other EPTB were significantly more likely to be under-reported. This under-reporting associated with type of TB has also been described in other studies [8,12,14,30,31]. Additionally, the reporting requirements of TB pleurisy and other EPTB vary by province. In most provinces, medical institutions are not required to report patients with TB pleurisy. Mandatory reporting of other EPTB is also not required in every province. This is a major challenge and issue; non-standard definitions and reporting requirements severely limit the ability to make comparisons and follow trends.
It is notable from our analysis that the odds of under-reporting are significantly higher in tertiary health facilities compared with primary health facilities. In China, tertiary health facilities are all general hospitals with a high medical level, more than 500 beds, and large numbers of patients being referred to or seeking diagnosis and treatment in these hospitals. Consequently, physicians who are responsible for reporting PTB patients to surveillance systems in tertiary health facilities may spend more time seeing patients than reporting to surveillance systems. Our finding is supported by a study conducted in Kenya, where larger facilities and heavy workload were associated with under-reporting [13]. However, other studies indicated that diagnosis in general hospitals contributes to the notification of TB patients [28,32]. Our findings emphasize the importance of increasing human resource capacity for data collection, management, and reporting of TB patients or shifting these tasks to nurses or non-clinical staff in tertiary health facilities.
Our study revealed substantial under-reporting both to IDRS and TBIMS among non-residents, while the proportion under-reported to TBIMS is much higher. This may be due to economic factors. Most non-resident TB patients are more likely to have low income and lack medical insurance [33]. Non-residents with medical insurance generally received a lower proportion of reimbursement outside of the location in which they are a resident, which may result in refusal of anti-TB treatment. In addition, many non-resident TB patients do not have stable work and a permanent place of residence, which may lead to difficulty in linking the patient to TB services. To strengthen the surveillance of non-resident TB patients, it is necessary to focus on reporting of non-residents and ensure funding is devoted to supporting and following up low-income and non-resident patients. Though information on which facilities had paper records was not collected, facilities that are smaller and located in lower-income areas are more likely (anecdotally) to be paper-based, which could potentially contribute to decreased data quality and reporting.
In our study, under-reporting to TBIMS was also associated with old age. Patients over 65 years old were more likely to be under-reported compared with those aged 15–64 years old. This may be related to a higher rate of comorbidity in patients aged 65 or older, which could necessitate treatment in non-TB-designated health facilities. This is consistent with the bivariate analysis in a study conducted in Spain [14]. We also found that the risk of under-diagnosis was high among patients under 15, which is corroborated by various studies indicated younger age as a risk factor of under-reporting [8,12,32]. However, Kang et al. found that age did not significantly affect TB reporting [28]. The number of TB patients under 15 years old influences study results. In 2016, the WHO estimated that about 11% of TB patients in China were under 15 years old [23]. However, in our study, only 0.9% of TB patients identified were under 15 years old. This may be related to the difference in where children seek healthcare services and the facilities sampled in this study. Most pediatric TB patients are treated in children’s hospitals and therefore reported by regional or national referral hospitals located in big cities. However, none of the hospitals in our selected six counties included this type of hospital. Further studies including children’s hospitals are needed to understand the association between young age and under-reporting of TB patients.
Concordance between systems and reporting of TB patients has been researched in other studies [29,32,34,35,36]. Salyer et al. reported inconsistent smear status of TB patients between records in health facilities and a national surveillance database [29]. Podewils et al. reported a poor agreement of HIV status among TB patients [34]. In our study, address and dates in IDRS and TBIMS were the variables most discordant with medical records. Podewils et al. showed similar findings in their study [34]. This may be due to multiple reasons. Physicians may not have time for adequate epidemiological investigation due to high workload burden in both general hospitals and designated facilities. Patients may also face stigma pressure to not give their private information [37]. Address is important for tracing patients and facilitating full course follow-up, and thus important to include in reporting and recording as an essential variable. Timeliness of reporting was evaluated in multiple studies by different variables, making comparisons difficult. Some studies reported that the proportion of patients with delayed reporting (>7 days) varied from 18.2% to 25.7% [28,32]. Johnson et al. reported that 11% of TB patients were not reported to an electronic communicable disease surveillance system in one business day [38]. Some studies reported the average duration of delay in reporting TB patients (ranging from 4 days to 3 months) [39,40,41]. There was greater under-reporting to TBIMS compared with IDRS. However, when patients were reported, there was greater delay in reporting to IDRS compared with TBIMS (12.3% vs. 6.5%).
This study has demonstrated success in applying TB inventory study methodology in China. Based on this experience, the NTP is planning to integrate routine inventory study activities in the national TB program. The requirements and standard procedure of under-reporting investigation will be formally added in the upcoming newest national TB control guidelines (2021 version). A toolkit will also be issued to train all levels of TB control health workers to implement this work. We expect these activities to help in reducing under-reporting in both systems and improving data recording quality. Moreover, the results and risk factors found can catalyze the TB program and other stakeholders to understand and improve our surveillance systems. The under-reporting and mistakes that occurred in hospitals were often caused by information exchange barriers among different information systems, for example, inconsistency caused by repeat entry, or duplication caused by multiple visits in different hospitals. We aimed to create a platform to enable different systems to exchange patient information, not only data from different departments in the same hospital but also all visits for different diseases in different hospitals. The vision is a Universal Health Care system realized through a unique platform and use of a unique ID (National ID). This can prevent healthcare workers from carrying out unnecessary repeat entry and reduce under-reporting/inconsistency/incompleteness.
Our study has several limitations. First, we used purposive sampling to select six counties, for ease of introducing and implementing matching software; however, this made our findings not representative of other areas in China. Second, we focused on healthcare facilities that had capacity to perform chest x-rays (CXR) and had diagnosed at least one TB patient during the project period, which means patients seeking healthcare in facilities not meeting the criteria were excluded, thus limiting the inclusion of EPTB. It is crucial to ensure that these patients are diagnosed and treated properly. Therefore, under-reporting of under-diagnosed patients deserves further study. Third, children’s hospitals were not included in our study, which could bias our results of under-reporting among children.

5. Conclusions

TB patients were under-reported to both China’s national infectious disease reporting system, IDRS, and TB-specific management system, TBIMS. It is important to improve the reporting and recording of TB patients. Local TB programs may focus on reporting and improvement activities in order to support high-patient-load hospitals, non-resident patients, and patients with TB pleurisy or EPTB. Human resource capacity for data collection and management could be enhanced and accuracy of data entry could be reinforced to improve national surveillance systems and TB prevention, diagnosis, and treatment.

Author Contributions

T.L., L.Y. and S.E.S.-J. were involved in conception and study design. T.L., L.Y., S.E.S.-J., A.W., H.G., W.C., X.D. and H.Z. performed material preparation, data collection, and analysis. The first draft of the manu-script was written by T.L. and L.Y. and all authors commented on previous versions of the manu-script. T.L. and L.Y. contributed equally as first authors; X.D. and H.Z. contributed equally as corresponding authors. All authors have read and agreed to the published version of the manuscript.

Funding

The project implementation and results publication was funded by the China-US Collaborative Program on Emerging and Re-Emerging Infectious Diseases. Project implementation was funded by the US CDC International Emerging Infections Program cooperative agreement. The study implementation as well as the open access fee for the publication was funded by the US CDC Atlanta through Combating Antimicrobial Resistant Bacteria (CARB) funds.

Institutional Review Board Statement

Permission for the study was sought from the National Center for Tuberculosis Control and Prevention, Chinese Center for Disease Control and Prevention.

Informed Consent Statement

As this study involved analysis of collected secondary data, waiver of informed consent was sought and approved. This project was also reviewed in accordance with the US Centers for Disease Control and Prevention human research protection procedures and was determined to be non-research, program evaluation.

Data Availability Statement

All data generated or analyzed during the study are included in this published article. The datasets used and/or analyzed during the present study are available from the corresponding author upon reasonable request.

Acknowledgments

We thank our colleagues and healthcare workers who contributed to the project from Guangdong, Henan, Heilongjiang, Jiangsu, Sichuan, and Yunnan and Jiangsu for data collection and review. The findings and conclusions in this report are those of the author(s) and do not necessarily represent the official position of the Centers for Disease Control and Prevention/Agency for Toxic Substances and Disease Registry.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

TBtuberculosis;
WHOWorld Health Organization;
PTBpulmonary TB;
IDRSInfectious Disease Reporting System;
TBIMSTuberculosis Information Management System;
CDCCenter for Disease Control and Prevention;
NTPnational TB program;
PLADsprovincial-level administrative divisions;
CXRchest x-rays;
EPTBextra-pulmonary TB;
ORodds ratio

References

  1. Van Leth, F.; Evenblij, K.; Wit, F.; Kiers, A.; Sprenger, H.; Verhagen, M.; Hillebregt, M.; Kalisvaart, N.; Schimmel, H.; Verbon, A. TB-HIV co-infection in the Netherlands: Estimating prevalence and under-reporting in national registration databases using a capture-recapture analysis. J. Epidemiol. Community Health 2016, 70, 556–560. [Google Scholar] [CrossRef] [PubMed]
  2. Avong, Y.K.; Jatau, B.; Gurumnaan, R.; Danat, N.; Okuma, J.; Usman, I.; Mordi, D.; Ukpabi, B.; Kayode, G.A.; Dutt, S.; et al. Addressing the under-reporting of adverse drug reactions in public health programs controlling HIV/AIDS, Tuberculosis and Malaria: A prospective cohort study. PLoS ONE 2018, 13, e0200810. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Crowcroft, N.S.; Johnson, C.; Chen, C.; Li, Y.; Marchand-Austin, A.; Bolotin, S.; Schwartz, K.; Deeks, S.L.; Jamieson, F.; Drews, S.; et al. Under-reporting of pertussis in Ontario: A Canadian Immunization Research Network (CIRN) study using capture-recapture. PLoS ONE 2018, 13, e0195984. [Google Scholar] [CrossRef] [Green Version]
  4. Guo, K.; Yin, P.; Wang, L.; Ji, Y.; Li, Q.; Bishai, D.; Liu, S.; Liu, Y.; Astell-Burt, T.; Feng, X.; et al. Propensity score weighting for addressing under-reporting in mortality surveillance: A proof-of-concept study using the nationally representative mortality data in China. Popul. Health Metr. 2015, 13, 1–11. [Google Scholar] [CrossRef] [Green Version]
  5. Kustec, T.; Keše, D.; Klavs, I. Under-reporting of sexually transmitted infection with chlamydia trachomatis—A revision of surveillance system is required. Slov. J. Public Health 2016, 55, 174–178. [Google Scholar] [CrossRef] [Green Version]
  6. Shankar, M.B.; Rodríguez-Acosta, R.L.; Sharp, T.M.; Tomashek, K.M.; Margolis, H.S.; Meltzer, M.I. Estimating dengue under-reporting in Puerto Rico using a multiplier model. PLoS Negl. Trop. Dis. 2018, 12, e0006650. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  7. World Health Organization. Global Tuberculosis Report 2016. Available online: https://apps.who.int/iris/bitstream/handle/10665/250441/9789241565394-eng.pdf?sequence=1 (accessed on 15 January 2020).
  8. World Health Organization. Global Tuberculosis Report 2019. Available online: https://apps.who.int/iris/bitstream/handle/10665/329368/9789241565714-eng.pdf?ua=1 (accessed on 15 January 2020).
  9. World Health Organization. Implementing the End TB Strategy: The Essentials. 2015. Available online: https://www.who.int/tb/publications/2015/The_Essentials_to_End_TB/en/ (accessed on 15 January 2020).
  10. Lin, H.H.; Wang, L.; Zhang, H.; Ruan, Y.; Chin, D.P.; Dye, C. Tuberculosis control in China: Use of modelling to develop targets and policies. Bull. World Health Organ. 2015, 93, 790–798. [Google Scholar] [CrossRef] [PubMed]
  11. National Health Commission of the People’s Republic of China. Progress in Disease Control and Prevention in China in 2015. Available online: http://www.nhc.gov.cn/jkj/s7915v/201504/d5f3f871e02e4d6e912def7ced719353.shtml (accessed on 15 January 2020).
  12. Li, T.; Shewade, H.D.; Soe, K.T.; Rainey, J.J.; Zhang, H.; Du, X.; Wang, L. Under-reporting of diagnosed tuberculosis to the national surveillance system in China: An inventory study in nine counties in 2015. BMJ Open 2019, 9, e021529. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  13. Tollefson, D.; Ngari, F.; Mwakala, M.; Gethi, D.; Kipruto, H.; Cain, K.; Bloss, E. Under-reporting of sputum smear-positive tuberculosis cases in Kenya. Int. J. Tuberc. Lung Dis. 2016, 20, 1334–1341. [Google Scholar] [CrossRef]
  14. Morales-Garcia, C.; Rodrigo, T.; Garcia-Clemente, M.M.; Munoz, A.; Bermudez, P.; Casas, F.; Somoza, M.; Mila, C.; Penas, A.; Hidalgo, C.; et al. Factors associated with unreported tuberculosis cases in Spanish hospitals. BMC Infect. Dis. 2015, 15, 295. [Google Scholar] [CrossRef] [Green Version]
  15. Hong, S.J.; Park, Y.S.; An, H.; Kang, S.M.; Cho, E.H.; Shin, S.S. Factors leading to under-reporting of tuberculosis in the private sector in Korea. Int. J. Tuberc. Lung Dis. 2012, 16, 1221–1227. [Google Scholar] [CrossRef] [PubMed]
  16. Furtado da Luz, E.; Braga, J.U. Under-reporting of tuberculosis in Praia, Cape Verde, from 2006 to 2012. Int. J. Tuberc. Lung Dis. 2018, 22, 258–263. [Google Scholar] [CrossRef] [PubMed]
  17. Bassili, A.; Grant, A.D.; El-Mohgazy, E.; Galal, A.; Glaziou, P.; Seita, A.; Abubakar, I.; Bierrenbach, A.L.; Crofts, J.P.; van Hest, N.A. Estimating tuberculosis case detection rate in resource-limited countries: A capture-recapture study in Egypt. Int. J. Tuberc. Lung Dis. 2010, 14, 727–732. [Google Scholar]
  18. World Health Organization. Assessing Tuberculosis Under-Reporting through Inventory Studies. 2012. Available online: https://apps.who.int/iris/bitstream/handle/10665/78073/9789241504942_eng.pdf?sequence=1 (accessed on 15 January 2020).
  19. National Bureau of Statistics. China Statistical Yearbook. 2018. Available online: http://www.stats.gov.cn/tjsj/ndsj/2018/indexch.htm (accessed on 15 January 2020).
  20. Fan, C.; Rongsheng, Z.; Jing, Z.; Yun, X.; Fan, Y. Current status and prospects of tuberculosis prevention and control in China. J. Public Health Prev. Med. 2019, 30, 8–11. [Google Scholar] [CrossRef]
  21. Ministry of Health. Guidelines for Implementing the National Tuberculosis Control Program in China (2008); China Union Medical University Press: Beijing, China, 2009.
  22. Ministry of Health. National Tuberculosis Diagnostic Criteria (WS288-2008); People’s Health Publishing House: Beijing, China, 2008.
  23. World Health Organization. Global Tuberculosis Report 2017. Available online: https://www.who.int/tb/publications/2017/en/ (accessed on 15 January 2020).
  24. Dunbar, R.; van Hest, R.; Lawrence, K.; Verver, S.; Enarson, D.A.; Lombard, C.; Beyers, N.; Barnes, J.M. Capture-recapture to estimate completeness of tuberculosis surveillance in two communities in South Africa. Int. J. Tuberc. Lung Dis. 2011, 15, 1038–1043. [Google Scholar] [CrossRef] [PubMed]
  25. Alkhalawi, M.J.; McNabb, S.J.; Assiri, A.M.; Memish, Z.A. Evaluation of tuberculosis public health surveillance, Al-Madinah province, Kingdom of Saudi Arabia, 2012. J. Epidemiol. Glob. Health 2016, 6, 37–44. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Ibarz-Pavon, A.B.; Papaventsis, D.; Kalkouni, R.; Metaxas, G.; Spala, G.; Georgakopoulou, T.; Gerakis, T.; Pefanis, A.; Vogiatzakis, E. Pilot study of the completeness of notification of adult tuberculosis in Athens, Greece. Int. J. Tuberc. Lung Dis. 2016, 20, 920–925. [Google Scholar] [CrossRef]
  27. Fatima, R.; Harris, R.J.; Enarson, D.A.; Hinderaker, S.G.; Qadeer, E.; Ali, K.; Bassili, A. Estimating tuberculosis burden and case detection in Pakistan. Int. J. Tuberc. Lung Dis. 2014, 18, 55–60. [Google Scholar] [CrossRef] [Green Version]
  28. Kang, H.Y.; Yoo, H.; Park, W.; Go, U.; Jeong, E.; Jung, K.S.; Son, H. Tuberculosis Notification Completeness and Timeliness in the Republic of Korea During 2012–2014. Osong Public Health Res. Perspect. 2016, 7, 320–326. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  29. Salyer, S.J.; Fitter, D.L.; Milo, R.; Blanton, C.; Ho, J.L.; Geffrard, H.; Morose, W.; Marston, B.J. Evaluation of the national tuberculosis surveillance program in Haiti. Int. J. Tuberc. Lung Dis. 2015, 19, 1045–1050. [Google Scholar] [CrossRef]
  30. Gimenez Duran, J.; Galmes Truyols, A.M.; Herrera Guibert, D.; Bonilla Vargas, L.A.; Luque Fernandez, M.A.; Bosch Isabel, C.; Nicolau Riutort, A.; Cayla Buqueras, J. Tuberculosis surveillance in the Balearic Islands and characteristics of unreported cases from 2005 to 2007. Gac. Sanit. 2011, 25, 84–86. [Google Scholar] [CrossRef] [Green Version]
  31. Melosini, L.; Vetrano, U.; Dente, F.L.; Cristofano, M.; Giraldi, M.; Gabbrielli, L.; Novelli, F.; Aquilini, F.; Rindi, L.; Menichetti, F.; et al. Evaluation of underreporting tuberculosis in Central Italy by means of record linkage. BMC Public Health 2012, 12, 472. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  32. Lo, H.Y.; Yang, S.L.; Chou, P.; Chuang, J.H.; Chiang, C.Y. Completeness and timeliness of tuberculosis notification in Taiwan. BMC Public Health 2011, 11, 915. [Google Scholar] [CrossRef] [Green Version]
  33. Yichen, C.; Jiehua, L. The Main Factors Affecting the Inter-provincial Floating Population’s Unemployment in China:An Analysis of the Data of the Dynamic Monitoring Survey of Migrants by National Health and Family Planning Commission in 2015. South China Popul. 2018, 33, 10–19. [Google Scholar] [CrossRef]
  34. Podewils, L.J.; Bantubani, N.; Bristow, C.; Bronner, L.E.; Peters, A.; Pym, A.; Mametja, L.D. Completeness and Reliability of the Republic of South Africa National Tuberculosis (TB) Surveillance System. BMC Public Health 2015, 15, 765. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  35. Mlotshwa, M.; Smit, S.; Williams, S.; Reddy, C.; Medina-Marino, A. Evaluating the electronic tuberculosis register surveillance system in Eden District, Western Cape, South Africa, 2015. Glob. Health Action 2017, 10, 1360560. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  36. Sharma, A.; Ndisha, M.; Ngari, F.; Kipruto, H.; Cain, K.P.; Sitienei, J.; Bloss, E. A review of data quality of an electronic tuberculosis surveillance system for case-based reporting in Kenya. Eur. J. Public Health 2015, 25, 1095–1097. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  37. Craig, G.M.; Daftary, A.; Engel, N.; O’Driscoll, S.; Ioannaki, A. Tuberculosis stigma as a social determinant of health: A systematic mapping review of research in low incidence countries. Int. J. Tuberc. Lung Dis. 2017, 56, 90–100. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  38. Johnson, M.G.; Williams, J.; Lee, A.; Bradley, K.K. Completeness and timeliness of electronic vs. conventional laboratory reporting for communicable disease surveillance—Oklahoma, 2011. Public Health Rep. 2014, 129, 261–266. [Google Scholar] [CrossRef]
  39. Silin, M.; Laraque, F.; Munsiff, S.S.; Crossa, A.; Harris, T.G. The impact of monitoring tuberculosis reporting delays in New York City. J. Public Health Manag. Pract. 2010, 16, E09–E17. [Google Scholar] [CrossRef]
  40. Garcell, H.G.; Hernandez, T.M.; Abdo, E.A.; Arias, A.V. Evaluation of the timeliness and completeness of communicable disease reporting: Surveillance in The Cuban Hospital, Qatar. Qatar Med. J. 2014, 2014, 50–56. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  41. Saeed, K.M.; Bano, R.; Asghar, R.J. Evaluation of the national tuberculosis surveillance system in Afghanistan. East Mediterr. Health J. 2013, 19, 200–207. [Google Scholar] [CrossRef] [PubMed]
Figure 1. The distribution of TB patients from medical records, IDRS, and TBIMS in the six counties in 2016.
Figure 1. The distribution of TB patients from medical records, IDRS, and TBIMS in the six counties in 2016.
Ijerph 18 02264 g001
Table 1. Characteristics of diagnosed tuberculosis (TB) patients in six counties in 2016.
Table 1. Characteristics of diagnosed tuberculosis (TB) patients in six counties in 2016.
Diagnosed
Patients%
Total4698100
Age
≤15400.9
15–64365877.9
≥65100021.3
Sex
Male312766.6
Female157133.4
Type of TB
PTB clinically diagnosed302864.5
PTB laboratory-confirmed129927.7
Pleurisy or other EPTB3717.9
Patient type
Outpatient341972.8
Inpatient91919.6
Lab3607.7
Level of health facility
≤170214.9
2147931.5
3251753.6
Residence
Resident411787.6
Non-resident58112.4
County
Nanshan81917.4
Liyang3798.1
Xingyang4419.4
Yilan3206.8
Lu93219.8
Simao180738.5
Table 2. The number and percentage of diagnosed TB patients missing from Infectious Disease Reporting System (IDRS) and Tuberculosis Information Management System (TBIMS) in six counties in 2016.
Table 2. The number and percentage of diagnosed TB patients missing from Infectious Disease Reporting System (IDRS) and Tuberculosis Information Management System (TBIMS) in six counties in 2016.
CountyTotalIDRSTBIMS
Missing PatientsProportion (%)Missing PatientsProportion (%)
Nanshan819506.128334.6
Liyang3795213.711229.6
Xingyang441337.5439.8
Yilan32061.972.2
Lu93240.4879.3
Simao180736019.991950.9
Total469850510.8145130.9
Table 3. Factors associated with under-reporting to IDRS among diagnosed TB patients in six counties in 2016.
Table 3. Factors associated with under-reporting to IDRS among diagnosed TB patients in six counties in 2016.
VariablesTotalUnder-ReportingPearson’s Chi-Square p-ValueCrude OR
(95%CI)
Adjusted OR
(95%CI)
p-Value
N%
Total469850510.7
Age in years
<1540922.50.042.5 (1.2–5.3)1.5 (0.6–3.7)0.4
15–64365838310.5refref
≥65100011311.31.1 (0.9–1.4)1.3 (1.0–1.6)0.09
Sex
Male31273019.60.0005refref
Female157120413.01.4 (1.2–1.7)1.1 (0.9–1.4)0.4
Data source
Outpatient341935910.50.061.3 (0.9–1.9)2.7 (1.8–4.1)<0.001
Inpatient91911612.61.6 (1.0–2.4)0.7 (0.4–1.1)0.08
Lab360308.3refref
Level of health facility
≤1702142.0<0.0001ref
214791107.44.0 (2.3–6.9)1.7 (0.8–3.6)0.1
3251738115.18.8 (5.1–15.1)12.9 (6.4–25.8)<0.001
Residence
Resident411746511.30.0013refref
Non-resident581406.90.6 (0.4–0.8)2.2 (1.2–4.0)0.009
County
Nanshan819506.1<0.0001refref
Liyang3795213.72.5 (1.6–3.7)5.7 (2.8–11.6)<0.001
Xingyang441337.51.2 (0.8–2.0)4.5 (2.1–9.8)<0.001
Yilan32061.90.3 (0.1–0.7)1.3 (0.4–3.8)0.6
Lu93240.40.1 (0.0–0.2)0.0 (0.0–0.1)<0.001
Simao180736019.93.8 (2.8–5.2)4.1 (2.2–7.6)<0.001
Table 4. Factors associated with under-reporting to TBIMS among diagnosed TB patients in six counties in 2016.
Table 4. Factors associated with under-reporting to TBIMS among diagnosed TB patients in six counties in 2016.
VariablesTotalUnder-ReportingPearson’s Chi-Square p-ValueCrude OR
(95%CI)
Adjusted OR
(95%CI)
p-Value
N%
Total4698145130.9
Age in years
<15401640.00.00051.6 (0.8–3.0)1.0 (0.5–2.0)0.9
15–643658107929.5refref
≥65100035635.61.3 (1.1–1.5)1.7 (1.4–2.0)<0.001
Sex
Male312790929.070.0001refref
Female157154234.501.29 (1.13–1.46)1.04 (0.89–1.21)0.6
Data source
Outpatient341980723.60<0.00010.54 (0.43–0.68)0.30 (0.21–0.43)<0.001
Inpatient91951355.822.21 (1.72–2.84)0.54 (0.37–0.79)0.002
Lab36013136.39refref
Type of TB
PTB clinically diagnosed302898432.50<0.00011.98 (1.69–2.32)2.54 (1.94–3.32)<0.001
PTB laboratory-confirmed129925419.55 refref
Pleurisy or other EPTB37121357.41 5.55 (4.33–7.10)9.27 (6.50–13.23)<0.001
Level of medical institution
≤1702141.99<0.0001refref
214791107.44 3.95 (2.25–6.94)1.77 (0.86–3.65)0.1
3251738115.14 8.77 (5.11–15.05)10.01 (4.99–20.11)<0.001
Residence
Local4117114727.86<0.0001refref
Non-resident58130452.322.84 (2.38–3.39)18.80 (13.77–25.67)<0.0001
County
Nanshan81928334.55<0.0001refref
Liyang37911229.550.79 (0.61–1.03)1.56 (1.10–2.20)0.01
Xingyang441439.750.20 (0.14–0.29)0.47 (0.31–0.70)<0.001
Yilan32072.190.04 (0.02–0.09)0.31 (0.14–0.69)0.004
Lu932879.330.20 (0.15–0.25)0.11 (0.08–0.16)<0.001
Simao180791950.861.96 (1.65–2.33)5.00 (3.80–6.57)<0.001
Table 5. Concordance of key variables for diagnosed TB patients between facility records and TB surveillance systems (by counties).
Table 5. Concordance of key variables for diagnosed TB patients between facility records and TB surveillance systems (by counties).
Key VariablesMedical Records and IDRSMedical Records and TBIMS
Patients Reviewed in IDRSInconsistent with Medical RecordsPatients Reviewed in TBIMSInconsistent with Medical Records
Total records
National ID number1613 (1.9%)1483 (2.0%)
Patient name1711 (0.6%)1700 (0%)
Address16918 (10.7%)17012 (7.1%)
Smear status--1704 (2.4%)
DST status--170 (0%)
Diagnosis--1701 (0.6%)
Treatment outcome--1681 (0.6%)
Diagnosis date17114 (8.2%)1705 (2.9%)
Registration--1701 (0.6%)
Date of follow-up examination at the end of 2nd month--1526 (3.9%)
Date of end course examination--15722 (14.0%)
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Li, T.; Yang, L.; Smith-Jeffcoat, S.E.; Wang, A.; Guo, H.; Chen, W.; Du, X.; Zhang, H. Assessing the Quality of Reporting to China’s National TB Surveillance Systems. Int. J. Environ. Res. Public Health 2021, 18, 2264. https://doi.org/10.3390/ijerph18052264

AMA Style

Li T, Yang L, Smith-Jeffcoat SE, Wang A, Guo H, Chen W, Du X, Zhang H. Assessing the Quality of Reporting to China’s National TB Surveillance Systems. International Journal of Environmental Research and Public Health. 2021; 18(5):2264. https://doi.org/10.3390/ijerph18052264

Chicago/Turabian Style

Li, Tao, Lijia Yang, Sarah E. Smith-Jeffcoat, Alice Wang, Hui Guo, Wei Chen, Xin Du, and Hui Zhang. 2021. "Assessing the Quality of Reporting to China’s National TB Surveillance Systems" International Journal of Environmental Research and Public Health 18, no. 5: 2264. https://doi.org/10.3390/ijerph18052264

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop