Next Article in Journal
Overcrowding in Emergency Department: Causes, Consequences, and Solutions—A Narrative Review
Next Article in Special Issue
Consultation Management during the COVID-19 Pandemic: The Experience of Lithuanian Physicians
Previous Article in Journal
Tackling Thyroid Cancer in Europe—The Challenges and Opportunities
Previous Article in Special Issue
Evaluation of a Non-Face-to-Face Multidisciplinary Health Care Model in a Population with Rheumatoid Arthritis Vulnerable to COVID-19 in a Health Emergency Situation
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Identifying the High-Risk Population for COVID-19 Transmission in Hong Kong Leveraging Explainable Machine Learning

1
Department of Electrical and Electronic Engineering, Faculty of Engineering, The University of Hong Kong, Hong Kong 999077, China
2
Department of Paediatrics and Adolescent Medicine, LKS Faculty of Medicine, The University of Hong Kong, Hong Kong 999077, China
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Healthcare 2022, 10(9), 1624; https://doi.org/10.3390/healthcare10091624
Submission received: 11 July 2022 / Revised: 15 August 2022 / Accepted: 22 August 2022 / Published: 25 August 2022

Abstract

:
The worldwide spread of COVID-19 has caused significant damage to people’s health and economics. Many works have leveraged machine learning models to facilitate the control and treatment of COVID-19. However, most of them focus on clinical medicine and few on understanding the spatial dynamics of the high-risk population for transmission of COVID-19 in real-world settings. This study aims to investigate the association between population features and COVID-19 transmission risk in Hong Kong, which can help guide the allocation of medical resources and the implementation of preventative measures to control the spread of the pandemic. First, we built machine learning models to predict the number of COVID-19 cases based on the population features of different tertiary planning units (TPUs). Then, we analyzed the distribution of cases and the prediction results to find specific characteristics of TPUs leading to large-scale outbreaks of COVID-19. We further evaluated the importance and influence of various population features on the prediction results using SHAP values to identify indicators for high-risk populations for COVID-19 transmission. The evaluation of COVID-19 cases and the TPU dataset in Hong Kong shows the effectiveness of the proposed methods. The top three most important indicators are identified as people in accommodation and food services, low income, and high population density.

1. Introduction

The World Health Organization has declared coronavirus infectious disease 2019 (COVID-19) a pandemic since 11 March 2020 [1]. As a result of the epidemic, hospitals are overburdened and face significant issues in terms of people staffing, personal protective equipment availability, and intensive care unit bed allocation during the fifth wave in Hong Kong [2]. In this case, slowing down or even cutting off the spread of COVID-19 is vital to relieve the heavy burden on medical systems [3]. As all countries worldwide strive to prevent the growing threat of coronavirus, data on populations, their relative traits, livelihoods, and geography have proven to be invaluable for response efforts to a disease with substantial unknowns [4,5].
Moreover, Hong Kong began administering the fourth round of COVID-19 vaccines to residents aged 18 to 59 in April 2022, with some health experts proposing that the fourth dose be given only to specific groups. The COVID-19 vaccines are unquestionably effective at alleviating the disease, particularly severe symptoms [6]. However, the spatial dynamics of high-risk populations for COVID-19 transmission, which can be helpful for health experts in guiding response efforts such as emergency funding allocation and preventative measures, remain to be further studied.
The development of machine learning algorithms makes it feasible to learn from the available data for accessing the evolving risk factors and the newly exposed areas. Several studies have used supervised machine learning algorithms to identify patients at risk of developing severe COVID-19 symptoms [7]. For example, Assaf et al. [8] predicted risk for critical COVID-19 based on status at admission using machine learning models. Yan et al. [9] developed a machine learning-based model to predict the survival of severe COVID-19 patients with clinical features. In [10], researchers built a machine learning-based model to estimate patients’ health conditions and mortality risk with COVID-19. The majority of them, however, focused on the association between machine learning algorithms and clinical medicine [11], lacking the understanding of spatial dynamics of the high-risk population for COVID-19 transmission. Hyper-local knowledge of what may put people at risk and where to find vulnerable groups can help plan preventative measures and facilitate medical resource allocation, significantly improving the pandemic response to a disease that affects people on a global scale. Therefore, this study aims to investigate the association between population features and COVID-19 transmission risk in Hong Kong.
Moreover, although many state-of-the-art machine learning models achieve remarkable performance in various domains, they are difficult to interpret, hindering their application, especially in healthcare [12]. Fortunately, the recent development of explainable machine learning has enabled the explanation of many complex machine learning algorithms. By leveraging various methods such as feature importance scores, counterfactual explanations, and influential training data, explainable machine learning provides insights into model behaviors [13]. For example, in [14], an explainable machine learning pipeline was proposed to predict material properties. Han et al. proposed a novel degree of locality preservation approach to enhance the explainability of manifold learning [15]. SHAP (SHapley Additive exPlanation) [16] is a game-theoretic approach measuring the importance of features and interpreting the output of machine learning models, which is powerful and has been utilized to explain various techniques and applied to different domains (e.g., healthcare, Internet of Things, and transportation) [17]. For example, Wang et al. proposed an explainable machine learning framework based on SHAP for intrusion detection systems [18]. Ng et al. assessed the mortality and recurrence risk factors of clostridioides difficile infection patients using an explainable machine learning prediction system based on SHAP [19]. SHAP quantifies the contribution of each player (feature) in a collaborative game (the machine learning model) [16]. Unlike many traditional importance analysis methods, the SHAP values can explain the model output globally and locally [20], not only reflecting the importance rank of features in the prediction for each sample but also presenting the different effects of different features on the prediction results in a quantitative way [21].
Therefore, in this work, we first obtained the number of COVID-19 cases and population features for each tertiary planning unit (TPU) (a TPU is a geographic reference system demarcated by the Planning Department for the Territory of Hong Kong, identifying the boundaries of living areas of all individuals [22], detailed in Section 2). Second, we built regression models based on machine learning algorithms to predict the number of cases using population features. Third, we used SHAP values to explain the model output and analyzed the importance and influence of different population features. In this way, the COVID-19 transmission risk of different TPUs can be estimated, and the indicators for high-risk populations can be identified.
We organized our paper as follows. First, we introduce the background, motivation, and objectives of this study in Section 1. Then, we describe the datasets and methodology in Section 2 and report the experiment results in Section 3. Next, we discuss the key findings, implications, limitations, and future work in Section 4. Finally, we conclude this study in Section 5.

2. Materials and Methods

In this section, we first describe the datasets we used in this study and the data processing procedure. Then, we introduce the machine learning algorithms used for predicting the number of COVID-19 cases based on population features and the feature importance analysis.

2.1. Dataset Description and Processing

The datasets used in this study include the COVID-19 case dataset and the TPU dataset. The data source of COVID-19 is a surveillance system titled “Together, we fight the virus!” designed by the Department of Health of Hong Kong SAR to capture the COVID-19-related vaccination history and provide an update on the infection situation for all residents [23]. The tertiary planning unit (TPU) is a geographic reference system demarcated by the Planning Department for the Territory of Hong Kong [22]. It identifies the boundaries of living areas of all individuals in Hong Kong. Under this boundary system, the whole land area of Hong Kong is divided into 291 TPUs according to the 2016 Population By-census. Each TPU has its socioeconomic features, including demographic, educational, economic, household, and housing variables, characterizing different dimensions of the respective area. Therefore, we explored the relationships between these population features and COVID-19 transmission risk. In this way, high-risk populations for COVID-19 transmission can be timely identified, and corresponding strategies can be implemented to prevent the pandemic outbreak. The study did not require ethical approval because all existing data were retrieved retrospectively and anonymized.
The COVID-19 case dataset contains 10,603 COVID-19 cases in Hong Kong SAR from January 2020 to January 2022, including the age, sex, residential address, and travel history of the cases. There are 5518 females and 5085 males. Their ages range from 12 days to 100 years old (mean (M) = 44.54, standard deviation (SD) = 19.99, in years). We further divided the cases into imported cases, local cases, and unknown cases according to their residential addresses and travel history. It resulted in 1297 imported cases, 9274 local cases, and 32 unknown cases.
The TPU dataset includes the population features in each TPU. Each TPU is identified by a unique three-digit number. As shown in Table 1, these features describe the demographic, economic, industry, housing type, and place of work of the population in TPUs. The total population of TPUs ranges from 1032 to 286,232 (M = 35,784, SD = 41,490). We also calculated the population density for each TPU according to their total population and areas. The household per room is obtained by dividing the number of households by the number of rooms (excluding kitchens, toilets, and bathrooms). Besides the absolute values of different types of populations, we also calculated the proportions of the total population.
Then, we mapped the COVID-19 cases to TPUs according to the residence of cases and finally had 215 TPUs with COVID-19 cases. The number of cases in each TPU ranges from 1 to 708 (M = 49.32, SD = 75.92).

2.2. COVID-19 Case Prediction and Feature Importance Analysis

To investigate the association between population features and COVID-19 transmission risk, we built the regression model to bridge the population features and the number of COVID-19 cases in TPUs. Then we analyzed the importance and influence of features on the prediction results to identify important population features. The pipeline is shown in Figure 1.
We divided the 215 TPUs into a training set (172 TPUs, 80%) and a test set (43 TPUs, 20%), and trained regression models on the training set using the following algorithms.
  • Linear Regression (LR) is a linear approach for modeling the relationship between features and output [24]. The objective is to minimize the residual sum of squares between the ground-truth values and the predicted values by the linear approximation. It is low-cost and easy to implement.
  • K-Nearest Neighbor Regression (KN) only consider the k-nearest data samples assuming that the predicted value should be in the neighborhood. It averages the observations in the same neighborhood to model the relationship between features and output [25]. It requires few parameters, is easy to implement, and can be applied to various linear or non-linear regression tasks.
  • Decision Tree (DT) is a model with a tree structure including the root node, internal nodes, leaf nodes, and branches, aiming to make a rational decision based on the features of the training set by answering all the questions on root and internal nodes [26]. The leaf nodes can be categories or real numbers, making it applicable to both classification and regression problems. Since every decision is made by all the information on each layer of the tree, it has good interpretability and is easy to understand.
  • Random Forest (RF) consists of several randomly created decision trees, and the output prediction is aggregated from predictions of these decision trees, i.e., the average of outputs [27]. A random forest regression model is trained by constructing multiple decision trees with the training dataset in parallel. When testing the model, a new data point will go through all the decision trees, and the result will be the average value across all the predicted values. It can achieve high accuracy and is a robust algorithm.
  • XGBoost (XGB) is eXtreme Gradient Boosting, an efficient implementation of distributed gradient boosting that can be used for building regression model [28]. It provides parallel tree boosting and has achieved outstanding performance in various domains. It stands out from other algorithms due to its high efficiency, low computational cost, good performance, and generalization [29].
The above-mentioned algorithms have been applied to various domains and achieved remarkable performance. Compared with many other machine learning and deep learning algorithms, they are easier to implement, more efficient, explainable, and require less data for training. We trained models based on these algorithms and selected the one with the best performance for further analysis.
For each model, the parameters are determined by grid search and validated through five-fold cross validation [30] on the training set. Then, we compared the performance of the models on the test set and select the one with the best performance for further analysis. Specifically, for LR and KN, we used principal components analysis (PCA) to reduce the influence of multicollinearity [31]. The explained variance in PCA is set to 95%. We used the R 2 score as the coefficient of determination, which is commonly used to evaluate the performance of a regression model. It depends on the ratio of total deviation of results described by the model. A higher R 2 score value indicates a higher proportion of data points within the line created by the regression equation. Therefore, a higher R 2 score means better performance. The formula for the R 2 score is given as follows:
R 2 = 1 S r / S t .
Here, S r is the sum of squares of the residual errors and S t is the total sum of the errors.
We also report the mean absolute error (MAE) of the prediction results. MAE measures the errors between the predicted and observed values. It is calculated as the sum of the absolute errors divided by the sample size, detailed as follows:
M A E = i = 1 n | y i p r e d i c t e d y i g r o u n d t r u t h | n ,
where y i p r e d i c t e d , y i g r o u n d t r u t h , and n are the predicted value, ground truth value, and the size of the test set.
After selecting the model with the best performance, we conducted the feature importance analysis on the regression model leveraging SHAP [16] to rank the importance of different population features and analyze the influence of important features on the prediction results. More specifically, suppose X = { ( x i , y i ) | i = 1 , 2 , , N } is the training dataset, where x i and y i are the input and output of ith sample, and N is the number of samples. We denote the jth feature of x i by x i j , and the number of features is M. Then, the SHAP values follow the equation below:
y i = E [ f ( X ) ] + j = 1 M f ( x i j ) , i = 1 , 2 , , N ,
where E [ f ( X ) ] is the baseline value of the whole model (the expected output, which is usually the mean of the predicted value of all samples), and f ( x i j ) is the SHAP value of x i j , denoting the contribution of the jth feature in the prediction of ith sample to y i . The SHAP values of features reflect their impacts on the model output. A positive SHAP value ( f ( x i j ) > 0 ) increases the number of COVID-19 cases predicted, while a negative SHAP value decreases the output. The mean values of the absolute SHAP values for features are used to rank the importance of features [32]. By analyzing the SHAP values and importance rank of features, we can figure out the influence of different features on the prediction results so as to identify indicators for COVID-19 transmission risk in TPUs and select the most important features required to achieve good performance.
Furthermore, we normalized the SHAP values of features with the following equation:
S H A P ( i ) ˜ = S H A P ( i ) j = 1 N S H A P ( j ) ,
where S H A P ( i ) ˜ and S H A P ( i ) are the normalized SHAP value and raw SHAP value of feature i, and N is the number of original features (N = 74). Therefore, j = 1 N S H A P ( j ) is the sum of the SHAP values of the 74 original features, and the normalized SHAP value of feature i ( S H A P ( i ) ˜ ) is the proportion of the raw SHAP value of feature i in the sum of SHAP values of all features. Then, we selected the top n features when their cumulative normalized SHAP values account for more than 90% of the sum of all normalized SHAP values, i.e., i = 1 n S H A P ( i ) ˜ > 0.9 , and retrained the models based on the selected important features. In this way, the redundant features can be excluded to reduce the model complexity [19].

3. Results

In this section, we elaborate on the results of COVID-19 case prediction and feature importance analysis.

3.1. COVID-19 Case Prediction

The prediction results of COVID-19 cases are shown in Table 2 ( R 0 , 0 2 and R 0 , 1 2 ). We can find that the R 2 scores of all algorithms are less than 0.5, indicating a disappointing regression performance. However, after looking into the prediction results, we find that the model achieves good performance except for some TPUs with extremely high COVID-19 cases, as shown in Figure 2. We look into the top three TPUs with the highest number of COVID-19 cases. The TPU with the most COVID-19 cases (TPU ID: 326, 667 local cases, 37 imported cases, and 4 unknown cases) is located in Kwai Chung where there was a large-scale outbreak in a few housing estates, including Kwai Chung Estate, Tai Wo Hau Estate, and Kwai Shing West Estate. There were many cases involving residents working at hospitals and elderly homes. Residents also complained that they had to queue for a long time to get tested at mobile testing stations, increasing the cross-contamination risk [33]. The TPU with the second highest cases (TPU ID: 281, 495 local cases, 2 imported cases) is located in Tsz Wan Shan, which belongs to Wong Tai Sin District with a high poverty rate and a large number of public housing estates for lower socioeconomic groups [34]. The TPU with the third highest cases (TPU ID: 225) is located in Yau Ma Tei, which is an older and well-known district attracting many tourists and locals. Based on the above observations, we believe that the environment of the housing estates may play a more significant role than the general regional characteristics of the TPU. Further studies should be conducted on these special cases. Therefore, we removed the top three TPUs with the highest COVID-19 cases and retrain the model. In this case, the performances of KN, RF, and XGB significantly improve, achieving R 2 scores above 0.8 ( R 1 , 0 2 and R 1 , 1 2 in Table 2).
In general, XGB achieves the best performance with R 2 scores of 0.695 and 0.830 for local cases and all cases, respectively, as shown in Figure 3. The MAE local case prediction is 34.566, and the MAE on the prediction of all cases is 10.490. Specifically, we find that for the TPU with ID = 951, the model shows high accuracy in terms of total case prediction, while in terms of local case prediction, there is a big gap between the ground-truth value (2 cases) and prediction value (99 cases). This TPU is Chek Lap Kok, which has many hotels and an international airport. Therefore, it has many imported cases (105 cases) and only two local cases. However, as shown in Figure 4, the larger number of hotels increases the population working in accommodation and food services, and thus increases the number of COVID-19 cases predicted. This case shows that the model performs better in total case prediction, and more features about the environment of TPUs are required to predict the number of cases in a more fine-grained manner.

3.2. Feature Importance Analysis

We explore the importance and influence of population features to find high-risk populations for COVID-19 transmission using SHAP. The overview of the SHAP values of the features for predicting local cases and total cases are shown in Figure 5a,b, respectively.
We can find that the population working in accommodation and food services, the population with a monthly income between 6000 and 9999, and the population density are the top three most important features. For local case prediction as well as all case prediction, the number of cases increases with the increase of the population working in accommodation and food services, population density, and population with income between 6000 and 9999 (a lower income in Hong Kong SAR). Moreover, the local cases increase with the increasing population working in construction, manufacturing, and population with age ≥65. The number of total cases increases with the increase of the population with the population working in import/export, wholesale and retail trades, construction, transportation, storage, postal and courier services, population with private permanent housing, and public rental housing.
Then, we normalized the SHAP values according to Equation (4) and selected the top n features when their cumulative normalized SHAP values account for more than 90% of the sum of all normalized SHAP values. In this way, we selected the top 37, 41, 18, and 16 most important features for local case prediction on all TPUs, total case prediction for all TPUs, local case prediction for TPUs excluding the top three TPUs, and total case prediction for TPUs excluding the top three TPUs, respectively. We retrain the models based on the selected important features, and the results are shown in Table 2 ( R 0 , 0 , s 2 , R 0 , 1 , s 2 , R 1 , 0 , s 2 , and R 1 , 1 , s 2 ). We can find that the models based on the important features can achieve close or even better performance compared with using the original 74 features, which shows the effectiveness of the importance rank and the importance of these features, and the model complexity can be significantly reduced.

4. Discussion

This study explored the impacts of population features on the transmission risk of COVID-19. We built machine learning models to predict the number of COVID-19 cases using the population features in TPUs and evaluated the influence of different features by explaining the model using SHAP. The top three most important indicators for high-risk COVID-19 transmission population are identified as people in accommodation and food services, low income, and high population density.
According to our findings, it is interesting that the population working in accommodation and food services plays the most significant role, not healthcare workers [35]. TPUs with more of this type of population are predicted to have more COVID-19 cases. Occupational exposure may be related to different characteristics of their works [36], particularly in the accommodation and food service sub-sectors, where human interaction is essential [37]. There is a lot of interaction between customers and employees in restaurants and hotels. The Designated Quarantine Hotel Scheme has been fully implemented since December 2020 in Hong Kong. Those designated hotels solely receive travelers arriving from foreign places for compulsory quarantine. Therefore, the workers and their representatives in the accommodation and food services sub-sectors are at risk of infection. Their irregular operations at work may bring the virus from the quarantined passengers to local residents. This is especially important today because ensuring workplace safety and health is critical for managing the COVID-19 pandemic, particularly in these sub-sectors. It can also benefit the monitoring and updating of the knowledge available about COVID-19, including prevention of transmission and the management of suspected or confirmed cases. A checklist has been designed as a tool to help implement and continuously improve practical action to prevent and mitigate the spread of COVID-19 in accommodation and food service activities established by the International Labour Organization [37]. Restaurant, hotel, and bar staff should regularly practice hygiene practices (frequent handwashing, respiratory hygiene, and frequent cleaning/disinfection of work surfaces and touch points) in accordance with WHO COVID-19 guidance for food businesses on food safety [38].
Moreover, special attention should be paid to areas with high population density areas and lower-income populations. Co-locating overcrowdedness and residents from unfavored socioeconomic classes usually synergistically increase the vulnerability among them and result in the spread of within-neighborhood transmission [39,40,41]. Therefore, the authority should provide more resources in the related lower-income and high-population districts.
Furthermore, more prevention measures should be taken for the aged care centers where there are many old people who are more likely to have severe symptoms gathering together. Unfortunately, in the fifth wave of COVID-19 in Hong Kong, many aged care centers witnessed the outbreak of the pandemic, causing a lot of deaths. As shown in our analysis, the number of local cases is positively related to the population with age ≥65, which is possibly because the elderly have a lower vaccination rate and are more susceptible to the virus [42]. Another important feature is the population working in construction. This may be due to sharing changing rooms and not wearing masks properly at work because of the working environment [43]. Additionally, the number of cases increases with the increase of the population working in import/export, wholesale and retail trades, transportation, storage, postal and courier services, since they have to touch a lot of domestic and overseas goods, increasing the risk of exposure to the virus. We suggest that those critical groups should be eligible for vaccination with the fourth dose.

4.1. Implications

Our study demonstrates that the population features of TPUs can be used to accurately predict the number of COVID-19 cases using machine learning algorithms. Apart from the population features, more fine-grained environmental features of TPUs can be used to improve the prediction performance. Furthermore, by leveraging the explainable machine learning, we can find the influence of different population features on the transmission of COVID-19 and identify indicators for high-risk populations for COVID-19 transmission effectively and efficiently. The analysis provides implications for policymakers to pay more attention to the populations with a high risk of COVID-19 transmission. The predicted COVID-19 cases can be significantly reduced by improving the critical features. The proposed pipeline can help investigate the dynamic feature importance and influence to facilitate the update of preventative strategies adaptively.
It also indicates the power of explainable machine learning, and the pipeline can also be applied to other tasks in public health studies. For example, people’s contextual information, such as demographics and environmental conditions, can be used to predict their health status, and by explaining the prediction model, the influence of different contexts can be analyzed. It can also be applied to classify the risk of pandemic transmission for different areas based on environmental features, and by evaluating the influence of environmental features, policymakers can take corresponding strategies to reduce the risk.

4.2. Limitations and Future Work

We discuss the following limitations of our work. First, we find that our model performs well on most TPUs except for some TPUs with specific characteristics where there were large-scale outbreaks of COVID-19, such as areas with many quarantine hotels and aged care centers. To address this issue, besides the population features of TPUs, the environmental features, such as points of interest and built-environment features, can be incorporated to improve the prediction performance. Furthermore, we plan to improve the existing machine learning algorithm to make it more adaptive to the prediction of COVID-19 cases based on environmental features.
Second, it is difficult to directly figure out the non-monotonic association between the population features and the number of COVID-19 cases based on the SHAP values. However, the importance rank of features can help us prune some unimportant features. In this case, we can target those crucial features to investigate their complex influences on the prediction result.
Third, because of the limited data size and considering the interpretability of the model, we use no deep learning-based methods [44]. However, the development of transfer learning and explainable deep learning has made it possible to train a deep learning model with a small dataset and explain it. In the future, we plan to compare the current model with more state-of-the-art deep learning models. Additionally, most of the COVID-19 cases included in this study are from the first to fourth waves of COVID-19 in Hong Kong. However, the COVID-19 cases significantly surge in the fifth wave. In the future, we plan to conduct more analyses after collecting more COVID-19 cases.

5. Conclusions

We built machine learning models to predict COVID-19 cases accurately and identify high-risk populations for COVID-19 transmission effectively. Response efforts such as resource allocation and preventative measures can be implemented more efficiently. We believe policymakers should pay more attention to the high-risk groups identified and apply further interventions to reduce risk or prioritize vaccination for them.

Author Contributions

Conceptualization, Z.J., K.-M.Y., H.-K.S., W.W. and E.C.H.N.; methodology, Z.J.; validation, Z.J. and K.-M.Y.; formal analysis, Z.J. and K.-M.Y.; investigation, Z.J., X.Z. and J.D.; resources, K.-M.Y., H.-K.S. and W.W.; data curation, Z.J., X.Z. and J.D.; software, Z.J.; visualization, Z.J.; writing—original draft preparation, Z.J.; writing—review and editing, K.-M.Y., X.Z., J.D., H.-K.S. and E.C.H.N.; supervision, E.C.H.N., W.W. and H.-K.S.; project administration, E.C.H.N., W.W. and H.-K.S.; funding acquisition, E.C.H.N. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

The authors would like to acknowledge the start-up grant and the COVID-19 Action Seed Fund from the Faculty of Engineering at The University of Hong Kong and the datasets published by the Department of Health and Planning Department for the Territory of Hong Kong SAR.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
COVID-19Coronavirus Infectious Disease 2019
TPUTertiary Planning Unit
SHAPSHapley Additive exPlanation
LRLinear Regression
KNK-Nearest Neighbor Regression
DTDecision Tree
RFRandom Forest
XGBeXtreme Gradient Boosting

References

  1. WHO. Statement on the Second Meeting of the International Health Regulations (2005) Emergency Committee Regarding the Outbreak of Novel Coronavirus (2019-nCoV); World Health Organization: Geneva, Switzerland, 2020. [Google Scholar]
  2. Burki, T. Hong Kong’s Fifth COVID-19 Wave—The Worst yet. Lancet Infect. Dis. 2022, 22, 455–456. [Google Scholar] [CrossRef]
  3. Miller, I.F.; Becker, A.D.; Grenfell, B.T.; Metcalf, C.J.E. Disease and Healthcare Burden of COVID-19 in the United States. Nat. Med. 2020, 26, 1212–1217. [Google Scholar] [CrossRef] [PubMed]
  4. Liu, L.; Hu, T.; Bao, S.; Wu, H.; Peng, Z.; Wang, R. The Spatiotemporal Interaction Effect of COVID-19 Transmission in the United States. ISPRS Int. J. Geo-Inf. 2021, 10, 387. [Google Scholar] [CrossRef]
  5. Zhu, M.; Kleepbua, J.; Guan, Z.; Chew, S.P.; Tan, J.W.; Shen, J.; Latthitham, N.; Hu, J.; Law, J.X.; Li, L. Early Spatiotemporal Patterns and Population Characteristics of the COVID-19 Pandemic in Southeast Asia. Healthcare 2021, 9, 1220. [Google Scholar] [CrossRef]
  6. Kim, J.H.; Marks, F.; Clemens, J.D. Looking beyond COVID-19 Vaccine Phase 3 Trials. Nat. Med. 2021, 27, 205–211. [Google Scholar] [CrossRef]
  7. Bezzan, V.P.; Rocco, C.D. Predicting Special Care during the COVID-19 Pandemic: A Machine Learning Approach. Health Inf. Sci. Syst. 2021, 9, 34. [Google Scholar] [CrossRef] [PubMed]
  8. Assaf, D.; Gutman, Y.; Neuman, Y.; Segal, G.; Amit, S.; Gefen-Halevi, S.; Shilo, N.; Epstein, A.; Mor-Cohen, R.; Biber, A.; et al. Utilization of Machine-Learning Models to Accurately Predict the Risk for Critical COVID-19. Intern. Emerg. Med. 2020, 15, 1435–1443. [Google Scholar] [CrossRef]
  9. Yan, L.; Zhang, H.T.; Xiao, Y.; Wang, M.; Sun, C.; Liang, J.; Li, S.; Zhang, M.; Guo, Y.; Xiao, Y.; et al. Prediction of Survival for Severe COVID-19 Patients with Three Clinical Features: Development of A Machine Learning-Based Prognostic Model with Clinical Data in Wuhan. medRxiv 2020. [Google Scholar] [CrossRef]
  10. Pourhomayoun, M.; Shakibi, M. Predicting Mortality Risk in Patients with COVID-19 using Machine Learning to Help Medical Decision-Making. Smart Health 2021, 20, 100178. [Google Scholar] [CrossRef]
  11. Quiroz-Juárez, M.A.; Torres-Gómez, A.; Hoyo-Ulloa, I.; León-Montiel, R.d.J.; U’Ren, A.B. Identification of High-Risk COVID-19 Patients using Machine Learning. PLoS ONE 2021, 16, e0257234. [Google Scholar] [CrossRef]
  12. Ahmad, M.A.; Eckert, C.; Teredesai, A. Interpretable Machine Learning in Healthcare. In Proceedings of the 2018 ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics, Washington, DC, USA, 29 August–1 September 2018; pp. 559–560. [Google Scholar]
  13. Bhatt, U.; Xiang, A.; Sharma, S.; Weller, A.; Taly, A.; Jia, Y.; Ghosh, J.; Puri, R.; Moura, J.M.; Eckersley, P. Explainable Machine Learning in Deployment. In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency, Barcelona, Spain, 27–30 January 2020; pp. 648–657. [Google Scholar]
  14. Kailkhura, B.; Gallagher, B.; Kim, S.; Hiszpanski, A.; Han, T. Reliable and Explainable Machine-Learning Methods for Accelerated Material Discovery. NPJ Comput. Mater. 2019, 5, 108. [Google Scholar] [CrossRef]
  15. Han, H.; Li, W.; Wang, J.; Qin, G.; Qin, X. Enhance Explainability of Manifold Learning. Neurocomputing 2022, 500, 877–895. [Google Scholar] [CrossRef]
  16. Lundberg, S.M.; Lee, S.I. A Unified Approach to Interpreting Model Predictions. Adv. Neural Inf. Process. Syst. 2017, 30, 4765–4774. [Google Scholar]
  17. Parsa, A.B.; Movahedi, A.; Taghipour, H.; Derrible, S.; Mohammadian, A.K. Toward Safer Highways, Application of XGBoost and SHAP for Real-Time Accident Detection and Feature Analysis. Accid. Anal. Prev. 2020, 136, 105405. [Google Scholar] [CrossRef] [PubMed]
  18. Wang, M.; Zheng, K.; Yang, Y.; Wang, X. An Explainable Machine Learning Framework for Intrusion Detection Systems. IEEE Access 2020, 8, 73127–73141. [Google Scholar] [CrossRef]
  19. Ng, Y.L.; Lo, M.C.; Lee, K.H.; Xie, X.; Kwong, T.N.; Ip, M.; Zhang, L.; Yu, J.; Sung, J.J.; Wu, W.K.; et al. Development of an Open-Access and Explainable Machine Learning Prediction System to Assess the Mortality and Recurrence Risk Factors of Clostridioides Difficile Infection Patients. Adv. Intell. Syst. 2021, 3, 2000188. [Google Scholar] [CrossRef]
  20. Mangalathu, S.; Hwang, S.H.; Jeon, J.S. Failure Mode and Effects Analysis of RC Members based on Machine-Learning-Based SHapley Additive exPlanations (SHAP) Approach. Eng. Struct. 2020, 219, 110927. [Google Scholar] [CrossRef]
  21. Yang, H.; Li, E.; Cai, Y.F.; Li, J.; Yuan, G.X. The Extraction of Early Warning Features for Predicting Financial Distress based on XGBoost Model and SHAP Framework. Int. J. Financ. Eng. 2021, 8, 2141004. [Google Scholar] [CrossRef]
  22. The Government of the Hong Kong Special Administrative Region, the Department of Census and Statistics. District Profiles. Available online: https://www.bycensus2016.gov.hk/en/bc-dp-tpu.html (accessed on 18 June 2022).
  23. The Government of the Hong Kong Special Administrative Region, the Department of Health. Together, We Fight the Virus! Available online: https://www.coronavirus.gov.hk/chi/index.html (accessed on 18 June 2022).
  24. Seber, G.A.; Lee, A.J. Linear Regression Analysis; John Wiley & Sons: New York, NY, USA, 2012. [Google Scholar]
  25. Maltamo, M.; Kangas, A. Methods based on K-Nearest Neighbor Regression in the Prediction of Basal Area Diameter Distribution. Can. J. For. Res. 1998, 28, 1107–1115. [Google Scholar] [CrossRef]
  26. Tso, G.K.; Yau, K.K. Predicting Electricity Energy Consumption: A Comparison of Regression Analysis, Decision Tree and Neural Networks. Energy 2007, 32, 1761–1768. [Google Scholar] [CrossRef]
  27. Svetnik, V.; Liaw, A.; Tong, C.; Culberson, J.C.; Sheridan, R.P.; Feuston, B.P. Random Forest: A Classification and Regression Tool for Compound Classification and QSAR Modeling. J. Chem. Inf. Comput. Sci. 2003, 43, 1947–1958. [Google Scholar] [CrossRef]
  28. Chen, T.; Guestrin, C. Xgboost: A Scalable Tree Boosting System. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA, 13–17 August 2016; pp. 785–794. [Google Scholar]
  29. Ogunleye, A.; Wang, Q.G. XGBoost Model for Chronic Kidney Disease Diagnosis. IEEE/ACM Trans. Comput. Biol. Bioinform. 2020, 17, 2131–2140. [Google Scholar] [CrossRef] [PubMed]
  30. Ayon, S.I.; Islam, M.M. Diabetes Prediction: A Deep Learning Approach. Int. J. Inf. Eng. Electron. Bus. 2019, 12, 21–27. [Google Scholar]
  31. Rahayu, S.; Sugiarto, T.; Ludiro, M.; Subagyo, A. Application of Principal Component Analysis (PCA) to Reduce Multicollinearity Exchange Rate Currency of Some Countries in Asia Period 2004–2014. Int. J. Educ. Methodol. 2017, 3, 75–83. [Google Scholar] [CrossRef]
  32. Bi, Y.; Xiang, D.; Ge, Z.; Li, F.; Jia, C.; Song, J. An Interpretable Prediction Model for Identifying N7-Methylguanosine Sites based on XGBoost and SHAP. Mol. Ther.-Nucleic Acids 2020, 22, 362–372. [Google Scholar] [CrossRef]
  33. Leung, H. COVID-19: Hong Kong Civil Servants Told to Work from Home as Kwai Chung Cluster Grows to over 170 Cases. Available online: https://hongkongfp.com/2022/01/24/covid-19-hong-kong-civil-servants-told-to-work-from-home-as-kwai-chung-cluster-grows-to-over-170-cases/ (accessed on 24 June 2022).
  34. Siu, J.Y.m. Health Inequality Experienced by the Socially Disadvantaged Populations during the Outbreak of COVID-19 in Hong Kong: An Interaction with Social Inequality. Health Soc. Care Community 2021, 29, 1522–1529. [Google Scholar] [CrossRef]
  35. Ran, L.; Chen, X.; Wang, Y.; Wu, W.; Zhang, L.; Tan, X. Risk Factors of Healthcare Workers with Corona Virus Disease 2019: A Retrospective Cohort Study in a Designated Hospital of Wuhan in China. Clin. Infect. Dis. 2020, 71, 2218–2221. [Google Scholar] [CrossRef]
  36. Baker, M.G.; Peckham, T.K.; Seixas, N.S. Estimating the Burden of United States Workers Exposed to Infection or Disease: A Key Factor in Containing Risk of COVID-19 Infection. PLoS ONE 2020, 15, e0232452. [Google Scholar] [CrossRef]
  37. International Labour Organization. COVID-19 and Accommodation and Food Service Activities Prevention and Control Checklist. Available online: https://www.ilo.org/sector/Resources/publications/WCMS_754201/lang-en/index.htm (accessed on 29 June 2022).
  38. World Health Organization COVID-19 and Food Safety: Guidance for Food Businesses: Interim Guidance, 07 April 2020; Technical Report; World Health Organization: Geneva, Switzerland, 2020.
  39. Zhang, A.; Shi, W.; Tong, C.; Zhu, X.; Liu, Y.; Liu, Z.; Yao, Y.; Shi, Z. The Fine-Scale Associations between Socioeconomic Status, Density, Functionality, and Spread of COVID-19 within a High-Density City. BMC Infect. Dis. 2022, 22, 274. [Google Scholar] [CrossRef]
  40. Mena, G.E.; Martinez, P.P.; Mahmud, A.S.; Marquet, P.A.; Buckee, C.O.; Santillana, M. Socioeconomic Status Determines COVID-19 Incidence and Related Mortality in Santiago, Chile. Science 2021, 372, eabg5298. [Google Scholar] [CrossRef]
  41. Hawkins, R.B.; Charles, E.J.; Mehaffey, J.H. Socio-Economic Status and COVID-19-Related Cases and Fatalities. Public Health 2020, 189, 129–134. [Google Scholar] [CrossRef] [PubMed]
  42. The Government of the Hong Kong Special Administrative Region. Hong Kong Vaccination Dashboard. Available online: https://www.covidvaccine.gov.hk/en/dashboard/eHealth (accessed on 22 June 2022).
  43. Low, Z.; Cheung, E.; Yau, C. Hong Kong’s Construction Sites Could Be Covid-19 Transmission Hotspots, Experts Say, but Blanket Work Stoppages are Unlikely to Help. Available online: https://www.scmp.com/news/hong-kong/health-environment/article/3113264/hong-kongs-construction-sites-could-be-covid-19 (accessed on 22 June 2022).
  44. Li, Y.; Yang, L.; Yang, B.; Wang, N.; Wu, T. Application of Interpretable Machine Learning Models for the Intelligent Decision. Neurocomputing 2019, 333, 273–283. [Google Scholar] [CrossRef]
Figure 1. The pipeline of identifying indicators for high-risk COVID-19 transmission population.
Figure 1. The pipeline of identifying indicators for high-risk COVID-19 transmission population.
Healthcare 10 01624 g001
Figure 2. The prediction results of XGB for all TPUs. (a) Prediction results of local cases for all TPUs ( R 0 , 0 2 = 0.470 , M A E = 31.931 ). (b) Prediction results of all cases for all TPUs ( R 0 , 1 2 = 0.444 , M A E = 34.566 ).
Figure 2. The prediction results of XGB for all TPUs. (a) Prediction results of local cases for all TPUs ( R 0 , 0 2 = 0.470 , M A E = 31.931 ). (b) Prediction results of all cases for all TPUs ( R 0 , 1 2 = 0.444 , M A E = 34.566 ).
Healthcare 10 01624 g002
Figure 3. The prediction results of XGB for TPUs excluding the top 3 TPUs. (a) Prediction results of local cases for TPUs excluding the top 3 TPUs ( R 1 , 0 2 = 0.695 , M A E = 10.136 ). (b) Prediction results of all cases for TPUs excluding the top 3 TPUs ( R 1 , 1 2 = 0.830 , M A E = 10.490 ).
Figure 3. The prediction results of XGB for TPUs excluding the top 3 TPUs. (a) Prediction results of local cases for TPUs excluding the top 3 TPUs ( R 1 , 0 2 = 0.695 , M A E = 10.136 ). (b) Prediction results of all cases for TPUs excluding the top 3 TPUs ( R 1 , 1 2 = 0.830 , M A E = 10.490 ).
Healthcare 10 01624 g003
Figure 4. The influence of population features of TPU with ID 951 on prediction.
Figure 4. The influence of population features of TPU with ID 951 on prediction.
Healthcare 10 01624 g004
Figure 5. The overview of the features’ SHAP values. The features are ranked by importance (the most important is at the top). Red color means higher feature values and blue means lower feature values. Lower SHAP values mean lower COVID-19 cases. (a) Top 20 most important features and the sum of 55 other features for the prediction of local cases. (b) Top 20 most important features and the sum of 55 other features for the prediction of all cases.
Figure 5. The overview of the features’ SHAP values. The features are ranked by importance (the most important is at the top). Red color means higher feature values and blue means lower feature values. Lower SHAP values mean lower COVID-19 cases. (a) Top 20 most important features and the sum of 55 other features for the prediction of local cases. (b) Top 20 most important features and the sum of 55 other features for the prediction of all cases.
Healthcare 10 01624 g005
Table 1. Population features.
Table 1. Population features.
Type of FeaturesFeatures
General InformationTotal population
Population density
Household per Room (excluding kitchens and toilets/bathrooms)
Population by SexMale
Female
Population by Age<15
[15, 24]
[25, 44]
[45, 64]
≥65
Population by Type of HousingPublic rental housing
Subsidised homeownership housing
Private permanent housing
Non-domestic housing
Temporary housing
Population by Monthly Income<6000
from Main Employment[6000, 9999]
(excluding unpaid family workers, in HKD)[10,000, 19,999]
[20,000, 29,999]
[30,000, 39,999]
[40,000, 59,999]
≥60,000
Population by Place of WorkWork in the same district in Hong Kong
Work in another district in Hong Kong
No fixed place/marine
Work from home
Places outside Hong Kong
Population by IndustryManufacturing
Construction
Import/export, wholesale and retail trades
Transportation, storage, postal, and courier services
Accommodation and food services
Information and communications
Financing and insurance
Real estate, professional, and business services
Public administration, education, human health, and social work activities
Miscellaneous social and personal services
Others
Table 2. Results of COVID-19 cases prediction.
Table 2. Results of COVID-19 cases prediction.
ResultsLRKNDTRFXGB
R 0 , 0 2 0.4210.3430.4910.3980.470
R 0 , 1 2 0.4290.3330.4450.3830.444
R 1 , 0 2 0.0470.6150.6870.6310.695
R 1 , 1 2 0.3940.8010.2480.8120.830
R 0 , 0 , s 2 0.4640.3470.5120.4160.428
R 0 , 1 , s 2 0.4710.3570.3820.3900.440
R 1 , 0 , s 2 0.3640.6410.4560.6240.698
R 1 , 1 , s 2 0.6880.8110.3210.8120.838
R 0 , 0 2 and R 0 , 1 2 are the R 2 scores of the local case and total case prediction for all TPUs. R 1 , 0 2 and R 1 , 1 2 are the R 2 scores of the local case and total case prediction for TPUs excluding the top 3 TPUs. R 0 , 0 , s 2 and R 0 , 1 , s 2 are the R 2 scores of the local case and total case prediction with reduced features (the top 20 most important features) for all TPUs. R 1 , 0 , s 2 and R 1 , 1 , s 2 are the R 2 scores of the local case and total case prediction with reduced features (the top 20 most important features) for TPUs excluding the top three TPUs. In KN, n _ n e i g h b o r s = 8 . In DT, m a x _ d e p t h = 8 and m i n _ s a m p l e s _ s p l i t = 9 . In RF, m a x _ d e p t h = 8 , m i n _ s a m p l e s _ s p l i t = 4 , and n _ e s t i m a t o r s = 450 . In XGB, for training on all TPUs, n _ e s t i m a t o r s = 450 , l e a r n i n g _ r a t e = 0.06 ; for training on TPUs excluding the top 3 TPUs, n _ e s t i m a t o r s = 200 , l e a r n i n g _ r a t e = 0.01 ; moreover, m a x _ d e p t h = 2 , m i n _ c h i l d _ w e i g h t = 1 , s u b s a m p l e = 0.8 , c o l s a m p l e _ b y t r e e = 0.8 , r e g _ a l p h a = 0 , r e g _ l a m b d a = 0 . Other parameters followed the default setting.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Jiang, Z.; Yip, K.-M.; Zhang, X.; Deng, J.; Wong, W.; So, H.-K.; Ngai, E.C.H. Identifying the High-Risk Population for COVID-19 Transmission in Hong Kong Leveraging Explainable Machine Learning. Healthcare 2022, 10, 1624. https://doi.org/10.3390/healthcare10091624

AMA Style

Jiang Z, Yip K-M, Zhang X, Deng J, Wong W, So H-K, Ngai ECH. Identifying the High-Risk Population for COVID-19 Transmission in Hong Kong Leveraging Explainable Machine Learning. Healthcare. 2022; 10(9):1624. https://doi.org/10.3390/healthcare10091624

Chicago/Turabian Style

Jiang, Zhihan, Ka-Man Yip, Xinchen Zhang, Jing Deng, Wilfred Wong, Hung-Kwan So, and Edith C. H. Ngai. 2022. "Identifying the High-Risk Population for COVID-19 Transmission in Hong Kong Leveraging Explainable Machine Learning" Healthcare 10, no. 9: 1624. https://doi.org/10.3390/healthcare10091624

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop