Next Article in Journal
FCNet: Stereo 3D Object Detection with Feature Correlation Networks
Next Article in Special Issue
Comparison of Non-Uniform Image Quality Caused by Anode Heel Effect between Two Digital Radiographic Systems Using a Circular Step-Wedge Phantom and Mutual Information
Previous Article in Journal
A Fast and Efficient Ensemble Transfer Entropy and Applications in Neural Signals
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

An Entropy-Based Measure of Complexity: An Application in Lung-Damage

by
Pilar Ortiz-Vilchis
and
Aldo Ramirez-Arellano
*,†
Escuela Superior de Medicina, Instituto Politécnico Nacional, Mexico City C.P. 11340, Mexico
*
Author to whom correspondence should be addressed.
Current address: Unidad Profesional Interdisciplinaria de Ingeniería y Ciencias Sociales y Administrativas, Instituto Politécnico Nacional, Mexico City C.P. 08400, Mexico.
Entropy 2022, 24(8), 1119; https://doi.org/10.3390/e24081119
Submission received: 18 June 2022 / Revised: 23 July 2022 / Accepted: 12 August 2022 / Published: 14 August 2022
(This article belongs to the Special Issue Applications of Statistical Methods in Medicine and Biology)

Abstract

:
The computed tomography (CT) chest is a tool for diagnostic tests and the early evaluation of lung infections, pulmonary interstitial damage, and complications caused by common pneumonia and COVID-19. Additionally, computer-aided diagnostic systems and methods based on entropy, fractality, and deep learning have been implemented to analyse lung CT images. This article aims to introduce an Entropy-based Measure of Complexity (EMC). In addition, derived from EMC, a Lung Damage Measure (LDM) is introduced to show a medical application. CT scans of 486 healthy subjects, 263 diagnosed with COVID-19, and 329 with pneumonia were analysed using the LDM. The statistical analysis shows a significant difference in LDM between healthy subjects and those suffering from COVID-19 and common pneumonia. The LDM of common pneumonia was the highest, followed by COVID-19 and healthy subjects. Furthermore, LDM increased as much as clinical classification and CO-RADS scores. Thus, LDM is a measure that could be used to determine or confirm the scored severity. On the other hand, the d-summable information model best fits the information obtained by the covering of the CT; thus, it can be the cornerstone for formulating a fractional LDM.

1. Introduction

The imaging studies X-ray and Computed Tomography (CT) are diagnostic tests for early detection of injuries, internal bleeding, diseases, cancer, and infections (pneumonia and COVID-19) in specific areas. CT is a tool for evaluating the evolution of lung infections and pulmonary interstitial damages, complications caused by common pneumonia, cancer, and COVID-19 [1,2,3,4]. The clinical scoring systems have been proposed as a guide to assess and report image findings. They are usually semi-quantitative or quantitative and do not demand significant additional resources [5,6,7,8,9]. However, medical expertise and clinic tests are essential to apply them. Furthermore, many Computer-Aided Diagnostic (CAD) systems have been implemented to improve diagnosing and monitoring the lung disease progression [10,11,12,13,14,15,16,17]. Several methods based on entropy [18,19,20,21] and fractality [22,23,24,25,26,27,28] have been proposed to analyse airway branching complexity and pulmonary parenchyma on lung CT images.
Machine and deep learning are powerful tools for detecting, diagnosing, and predicting pulmonary diseases such as COVID-19. The reader is referred to [29,30,31] for a profound discussion on the machine and deep learning CT analysis. However, these approaches need many high-quality images to be accurate in the diagnosis, which is an open issue in this field [32]. The resulting models are difficult to be interpreted by humans. In addition, a measure that quantifies the complexity, or even the severity of the damage caused by the infection is rather difficult to be extracted from them [33]. Thus, a measure of complexity of the space-filling relied on entropy has not been proposed, to the authors’ best knowledge. Furthermore, no investigations have been conducted on developing a measure of the complexity of lung damage by analysing CT images, which is the second goal of this research. The cornerstone of the two proposed measures is quantifying the information produced by how fast the space is filling by falling in [0, 1], where one means the highest complexity value.
After this introduction the related works and preliminaries are presented, followed by the Entropy-based Measure of Complexity (EMC) and Lung Damage Measure (LDM), a particular case of the first. Next, the methodology is described, and an application is presented. Finally, the discussion and conclusion are given.

2. Related Works

2.1. Entropy and Complex Approaches

Entropy measures the unpredictability that specifies a system’s degree of disorder and complexity. Entropy is the cornerstone to enhance chest X-ray pneumonia images [18], select the relevant features to train an Artificial Neural Network (ANN) to recognize pneumonia [19] and lung nodules in CT images [20]. Similarly, Tsallis–Havrda–Charvat and Shannon entropies are a loss function in a deep neural network to identify lung cancer based on CT images and clinical data [21].
Fractal analysis has been applied to medical imaging. The fractal dimension is the omnipresent measure in this analysis. It was computed on a pulmonary arterial network extracted from X-ray images to show its fractal pattern [22]. Similarly, the fractal dimension of the lung CT images was associated with morbidity caused by chronic obstructive pulmonary disease [23,24] and with the stage of lung cancer [27].
Multifractal analysis of lung CT images of patients with COVID-19 shows that the capacity dimension is correlated with the progression and reduction of lung infection [28]. The use of entropy (as a measurement of complexity) in fractal analysis raises the information dimension measure. This measure can differentiate among several lung affections [25,26].
The previous works show that the fractal and capacity dimensions are associated with the repercussion of pulmonary illnesses such as COVID-19. These repercussions include mortality, the extension and the complexity of lung damage. Furthermore, the fractal and information dimensions lack standardization and independence of the scale. It means that these measures are influenced by the size of CT and could take a wide range of values. Thus, it is rather difficult to compare the results in different contexts.

2.2. Artificial Intelligence

Machine-learning and deep-learning are areas of artificial intelligence that employ multi-layered artificial neural network models. They have important applications in clinical practice, focusing on modelling, classification and diagnosis without human interaction.
Artificial intelligence algorithms have been used for disease modelling, classification, and characterisation [34,35,36]. They pursue the discovery of hidden associations in the data [37], identifying key clinical variables, making predictions to support decisions [38], reducing laboratory tests [35,39] and processing images to diagnose [34,40,41,42,43]. The ultrasound image of the carotid atherosclerotic plaque tissue is analysed by a 3-D deep convolution neural network [34] to identify the tissue rupture that can be the precursor of a stroke. Similarly, the author of [43] proposed a convolutional neural network for the automatic segmentation of chest X-ray to diagnose cardiomegaly. Furthermore, the electrocardiogram analysis by the convolutional neural network has been employed to identify five types of arrhythmic heartbeats [42] and guide the screening process for subcutaneous implantable cardioverter-defibrillators [44]. The convolutional neural network has analysed CT to identify cerebral infarction [40] and pulmonary fibrosis [41].
Several convolutional neural networks have also been used to identify infection of COVID-19 in X-ray and CT images for quick and accurate diagnosis [45,46,47,48,49,50]. ResNet-101 and Xception could characterize and diagnose COVID-19 infections with high sensitivity, specificity, and accuracy between 80–99% [45,49,50] compared to the radiologist’s performance with a sensitivity, specificity, and accuracy of less than 90% [45]. New algorithms have been designed to classify and detect COVID-19. MODE convolutional neural networks-based on classifying COVID-19-infected patients with lesser false-negative and false-positive values [46]. FGCNet fuse a graph convolutional network and a convolutional neural network to detect COVID-19 from chest CT images. Another tailored deep convolutional neural network, COVIDNet-CT, was designed to detect COVID-19 in CT images with a high test accuracy (99.1%) and low architectural and computational complexity [51].
The approaches based on deep neural networks and machine learning techniques have shown high accuracy rates in classifying and diagnosing COVID-19 disease using CT images. However, a measure that quantifies the complexity and the severity of the damage caused by lung illnesses is difficult to be extracted from them. Thus, indirect measurements are computed instead based on the lesions identified by the artificial neural networks. For example, the change in the volume of the lesions from CT at two different times [1] is compared to measure the progression of the illness. Similarly, the z-score between the average volume of lung opacities in healthy subjects and the opacities caused by lung lesions of COVID-19 are used to classify the illness as mild, moderate and severe [13]. Both measures quantify the volume of the lesions but not their complexity.

3. Preliminaries

3.1. Fractal and Information Dimensions

A fractal dimension quantifies the complexity of a pattern or set as a ratio of the change in detail to the change in scale. Mandelbrot [52] defines a fractal as a subset of the Euclidean space with a fractal dimension that strictly exceeds its topological dimension. The Hausdorff dimension of bounded and closed sets can be obtained by counting the finite coverings by closed boxes, which satisfies the condition that the intersection of the interiors of any pair of boxes is empty. The so-called box-counting dimension is more appropriate than the Hausdorff dimension for measuring a given set’s fractality (e.g., see [53]. The box-counting dimension of a compact set E R n is defined as follows:
d b = lim ε 0 log N ( ε ) log ε ,
where N ( ε ) stands for the minimal number of boxes of diameter at most ε needed to cover E , and the size of the box ε has a range of values that produces the set of points ε vs. N ( ε ) .
The information dimension was introduced in [54] as follows:
d I = lim ε 0 I c ( ε ) log ε = lim ε 0 i = 1 N p i ( ε ) log p i ( ε ) log ε ,
where p i ( ε ) is the probability of a symbol given a box of diameter ε , and N is the number of boxes covering the set. The term box is general known, but for CT it should be a cube. If all events are uniformly distributed, i.e., p i = 1 / w , the entropy I ( ε ) is maximum [55]. For example, the CT of Figure 1a is covered by a cube of size ε = s , where s is the width and height of the CT. For simplicity, we assume that the CT has s slices. Figure 1b shows the covering by 2 3 cubes of size s / 2 . Now, the probability p i ( ε ) is calculated by first normalising all pixels in each cube by dividing its value by the max intensity [56]; in our example, each pixel has a value of 0 or 255, and each cube has four pixels. Thus, this process results in the table in Figure 2a. Then the mean of each box is computing, see Figure 2b. Finally, the mean is divided by the total number of boxes to obtain p i ( ε ) .
By (2), we can assert that
I c ( ε ) d I log ε + β ,
for some constant β , where ε is the size of the boxes covering the set.

3.2. D-Summable Information Dimension

A bounded and closed set is said to be d-summable if and only if the improper integral converges.
0 1 N ( ε ) ε d 1 d ε ,
N ( ε ) is the number of boxes of diameter ε covering E , and d is the fractal dimension. The reader is referred to a detailed discussion of d-summable sets [57].
The d-summable dimension [58] is defined as follows:
N ( ε ) ε 1 ν C ε d ,
where d is the d-summable dimension, and N is the number of boxes of size ε needed to cover the set.
From (4), (5) and (2), we deduce that
d d I = lim ε 0 i = 1 N p i ( ε ) log p i ( ε ) ε 1 ν log ε ,
where ε is the size of the boxes, and p i ( ε ) is the probability of a given box. The information dimension is obtained when ν 1 . For more details on the definition of the d-summable information dimension, the reader is referred to [58].
The information (2) and d-summable information (6) dimensions have an indeterminacy, because for ε = 1 , the denominators of both equations are zero. This indeterminacy is solved in [59], which reformulates the information dimension by restricting the box size to [ 2 , Δ 1 ] , where Δ is the maximum size needed to cover the set with one box fully.
Similarly, for some constant β , we see that
d I ( ε ) ( d d I log ε + β ) ε 1 ν ,
where d d I is the d-summable information dimension, and ε is the size of the boxes necessary to cover the set.

3.3. Entropy-Based Measure of Complexity

The entropy-based measure of complexity is defined as:
E M C = 1 a b I ( ε ) d ε ( b a ) ( I m a x ( a ) I m a x ( b ) ) 2 + I m a x ( b ) ( b a ) ,
where I ( ε ) is the information function such as the classical information (3) or d-summable (7). The physical meaning of EMC is the quantification of the information of how fast the space is filled by changing the scale. Note that EMC is a normalised measure where one means that the information speed for filling the space is the highest. The lung damage measure can be derived from (8), considering the following. Since the CT are stored as binary objects, the size of each cube to cover the CT is ε = [ a = 2 , 4 , , b = 2 l o g 2 ( s ) 1 ] , where s is the size of the CT p.e. 512 pixels. I m a x ( ε ) is obtained when p i ( ε ) = 1 / w , where w is the number of cubes of size ε to cover the CT. Moreover, I m a x ( ε ) = log ( s ε ) 3 . The lung damage measure is defined as:
L D M = 1 a b I ( ε ) d ε ( b a ) ( log ( s a ) 3 log ( s b ) 3 ) 2 + log ( s b ) 3 ( b a ) .
In practise, a b I ( ε ) d ε can be approximated by computing I ( ε ) c = i = 1 N p i ( ε ) log p i ( ε ) ; then it can be integrated numerically.
The geometrical interpretation of LDM is shown in Figure 3. The blue line is I ( ε ) for [ a , , b ] obtained by the CT’s box-covering. Thus, the gray area is a b I ( ε ) d ε . The orange line between the points ( a , I m a x ( a ) ) and ( b , I m a x ( b ) ) means the maximum entropy I m a x ( ε ) for each ε . Thus, I m a x ( a ) = log ( s a ) 3 and I m a x ( b ) = log ( s b ) 3 . The divisor of (9) is the area under max entropy I m a x ( ε ) (orange line) plus the area of the rectangle ( b a ) I m a x ( b ) . The second term of (9) means the area of the CT divided by the area of the max entropy that can be obtained by an object of the same size. I ( ε ) (blue line) is expected to decay faster for a complex object. Thus, a b I ( ε ) d ε 0 and L D M 1 ; on the less complex object occurs the opposite.
Now, we are ready to give an interpretation of LDM in the context of medical imaging. A healthy lung is mostly an empty space (the CT is mostly black), so the information on how fast the space is filled should be low (little information is contained no matter the size of the cubes to cover the lungs). On the contrary, lung lesions (lung volume loss, septal thickening, halo sign, bronchial dilatation, centrilobular nodules, ground-glass opacities, consolidations, crazy paving) appear on a CT as a white region. The entropy for a given scale I ( ε ) quantify the lesion extension (space-filling as ones in the boxes) see Figure 2a, and how complex they are (the entropy computed using the p i ( ε ) shown in Figure 2c. Integrating this information a b I ( ε ) d ε , we have a global measure of both. In summary, the LDM measures the extension and complexity of the lesions.

4. Method

The CT of subjects with healthy lungs (486), COVID-19 confirmed diagnosis (263) and those with common pneumonia (329) included in this study were gathered from [60]. In addition, COVID-19 (49) with clinical description data were collected from Radiopaedia [61]. The search criteria were: “cases”, “breast system”, “CT study modality”, “COVID-19”, and “adult”. The selected CT were those in which the slices covered the lung region completely. The lungs were selected as the Region Of Interest (ROI) using a mask. The image of each slice was converted to a matrix then they were piled to build a CT cube of 512 by 512 by the number of slices, see Figure 4a. Once the CT cube was built, the box-covering algorithm was employed to compute the number of cubes N, of size ε , to cover the regions filled up in the CT, see Figure 4b. Finally, the p i ( ε ) is obtained from each cube, as was explained, see Figure 4c. Finally, the LDM is computed, see Figure 4d. The ROI selection was performed automatically using ad-hoc software. Four expert radiologists validated the ROI.
The LDM computed on the CT of healthy, COVID-19, and common pneumonia were analysed using a Kruskal–Wallis test to show the effect of these diseases. Since the LDM was neither normally distributed nor homoscedastic the Kolmogorov–Smirnov and Levene tests were employed to verify the non-normality and non-homoscedasticity, respectively. A statistical analysis focused on Pearson’s correlation coefficient (r) between the clinical classification of The National Commission of Chinese Health, the COVID-19 Reporting and Data System (CO-RADS), and LDM was carried out using CT of COVID-19 (49) collected from Radiopaedia [61]. According to [62], the clinical classification distinguishes four levels of gravity (mild, moderate, severe and critical cases) based on clinical manifestations and imaging findings. CO-RADS is a scoring system (0–6 points) based on stratifying the suspicion of pulmonary involvement in COVID-19 using the chest CT findings to make decisions in clinical practice. The score increases according to suspiction from insufficient evidence (category 0), very low to very high (categories 1–5), and confirmed by polymerase chain reaction (PCR) (category 6) [63]. The individual effect of clinical classification and CO-RADS on LDM was tested using a one-way ANOVA and Bonferroni post hoc. These statistical analyses were performed using SPSS Statistics 25; meanwhile, the computation of LDM was performed in Matlab R2022a.
The Akaike Information Criterion (AIC) [64] was employed to select from (3) and (7) the best model that describes the information obtained from each CT. The AIC balances the goodness-of-fit and the complexity of the model (number of parameters) in a single measure to avoid over-fitting. The parameters of (3) and (7) were approximated by non-linear regression [65].

5. Applications

The number of CT, the average number of slices and LDM computed on healthy, COVID-19, and common pneumonia are shown in Table 1. The Kolmogorov–Smirnov and Levene test on LDM show that it is not normally distributed nor homoscedastic, respectively. The Kruskal–Wallis test showed a significant difference in the illnesses on LDM, H ( 2 ) = 428.349 , p < 0.0001 . The pairwise comparisons (Mann–Whitney test) using the Bonferroni adjustment [66] showed a significant difference of LDM between healthy subjects, and those suffered from COVID-19 U ( N h = 486 , N c = 263 ) = 32,157 , z = 11.234 , p < 0.001 and common pneumonia U ( N h = 486 , N p = 329 ) = 15,362 , z = 19.587 , p < 0.001 . Additionally, the COVID-19 and common pneumonia comparison showed a significant difference of LDM U ( N c = 263 , N p = 329 ) = 22,908, z = 9.844 , p < 0.001 .
Figure 5 show slice lungs of healthy, COVID-19, and common pneumonia. The LDM of a healthy subject (a) is the lowest, followed by COVID-19 (b,c), where the complexity of the lesions is higher. The COVID-19 and common pneumonia image findings are paved, bronchus distortion, bronchiectasis and consolidation in bilateral involvement, see Figure 5b–e. However, the ground glass opacification is evident only in COVID-19 slices. Furthermore, atelectasis and peribronchovascular thickening are only presented in common pneumonia examples, Figure 5d,e. The LDM quantify the complexity of these findings by the roughness and fractured patterns in those lesions. For example, the lesions in Figure 5e present more sharpened edges than those in Figure 5c.
The CT of subjects suffering from COVID-19 (n = 49, gathered from Radiopaedia) was scored using the clinical classification and CO-RADS. Kolmogorov–Smirnov and Levene test on LDM ( μ = 0.810 , σ = 0.048 ) shows that it is normally distributed and homoscedastic by both scores. A Pearson’s coefficient was calculated to assess the correlation between LDM and clinical classification ( r ( 46 ) = 0.49 , p = 0.01 ), and LDM and CO-RADS ( r ( 46 ) = 0.47 , p = 0.01 ). In addition, the ANOVA show an effect of clinical classification on LDM ( F ( 2 , 45 ) = 7.377 , p = 0.002 ). A statistical difference was found between level mild, ( μ = 0.779 , σ = 0.043 ) and severe ( μ = 0.831 , σ = 0.042 ) by Bonferroni post hoc. Although, no significant difference was found between level mild ( μ = 0.779 , σ = 0.043 ) and moderate, ( μ = 0.794 , σ = 0.043 ) and between level moderate, ( μ = 0.794 , σ = 0.043 ) and severe ( μ = 0.831 , σ = 0.042 ) the LDM increases as clinical classification, see Figure 6. The critical level was not identified because no extensive consolidations or white lung were notorious in the CT.
The ANOVA shows that the CO-RADS score affects LDM ( F ( 3 , 44 ) = 4.810 , p = 0.006 ) . A statistical difference was found only between level two ( μ = 0.779 , σ = 0.049 ) and five ( μ = 0.8310 , σ = 0.042 ) by Bonferroni post hoc while no significant difference was found between the remaining levels in multiple comparisons (level three μ = 0.780 , σ = 0.033 , level four μ = 0.794 , σ = 0.043 ). However, LDM increased as much as the CO-RADS score, see Figure 7. Levels one and six were not considered due to not being based on tomographic findings.
The functional form of I ( ε ) was selected from (3) and (7) using the AIC [64]. First, the minimum value of AIC of two models is chosen A I C m i n ; then each Δ A I C i = A I C i A I C m i n is computed, where i is the candidate model; i = I for (3) and i = d I for (7). The rule of thumb is that two models fit the data equally if Δ A I C i < 2 [67,68]. On the other hand, if Δ A I C 2 , there is sufficient statistical evidence to choose one over the other. Table 2 shows the average and standard deviation of A I C i and Δ A I C i for information model (I) and d-summable information model ( d I ) as well as information dimension ( d I ), d-summable information dimension ( d d I ), and ν . The d-summable information model (7) was selected for healthy and COVID-19 CT and mostly for those lungs affected by common pneumonia. For twenty-eight out of 320 CT affected by common pneumonia, there is no difference in selecting the information model or d-summable information model since Δ A I C < 2 for both models. Thus, the d-summable information model describes the complexity of the analysed CT. Note that the d I and d d I are higher for healthy lungs and decrease for COVID-19 and common pneumonia.

6. Discussion and Conclusions

This study aimed at introducing a measure of the information produced by how fast the space is filled by changing the scale named EMC. A particular case of EMC called LDM was applied on CT images to differentiate the lesions caused by COVID-19 and common pneumonia. The results showed that the LDM statistically differs between healthy, common pneumonia, and COVID-19 lungs. This means that the complexity of healthy lungs is the lowest; meanwhile the complexity increased for COVID-19 and common pneumonia. The fractal dimension has been used to analyse pulmonary vessel and airway branching patterns and pneumonia lesion detection on X-ray and CT images [23], but not to quantify the complexity of the lesions. Moreover, the LDM could be the cornerstone of automatic-computational diagnostic systems. The complexity of the lungs affected by COVID-19 and common pneumonia is higher than healthy lungs; thus, these findings align with previous studies performed in both X-ray and CT images [25,28].
The image findings and clinical scoring systems help diagnose and classify patients’ health status. Our findings show that LDM increases as much as the scored severity of patients’ illnesses. Hence LDM is a measure that could be used to determine or confirm the scored severity. In addition, the d-summable information model best fits the information I c ( ε ) obtained by the covering of the CT; thus, it paves the way to formulate a fractional LDM based on this model. The EMC can be applied to complex networks, or individual images such as X-rays. Furthermore, the LDM (designed for three dimensional objects) is not restricted to the lungs. It could be applied to other organs such as the liver or kidneys.

Author Contributions

Conceptualization, A.R.-A.; Formal analysis, A.R.-A.; Investigation, P.O.-V.; Methodology, A.R.-A.; Supervision, A.R.-A.; Writing—original draft, P.O.-V. and A.R.-A.; Writing—review & editing, P.O.-V. and A.R.-A. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by Secretaria de Investigación de Posgrado grant number SIP20220415 and SIP20220421.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data that support the findings of this study are available from the corresponding author upon reasonable request.

Acknowledgments

This work was partially supported by Secretaria de Investigación de Posgrado under Grant No. SIP20220415 and SIP20220421.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
AICAkaike Information Criterion
ANOVAAnalysis of Variance
CADComputer-aided Diagnostic
CO-RADSClassification of the NCCH, the COVID-19 Reporting and Data System
COVID-19Coronavirus Disease 2019
CTComputed Tomography
EMCEntropy-based Measure of Complexity
LDMLung Damage Measure
PCRPolymerase Chain Reaction
ROIRegion Of Interest

References

  1. Pu, J.; Leader, J.K.; Bandos, A.; Ke, S.; Wang, J.; Shi, J.; Du, P.; Guo, Y.; Wenzel, S.E.; Fuhrman, C.R.; et al. Automated quantification of COVID-19 severity and progression using chest CT images. Eur. Radiol. 2021, 31, 436–446. [Google Scholar] [CrossRef] [PubMed]
  2. Zhang, N.; Xu, X.; Zhou, L.Y.; Chen, G.; Li, Y.; Yin, H.; Sun, Z. Clinical characteristics and chest CT imaging features of critically ill COVID-19 patients. Eur. Radiol. 2020, 30, 6151–6160. [Google Scholar] [CrossRef] [PubMed]
  3. Zhao, W.; Zhong, Z.; Xie, X.; Yu, Q.; Liu, J. Relation between chest CT findings and clinical conditions of coronavirus disease (COVID-19) pneumonia: A multicenter study. AJR Am. J. Roentgenol. 2020, 214, 1072–1077. [Google Scholar] [CrossRef] [PubMed]
  4. Liu, K.C.; Xu, P.; Lv, W.F.; Qiu, X.H.; Yao, J.L.; Gu, J.F.; Wei, W. CT manifestations of coronavirus disease-2019: A retrospective analysis of 73 cases by disease severity. Eur. J. Radiol. 2020, 126, 108941. [Google Scholar] [CrossRef] [PubMed]
  5. Taylor, E.; Haven, K.; Reed, P.; Bissielo, A.; Harvey, D.; McArthur, C.; Bringans, C.; Freundlich, S.; Ingram, R.J.H.; Perry, D.; et al. A chest radiograph scoring system in patients with severe acute respiratory infection: A validation study. BMC Med. Imaging 2015, 15, 61. [Google Scholar] [CrossRef]
  6. Salahshour, F.; Mehrabinejad, M.M.; Nassiri Toosi, M.; Gity, M.; Ghanaati, H.; Shakiba, M.; Nosrat Sheybani, S.; Komaki, H.; Kolahi, S. Clinical and chest CT features as a predictive tool for COVID-19 clinical progress: Introducing a novel semi-quantitative scoring system. Eur. Radiol. 2021, 31, 5178–5188. [Google Scholar] [CrossRef]
  7. De Smet, K.; De Smet, D.; Ryckaert, T.; Laridon, E.; Heremans, B.; Vandenbulcke, R.; Demedts, I.; Bouckaert, B.; Gryspeerdt, S.; Martens, G.A. Diagnostic performance of chest CT for SARS-CoV-2 infection in individuals with or without COVID-19 symptoms. Radiology 2021, 298, E30–E37. [Google Scholar] [CrossRef]
  8. Rossi, G.; Bauckneht, M.; Genova, C.; Rijavec, E.; Biello, F.; Mennella, S.; Dal Bello, M.G.; Cittadini, G.; Bruzzi, P.; Piva, R.; et al. Comparison between 18F-FDG PET–based and CT-based criteria in non–small cell lung cancer Patients treated with nivolumab. J. Nucl. Med. 2020, 61, 990–998. [Google Scholar] [CrossRef]
  9. Doubková, M.; Švancara, J.; Svoboda, M.; Šterclová, M.; Bartoš, V.; Plačková, M.; Lacina, L.; Žurková, M.; Binková, I.; Bittenglová, R.; et al. EMPIRE registry, Czech part: Impact of demographics, pulmonary function and HRCT on survival and clinical course in idiopathic pulmonary fibrosis. Clin. Respir. J. 2018, 12, 1526–1535. [Google Scholar] [CrossRef]
  10. Flechsig, P.; Rastgoo, R.; Kratochwil, C.; Martin, O.; Holland-Letz, T.; Harms, A.; Kauczor, H.U.; Haberkorn, U.; Giesel, F.L. Impact of computer-aided CT and PET analysis on non-invasive T staging in patients with lung cancer and atelectasis. Mol. Imaging Biol. 2018, 20, 1044–1052. [Google Scholar] [CrossRef]
  11. Hooda, R.; Mittal, A.; Sofat, S. Tuberculosis detection from chest radiographs: A comprehensive survey on computer-aided diagnosis techniques. Curr. Med. Imaging 2018, 14, 506–520. [Google Scholar] [CrossRef]
  12. Mahomed, N.; van Ginneken, B.; Philipsen, R.H.; Melendez, J.; Moore, D.P.; Moodley, H.; Sewchuran, T.; Mathew, D.; Madhi, S.A. Computer-aided diagnosis for World Health Organization-defined chest radiograph primary-endpoint pneumonia in children. Pediatr. Radiol. 2020, 50, 482–491. [Google Scholar] [CrossRef]
  13. Carvalho, A.R.S.; Guimarães, A.; Werberich, G.M.; de Castro, S.N.; Pinto, J.S.F.; Schmitt, W.R.; França, M.; Bozza, F.A.; Guimarães, B.L.d.S.; Zin, W.A.; et al. COVID-19 Chest Computed Tomography to Stratify Severity and Disease Extension by Artificial Neural Network Computer-Aided Diagnosis. Front. Med. 2020, 7, 577609. [Google Scholar] [CrossRef]
  14. Khan, M.A.; Majid, A.; Akram, T.; Hussain, N.; Nam, Y.; Kadry, S.; Wang, S.H.; Alhaisoni, M. Classification of COVID-19 CT scans via extreme learning machine. Comput. Mater. Contin. 2021, 68, 1003–1019. [Google Scholar]
  15. Al-Antari, M.A.; Hua, C.H.; Bang, J.; Lee, S. Fast deep learning computer-aided diagnosis of COVID-19 based on digital chest X-ray images. Appl. Intell. 2021, 51, 2890–2907. [Google Scholar] [CrossRef] [PubMed]
  16. Wang, Y.; Dong, C.; Hu, Y.; Li, C.; Ren, Q.; Zhang, X.; Shi, H.; Zhou, M. Temporal Changes of CT Findings in 90 Patients with COVID-19 Pneumonia: A Longitudinal Study. Radiology 2020, 296, E55–E64. [Google Scholar] [CrossRef] [PubMed]
  17. Wu, J.; Wu, X.; Zeng, W.; Guo, D.; Fang, Z.; Chen, L.; Huang, H.; Li, C. Chest CT findings in patients with coronavirus disease 2019 and its relationship with clinical features. Investig. Radiol. 2020, 55, 257. [Google Scholar] [CrossRef] [PubMed]
  18. Abin, D.; Thepade, S.D.; Mankar, H.; Raut, S.; Yadav, A. Blending of Contrast Enhancement Techniques for Chest X-ray Pneumonia Images. In Proceedings of the 2022 International Conference on Electronics and Renewable Systems (ICEARS), Tuticorin, India, 16–18 March 2022; pp. 981–985. [Google Scholar]
  19. Wang, S.H.; Zhou, J.; Zhang, Y.D. Community-acquired pneumonia recognition by wavelet entropy and cat swarm optimization. Mob. Netw. Appl. 2022, 1, 1–18. [Google Scholar] [CrossRef]
  20. Santos, A.M.; de Carvalho Filho, A.O.; Silva, A.C.; de Paiva, A.C.; Nunes, R.A.; Gattass, M. Automatic detection of small lung nodules in 3D CT data using Gaussian mixture models, Tsallis entropy and SVM. Eng. Appl. Artif. Intell. 2014, 36, 27–39. [Google Scholar] [CrossRef]
  21. Brochet, T.; Lapuyade-Lahorgue, J.; Huat, A.; Thureau, S.; Pasquier, D.; Gardin, I.; Modzelewski, R.; Gibon, D.; Thariat, J.; Grégoire, V.; et al. A Quantitative Comparison between Shannon and Tsallis–Havrda–Charvat Entropies Applied to Cancer Outcome Prediction. Entropy 2022, 24, 436. [Google Scholar] [CrossRef]
  22. Postolache, P.; Borsos, Z.; Paun, V.A.; Paun, V.P. New way in fractal analysis of pulmonary medical images. Univ. Politeh. Buchar. Sci. Bull.-Ser. A-Appl. Math. Phys. 2018, 80, 313–322. [Google Scholar]
  23. Bodduluri, S.; Puliyakote, A.S.K.; Gerard, S.E.; Reinhardt, J.M.; Hoffman, E.A.; Newell, J.D.; Nath, H.P.; Han, M.K.; Washko, G.R.; Estépar, R.S.J.; et al. Airway fractal dimension predicts respiratory morbidity and mortality in COPD. J. Clin. Investig. 2018, 128, 5374–5382. [Google Scholar] [CrossRef] [PubMed]
  24. Van de Moortele, T.; Goerke, U.; Wendt, C.H.; Coletti, F. Airway morphology and inspiratory flow features in the early stages of Chronic Obstructive Pulmonary Disease. Clin. Biomech. 2019, 66, 60–65. [Google Scholar] [CrossRef] [PubMed]
  25. Ramirez-Arellano, A.; Ortiz-Vilchis, P.; Bory-Reyes, J. The role of D-summable information dimension in differentiating COVID-19 disease. Fractals 2021, 29, 2150255. [Google Scholar] [CrossRef]
  26. Namazi, H.; Kulish, V.V. Complexity-based classification of the coronavirus disease (COVID-19). Fractals 2020, 28, 2050114. [Google Scholar] [CrossRef]
  27. Al-Kadi, O.S. Prediction of FDG-PET stage and uptake for non-small cell lung cancer on non-contrast enhanced CT scans via fractal analysis. Clin. Imaging 2020, 65, 54–59. [Google Scholar] [CrossRef] [PubMed]
  28. Astinchap, B.; Ghanbaripour, H.; Amuzgar, R. Multifractal analysis of chest CT images of patients with the 2019 novel coronavirus disease (COVID-19). Chaos Solitons Fractals 2022, 156, 111820. [Google Scholar] [CrossRef]
  29. Subramanian, N.; Elharrouss, O.; Al-Maadeed, S.; Chowdhury, M. A review of deep learning-based detection methods for COVID-19. Comput. Biol. Med. 2022, 143, 105233. [Google Scholar] [CrossRef] [PubMed]
  30. Alafif, T.; Tehame, A.M.; Bajaba, S.; Barnawi, A.; Zia, S. Machine and Deep Learning towards COVID-19 Diagnosis and Treatment: Survey, Challenges, and Future Directions. Int. J. Environ. Res. Public Health 2021, 18, 1117. [Google Scholar] [CrossRef] [PubMed]
  31. Alyasseri, Z.A.A.; Al-Betar, M.A.; Doush, I.A.; Awadallah, M.A.; Abasi, A.K.; Makhadmeh, S.N.; Alomari, O.A.; Abdulkareem, K.H.; Adam, A.; Damasevicius, R.; et al. Review on COVID-19 diagnosis models based on machine learning and deep learning approaches. Expert Syst. 2022, 39, e12759. [Google Scholar] [CrossRef] [PubMed]
  32. Liu, T.; Siegel, E.; Shen, D. Deep Learning and Medical Image Analysis for COVID-19 Diagnosis and Prediction. Annu. Rev. Biomed. Eng. 2022, 24, 179–201. [Google Scholar] [CrossRef] [PubMed]
  33. Islam, M.M.; Karray, F.; Alhajj, R.; Zeng, J. A Review on Deep Learning Techniques for the Diagnosis of Novel Coronavirus (COVID-19). IEEE Access 2021, 9, 30551–30572. [Google Scholar] [CrossRef] [PubMed]
  34. Skandha, S.S.; Gupta, S.K.; Saba, L.; Koppula, V.K.; Johri, A.M.; Khanna, N.N.; Mavrogeni, S.; Laird, J.R.; Pareek, G.; Miner, M.; et al. 3-D optimized classification and characterization artificial intelligence paradigm for cardiovascular/stroke risk stratification using carotid ultrasound-based delineated plaque: Atheromatic™ 2.0. Comput. Biol. Med. 2020, 125, 103958. [Google Scholar] [CrossRef] [PubMed]
  35. Malkawi, A.; Almarzooq, Z.; Al-Mallah, M.H.; Al’Aref, S.J. Artificial Intelligence-Based Cardiovascular Risk Stratification. In Artificial Intelligence in Cardiothoracic Imaging; Springer: Cham, Switzerland, 2022; pp. 403–419. [Google Scholar]
  36. Suri, J.S.; Paul, S.; Maindarkar, M.A.; Puvvula, A.; Saxena, S.; Saba, L.; Turk, M.; Laird, J.R.; Khanna, N.N.; Viskovic, K.; et al. Cardiovascular/Stroke Risk Stratification in Parkinson’s Disease Patients Using Atherosclerosis Pathway and Artificial Intelligence Paradigm: A Systematic Review. Metabolites 2022, 12, 312. [Google Scholar] [CrossRef] [PubMed]
  37. Willan, J.; Katz, H.; Keeling, D. The use of artificial neural network analysis can improve the risk-stratification of patients presenting with suspected deep vein thrombosis. Br. J. Haematol. 2019, 185, 289–296. [Google Scholar] [CrossRef] [PubMed]
  38. Zhu, J.S.; Ge, P.; Jiang, C.; Zhang, Y.; Li, X.; Zhao, Z.; Zhang, L.; Duong, T.Q. Deep-learning artificial intelligence analysis of clinical variables predicts mortality in COVID-19 patients. J. Am. Coll. Emerg. Physicians Open 2020, 1, 1364–1373. [Google Scholar] [CrossRef]
  39. Thomas, J.; Haertling, T. AIBx, artificial intelligence model to risk stratify thyroid nodules. Thyroid 2020, 30, 878–884. [Google Scholar] [CrossRef]
  40. Guan, Y.; Wang, P.; Wang, Q.; Li, P.; Zeng, J.; Qin, P.; Meng, Y. Separability of acute cerebral infarction lesions in CT based radiomics: Toward artificial intelligence-assisted diagnosis. BioMed Res. Int. 2020, 2020, 8864756. [Google Scholar] [CrossRef]
  41. Handa, T.; Tanizawa, K.; Oguma, T.; Uozumi, R.; Watanabe, K.; Tanabe, N.; Niwamoto, T.; Shima, H.; Mori, R.; Nobashi, T.W.; et al. Novel artificial intelligence-based technology for chest computed tomography analysis of idiopathic pulmonary fibrosis. Ann. Am. Thorac. Soc. 2022, 19, 399–406. [Google Scholar] [CrossRef]
  42. Acharya, U.R.; Oh, S.L.; Hagiwara, Y.; Tan, J.H.; Adam, M.; Gertych, A.; San Tan, R. A deep convolutional neural network model to classify heartbeats. Comput. Biol. Med. 2017, 89, 389–396. [Google Scholar] [CrossRef] [PubMed]
  43. Arsalan, M.; Owais, M.; Mahmood, T.; Choi, J.; Park, K.R. Artificial intelligence-based diagnosis of cardiac and related diseases. J. Clin. Med. 2020, 9, 871. [Google Scholar] [CrossRef] [PubMed]
  44. Dunn, A.J.; ElRefai, M.H.; Roberts, P.R.; Coniglio, S.; Wiles, B.M.; Zemkoho, A.B. Deep learning methods for screening patients’ S-ICD implantation eligibility. Artif. Intell. Med. 2021, 119, 102139. [Google Scholar] [CrossRef] [PubMed]
  45. Ardakani, A.A.; Kanafi, A.R.; Acharya, U.R.; Khadem, N.; Mohammadi, A. Application of deep learning technique to manage COVID-19 in routine clinical practice using CT images: Results of 10 convolutional neural networks. Comput. Biol. Med. 2020, 121, 103795. [Google Scholar] [CrossRef] [PubMed]
  46. Singh, D.; Kumar, V.; Kaur, M. Classification of COVID-19 patients from chest CT images using multi-objective differential evolution–based convolutional neural networks. Eur. J. Clin. Microbiol. Infect. Dis. 2020, 39, 1379–1389. [Google Scholar] [CrossRef]
  47. Wang, S.H.; Govindaraj, V.V.; Górriz, J.M.; Zhang, X.; Zhang, Y.D. COVID-19 classification by FGCNet with deep feature fusion from graph convolutional network and convolutional neural network. Inf. Fusion 2021, 67, 208–229. [Google Scholar] [CrossRef]
  48. Yan, T.; Wong, P.K.; Ren, H.; Wang, H.; Wang, J.; Li, Y. Automatic distinction between COVID-19 and common pneumonia using multi-scale convolutional neural network on chest CT scans. Chaos Solitons Fractals 2020, 140, 110153. [Google Scholar] [CrossRef]
  49. Sharifrazi, D.; Alizadehsani, R.; Roshanzamir, M.; Joloudari, J.H.; Shoeibi, A.; Jafari, M.; Hussain, S.; Sani, Z.A.; Hasanzadeh, F.; Khozeimeh, F.; et al. Fusion of convolution neural network, support vector machine and Sobel filter for accurate detection of COVID-19 patients using X-ray images. Biomed. Signal Process. Control 2021, 68, 102622. [Google Scholar] [CrossRef] [PubMed]
  50. Pham, T.D. A comprehensive study on classification of COVID-19 on computed tomography with pretrained convolutional neural networks. Sci. Rep. 2020, 10, 16942. [Google Scholar] [CrossRef] [PubMed]
  51. Gunraj, H.; Wang, L.; Wong, A. Covidnet-ct: A tailored deep convolutional neural network design for detection of covid-19 cases from chest ct images. Front. Med. 2020, 7, 608525. [Google Scholar] [CrossRef] [PubMed]
  52. Mandelbrot, B.B. The Fractal Geometry of Nature; Freeman: San Francisco, CA, USA, 1982. [Google Scholar]
  53. Lapidus, M.L. Fractal drum, inverse spectral problems for elliptic operators and a partial resolution of the Weyl–Berry conjeture. Trans. Am. Math. Soc. 1991, 325, 465–529. [Google Scholar] [CrossRef]
  54. Wei, D.; Wei, B.; Hu, Y.; Zhang, H.; Deng, Y. A new information dimension of complex networks. Phys. Lett. A 2014, 378, 1091–1094. [Google Scholar] [CrossRef]
  55. Beck, C. Generalized information and entropy measures in physics. Contemp. Phys. 2009, 50, 495–510. [Google Scholar] [CrossRef]
  56. Namazi, H.; Daneshi, A.; Shirzadian, T.; Azarnoush, H.; Jafari, S. Information-Based Analysis of the Relation Between Visual Stimuli and Human Eye Movements. Fluct. Noise Lett. 2019, 18, 1950010. [Google Scholar] [CrossRef]
  57. Borodich, F.M.; Volovikov, A.Y. Surface integrals for domains with fractal boundaries and some applications to elasticity. Proc. R. Soc. Lond. A Math. Phys. Eng. Sci. 2000, 456, 1–24. [Google Scholar] [CrossRef]
  58. Ramirez-Arellano, A.; Bermúdez-Gómez, S.; Hernández-Simón, L.M.; Bory-Reyes, J. D-summable fractal dimensions of complex networks. Chaos Solitons Fractals 2019, 119, 210–214. [Google Scholar] [CrossRef]
  59. Rosenberg, E. Maximal entropy coverings and the information dimension of a complex network. Phys. Lett. A 2017, 381, 574–580. [Google Scholar] [CrossRef]
  60. Zhang, K.; Liu, X.; Shen, J.; Li, Z.; Sang, Y.; Wu, X.; Zha, Y.; Liang, W.; Wang, C.; Wang, K.; et al. Clinically applicable AI system for accurate diagnosis, quantitative measurements, and prognosis of COVID-19 pneumonia using computed tomography. Cell 2020, 181, 1423–1433. [Google Scholar] [CrossRef]
  61. Radiopaedia. 1999. Available online: https://radiopaedia.org/ (accessed on 12 May 2021).
  62. Wei, P.F. Diagnosis and treatment protocol for novel coronavirus pneumonia (trial version 7). Chin. Med. J. 2020, 133, 1087–1095. [Google Scholar]
  63. Prokop, M.; Van Everdingen, W.; van Rees Vellinga, T.; Quarles van Ufford, H.; Stöger, L.; Beenen, L.; Geurts, B.; Gietema, H.; Krdzalic, J.; Schaefer-Prokop, C.; et al. CO-RADS: A categorical CT assessment scheme for patients suspected of having COVID-19—Definition and evaluation. Radiology 2020, 296, E97–E104. [Google Scholar] [CrossRef]
  64. Akaike, H. A new look at the statistical model identification. IEEE Trans. Autom. Control 1974, 19, 716–723. [Google Scholar] [CrossRef]
  65. Seber, G.; Wild, C. Nonlinear Regression; Wiley Series in Probability and Statistics; Wiley: Hoboken, NJ, USA, 2003. [Google Scholar]
  66. Ennos, A. Statistical and Data Handling Skills in Biology; Pearson/Prentice Hall: Upper Saddle River, NJ, USA, 2007. [Google Scholar]
  67. Burnham, K.P.; Anderson, D.R. Multimodel inference: Understanding AIC and BIC in model selection. Sociol. Methods Res. 2004, 33, 261–304. [Google Scholar] [CrossRef]
  68. Burnham, K.; Selection, A.M.; Inference, M. A Practical Information-Theoretic Approach; Springer: New York, NY, USA, 2010. [Google Scholar]
Figure 1. The covering of the CT by cubes of size (a) s and (b) s / 2 .
Figure 1. The covering of the CT by cubes of size (a) s and (b) s / 2 .
Entropy 24 01119 g001
Figure 2. Computation of the probabilities of each box of size ε = s / 2 .
Figure 2. Computation of the probabilities of each box of size ε = s / 2 .
Entropy 24 01119 g002
Figure 3. The geometrical interpretation of the lung damage measure.
Figure 3. The geometrical interpretation of the lung damage measure.
Entropy 24 01119 g003
Figure 4. The steps to compute the LDM.
Figure 4. The steps to compute the LDM.
Entropy 24 01119 g004
Figure 5. Slice lungs of healthy (a), COVID-19 (b,c), and pneumonia (d,e).
Figure 5. Slice lungs of healthy (a), COVID-19 (b,c), and pneumonia (d,e).
Entropy 24 01119 g005
Figure 6. The LDM for clinical classification score. * Means that LDM of mild and severe were statistically different.
Figure 6. The LDM for clinical classification score. * Means that LDM of mild and severe were statistically different.
Entropy 24 01119 g006
Figure 7. The LDM for CO-RADS score. * Means that LDM of levels two and five were statistically different.
Figure 7. The LDM for CO-RADS score. * Means that LDM of levels two and five were statistically different.
Entropy 24 01119 g007
Table 1. Chest tomography features. Results are expressed as mean ( μ ) and standard deviation ( σ ).
Table 1. Chest tomography features. Results are expressed as mean ( μ ) and standard deviation ( σ ).
DiseaseCT NumberSlice NumberLDM
Healthy lungs48690.300 (8.703)0.779 (0.031)
COVID-1926365.027 (16.084)0.814 (0.042)
Common pneumonia32986.611 (14.262)0.852 (0.045)
Table 2. The A I C and Δ A I C from information model (I) and d-summable information model ( d I ). Results are expressed as mean ( μ ) and standard deviation ( σ ).
Table 2. The A I C and Δ A I C from information model (I) and d-summable information model ( d I ). Results are expressed as mean ( μ ) and standard deviation ( σ ).
Disease AIC I AIC dI Δ AIC I Δ AIC dI d I d dI ν
Healthy lungs−24.182 (3.255)−42.927 (1.760)15.14 (2.782)0 (0)1.016 (0.164)1.007 (0.165)1.019 (0.004)
COVID-19−23.085 (2.53)−42.273 (3.1384)15.58 (2.601)0 (0)0.838 (0.211)0.826 (0.213)1.027 (0.009)
Common pneumonia−30.146 (9.990)−46.358 (6.035)12.986 (5.601)0.08 (0.352)0.637 (0.231)0.628 (0.230)1.024 (0.001)
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Ortiz-Vilchis, P.; Ramirez-Arellano, A. An Entropy-Based Measure of Complexity: An Application in Lung-Damage. Entropy 2022, 24, 1119. https://doi.org/10.3390/e24081119

AMA Style

Ortiz-Vilchis P, Ramirez-Arellano A. An Entropy-Based Measure of Complexity: An Application in Lung-Damage. Entropy. 2022; 24(8):1119. https://doi.org/10.3390/e24081119

Chicago/Turabian Style

Ortiz-Vilchis, Pilar, and Aldo Ramirez-Arellano. 2022. "An Entropy-Based Measure of Complexity: An Application in Lung-Damage" Entropy 24, no. 8: 1119. https://doi.org/10.3390/e24081119

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop