Next Article in Journal
A Machine Learning Force Field for Bio-Macromolecular Modeling Based on Quantum Chemistry-Calculated Interaction Energy Datasets
Next Article in Special Issue
Deep Learning Method for Precise Landmark Identification and Structural Assessment of Whole-Spine Radiographs
Previous Article in Journal
Blood Urea Nitrogen-to-Albumin Ratio May Predict Mortality in Patients with Traumatic Brain Injury from the MIMIC Database: A Retrospective Study
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Automatic Osteoporosis Screening System Using Radiomics and Deep Learning from Low-Dose Chest CT Images

Department of Radiology, First Affiliated Hospital of Dalian Medical University, Dalian 116014, China
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Bioengineering 2024, 11(1), 50; https://doi.org/10.3390/bioengineering11010050
Submission received: 28 November 2023 / Revised: 21 December 2023 / Accepted: 29 December 2023 / Published: 2 January 2024
(This article belongs to the Special Issue Artificial Intelligence and Machine Learning in Spine Research)

Abstract

:
Objective: Develop two fully automatic osteoporosis screening systems using deep learning (DL) and radiomics (Rad) techniques based on low-dose chest CT (LDCT) images and evaluate their diagnostic effectiveness. Methods: In total, 434 patients who underwent LDCT and bone mineral density (BMD) examination were retrospectively enrolled and divided into the development set (n = 333) and temporal validation set (n = 101). An automatic thoracic vertebra cancellous bone (TVCB) segmentation model was developed. The Dice similarity coefficient (DSC) was used to evaluate the segmentation performance. Furthermore, the three-class Rad and DL models were developed to distinguish osteoporosis, osteopenia, and normal bone mass. The diagnostic performance of these models was evaluated using the receiver operating characteristic (ROC) curve and decision curve analysis (DCA). Results: The automatic segmentation model achieved excellent segmentation performance, with a mean DSC of 0.96 ± 0.02 in the temporal validation set. The Rad model was used to identify osteoporosis, osteopenia, and normal BMD in the temporal validation set, with respective area under the receiver operating characteristic curve (AUC) values of 0.943, 0.801, and 0.932. The DL model achieved higher AUC values of 0.983, 0.906, and 0.969 for the same categories in the same validation set. The Delong test affirmed that both models performed similarly in BMD assessment. However, the accuracy of the DL model is 81.2%, which is better than the 73.3% accuracy of the Rad model in the temporal validation set. Additionally, DCA indicated that the DL model provided a greater net benefit compared to the Rad model across the majority of the reasonable threshold probabilities Conclusions: The automated segmentation framework we developed can accurately segment cancellous bone on low-dose chest CT images. These predictive models, which are based on deep learning and radiomics, provided comparable diagnostic performance in automatic BMD assessment. Nevertheless, it is important to highlight that the DL model demonstrates higher accuracy and precision than the Rad model.

1. Introduction

Osteoporosis, a commonly occurring musculoskeletal disease, is characterized by a decrease in bone mineral density (BMD) and damage to the microstructure of bone tissue, leading to heightened bone fragility and an increased risk of fractures [1]. Often termed a “silent disease”, osteoporosis typically exhibits no discernible signs or symptoms until fractures manifest [2]. Notably, osteoporosis-related fractures are the primary cause of morbidity and mortality in the elderly. It is estimated that globally, approximately 9 million new cases of osteoporosis-related fractures occur annually, leading to a substantial burden on public health systems [3,4]. Given these circumstances, it is imperative to prioritize early warning and screening for osteoporosis.
Radiomics (Rad), a quantitative technique that utilizes high-throughput radiomics features, has provided substantial evidence in assessing diseases. Specifically, it has been shown that radiomics can effectively extract BMD information from thoracic vertebrae within chest CT images, enabling the provision of quantitative heterogeneity measures [5]. This approach holds promise for opportunistic and preventive osteoporosis screening, as it eliminates the need for additional costs and radiation exposure. In addition, there is growing concern regarding the radiation risks associated with CT scans, given the increasing utilization of CT imaging and the public’s heightened awareness of radiation protection [6,7]. Low-dose chest CT (LDCT), particularly with a tube voltage of 80 kVp, has been widely applied in clinical practice for lung cancer screening among the high-risk population, as well as routine physical examination [8,9]. However, it is worth noting that modifying the tube voltage setting can potentially impact the stability of the radiomics model [10,11,12]. To the best of our knowledge, the Rad model of BMD assessment based on 80 kVp images has not been well established.
Recently, the field of artificial intelligence has witnessed a surge of interest in deep learning (DL) techniques. DL utilizes deep convolutional neural networks (CNN) to automatically extract high-dimensional features from CT images, enabling end-to-end learning without requiring manual feature extraction [13,14]. DL has exhibited remarkable performance in image analysis and has proven advantages in differentiating between benign and malignant vertebral compression fractures [15]. Although both Rad and DL methods have demonstrated promising diagnostic capabilities in relevant aspects, there exists a dearth of studies comparing their performance in BMD assessment based on chest LDCT images, especially 80 kVp CT images. Can the novel deep learning network surpass traditional radiomics models in accurately diagnosing bone density?
It is worth noting that both Rad and DL methods require manual delineation of the region of interest, which can be a burdensome workload for radiologists and may introduce observer variability that can impact image analysis. Fortunately, advancements in deep learning architectures have enabled the development of automatic segmentation models that can mitigate these challenges and provide satisfactory segmentation results [16,17]. Therefore, this study had dual objectives. Firstly, we endeavored to train an automatic segmentation model using VB-Net architecture specifically for thoracic vertebra cancellous bone (TVCB). Secondly, we aimed to develop and compare the diagnostic performance of two predictive models—a deep learning-based model (DL model) and a radiomics-based model (Rad model)—for BMD assessment based on low-dose chest CT images acquired at 80 kVp. We hypothesize that the novel DL model may outperform traditional Rad models in accurately assessing bone mineral density.

2. Materials and Methods

This retrospective study received approval from the Ethics Committee, which also waived the requirement for informed patient consent (IRB No. PJ-KS-KY-2023-276).

2.1. Study Population

A total of 687 patients who underwent chest LDCT scans and BMD examination were retrospectively retrieved from the picture archiving and communication system from May 2021 to April 2023. Patients with the following conditions were excluded: (1) the time interval between LDCT and BMD was more than one month (n = 138); (2) the scanning range failed to cover the required thoracic vertebra (n = 9); (3) a history of surgery and metal implants in the lower thoracic vertebrae (n = 36); (4) bone metastasis of malignant tumors (n = 38); (5) abnormal vertebral morphology in the lower thoracic vertebrae, such as compression fracture, severe degenerative changes or deformities (n = 29); and (6) recent use of drugs affecting bone metabolism (n = 3). Eventually, 434 patients were enrolled and divided into a development set (n = 333, examined between May 2021 and June 2022) and a temporal validation set (n = 101, examined between July 2022 and April 2023) according to the examination time. This development set was utilized for training automatic segmentation models as well as BMD assessment models. During the training of the BMD assessment models (Rad and DL model), the development set was randomly partitioned into two subsets for BMD assessment models training and internal evaluation, with 80% allocated for the internal training set and the remaining 20% for the testing set. The temporal validation set was used to evaluate the performance of all models. A detailed enrollment flowchart is shown in Figure 1, and the overall workflow of this study is illustrated in Figure 2. The automatic segmentation framework construction, Rad model, and DL model were developed and validated on the uAI Research Portal V1.1 (United Imaging Intelligence, Co., Ltd. (Shanghai, China)). The design of uAI Research Portal architecture takes a modular and layered approach [18]: (1) The lower level is composed of hardware drivers, such as graphics processing unit (GPU) accelerated using NVIDIA CUDA, and cloud servers, such as Amazon web services (AWS); (2) At the middle level, there is an application programming interface (API), primarily Python and C++, contributing a range of algorithms (e.g., segmentation, classification); (3) the higher level presents build blocks to the end users for domain-specific analysis.

2.2. Image Acquisition and BMD Assessment

All CT images were acquired on a 256-row CT scanner (Revolution CT, GE HealthCare, Milwaukee, WI, USA). The chest LDCT scans were acquired using a low tube voltage of 80 kV, smart mA (noise index: 10, 50–400 mA), rotation speed of 0.5 s/rot, detector width of 80 mm, pitch of 0.992, and scanning slice thickness and slice interval of 5 mm. The scan coverage started from the lung apexes to 2 cm below the diaphragm. All images were reconstructed using the standard kernel, adaptive statistical iterative reconstruction-Veo (ASIR-V) at 40% strength, and reconstruction thickness and interval of 1.25 mm.
BMD examinations were performed using a standardized protocol following the manufacturer’s guidelines for the quantitative computed tomography (QCT) workstation. The details of the QCT scanning protocol can be found in Supplementary S1. Patient abdominal data were transferred to a QCT Pro workstation (version 6.1, Mindways Software, Inc. (Austin, TX, USA)), and BMD measurements were taken at two consecutive vertebral bodies (L1 and L2). Compared to conventional methods, QCT measures volumetric BMD, reflecting BMD in different regions (trabecular and cortical) of the skeleton. This gives QCT an advantage in assessing osteoporosis severity, guiding treatment strategies, and monitoring treatment efficacy. According to clinical guidelines for BMD assessment [19], osteoporosis was defined as a BMD below 80 mg/cm3, osteopenia as a BMD between 80 and 120 mg/cm3, and normal status as a BMD above 120 mg/cm3. For this study, the diagnostic performance was analyzed through the construction of receiver operating characteristic (ROC) curves, employing QCT data as the diagnostic standard. The ROC curve assesses a classification or diagnostic model’s performance by plotting the true positive (sensitivity) and false positive rate (1-specificity) against various thresholds [20]. This provides an overview of the model’s performance in predicting bone status.

2.3. TVCB Auto-Segmentation Framework and VOI Delineation

Budoff et al. suggested that the cancellous bone of the lower thoracic vertebrae (TVCB), specifically T10–12, closely correlates with lumbar vertebrae in providing information about bone mineral density (BMD), making it a viable target for BMD assessment [21]. Therefore, the volume of interest (VOI) of TVCB was manually delineated on the axial images and carefully avoided vertebral venous plexuses and cortical bone. The boundary was placed along the inner edge of the vertebral cortex. In addition, 100 patients were randomly selected to assess the interobserver repeatability in the manual segmentation, and VOI was independently delineated on CT images by two readers (W. Wei and Y. Liu, with 5 and 12 years of experience in musculoskeletal radiology, respectively). The Dice similarity coefficient (DSC) was employed to assess the consistency of inter-observer segmentation. If a satisfactory agreement was achieved, the junior radiologist would complete the remaining cases under the supervision of the senior radiologist.
For the auto-segmentation framework, we trained a cascade model with two VB-Nets based on the coarse-to-fine principle, including a coarse-scale segmentation network for rapidly locating the target area and a fine-scale segmentation network for precisely delineating target and optimization. The detailed architecture of the VB-Net is shown in Supplementary Figure S1. In pre-processing, it was normalized by subtracting the window level (WL: 100) and dividing by the window width (WW: 300). For training the coarse-scale segmentation network, global sampling was used. The images were resampled to 3 × 3 × 3 mm using B-Spline interpolation. In the fine-scale segmentation network, images were resampled to crop high-resolution local images with a resampling voxel size of 1 × 1 × 1 mm, and mask sampling was used. The learning rate was 1 × 10−4, the batch size was 8, the number of epochs was set to 1001, and the optimizer was Adam. We used the focal loss function to monitor the convergence of the training model and optimize the network. The detailed settings of the coarse-scale segmentation network are given in Supplementary S2. DSC and volume difference (VD) were used to evaluate the segmentation performance of the model. The DSC coefficient is a measure of similarity between the segmentation results and the reference criteria. Its calculation method is based on the overlapping area between the segmentation result and the reference standard. The VD was defined as the absolute value of the manually segmented volume minus the automatically segmented volume.

2.4. Radiomics Model Construction

After establishing the auto-segmentation model, the model was used for automatic cancellous bone segmentation in the development and temporal validation sets.

2.4.1. Radiomics Features Extraction

All images were normalized using Z-score and resampled, the voxel spacing to 1 × 1 × 1 mm using B-Spline interpolation, and the image gray level was discretized with 25 binwidth. Z-score normalization is a widely utilized technique for standardizing data to make it comparable across different features. This is accomplished by subtracting the mean from each data point and dividing it by the standard deviation of the feature’s data within the given sample. A total of 90 features in six categories were extracted from the original images, including first-order features and texture features. Details of the extracted radiomics features are provided in Supplementary Table S1.

2.4.2. Features Selection and Model Construction

The development set was randomly divided into the internal training and testing sets at a ratio of 8:2. The Z-score normalization was conducted to pre-process the features and ensure the comparability between the data before the feature selection and Rad model construction. A step-wise feature selection strategy was used to determine the optimal features (Supplementary S3).
Finally, random forest was performed to establish a three-classification model to distinguish osteoporosis, osteopenia, and normal BMD. Random forest is a widely used ensemble technique in radiomics classification tasks. It is based on a collection of decision trees, forming a “forest”, and incorporates random feature selection and bootstrap sampling during training and prediction. The ROC curve was conducted to evaluate the efficacy of the Rad model in diagnosing osteoporosis, osteopenia, and normal BMD. The area under the receiver operating characteristic curve (AUC), sensitivity, specificity, precision, and accuracy were calculated to evaluate the performance of training, internal test, and temporal validation set.

2.5. Deep Learning Network Construction

The DL model was trained using the residual network (Res-Net), which integrates residual learning to prevent gradient dispersion and precision loss in deep networks, achieving enhanced accuracy as the network depth increases [22]. The Res-Net is composed of four simple residual blocks, which enable the network to learn more efficiently and effectively; each residual block consists of two convolutional layers followed by a skip connection, which can effectively learn both low-level and high-level features simultaneously. During the training process, all images were resampled with voxel spacing of 1 × 1 × 1 mm and normalized by min-max normalization. Figure 3 shows the detailed architecture of the Res-Net. The batch size was set to 8, and the IO threads were set to 4. The focal loss function and Adam optimizer were used to monitor the convergence of the model with an initial learning rate of 1 × 10−4, and the “step” learning rate strategy was applied to accelerate convergence. The diagnostic performance of the deep learning classification model was evaluated on the internal test and temporal validation sets using ROC analysis.

2.6. Statistical Analysis

SPSS version 24.0 (IBM Corp., Armonk, NY, USA) and MedCalc version 20.022 (MedCalc Ltd., Ostend, Belgium) were used for statistical analysis. The data were tested for normality using the Kolmogorov–Smirnov test, and continuous variables were expressed as mean ± standard deviation or medians (25–75th percentile). The chi-square test was used for gender and bone status distribution in development and temporal validation sets. An independent sample t-test was used to test the age difference between the development and the temporal validation sets. The DeLong test was used to assess the difference in diagnostic performance between the Rad model and the DL model. The clinical application value of the Rad model and the DL model was evaluated in the temporal validation set by constructing decision curve analysis (DCA).

3. Results

3.1. Participant Demographics

A total of 434 patients were enrolled in the study, including 333 patients in the development set (mean age: 62.89 ± 11.55 years) and 101 patients in the temporal validation set (mean age: 60.76 ± 10.41 years). In both sets, there were no significant differences in the distributions of age, gender, and BMD distribution. The detailed demographic characteristics are shown in Table 1.

3.2. Automatic Segmentation Model

The cancellous bone segmentation was in good agreement between the two observers, with a mean DSC of 0.96 ± 0.02. The automatic segmentation model demonstrated excellent performance with a mean DSC of 0.96 ± 0.02 in the temporal validation set. The detailed distribution of DSC is shown in Figure 4. The VD did not exceed 1 cm3 with a mean of 0.50 (0.17, 0.69). The segmentation performance of TVCB for different BMD populations is illustrated in Table 2.

3.3. The Comparison of the Rad Model and DL Model

In the Rad model, 6 radiomics features were selected, including 1 first-order feature and 5 texture features (Supplementary Table S2). The AUCs in predicting osteoporosis, osteopenia, and normal BMD were 0.919, 0.873, and 0.976, respectively, in the internal test set. In the temporal validation set, the AUCs were 0.943, 0.801, and 0.932, respectively.
As for the DL model, the AUCs in predicting osteoporosis, osteopenia, and normal BMD were 0.942, 0.866, and 0.972, respectively, in the internal test set. In the temporal validation set, the AUCs were 0.983, 0.906, and 0.969, respectively.
The two models achieved similar performance in distinguishing osteoporosis, osteopenia, and normal BMD for the temporal validation set, with no significant difference demonstrated by the DeLong test. The results of more detailed metrics are summarized in Table 3, and the ROC curves are shown in Figure 5 and Figure 6. DCA showed that the DL model had a higher net benefit than the Rad model across the majority of the range of reasonable threshold probabilities in the temporal validation set, indicating that the DL model has good clinical utility (Figure 7).
Furthermore, we compared the performance of the proposed method with several benchmark methods. The comparison reveals that our DL model demonstrates superior performance in detecting osteoporosis, osteopenia, and normal BMD (Table 4).

4. Discussion

In this study, we developed an automatic TVCB segmentation model using the VB-Net network architecture and a coarse-to-fine cascade training strategy based on 80 kVp chest LDCT images. The model achieved segmentation accuracy comparable to that of manual depiction, with mean DSC surpassing 0.90. In addition, we compared the classification performance between the Rad and DL models for BMD assessment. The AUCs of the Rad and DL models were 0.943 and 0.983 for predicting osteoporosis, 0.801 and 0.906 for predicting osteopenia, and 0.932 and 0.969 for predicting normal BMD in the validation set, respectively. The Delong test showed that for diagnostic performance, there was no statistically significant difference between the Rad and DL models. However, the DL model demonstrated superior sensitivity, specificity, precision, and overall accuracy in evaluating various performance metrics compared to the traditional Rad model. In addition, the end-to-end learning strategy employed in the DL model eliminated intermediate steps such as Rad model data pre-processing, feature extraction, and classifier selection, which reduces human intervention and improves the efficiency of model construction and the objectivity of the results.
LDCT is primarily accomplished by reducing the tube current or tube voltage. As the radiation dose is directly proportional to the square of the tube voltage, reducing the tube voltage can effectively decrease the radiation dose [26]. This is particularly advantageous for the Asian population, which typically has smaller body sizes. Lower tube voltage scans do not significantly compromise diagnostic confidence but provide more cost-effective and radiation-dose-efficient imaging for patients [27].
To the best of our knowledge, no attempt has been made to establish automatic segmentation of TVCB on LDCT using 80 kVp. Previous segmentation models have been constructed using 120 kVp images in a complex or error-prone manner. Chen et al. initially used CNN networks to identify the entire thoracic vertebrae and subsequently applied an erosion algorithm to remove the bone cortex [24]. However, the working process of this method to obtain TVCB was complex. Wang et al. used a fixed-size cylindrical shape to identify TVCB, leading to incomplete segmentation in cancellous bone and introducing bias in the BMD assessment [28]. In our study, we employed the VB-Net to construct an automatic segmentation model for TVCB. The VB-Net is a modified version of CNN that incorporates a bottleneck structure in place of convolutional, normalization, and activation layers. This modification not only reduces the number of model parameters but also improves inference efficiency and robustness [28]. The VB-Net has been demonstrated to produce satisfactory segmentation results, with established applications in cervical and lung cancer segmentation [29,30]. Additionally, the uneven distribution of BMD in the thoracic vertebrae can reduce the sensitivity of osteoporosis assessment if the entire vertebrae are segmented. However, some researchers found that utilizing the lower thoracic vertebrae (T10–12) for BMD assessment yields high levels of accuracy and repeatability [21]. Therefore, we used a cascade approach utilizing VB-Net in this work. The 10-12th vertebrae were initially identified at a “coarse” resolution to achieve accurate spatial localization, followed by the detailed delineation of bony cortex and cancellous bone at a “fine” resolution. It is worthwhile to emphasize the advantages of our method, as it efficiently and accurately identifies the TVCB in chest LDCT images. Our method achieved DSC results exceeding 0.90 in the temporal validation set.
Radiomics encompasses the extraction of high-dimensional tissue data from medical images, which can be further integrated with machine learning techniques to establish radiomics signatures. The radiomics features extracted from TVCB can reflect the transformation of bone microstructure and accurately assess BMD [31]. Notably, Chen et al. pointed out that the performance of radiomics in assessing BMD significantly decreased in the external validation set, with a 20% lower accuracy compared to the internal validation set [24]. This phenomenon occurs because the stability of radiomics features depends on image acquisition parameters. Altering factors such as tube voltage or slice thickness can indeed impact the effectiveness of existing radiomics models [32]. Therefore, we deem it imperative to establish a novel Rad model in 80 kVp chest CT images for BMD assessment. To ensure the stability of the feature selection process and the generalization ability of the Rad model, we employed a step-wise feature selection strategy to select 6 highly effective features. Encouragingly, these 6 features have been closely related to bone quantity, microstructure, and loss in relevant studies [23,25]. Our Rad model could provide valuable information in BMD assessment and demonstrate comparable or superior performance compared to recent research results.
Deep learning has emerged as a highly promising approach for achieving accurate diagnostic outcomes in medical imaging. Recent advancements in artificial intelligence have been crucial in driving this progression. Mehdi et al. developed a DL model that was capable of distinguishing tumor invasiveness, achieving accuracy comparable to pathology results [33]. Li et al. developed a DL model based on CT images using Res-Net, achieving faster convergence and high accuracy in diagnosing vertebral fractures [34]. Kitamura et al. [35] discovered that Res-Net convolutional neural networks demonstrated strong performance in ankle fracture detection with small sample sizes. Therefore, we selected Res-Net to build a three-classification BMD assessment model. The core concept of Res-Net is to learn residuals, which involves the network learning the difference between inputs and outputs. To tackle the challenges of vanishing and exploding gradients in training deep neural networks, Res-Net introduces “residual blocks” [34]. These blocks enable the network to efficiently capture the disparity between input and output through shortcut connections, resulting in faster convergence and improved accuracy [36]. With this innovative network architecture, Res-Net empowers models to train deeper neural networks, effectively addressing complex visual tasks like image classification, object detection, and semantic segmentation.
In our study, the DL model utilized automatic segmentation of TVCB as an input, eliminating the need for time-consuming, manually segmented regions of interest. Furthermore, the DL model enabled the extraction and analysis of high-level semantic features in an end-to-end manner, facilitating the automatic learning of pertinent and robust features without human intervention. Consequently, the overall approach mitigated human bias arising from artificial features. Our DL model yielded satisfactory outcomes in BMD assessment.
Previous studies have compared the performance of Rad and DL models across various tasks. Mehdi et al. [33] discovered that the Rad model outperformed the DL model in predicting malignancy of pulmonary nodules from chest LDCT images. Li et al. [37] observed that their DL model outperformed the Rad model in classifying molecular subtypes of diffuse gliomas. In our study, we developed Rad and DL models based on relatively large samples. To the best of our knowledge, this is the first study to investigate and compare the performance of DL networks against traditional Rad models in assessing BMD. The main findings of our study demonstrate that the novel DL model outperformed the traditional Rad model in the precise assessment of BMD. The DL model exhibited enhanced sensitivity, specificity, precision, and overall accuracy across various performance metrics relative to the traditional Rad model. Zhou et al. [37] obtained similar results when distinguishing between benign and malignant breast lesions using Rad and DL models. In the Rad model, it is necessary to determine the most suitable features for the BMD assessment task in advance. In contrast, the DL model does not require predefined features and can automatically determine the nuanced features of the target task with almost no human intervention, ensuring objectivity and efficient classification performance. Consequently, our results indicate that deep learning has the potential to serve as a diagnostic tool for BMD assessment in clinical practice. The improved performance of the DL model can provide enhanced diagnostic accuracy, thus leading to better clinical decision-making and improving patient outcomes. By accurately predicting BMD status, clinicians can identify individuals at high risk of fractures and tailor intervention strategies accordingly. This approach can lead to early interventions that prevent or mitigate the progression of bone diseases, ultimately improving patient outcomes and reducing healthcare costs. Furthermore, the successful application of DL networks in assessing BMD highlights the potential for similar approaches in other medical domains.
This study has some limitations. Firstly, our proposed Rad and DL models were developed using chest LDCT images acquired from a single center, which may restrict their applicability of the models to the LDCT in other institutions. Additionally, while residual networks have shown significant success in enhancing performance, the architecture can also suffer from black-box effects stemming from the complexity caused by convolutional layers and non-linear activation functions. Finally, the selection of the random forest classifier, although informed by a comprehensive literature review, was not accompanied by comparative analysis against other potential classifiers in our study, which leaves room for exploration regarding optimal classification strategies.

5. Conclusions

In conclusion, we developed and evaluated a model for automatic TVCB segmentation using 80 kVp chest LDCT images, which laid the foundation for future fully automated BMD assessment programs. In addition, we developed deep learning-based and radiomics-based predictive models, which provided similar excellent diagnostic performance in BMD assessment. Nevertheless, it is important to highlight that the deep learning model demonstrates higher accuracy and precision compared to the radiomics model. Future research should investigate whether variations in CT scan parameters would affect the performance of DL models in assessing bone mineral density.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/bioengineering11010050/s1, Supplementary S1: The BMD scanning protocol and measurement; Supplementary S2: The detailed settings of the coarse-scale segmentation network; Supplementary S3: Radiomic features extraction methods; Figure S1: VB-Net architecture. VB-Net is a variant segmentation network structure of V-Net that utilizes a bottleneck structure (B stands for bottleneck) instead of the convolution, normalization, and activation layers within the Down Block and Up block. A bottleneck structure in a neural network has fewer neurons than its adjacent layers, which helps compress feature representations to fit in the available vector space. The bottleneck structure consists of three convolutional layers. The first and third convolutional layers use the unit convolution kernel and match the dimensions of the preceding and succeeding layers, respectively. The second convolution layer performs spatial convolution on the feature image that has been reduced in dimension by the first convolution layer. This reduction in dimensionality helps reduce the number of model parameters, leading to increased efficiency; Table S1: Radiomics features extracted from original images; Table S2: Selected features for constructing radiomics model.

Author Contributions

Conceptualization, X.T., S.W. and W.W.; methodology, X.T. and S.W.; software, S.W. and J.Z.; validation, X.T. and Y.F.; investigation, X.T. and S.W.; resources, W.W. and Y.L.; data curation, Y.L.; writing—original draft preparation, X.T. and S.W.; writing—review and editing, J.Z.; visualization, Y.F.; supervision, W.W.; project administration, Y.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the Institutional Review Board (or Ethics Committee) of First Affiliated Hospital of Dalian Medical University (protocol code PJ-KS-KY-2023-276. Approval date 12 June 2023).

Informed Consent Statement

Patient consent was waived due to the retrospective nature of the study.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors without undue reservation.

Acknowledgments

We express our sincere appreciation to Jingjing Cui and Jianying Li for their invaluable contributions in proofreading the manuscript and offering insightful suggestions.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Gruenewald, L.D.; Koch, V.; Martin, S.S.; Yel, I.; Eichler, K.; Gruber-Rouh, T.; Lenga, L.; Wichmann, J.L.; Alizadeh, L.S.; Albrecht, M.H.; et al. Diagnostic accuracy of quantitative dual-energy CT-based volumetric bone mineral density assessment for the prediction of osteoporosis-associated fractures. Eur. Radiol. 2022, 32, 3076–3084. [Google Scholar] [CrossRef]
  2. Chang, Q.; Huang, J.; He, L.; Xi, F. Simple immunosensor for ultrasensitive electrochemical determination of biomarker of the bone metabolism in human serum. Front. Chem. 2022, 10, 940795. [Google Scholar] [CrossRef] [PubMed]
  3. Del Real, Á.; Valero, C.; Olmos, J.M.; Hernández, J.L.; Riancho, J.A. Pharmacogenetics of Osteoporosis: A Pathway Analysis of the Genetic Influence on the Effects of Antiresorptive Drugs. Pharmaceutics 2022, 14, 776. [Google Scholar] [CrossRef] [PubMed]
  4. Si, L.; Winzenberg, T.M.; Jiang, Q.; Chen, M.; Palmer, A.J. Projection of osteoporosis-related fractures and costs in China: 2010–2050. Osteoporos. Int. 2015, 26, 1929–1937. [Google Scholar] [CrossRef] [PubMed]
  5. Yang, J.; Liao, M.; Wang, Y.; Chen, L.; He, L.; Ji, Y.; Xiao, Y.; Lu, Y.; Fan, W.; Nie, Z.; et al. Opportunistic osteoporosis screening using chest CT with artificial intelligence. Osteoporos. Int. 2022, 33, 2547–2561. [Google Scholar] [CrossRef]
  6. Yoon, H.J.; Chung, M.J.; Hwang, H.S.; Moon, J.W.; Lee, K.S. Adaptive Statistical Iterative Reconstruction-Applied Ultra-Low-Dose CT with Radiography-Comparable Radiation Dose: Usefulness for Lung Nodule Detection. Korean J. Radiol. 2015, 16, 1132–1141. [Google Scholar] [CrossRef]
  7. Xiao, M.; Zhang, M.; Lei, M.; Lin, F.; Chen, Y.; Chen, J.; Liu, J.; Ye, J. Diagnostic accuracy of ultra-low-dose CT compared to standard-dose CT for identification of non-displaced fractures of the shoulder, knee, ankle, and wrist. Insights Into Imaging 2023, 14, 40. [Google Scholar] [CrossRef]
  8. Wood, D.E.; Kazerooni, E.A.; Baum, S.L.; Eapen, G.A.; Ettinger, D.S.; Hou, L.; Jackman, D.M.; Klippenstein, D.; Kumar, R.; Lackner, R.P.; et al. Lung Cancer Screening, Version 3.2018, NCCN Clinical Practice Guidelines in Oncology. J. Natl. Compr. Cancer Netw. JNCCN 2018, 16, 412–441. [Google Scholar] [CrossRef]
  9. Aberle, D.R.; Adams, A.M.; Berg, C.D.; Black, W.C.; Clapp, J.D.; Fagerstrom, R.M.; Gareen, I.F.; Gatsonis, C.; Marcus, P.M.; Sicks, J.D. Reduced lung-cancer mortality with low-dose computed tomographic screening. N. Engl. J. Med. 2011, 365, 395–409. [Google Scholar] [CrossRef]
  10. Jin, S.; Zhang, B.; Zhang, L.; Li, S.; Li, S.; Li, P. Lung nodules assessment in ultra-low-dose CT with iterative reconstruction compared to conventional dose CT. Quant. Imaging Med. Surg. 2018, 8, 480–490. [Google Scholar] [CrossRef]
  11. Sun, J.; Zhang, Q.; Hu, D.; Shen, Y.; Yang, H.; Chen, C.; Zhou, Z.; Peng, Y. Feasibility study of using one-tenth mSv radiation dose in young children chest CT with 80 kVp and model-based iterative reconstruction. Sci. Rep. 2019, 9, 12481. [Google Scholar] [CrossRef] [PubMed]
  12. Reiazi, R.; Abbas, E.; Famiyeh, P.; Rezaie, A.; Kwan, J.Y.Y.; Patel, T.; Bratman, S.V.; Tadic, T.; Liu, F.F.; Haibe-Kains, B. The impact of the variation of imaging parameters on the robustness of Computed Tomography radiomic features: A review. Comput. Biol. Med. 2021, 133, 104400. [Google Scholar] [CrossRef] [PubMed]
  13. Gu, B.; Meng, M.; Bi, L.; Kim, J.; Feng, D.D.; Song, S. Prediction of 5-year progression-free survival in advanced nasopharyngeal carcinoma with pretreatment PET/CT using multi-modality deep learning-based radiomics. Front. Oncol. 2022, 12, 899351. [Google Scholar] [CrossRef] [PubMed]
  14. Guo, Y.; Gao, Y.; Shen, D. Deformable MR Prostate Segmentation via Deep Feature Learning and Sparse Patch Matching. IEEE Trans. Med. Imaging 2016, 35, 1077–1089. [Google Scholar] [CrossRef] [PubMed]
  15. Duan, S.; Hua, Y.; Cao, G.; Hu, J.; Cui, W.; Zhang, D.; Xu, S.; Rong, T.; Liu, B. Differential diagnosis of benign and malignant vertebral compression fractures: Comparison and correlation of radiomics and deep learning frameworks based on spinal CT and clinical characteristics. Eur. J. Radiol. 2023, 165, 110899. [Google Scholar] [CrossRef] [PubMed]
  16. Wu, K.; Gu, D.; Qi, P.; Cao, X.; Wu, D.; Chen, L.; Qu, G.; Wang, J.; Pan, X.; Wang, X.; et al. Evaluation of an automated intracranial aneurysm detection and rupture analysis approach using cascade detection and classification networks. Comput. Med. Imaging Graph. 2022, 102, 102126. [Google Scholar] [CrossRef]
  17. Lin, M.; Lin, N.; Yu, S.; Sha, Y.; Zeng, Y.; Liu, A.; Niu, Y. Automated Prediction of Early Recurrence in Advanced Sinonasal Squamous Cell Carcinoma With Deep Learning and Multi-parametric MRI-based Radiomics Nomogram. Acad. Radiol. 2023, 30, 2201–2211. [Google Scholar] [CrossRef]
  18. Wu, J.; Xia, Y.; Wang, X.; Wei, Y.; Liu, A.; Innanje, A.; Zheng, M.; Chen, L.; Shi, J.; Wang, L.; et al. uRP: An integrated research platform for one-stop analysis of medical images. Front. Radiol. 2023, 3, 1153784. [Google Scholar] [CrossRef]
  19. Engelke, K.; Lang, T.; Khosla, S.; Qin, L.; Zysset, P.; Leslie, W.D.; Shepherd, J.A.; Shousboe, J.T. Clinical Use of Quantitative Computed Tomography-Based Advanced Techniques in the Management of Osteoporosis in Adults: The 2015 ISCD Official Positions-Part III. J. Clin. Densitom. 2015, 18, 393–407. [Google Scholar] [CrossRef]
  20. Quaia, E.; Grisi, G.; Baratella, E.; Cuttin, R.; Poillucci, G.; Kus, S.; Cova, M.A. Diagnostic imaging costs before and after digital tomosynthesis implementation in patient management after detection of suspected thoracic lesions on chest radiography. Insights Into Imaging 2014, 5, 147–155. [Google Scholar] [CrossRef]
  21. Budoff, M.J.; Malpeso, J.M.; Zeb, I.; Gao, Y.L.; Li, D.; Choi, T.Y.; Dailing, C.A.; Mao, S.S. Measurement of phantomless thoracic bone mineral density on coronary artery calcium CT scans acquired with various CT scanner models. Radiology 2013, 267, 830–836. [Google Scholar] [CrossRef] [PubMed]
  22. Ardakani, A.A.; Kanafi, A.R.; Acharya, U.R.; Khadem, N.; Mohammadi, A. Application of deep learning technique to manage COVID-19 in routine clinical practice using CT images: Results of 10 convolutional neural networks. Comput. Biol. Med. 2020, 121, 103795. [Google Scholar] [CrossRef] [PubMed]
  23. Xue, Z.; Huo, J.; Sun, X.; Sun, X.; Ai, S.T.; Zhang, L.; Liu, C. Using radiomic features of lumbar spine CT images to differentiate osteoporosis from normal bone density. BMC Musculoskelet. Disord. 2022, 23, 336. [Google Scholar] [CrossRef] [PubMed]
  24. Chen, Y.C.; Li, Y.T.; Kuo, P.C.; Cheng, S.J.; Chung, Y.H.; Kuo, D.P.; Chen, C.Y. Automatic segmentation and radiomic texture analysis for osteoporosis screening using chest low-dose computed tomography. Eur. Radiol. 2023, 33, 5097–5106. [Google Scholar] [CrossRef]
  25. Wang, J.; Zhou, S.; Chen, S.; He, Y.; Gao, H.; Yan, L.; Hu, X.; Li, P.; Shen, H.; Luo, M.; et al. Prediction of osteoporosis using radiomics analysis derived from single source dual energy CT. BMC Musculoskelet. Disord. 2023, 24, 100. [Google Scholar] [CrossRef]
  26. Kim, S.Y.; Cho, J.Y.; Lee, J.; Hwang, S.I.; Moon, M.H.; Lee, E.J.; Hong, S.S.; Kim, C.K.; Kim, K.A.; Park, S.B.; et al. Low-Tube-Voltage CT Urography Using Low-Concentration-Iodine Contrast Media and Iterative Reconstruction: A Multi-Institutional Randomized Controlled Trial for Comparison with Conventional CT Urography. Korean J. Radiol. 2018, 19, 1119–1129. [Google Scholar] [CrossRef]
  27. Takafuji, M.; Kitagawa, K.; Ishida, M.; Goto, Y.; Nakamura, S.; Nagasawa, N.; Sakuma, H. Myocardial Coverage and Radiation Dose in Dynamic Myocardial Perfusion Imaging Using Third-Generation Dual-Source CT. Korean J. Radiol. 2020, 21, 58–67. [Google Scholar] [CrossRef]
  28. Beckmann, N.M. The Rising Utilization of Opportunistic CT Screening and Machine Learning in Bone Mineral Density. Can. Assoc. Radiol. J. 2023, 74, 616–617. [Google Scholar] [CrossRef]
  29. Ma, C.Y.; Zhou, J.Y.; Xu, X.T.; Guo, J.; Han, M.F.; Gao, Y.Z.; Du, H.; Stahl, J.N.; Maltz, J.S. Deep learning-based auto-segmentation of clinical target volumes for radiotherapy treatment of cervical cancer. J. Appl. Clin. Med. Phys. 2022, 23, e13470. [Google Scholar] [CrossRef]
  30. Dong, H.; Yin, L.; Chen, L.; Wang, Q.; Pan, X.; Li, Y.; Ye, X.; Zeng, M. Establishment and validation of a radiological-radiomics model for predicting high-grade patterns of lung adenocarcinoma less than or equal to 3 cm. Front. Oncol. 2022, 12, 964322. [Google Scholar] [CrossRef]
  31. Pan, Y.; Shi, D.; Wang, H.; Chen, T.; Cui, D.; Cheng, X.; Lu, Y. Automatic opportunistic osteoporosis screening using low-dose chest computed tomography scans obtained for lung cancer screening. Eur. Radiol. 2020, 30, 4107–4116. [Google Scholar] [CrossRef] [PubMed]
  32. Berenguer, R.; Pastor-Juan, M.D.R.; Canales-Vázquez, J.; Castro-García, M.; Villas, M.V.; Mansilla Legorburo, F.; Sabater, S. Radiomics of CT Features May Be Nonreproducible and Redundant: Influence of CT Acquisition Parameters. Radiology 2018, 288, 407–415. [Google Scholar] [CrossRef] [PubMed]
  33. Astaraki, M.; Yang, G.; Zakko, Y.; Toma-Dasu, I.; Smedby, Ö.; Wang, C. A Comparative Study of Radiomics and Deep-Learning Based Methods for Pulmonary Nodule Malignancy Prediction in Low Dose CT Images. Front. Oncol. 2021, 11, 737368. [Google Scholar] [CrossRef] [PubMed]
  34. Li, Y.; Zhang, Y.; Zhang, E.; Chen, Y.; Wang, Q.; Liu, K.; Yu, H.J.; Yuan, H.; Lang, N.; Su, M.Y. Differential diagnosis of benign and malignant vertebral fracture on CT using deep learning. Eur. Radiol. 2021, 31, 9612–9619. [Google Scholar] [CrossRef]
  35. Kitamura, G.; Chung, C.Y.; Moore, B.E., 2nd. Ankle Fracture Detection Utilizing a Convolutional Neural Network Ensemble Implemented with a Small Sample, De Novo Training, and Multiview Incorporation. J. Digit. Imaging 2019, 32, 672–677. [Google Scholar] [CrossRef]
  36. He, K.; Zhang, X.; Ren, S.; Sun, J. Deep Residual Learning for Image Recognition. In Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, 27–30 June 2016; pp. 770–778. [Google Scholar] [CrossRef]
  37. Li, Y.; Wei, D.; Liu, X.; Fan, X.; Wang, K.; Li, S.; Zhang, Z.; Ma, K.; Qian, T.; Jiang, T.; et al. Molecular subtyping of diffuse gliomas using magnetic resonance imaging: Comparison and correlation between radiomics and deep learning. Eur. Radiol. 2022, 32, 747–758. [Google Scholar] [CrossRef]
Figure 1. A detailed flowchart of patient enrollment.
Figure 1. A detailed flowchart of patient enrollment.
Bioengineering 11 00050 g001
Figure 2. The overall flowchart of this study. The construction of the radiomics model utilizes a random forest classifier, while the deep learning model adopts the Res-Net architecture. REF, Recursive Feature Elimination; MRMR, Minimum Redundancy Maximum Relevance; LASSO, the Least Absolute Shrinkage and Selection Operator.
Figure 2. The overall flowchart of this study. The construction of the radiomics model utilizes a random forest classifier, while the deep learning model adopts the Res-Net architecture. REF, Recursive Feature Elimination; MRMR, Minimum Redundancy Maximum Relevance; LASSO, the Least Absolute Shrinkage and Selection Operator.
Bioengineering 11 00050 g002
Figure 3. The Residual Network Structure.
Figure 3. The Residual Network Structure.
Bioengineering 11 00050 g003
Figure 4. Histogram of the DSC. DSC, Dice similarity coefficient.
Figure 4. Histogram of the DSC. DSC, Dice similarity coefficient.
Bioengineering 11 00050 g004
Figure 5. The receiver operating characteristic curves of the radiomics model on the internal training (A), the internal testing set (B), and the temporal validation set (C). The AUC values of the radiomics model on the internal training set for osteoporosis, osteopenia, and normal BMD were 0.959, 0.881, and 0.977, respectively. As for the internal testing set, these values were 0.919, 0.873, and 0.976, respectively. As for the temporal validation set, these values were 0.943, 0.801, and 0.932, respectively. The red, blue, and green lines represent predicted osteoporosis, osteopenia, and normal BMD, respectively. AUC, area under the receiver operating characteristic curve; BMD, bone mineral density.
Figure 5. The receiver operating characteristic curves of the radiomics model on the internal training (A), the internal testing set (B), and the temporal validation set (C). The AUC values of the radiomics model on the internal training set for osteoporosis, osteopenia, and normal BMD were 0.959, 0.881, and 0.977, respectively. As for the internal testing set, these values were 0.919, 0.873, and 0.976, respectively. As for the temporal validation set, these values were 0.943, 0.801, and 0.932, respectively. The red, blue, and green lines represent predicted osteoporosis, osteopenia, and normal BMD, respectively. AUC, area under the receiver operating characteristic curve; BMD, bone mineral density.
Bioengineering 11 00050 g005
Figure 6. The receiver operating characteristic curves of the deep learning model on the internal training (A), the internal testing set (B), and the temporal validation set (C). The AUC values of the radiomics model on the internal training set for osteoporosis, osteopenia, and normal BMD were 0.975, 0.936, and 0.972, respectively. As for the internal testing set, these values were 0.942, 0.866, and 0.972, respectively. As for the temporal validation set, these values were 0.983, 0.906, and 0.969, respectively. The red, blue, and green lines represent predicted osteoporosis, osteopenia, and normal BMD, respectively. AUC, area under the receiver operating characteristic curve; BMD, bone mineral density.
Figure 6. The receiver operating characteristic curves of the deep learning model on the internal training (A), the internal testing set (B), and the temporal validation set (C). The AUC values of the radiomics model on the internal training set for osteoporosis, osteopenia, and normal BMD were 0.975, 0.936, and 0.972, respectively. As for the internal testing set, these values were 0.942, 0.866, and 0.972, respectively. As for the temporal validation set, these values were 0.983, 0.906, and 0.969, respectively. The red, blue, and green lines represent predicted osteoporosis, osteopenia, and normal BMD, respectively. AUC, area under the receiver operating characteristic curve; BMD, bone mineral density.
Bioengineering 11 00050 g006
Figure 7. DCAs of the Rad model and DL model in the temporal validation set. (A) DCA of the Rad model and DL model in predicting abnormal BMD. (B) DCA of the Rad model and DL model in predicting osteopenia. (C) DCA of the Rad model and DL model in predicting osteoporosis. Rad model, radiomics model; DL model, deep learning model; DCA, decision curve analysis; BMD, bone mineral density.
Figure 7. DCAs of the Rad model and DL model in the temporal validation set. (A) DCA of the Rad model and DL model in predicting abnormal BMD. (B) DCA of the Rad model and DL model in predicting osteopenia. (C) DCA of the Rad model and DL model in predicting osteoporosis. Rad model, radiomics model; DL model, deep learning model; DCA, decision curve analysis; BMD, bone mineral density.
Bioengineering 11 00050 g007
Table 1. Participant demographics.
Table 1. Participant demographics.
CharacteristicDevelopment SetTemporal Validation Setp-Value
All (n)333101
Male (n)17057
Female (n)163440.404
All (years)62.89 ± 11.5560.76 ± 10.410.098
Male (years)65.37 ± 10.3762.60 ± 9.140.073
Female (years)60.30 ± 12.1758.39 ± 11.540.350
Osteoporosis (n)8420
Osteopenia (n)13434
Normal BMD (n)115470.094
Data are presented as the number of patients except for mean ± standard deviation for age.
Table 2. The Dice similarity coefficient and volume difference of manual and automatic segmentation.
Table 2. The Dice similarity coefficient and volume difference of manual and automatic segmentation.
CategoryDSCVD (cm3)
All0.96 ± 0.020.50 (0.17, 0.69)
Osteoporosis0.97 ± 0.010.44 (0.09, 0.68)
Osteopenia0.96 ± 0.020.53 (0.19, 0.63)
Normal BMD0.96 ± 0.020.50 (0.18, 0.80)
DSC, Dice similarity coefficient; VD, volume difference; BMD, bone mineral density.
Table 3. Overall performance of BMD assessment for the Rad model and DL model.
Table 3. Overall performance of BMD assessment for the Rad model and DL model.
ModelSetCategoryAUC95%CISensitivity (%)Specificity (%)Precision (%)Accuracy (%)
Rad ModelInternal training setOsteoporosis0.9590.927–0.97988.192.088.9
Osteopenia0.8810.835–0.91790.775.567.3
Normal BMD0.9770.95–0.99184.898.996.3
Overall 79.0
Internal test setOsteoporosis0.9190.826–0.97188.286.071.4
Osteopenia0.8730.769–0.94281.585.060.0
Normal BMD0.9760.906–0.998100.093.290.0
Overall 70.2
Temporal validation setOsteoporosis0.9430.878–0.97990.090.185.7
Osteopenia0.8010.709–0.87482.467.258.1
Normal BMD0.9320.864–0.97293.685.284.3
Overall 73.3
DL ModelInternal training setOsteoporosis0.9750.948–0.99095.596.587.7
Osteopenia0.9360.900–0.96289.795.693.2
Normal BMD0.9720.944–0.98896.794.895.6
Overall 92.5
Internal test setOsteoporosis0.9420.857–0.985100.076.075.0
Osteopenia0.8660.760–0.93774.185.071.4
Normal BMD0.9720.900–0.997100.090.987.0
Overall 77.6
Temporal validation setOsteoporosis0.9830.935–0.998100.092.684.2
Osteopenia0.9060.831–0.95585.380.668.3
Normal BMD0.9690.914–0.99395.785.292.7
Overall 81.2
DL, deep learning; Rad, radiomics; AUC, area under the receiver operating characteristic curve; CI, confidence interval; BMD, bone mineral density.
Table 4. The performance of our proposed method is compared with several benchmark methods.
Table 4. The performance of our proposed method is compared with several benchmark methods.
Authors(methods)Key FindingsAUCSensitivity (%)Specificity (%)Accuracy (%)
Xue et al. (Radiomics) [23]Detecting abnormal BMD0.94495.8--
Detecting osteoporosis0.86683.3--
Chen et al. (Radiomics) [24]Detecting abnormal BMD0.96093.089.091.0
Detecting osteoporosis0.98095.093.094.0
Wang et al. (Radiomics) [25]Detecting osteoporosis0.91490.775.089.8
Ours (Radiomics)Detecting abnormal BMD0.93293.685.273.3
Detecting osteopenia0.80182.467.5
Detecting osteoporosis0.94390.090.1
Yang et al. (Deep learning) [5]Detecting osteopenia0.83173.680.5-
Detecting osteoporosis0.97295.688.0
Ours (Deep learning)Detecting abnormal BMD0.96995.785.281.2
Detecting Osteopenia0.90685.380.6
Detecting osteoporosis0.98310092.6
BMD, bone mineral density.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Tong, X.; Wang, S.; Zhang, J.; Fan, Y.; Liu, Y.; Wei, W. Automatic Osteoporosis Screening System Using Radiomics and Deep Learning from Low-Dose Chest CT Images. Bioengineering 2024, 11, 50. https://doi.org/10.3390/bioengineering11010050

AMA Style

Tong X, Wang S, Zhang J, Fan Y, Liu Y, Wei W. Automatic Osteoporosis Screening System Using Radiomics and Deep Learning from Low-Dose Chest CT Images. Bioengineering. 2024; 11(1):50. https://doi.org/10.3390/bioengineering11010050

Chicago/Turabian Style

Tong, Xiaoyu, Shigeng Wang, Jingyi Zhang, Yong Fan, Yijun Liu, and Wei Wei. 2024. "Automatic Osteoporosis Screening System Using Radiomics and Deep Learning from Low-Dose Chest CT Images" Bioengineering 11, no. 1: 50. https://doi.org/10.3390/bioengineering11010050

APA Style

Tong, X., Wang, S., Zhang, J., Fan, Y., Liu, Y., & Wei, W. (2024). Automatic Osteoporosis Screening System Using Radiomics and Deep Learning from Low-Dose Chest CT Images. Bioengineering, 11(1), 50. https://doi.org/10.3390/bioengineering11010050

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop