Next Article in Journal
Dynamic Optical Coherence Tomography of Blood Vessels in Cutaneous Melanoma—Correlation with Histology, Immunohistochemistry and Dermoscopy
Previous Article in Journal
Long-Term Outcomes of Liver Transplantation in Hepatocellular Carcinoma with Bile Duct Tumor Thrombus: A Comparison with Portal Vein Tumor Thrombus
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Deep-Learning-Based Dose Predictor for Glioblastoma–Assessing the Sensitivity and Robustness for Dose Awareness in Contouring

1
Department of Radiation Oncology, Inselspital, Bern University Hospital, University of Bern, CH-3010 Bern, Switzerland
2
ARTORG Center for Biomedical Research, University of Bern, CH-3010 Bern, Switzerland
3
Department of Radiation Oncology, University Hospital Zurich, University of Zurich, CH-8091 Zurich, Switzerland
4
Division of Medical Radiation Physics, Inselspital, Bern University Hospital, University of Bern, CH-3010 Bern, Switzerland
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Cancers 2023, 15(17), 4226; https://doi.org/10.3390/cancers15174226
Submission received: 3 August 2023 / Revised: 16 August 2023 / Accepted: 21 August 2023 / Published: 23 August 2023

Abstract

:

Simple Summary

For accurate radiotherapy, a clear definition of the geometric extent of organs and tumor volumes is important. Due to the laborious task of manually drawing contours to define these, automatic segmentation models are becoming increasingly available. These models, however, need to be visually evaluated by radiation oncology experts. This evaluation itself takes up valuable time, therefore making an efficient and clinically relevant validation of auto-segmented results desirable. An accurate 3D dose prediction model can help create dose awareness prior to the actual dose-planning step. It can provide useful information for the quality assurance of the contouring step. In this study, we trained a 3D dose predictor for volumetric modulated arc therapy (VMAT) treatment of glioblastoma patients based on an existing architecture called a cascaded 3D U-Net. We further tested this model’s sensitivity and robustness for the purpose of estimating dose changes due to contour variations.

Abstract

External beam radiation therapy requires a sophisticated and laborious planning procedure. To improve the efficiency and quality of this procedure, machine-learning models that predict these dose distributions were introduced. The most recent dose prediction models are based on deep-learning architectures called 3D U-Nets that give good approximations of the dose in 3D almost instantly. Our purpose was to train such a 3D dose prediction model for glioblastoma VMAT treatment and test its robustness and sensitivity for the purpose of quality assurance of automatic contouring. From a cohort of 125 glioblastoma (GBM) patients, VMAT plans were created according to a clinical protocol. The initial model was trained on a cascaded 3D U-Net. A total of 60 cases were used for training, 15 for validation and 20 for testing. The prediction model was tested for sensitivity to dose changes when subject to realistic contour variations. Additionally, the model was tested for robustness by exposing it to a worst-case test set containing out-of-distribution cases. The initially trained prediction model had a dose score of 0.94 Gy and a mean DVH (dose volume histograms) score for all structures of 1.95 Gy. In terms of sensitivity, the model was able to predict the dose changes that occurred due to the contour variations with a mean error of 1.38 Gy. We obtained a 3D VMAT dose prediction model for GBM with limited data, providing good sensitivity to realistic contour variations. We tested and improved the model’s robustness by targeted updates to the training set, making it a useful technique for introducing dose awareness in the contouring evaluation and quality assurance process.

1. Introduction

Many cancers are currently treated by a combination of local and systemic therapy. Local therapy often consists of a combination of surgery and radiotherapy. The latter requires a sophisticated planning process to guarantee successful treatment. To improve the efficiency and quality of treatment planning in radiotherapy, methods for predicting possible dose distributions or dose volume histogram (DVH) curves have been introduced in previous years [1,2,3,4,5,6,7]. Since 2012, knowledge-based methods have been used to predict what is achievable in treatment planning. This was not only used for quality assurance in treatment planning [8,9,10], but also to speed up the planning process by initializing the treatment plan based on the prediction [11]. By reducing the number of inputs from the user, treatment planning becomes much more consistent, more resource-efficient, and potentially beneficial for treatment quality.
In recent years, three-dimensional dose prediction through neural networks has been shown to be a viable method for this purpose. In 2016, the first study using neural networks for dose predictions was published by Shiraishi et al. [12]. In the following years, approximately 30 more studies that tried to predict the 3D dose distribution with deep learning were published. Most of these were based on treatments with a relatively standard target orientation, with minor anatomical variations from patient to patient, such as prostate and oro/nasopharyngeal cancers [13,14,15,16]. However, there are also promising results for models in the brain, breast, and lungs [1,3,17]. In 2020, the Open-Access Knowledge-Based Planning (OpenKBP) Challenge was organized, providing an open-access dataset of head and neck treatment plans to train prediction models and evaluate them on a set of standardized metrics [18]. A total of 195 participants competed in this challenge, where the best-ranked team scored a mean absolute error (MAE) of 2.43 and 1.48 for the dose and DVH scores, respectively (see Section 2.6). Their methodology is publicly available and described as a technical note [19].
Dose prediction models are mainly used for treatment planning. This means that, in practice, in addition to the dose prediction, a second model is required to convert the predicted dose into an actual plan that is executable for the specific treatment technique. In this latter step, a final optimization incorporates individual case properties, physical constraints, and dose delivery hardware [20]. In our case, we want to use the dose prediction model for another purpose, namely contour evaluation.
The contouring of targets and organs at risk (OARs), the step that takes place prior to planning, is also subject to automation to improve efficiency and consistency with respect to the current manual process. With the implementation of artificial intelligence (AI), it is important to have specific tools for quality assurance [21]. To ensure quality, an assessment of the contours is required. Usually, visual inspection is the go-to method; however, this is a time-consuming task. For each target and OAR, every image slice needs to be visually inspected. If necessary, manual adjustments need to be made if a contour is deemed incorrect. Especially for deep-learning-based auto-segmentation models, a lack of robustness could result in unpredictable errors that can happen anywhere within the image volume [22]. There are, thus, good reasons to automate this QA step as well. There have been several attempts to provide an automatic assessment of automatic segmentations. Most of these were based on geometrical prior knowledge [23,24,25], but they lacked certainty for proper QA [26]. Moreover, more recent deep-learning-based approaches based on uncertainty maps seem to have issues [27]. To complement the current work performed on QA for auto-segmentation, we postulate that it would be beneficial to know the possible clinical impact of a specific segmentation. A deep-learning model that can give an accurate prediction of the dose received by an OAR instantly could provide the required information to assess the clinical impact of contour variations. Such dose awareness, for the evaluation of contours, can improve the efficiency of the process. Moreover, it provides clinically relevant feedback to the evaluator, who can then focus on potential segmentation errors that will have a larger impact on the treatment.
To assess the feasibility of a near-instant dose prediction model in providing dose awareness for the evaluation of auto-segmented contours, we made use of a deep-learning model to predict the dose for glioblastoma cases. Based on the network of Liu et al. [19] that was used in the OpenKBP challenge, a model was trained on a set of curated glioblastoma (GBM) cases. Unlike with current dose prediction algorithms, we wanted to verify the model’s performance for contouring quality assessment (QA). This means that, beyond specific accuracy and sensitivity, robust predictions for a broad range of situations are required. To do so, we tested our trained model on specific sets of contour alterations to assess its sensitivity. Furthermore, we stress-tested the model by using a specific worst-case test set, including rare cases where we expected it to fail. This enabled us to determine the robustness of the model and understand where further improvements are required. Subsequently, based on the outcome observed on the worst-case test set, we improved the robustness of the model by augmenting the training set with synthetically generated cases characterizing the observed failure patterns.

2. Materials and Methods

2.1. Data Collection and Preparation

Imaging data from a cohort of 125 GBM patients treated with radiotherapy at the Inselspital University Hospital (Bern, Switzerland) were available. For all patients, the planning target volume (PTV) and the OARs (organs at risk) were curated by a mutual agreement between three radiation oncology professionals. A plan was constructed using a strict dose prescription and standard templates for planning setup and dose optimization initiation for all cases. Of the first 95 cases, 60 were selected for model training, 15 were chosen as validation, and 20 were used as a test set. Of the remaining 30 cases, 10 were used to construct a worst-case test set manually, and the other 20 for improving the training by adding specific out-of-distribution cases. Section 2.5 further details how the worst-case test set and the out-of-distribution cases were designed.

2.2. Dose Planning

All cases were planned according to the clinical dose prescription of 60 Gy in 30 fractions based on the ESTRO-EANO guidelines [28] in the Eclipse treatment planning system (TPS) V15.06.05 (Varian Medical Systems, Palo Alto). All OARs were subject to a dose constraint, which, according to a priority list, could or could not be compromised (Table 1). All plans used a volumetric arc technique (VMAT) with a double full co-planar arc with 6 MV beams containing a flattening filter. The plans were optimized with the photon optimizer, and doses were calculated with the Anisotropic Analytical Algorithm [29]. After dose calculation, the dose was normalized so that 50% of the PTV was covered by 100% of the prescribed dose, according to the institutional clinical guidelines.

2.3. Training

The planning CT and the structures were available in DICOM format for each case. All data were converted from DICOM to NIfTI files, using the PyRaDise package [30]. The RTSS files containing the PTV and the OARs were divided into 14 separate 3D binary masks, each containing a single structure. The input files consisted of 16 3D volumes per case: the planning CT, the dose distribution, the PTV binary mask, and 13 OAR binary masks (Figure 1).
We trained a two-level cascaded 3D (C3D) U-Net [31] as the dose prediction network (i.e., the input to the second U-Net is the output of the first, concatenated with the input to the first U-Net). The U-Net is the most commonly used deep-learning neural network for dose prediction. It was first used in this context as a 2D network by Nguyen et al. [32]. Since then, many advances have been made, notably an extension to a 3D U-Net [33]. The C3D model was proposed to incorporate both global and local anatomical features for dose prediction and showed the best results among all the competing model architectures in the OpenKBP challenge [18,31].
The model input was a normalized CT volume and binary segmentation masks for each of the 13 OARs and target volume. As output, the model predicted a continuous-valued 3D dose (upscaled from [0, 1] to [0, 70 Gy] to normalize to the full range of the dose within the cohort) of the same dimension as the input. The loss was computed as follows:
L o s s = 0.5 L 1 ( r e f e r e n c e , A ) + L 1   ( r e f e r e n c e , B )
where A and B are the outputs of the first and second U-Nets, respectively. In this equation, reference indicates the reference dose, and L1 refers to the L1 loss. All volumes were resampled to 1283 voxels due to GPU memory constraints. The hyperparameters for training the C3D model were unchanged from the original implementation [9], except that the number of input binary masks was updated to 14 to match the number of structures in our dataset. The model’s weights were randomly initialized using the “He” method [34]. The training process ran for 80,000 iterations, and the model with the best validation dose score was saved. All experiments were run with PyTorch1.12 on an NVIDIA RTX A5000 graphics processing unit (GPU). We trained the model five times with the same hyperparameter set but a different random seed initialization to ensure reliable convergence. Each training run took 24 h. A single inference to run the dose prediction model takes about 1–2 min on a standard consumer level PC and about 15 s with a GPU.

2.4. Assessing the Model’s Sensitivity

One of the goals of the dose predictor is to provide realistic dosimetry information based on the input contours. It should additionally be able to predict realistic dose changes produced by small and realistic changes to the contours of an organ (i.e., inter-expert variability [35]). To analyze the sensitivity of the dose prediction model to these changes, a specific case was chosen where the GBM target is near the left optic nerve (ONL). In practice, the optic nerves are prone to variability in contours due to the intra- and inter-fractional movement of the eyes which also affect the optic nerves. In this case, small changes in the contour of the ONL would lead to significant dose changes. To simulate this situation, ten alternative contours of the ONL were manually drawn. The dose was re-optimized and recalculated on the TPS for each alternative contour in order to serve as a reference dose. The reference doses were then compared qualitatively and quantitatively to the doses predicted by the model. The dice similarity coefficients (DSCs) for the alternatives were calculated to correlate the dose differences to the geometric discrepancy of the ONL contours.

2.5. Improving the Model–Worst-Case Test Set

To assess the robustness of the model, a worst-case test set was selected. Based on the analysis and evaluation of the dose score results on the standard test set and the statistical analysis of the normal distribution of the training set, a number of test cases were defined where we expected the model to fail or have difficulties. The PTVs of these cases were manually manipulated to simulate rare cases not described by the training dataset (out-of-distribution cases), as well as to present a challenge in terms of the physical limitations of obtaining perfect dose conformity. Among these 10 cases, we included (i) targets of larger and smaller size than those present in the training set; (ii) targets consisting of multiple lesions; (iii) irregular shapes, such as elongated or concave targets; and (iv) targets that present an overlap with the OARs.
According to the worst-case test set results, we gained insight into which situations the model performs poorly in and where it could benefit from additional training. Our observations showed that the prediction model struggled mostly with the physical limitations of conforming the dose according to the targets outlined for specific shapes. Where conformity of the actual dose prediction decreases with concave shapes or multiple targets close to each other, the dose predictor overestimates the dose fall-off in these regions. To increase the overall robustness of the model while also improving the model for these situations, we updated the trained model by including a set of concave-shaped target cases and a set of cases where the target consists of multiple lesions.
The respective new training sets were constructed by manually adjusting the target volume (Figure 2). The ten cases used for both sets are from different patients and were not used in any previous model training. All new cases included dose planning according to the same protocol described above in order to serve as the reference dose.
First, we trained an updated “Concave Model” with 60 standard cases + 6 concave cases. The remaining 4 concave cases were used as the test set. Second, we trained an updated “Multiple Lesion Model” with the 60 standard cases + 6 multiple lesion cases. Again, 4 cases were used as a test set. Finally, we retrained the initial model with 60 standard cases + 6 concave cases + 6 multiple lesion cases. We tested these models on the standard test set, as well as these specific additional test cases, and compared this with the results of the initial model. An overview of the experimental setup is given in Figure 1.

2.6. Evaluation

The trained models were evaluated on the test set, and the prediction of the dose was compared to the actual planned dose by means of the standardized metrics used by the OpenKBP challenge [18]: the dose score and the DVH score. The dose score measures the mean error over all the voxels between the two 3D volumes. In this case, we used the whole brain to measure the dose score instead of the whole CT volume or whole body volume. Taking a larger volume dilutes the results to a more positive outcome. The DVH score is the mean error over a set of criteria specific to the given volume. For OARs, these criteria are the mean dose (Dmean) and the maximum dose to 0.1cc (D0.1cc). For the target volume, the criteria are the dose received by 1%, 95%, and 99% of the voxels within the volume (D1, D95, and D99). The DVH score is calculated for all OARs used in training (lens and retina are combined within the eye, since overlapping masks were not possible). We report the mean results for the five trained models and use one of them for a subsequent sensitivity analysis.
Additionally, the initial trained model and the updated models were tested on a set of concave target cases, a set of multiple lesion cases, and a combined test set that included both plus the standard test set.

3. Results

Based on the initial training set of 60 cases, the performance of the model was determined based on the standard test set of 20 cases. The mean result over five independently trained models showed a dose score, which was measured over the whole brain volume of 0.94 (standard deviation (SD) = 0.36). The mean DVH score over all OARs and the target was 1.95 (SD = 0.95).

3.1. Results for Sensitivity

An overview of the nine alternative left optic nerve contours is shown in Figure 3. The mean dose to the ONL, based on the treatment planning system, and the mean dose based on the prediction model for the reference and the nine alternative contours are shown in Table 2. There is a reasonable variation in the mean dose among the different alternative contours with respect to the reference contour. In some cases, only minor changes to the mean dose occur, even though the DSC metric shows a significant difference in contour similarity. In other cases, the mean dose change with respect to the reference contour can be as high as 5 to 7 Gy. The difference between the calculated dose and the predicted dose seems to follow a trend and varies under a maximum of 3.50 Gy, with a mean of 1.38 Gy. This shows that the predicted dose is more often overestimated.
The average difference of the calculated mean dose for the alternatives with respect to the calculated reference mean dose was 2.44 Gy (i.e., the difference between the alternatives to the reference dose). For the predicted dose, this difference was 2.32 Gy. This means that the correlation coefficient between reference and predicted dose differences across the contour alternatives was 0.89, while the correlation coefficient with the DSC was −0.42 [36].

3.2. Improving the Model–Worst-Case Test Set

While analyzing the results of the worst-case test set, we saw flaws, particularly in cases where targets have concave shapes and consist of multiple lesions (see Figure 4). In such cases, the prediction model overestimated the ability to conform the dose to the targets. This is mainly reflected in higher dose scores and less so in the DVH scores of the target since the dose discrepancy occurs just outside of the target structure. We updated our training data with six concave target cases and six multiple lesion target cases and a combination of both. The results for the different test sets are given for the dose score, the DVH score for the OARs, and the DVH score for the targets separately in Table 3.
Based on the standard test set, the updated models scored similarly to the initial model on the dose score and the DVH score for targets. The DVH score for OARs improved for all updated models. The updated model with the concave target cases shows, by far, the best results of all trained models.
Focusing on the concave updated model, we observed improvements in the dose and DVH score on the concave test set, as well as improved results on the multiple test set. This means that, for this this small set of specific cases, the concave updated model scores significantly better than the initial model. For the multiple-lesions updated model, we also observed an improvement, but to a lesser extent. The combined updated model, containing both concave and multiple target lesions, scored the worst of all updated models. For the standard test set, the combined updated model did not show improved scores with respect to the initial model.
For the combined test set, which is a combination of the three previous test sets, the updated models scored consistently better than the initial model.
Qualitatively, we can see an improvement in the spatial distribution of the predicted dose in the updated models at exactly the locations of concern, the concave parts of the target, and the space between multiple lesions, especially in the axial direction.

4. Discussion

By means of an existing dose prediction model that was trained for head and neck cases, we obtained good results for translating the dose prediction model to glioblastoma cases in the brain. For these initial results, only 60 cases were used for training. Compared to the results of the OpenKBP challenge, using their proposed metrics, our initial trained model scored better values than the top ranked participants did. However, we are aware that the anatomies of the evaluated treatment sites are different. It must be noted that different 3D volumes are used, as well as different OAR structures, which will have an influence on the used scores. We do not yet have a benchmark for these metrics in the brain region. On the other hand, whereas head and neck targets are much more similar from case to case, GBM targets vary much more in size, shape, and location. Nonetheless, the model was able to achieve good results on a relatively small training set. The overall dose score was less than 1 Gy. Although this might be relevant in a final dose distribution, for the dose predictor model and the purposes we aim to use it for, we believe this to be of sufficient accuracy. Although the prediction model might have struggled in reproducing the exact streaking patterns of the actual calculated dose, this did not have an impact on the relevant metrics, such as the mean and maximum dose received by the specific OARs. We conclude from this that a cascaded 3D U-Net is capable of predicting the dose when provided with high-quality and well-curated data to train it.
Although some other groups have published on dose prediction in the brain [7,12,17], for both VMAT and conventional intensity modulated radiotherapy (IMRT), they did not specify the nature of the brain tumors. Furthermore, different treatment prescriptions were included in these works, certain tumor locations were excluded, and additional planning parameters were used in the training model. This is the first dose prediction model specified for GBM treatment.
It seems that 3D dose distribution prediction is a great application for deep-learning models. Although the predictions are not perfect, they are useful in the initialization processes of automatic planning. It also provides a near-instant estimation of the dose distribution that outperforms any currently available analytical or mathematical prediction method. Our work shows that a dose prediction model for a specific purpose, i.e., treatment area and modality, is relatively easy to obtain. For our specific purpose, we wanted to predict the dose to OARs. We were able to improve the accuracy of the DVH score for the OARs with some minor additions to the training set.
Considering it is a 3D U-Net, the training times can be relatively long. In our scaled-down version (128 by 128 by 128 voxels), a single training course lasted around 24 h. Adding more training data—for instance, doubling or tripling the amount—would be feasible. In addition, increasing the resolution to 256 voxels would improve dose prediction resolutions at the cost of longer training and inference times. On the other hand, the fast inference time of only seconds on a high-end GPU enables multiple applications where the inference is run in a high-throughput manner. Some examples where a multitude of dose predictions are used are to show the dose effect of atomic surface transformations in OARs in the brain [37] or for a clinically relevant guidance of the loss function in automatic segmentation of targets volumes for GBM [38].
Furthermore, we did not analyze the interpretability of the model. It is, however, feasible to obtain saliency maps for the outcomes of the dose prediction model since it is based on the standard U-Net architecture [39].
To obtain the training data, we used plans that were made according to a strict and standardized protocol. This makes the resulting dose distribution better to predict. It might therefore be one of the reasons for the good results. On the other hand, using such a strict protocol makes the model only valid for treatments following this strict protocol. However, in clinical practice, different approaches are used depending not only on case specifics but also on the individual preference of doctors, planners, and the availability of specific hardware. In this case, we used a VMAT technique. The dose distribution of such plans is more predictable since, in every case, two full 360-degree co-planar arcs are used. In other techniques, such as conventional IMRT, using a set number of beam angles, or in more sophisticated VMAT techniques making use of non-coplanar arcs, the dose might be more difficult to predict. To solve this issue, one needs to make a dose prediction model for every different treatment strategy. Although this seems cumbersome, in clinical reality, this comes down to a few treatment strategies per treatment site for any department. Given our model’s results, only a limited number of data are required to obtain a viable model.
The main contribution of this paper was to show the feasibility of training an accurate deep-learning-based dose predictor for GBM treatment. If data are limited for a particular scenario but a demarcated treatment protocol exists, even for non-homogeneous anatomies (i.e., not prostate or head and neck, for which most of the dose prediction methods are proposed), satisfactory results can be obtained compared to currently reported outcomes. Although the main drive behind dose prediction models is the purpose of automation in dose planning, dose prediction models can also be important for many other purposes. Our hypothesis is that they can be useful in the quality management of the radiotherapy steps that take place prior to planning. There are possible positive consequences for the effectiveness of quality assurance, the accuracy of segmentation, and the optimization of treatment planning. By introducing clinically relevant objectives early in the radiotherapy planning process, we can improve automation and enable automated quality assurance. This makes the radiotherapy process faster and also improves the quality.
We tested the obtained dose prediction model for specific criteria important for a dose predictor in quality management, sensitivity, and robustness. We showed that the initially trained model is sensitive enough to detect dose trends on realistic contour variability in a critical organ such as the optic nerve. We also tested the initial model against robustness. Although we found that the model did lack a certain accuracy in specific situations, we showed that with a simple strategy of adding specific cases to the training set, the robustness and the overall accuracy of the model increased. We anticipate that dose prediction models can be more accurate when using larger datasets of carefully curated data. In addition, the models can be tailored to have specific characteristics to fulfil the needs of different tasks in radiotherapy management.

5. Conclusions

This manuscript showed that obtaining a dose prediction model for GBM VMAT treatment that is both robust and sensitive to realistic segmentation variations is possible with less than 100 cases. Although the model is only valid for one specific treatment strategy, the relative ease of implementation and the near-instant inference time make it a useful technique to incorporate dose awareness into the automation processes in radiotherapy prior to planning.

Author Contributions

R.P., conceptualization, methodology, data curation, data analysis, and writing original draft; A.J.K., conceptualization, methodology, training framework, model training, data analysis, and writing—review and editing; J.W., conceptualization and writing—review and editing; N.A., conceptualization and writing—review and editing; E.E., data curation and writing—review and editing; D.M.A., supervision and writing—review and editing; P.M., methodology, supervision, and writing—review and editing; M.R., conceptualization, methodology, supervision, and writing—review and editing. All authors have read and agreed to the published version of the manuscript.

Funding

This work is supported by the Innosuisse Grant 31274.1 IP-LS and by Swiss Cancer Research (KFS-5127-08-2020).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Patient consent was waived due to the data used being anonymized imaging data from a previous retrospective study.

Data Availability Statement

The data presented in this study are available upon request from the corresponding author. The data on which the models are trained are not able to be shared due to privacy and ethical considerations. The data of the networks that were trained are available from third party sources, which are referred to in the main text of the manuscript.

Conflicts of Interest

The authors of this manuscript declare no conflict of interest.

References

  1. Dahiya, N.; Jhanwar, G.; Yezzi, A.; Zarepisheh, M.; Nadeem, S. Deep Learning 3D Dose Prediction for Conventional Lung IMRT Using Consistent/Unbiased Automated Plans. arXiv 2021, arXiv:2106.03705. [Google Scholar]
  2. Kontaxis, C.; Bol, G.H.; Lagendijk, J.J.W.; Raaymakers, B.W. DeepDose: Towards a fast dose calculation engine for radiation therapy using deep learning. Phys. Med. Biol. 2020, 65, 075013. [Google Scholar] [CrossRef]
  3. Bakx, N.; Bluemink, H.; Hagelaar, E.; Van Der Sangen, M.; Theuws, J. Development and evaluation of radiotherapy deep learning dose prediction models for breast cancer. Phys. Imaging Radiat. Oncol. 2021, 17, 65–70. [Google Scholar] [CrossRef]
  4. Ahn, S.H.; Kim, E.; Kim, C.; Cheon, W.; Kim, M.; Lee, S.B.; Lim, Y.K.; Kim, H.; Shin, D.; Kim, D.Y.; et al. Deep learning method for prediction of patient-specific dose distribution in breast cancer. Radiat. Oncol. 2021, 16, 154. [Google Scholar] [CrossRef]
  5. Liu, Y.; Chen, Z.; Wang, J.; Wang, X.; Qu, B.; Ma, L.; Zhao, W.; Zhang, G.; Xu, S. Dose Prediction Using a Three-Dimensional Convolutional Neural Network for Nasopharyngeal Carcinoma with Tomotherapy. Front. Oncol. 2021, 11, 752007. [Google Scholar] [CrossRef]
  6. Yue, M.; Xue, X.; Wang, Z.; Lambo, R.L.; Zhao, W.; Xie, Y.; Cai, J.; Qin, W. Dose prediction via distance-guided deep learning: Initial development for nasopharyngeal carcinoma radiotherapy. Radiother. Oncol. 2022, 170, 198–204. [Google Scholar] [CrossRef]
  7. Yang, J.; Zhao, Y.; Zhang, F.; Liao, M.; Yang, X. Deep learning architecture with transformer and semantic field alignment for voxel-level dose prediction on brain tumors. Med. Phys. 2022, 50, 1149–1161. [Google Scholar] [CrossRef]
  8. Appenzoller, L.M.; Michalski, J.M.; Thorstad, W.L.; Mutic, S.; Moore, K.L. Predicting dose-volume histograms for organs-at-risk in IMRT planning. Med. Phys. 2012, 39, 7446–7461. [Google Scholar] [CrossRef]
  9. Tol, J.P.; Dahele, M.; Delaney, A.R.; Slotman, B.J.; Verbakel, W.F.A.R. Can knowledge-based DVH predictions be used for automated, individualized quality assurance of radiotherapy treatment plans? Radiat. Oncol. 2015, 10, 234. [Google Scholar] [CrossRef]
  10. Gronberg, M.P.; Beadle, B.M.; Garden, A.S.; Skinner, H.; Gay, S.; Netherton, T.; Cao, W.; Cardenas, C.E.; Chung, C.; Fuentes, D.T.; et al. Deep Learning–Based Dose Prediction for Automated, Individualized Quality Assurance of Head and Neck Radiation Therapy Plans. Pract. Radiat. Oncol. 2023, 13, e282–e291. [Google Scholar] [CrossRef]
  11. McIntosh, C.; Purdie, T.G. Contextual Atlas Regression Forests: Multiple-Atlas-Based Automated Dose Prediction in Radiation Therapy. IEEE Trans. Med. Imaging 2016, 35, 1000–1012. [Google Scholar] [CrossRef]
  12. Shiraishi, S.; Moore, K.L. Knowledge-based prediction of three-dimensional dose distributions for external beam radiotherapy. Med. Phys. 2016, 43, 378–387. [Google Scholar] [CrossRef]
  13. Ma, J.; Bai, T.; Nguyen, D.; Folkerts, M.; Jia, X. Individualized 3D Dose Distribution Prediction Using Deep Learning. In Artificial Intelligence in Radiation Therapy; Springer Nature: Cham, Switzerland, 2019; Volume 11850, pp. 110–118. [Google Scholar]
  14. Willems, S.; Crijns, W.; Sterpin, E.; Haustermans, K.; Maes, F. Feasibility of CT-Only 3D Dose Prediction for VMAT Prostate Plans Using Deep Learning. In Artificial Intelligence in Radiation Therapy; Springer: Cham, Switzerland, 2019; Volume 11850, pp. 10–17. [Google Scholar]
  15. Chen, X.; Men, K.; Li, Y.; Yi, J.; Dai, J. A feasibility study on an automated method to generate patient-specific dose distributions for radiotherapy using deep learning. Med. Phys. 2019, 46, 56–64. [Google Scholar] [CrossRef]
  16. Chen, X.; Zhu, J.; Yang, B.; Chen, D.; Men, K.; Dai, J. Combining distance and anatomical information for deep-learning based dose distribution predictions for nasopharyngeal cancer radiotherapy planning. Front. Oncol. 2023, 13, 1041769. [Google Scholar] [CrossRef]
  17. McIntosh, C.; Purdie, T.G. Voxel-based dose prediction with multi-patient atlas selection for automated radiotherapy treatment planning. Phys. Med. Biol. 2017, 62, 415–431. [Google Scholar] [CrossRef]
  18. Babier, A.; Zhang, B.; Mahmood, R.; Moore, K.L.; Purdie, T.G.; McNiven, A.L.; Chan, T.C.Y. OpenKBP: The open-access knowledge-based planning grand challenge and dataset. Med. Phys. 2021, 48, 5549–5561. [Google Scholar] [CrossRef]
  19. Wang, J.; Lu, J.; Qin, G.; Shen, L.; Sun, Y.; Ying, H.; Zhang, Z.; Hu, W. Technical Note: A deep learning-based autosegmentation of rectal tumors in MR images. Med. Phys. 2018, 45, 2560–2564. [Google Scholar] [CrossRef]
  20. Sun, Z.; Xia, X.; Fan, J.; Zhao, J.; Zhang, K.; Wang, J.; Hu, W. A hybrid optimization strategy for deliverable intensity-modulated radiotherapy plan generation using deep learning-based dose prediction. Med. Phys. 2022, 49, 1344–1356. [Google Scholar] [CrossRef]
  21. Huynh, E.; Hosny, A.; Guthier, C.; Bitterman, D.S.; Petit, S.F.; Haas-Kogan, D.A.; Kann, B.; Aerts, H.J.W.L.; Mak, R.H. Artificial intelligence in radiation oncology. Nat. Rev. Clin. Oncol. 2020, 17, 771–781. [Google Scholar] [CrossRef]
  22. Poel, R.; Rüfenacht, E.; Ermis, E.; Müller, M.; Fix, M.K.; Aebersold, D.M.; Manser, P.; Reyes, M. Impact of random outliers in auto-segmented targets on radiotherapy treatment plans for glioblastoma. Radiat. Oncol. 2022, 17, 170. [Google Scholar] [CrossRef]
  23. Altman, M.B.; Wooten, H.O.; Dewees, T.A.; Thorstad, W. A framework for automated contour quality assurance in radiation therapy including adaptive techniques A framework for automated contour quality assurance in radiation therapy including adaptive techniques. Phys. Med. Biol. 2015, 60, 5199–5209. [Google Scholar] [CrossRef]
  24. Chen, H.-C.; Tan, J.; Dolly, S.; Kavanaugh, J.; Anastasio, M.A.; Low, D.A.; Li, H.H.; Altman, M.; Gay, H.; Thorstad, W.L.; et al. Automated contouring error detection based on supervised geometric attribute distribution models for radiation therapy: A general strategy. Med. Phys. 2015, 42, 1048–1059. [Google Scholar] [CrossRef]
  25. Zhang, J.; Ates, O.; Li, A. Implementation of a Machine Learning–Based Automatic Contour Quality Assurance Tool for Online Adaptive Radiation Therapy of Prostate Cancer. Int. J. Radiat. Oncol. 2016, 96, E668. [Google Scholar] [CrossRef]
  26. Isaksson, L.J.; Summers, P.; Bhalerao, A.; Gandini, S.; Raimondi, S.; Pepa, M.; Zaffaroni, M.; Corrao, G.; Mazzola, G.C.; Rotondi, M.; et al. Quality assurance for automatically generated contours with additional deep learning. Insights Imaging 2022, 13, 137. [Google Scholar] [CrossRef]
  27. Jungo, A.; Meier, R.; Ermis, E.; Herrmann, E.; Reyes, M. Uncertainty-driven Sanity Check: Application to Postoperative Brain Tumor Cavity Segmentation. arXiv 2018, arXiv:1806.03106. [Google Scholar]
  28. Niyazi, M.; Andratschke, N.; Bendszus, M.; Chalmers, A.J.; Erridge, S.C.; Galldiks, N.; Lagerwaard, F.J.; Navarria, P.; Rosenschöld, P.M.A.; Ricardi, U.; et al. ESTRO-EANO guideline on target delineation and radiotherapy details for glioblastoma. Radiother. Oncol. 2023, 184, 109663. [Google Scholar] [CrossRef]
  29. Van Esch, A.; Tillikainen, L.; Pyykkonen, J.; Tenhunen, M.; Helminen, H.; Siljamäki, S.; Alakuijala, J.; Paiusco, M.; Iori, M.; Huyskens, D.P. Testing of the analytical anisotropic algorithm for photon dose calculation. Med. Phys. 2006, 33, 4130–4148. [Google Scholar] [CrossRef]
  30. Rüfenacht, E.; Kamath, A.; Suter, Y.; Poel, R.; Ermiş, E.; Scheib, S.; Reyes, M. PyRaDiSe: A Python package for DICOM-RT-based auto-segmentation pipeline construction and DICOM-RT data conversion. Comput. Methods Programs Biomed. 2023, 231, 107374. [Google Scholar] [CrossRef]
  31. Liu, S.; Zhang, J.; Li, T.; Yan, H.; Liu, J. Technical Note: A cascade 3D U-Net for dose prediction in radiotherapy. Med. Phys. 2021, 48, 5574–5582. [Google Scholar] [CrossRef]
  32. Nguyen, D.; Long, T.; Jia, X.; Lu, W.; Gu, X.; Iqbal, Z.; Jiang, S. A feasibility study for predicting optimal radiation therapy dose distributions of prostate cancer patients from patient anatomy using deep learning. Sci. Rep. 2019, 9, 1076. [Google Scholar] [CrossRef]
  33. Kearney, V.; Chan, J.W.; Haaf, S.; Descovich, M.; Solberg, T.D. DoseNet: A volumetric dose prediction algorithm using 3D fully-convolutional neural networks. Phys. Med. Biol. 2018, 63, 235022. [Google Scholar] [CrossRef] [PubMed]
  34. He, K.; Zhang, X.; Ren, S.; Sun, J. Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. Proc. IEEE Int. Conf. Comput. Vis. 2015, 2015, 1026–1034. [Google Scholar]
  35. Deeley, M.A.; Chen, A.; Datteri, R.; Noble, J.H.; Cmelak, A.J.; Donnelly, E.F.; Malcolm, A.W.; Moretti, L.; Jaboin, J.; Niermann, K.; et al. Comparison of manual and automatic segmentation methods for brain structures in the presence of space-occupying lesions: A multi-expert study. Phys. Med. Biol. 2011, 56, 4557–4577. [Google Scholar] [CrossRef] [PubMed]
  36. Poel, R.; Rüfenacht, E.; Hermann, E.; Scheib, S.; Manser, P.; Aebersold, D.M.; Reyes, M. The predictive value of segmentation metrics on dosimetry in organs at risk of the brain. Med. Image Anal. 2021, 73, 102161. [Google Scholar] [CrossRef]
  37. Kamath, A.; Poel, R.; Willmann, J.; Ermis, E.; Andratschke, N.; Reyes, M. ASTRA: Atomic Surface Transformations for Radiotherapy Quality Assurance. In Proceedings of the International Conference of the IEEE Engineering in Medicine and Biology Society, Sydney, Australia, 24–27 July 2023. [Google Scholar]
  38. Rüfenacht, E.; Kamath, A.; Suter, Y.; Poel, R.; Ermiş, E.; Scheib, S.; Reyes, M. Dose Guidance for Radiotherapy-oriented Deep Learning Segmentation. In Proceedings of the MICCAI Proceedings, Vancouver, BC, Canada, 8–12 October 2023. [Google Scholar]
  39. You, S.; Reyes, M. Influence of contrast and texture based image modifications on the performance and attention shift of U-Net models for brain tissue segmentation. Front. Neuroimaging 2022, 1, 1012639. [Google Scholar] [CrossRef]
Figure 1. Schematic overview of the training and testing process. The upper block represents the training procedure of the initial model with its inputs and outputs. The initial model is tested on the test cases, resulting in dose and DVH scores for each test set. The initial model (green block) is updated threefold with concave cases, multiple lesion cases, and a combination of the two. The updated models are tested on the same test sets. The results are then compared (blue blocks).
Figure 1. Schematic overview of the training and testing process. The upper block represents the training procedure of the initial model with its inputs and outputs. The initial model is tested on the test cases, resulting in dose and DVH scores for each test set. The initial model (green block) is updated threefold with concave cases, multiple lesion cases, and a combination of the two. The updated models are tested on the same test sets. The results are then compared (blue blocks).
Cancers 15 04226 g001
Figure 2. Examples of the additional training cases for the concave targets (above) and the multiple targets (below). The targets are drawn manually in red and do not represent actual tumor situations. The structures in other colors represent OARs.
Figure 2. Examples of the additional training cases for the concave targets (above) and the multiple targets (below). The targets are drawn manually in red and do not represent actual tumor situations. The structures in other colors represent OARs.
Cancers 15 04226 g002
Figure 3. On the left is an overview of all the 9 alternative contours of the ONL. On the right, the dose’s respective DVH curves are calculated with the treatment planning system, which shows the variation in the dose these contours have. The colors in the DVH curve correspond to the colors of the contours on the left.
Figure 3. On the left is an overview of all the 9 alternative contours of the ONL. On the right, the dose’s respective DVH curves are calculated with the treatment planning system, which shows the variation in the dose these contours have. The colors in the DVH curve correspond to the colors of the contours on the left.
Cancers 15 04226 g003
Figure 4. Dosimetric comparison of the calculated dose, the initial prediction model, and the updated model for a concave (above) and a multiple lesion case (below). The images represent a single axial slice. On the right, the dose difference maps of the corresponding axial slice are given. The difference between the latter shows improvements in the dose prediction. The depicted cases were not used in the training of the initial model or the updated model.
Figure 4. Dosimetric comparison of the calculated dose, the initial prediction model, and the updated model for a concave (above) and a multiple lesion case (below). The images represent a single axial slice. On the right, the dose difference maps of the corresponding axial slice are given. The difference between the latter shows improvements in the dose prediction. The depicted cases were not used in the training of the initial model or the updated model.
Cancers 15 04226 g004
Table 1. Clinical dose-planning guidelines for GBM treatment.
Table 1. Clinical dose-planning guidelines for GBM treatment.
OARConstraintPriority
Brain-PTV
  • V60 Gy ≤ 3 cc
2
Brainstem
  • D0.03cc ≤ 60 Gy (hard constraint)
  • D0.03cc < 54 Gy
1
4
Chiasm
  • D0.03cc ≤ 54 Gy (hard constraint)
  • D0.03cc ≤ 50 Gy
1
3
Cochlea (Ipsi-lat)
  • Dmean ≤ 45 Gy (<30% hearing loss)
  • Dmean ≤ 32 Gy (<20% tinnitus)
5
9
Cochlea (Bi-lat)
  • Dmean ≤ 45 Gy (<30% hearing loss)
  • Dmean ≤ 32 Gy (<20% tinnitus)
7
9
Hippocampus
  • Dmean ≤ 30 Gy (<30% IQ loss)
  • D0.03cc ≤ 30 Gy
  • D40% ≤ 7.3 Gy (long-term NCF)
8
14
11
Lacrimal Gland
  • Dmean ≤ 25 Gy (clinic) (hard constraint)
1
Lens
  • D0.03cc ≤ 7 Gy (<25% cataract)
12
Optic nerves (Ipsi-lat)
  • D0.03cc ≤ 54 Gy (hard constraint)
  • D0.03cc ≤ 50 Gy
1
3
Optic nerve (Bi-lat)
  • D0.03cc ≤ 54 Gy (hard constraint)
  • D0.03cc ≤ 50 Gy
1
6
Pituitary
  • Dmean ≤ 45 Gy (panhypopituitarism)
  • Dmean ≤ 20 Gy (growth hormone deficiency)
10
13
Retina
  • D0.03cc ≤ 45 Gy (hard constraint)
1
TargetObjectivePriority
PTV
  • D90% > 57 Gy (95%)
1
CTV
  • D100% > 60 Gy (100%)
2
PTV
  • D0.03cc < 64 Gy (107%)
3
Table 2. Predicted mean doses in Gy for the different optic nerve left contours.
Table 2. Predicted mean doses in Gy for the different optic nerve left contours.
ONL ContourCalc. DosePred. DoseΔ Dose Calc-PredDSCΔ to Calc-RefΔ to Pred-Ref
Reference34.735.5−0.8n.a.n.a.n.a
Alternative-132.235.7−3.50.31−2.50.2
Alternative-230.732.4−1.70.26−4−3.1
Alternative-334.234.5−0.30.63−0.5−1
Alternative-431.834.1−2.30.59−2.9−1.4
Alternative-526.930.1−3.20.51−7.8−5.4
Alternative-632.836−3.20.20−1.90.5
Alternative-741.841.20.60.167.15.7
Alternative-835.333.12.20.580.6−2.4
Alternative-934.536.1−1.60.05−0.20.6
Mean33.4934.87−1.380.37Corr. Coeff.: 0.89
Table 3. Results of the dose score and DVH scores of the initial and the updated dose prediction models. Lower values represent better scores.
Table 3. Results of the dose score and DVH scores of the initial and the updated dose prediction models. Lower values represent better scores.
Test SetInitial ModelConcave Updated ModelMultiple Lesion Updated ModelCombined Updated Model
Dose scores’ whole brain volume
Standard test set0.940.940.920.98
Concave test set0.870.810.810.87
Multiple test set1.300.841.241.02
Combined test set0.980.900.950.97
DVH scores’ OARs
Standard test set2.011.731.851.89
Concave test set2.111.671.992.08
Multiple test set3.051.863.052.67
Combined test set2.181.742.042.03
DVH scores’ targets
Standard test set1.191.121.201.26
Concave test set1.721.671.511.66
Multiple test set3.621.923.182.91
Combined test set1.611.311.531.55
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Poel, R.; Kamath, A.J.; Willmann, J.; Andratschke, N.; Ermiş, E.; Aebersold, D.M.; Manser, P.; Reyes, M. Deep-Learning-Based Dose Predictor for Glioblastoma–Assessing the Sensitivity and Robustness for Dose Awareness in Contouring. Cancers 2023, 15, 4226. https://doi.org/10.3390/cancers15174226

AMA Style

Poel R, Kamath AJ, Willmann J, Andratschke N, Ermiş E, Aebersold DM, Manser P, Reyes M. Deep-Learning-Based Dose Predictor for Glioblastoma–Assessing the Sensitivity and Robustness for Dose Awareness in Contouring. Cancers. 2023; 15(17):4226. https://doi.org/10.3390/cancers15174226

Chicago/Turabian Style

Poel, Robert, Amith J. Kamath, Jonas Willmann, Nicolaus Andratschke, Ekin Ermiş, Daniel M. Aebersold, Peter Manser, and Mauricio Reyes. 2023. "Deep-Learning-Based Dose Predictor for Glioblastoma–Assessing the Sensitivity and Robustness for Dose Awareness in Contouring" Cancers 15, no. 17: 4226. https://doi.org/10.3390/cancers15174226

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop