Next Article in Journal
Monocular Depth Estimation: Lightweight Convolutional and Matrix Capsule Feature-Fusion Network
Next Article in Special Issue
Generation of Prior Information in a Dual-Mode Microwave-Ultrasound Breast Imaging System
Previous Article in Journal
Object-Based Change Detection Algorithm with a Spatial AI Stereo Camera
Previous Article in Special Issue
Microwave Hyperthermia of Brain Tumors: A 2D Assessment Parametric Numerical Study
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Antenna Excitation Optimization with Deep Learning for Microwave Breast Cancer Hyperthermia

1
Department of Electronics and Communication Engineering, Istanbul Technical University, Istanbul 34469, Turkey
2
Mitos Medical Technologies, Istanbul 34469, Turkey
*
Author to whom correspondence should be addressed.
Sensors 2022, 22(17), 6343; https://doi.org/10.3390/s22176343
Submission received: 14 June 2022 / Revised: 5 August 2022 / Accepted: 17 August 2022 / Published: 23 August 2022

Abstract

:
Microwave hyperthermia (MH) requires the effective calibration of antenna excitations for the selective focusing of the microwave energy on the target region, with a nominal effect on the surrounding tissue. To this end, many different antenna calibration methods, such as optimization techniques and look-up tables, have been proposed in the literature. These optimization procedures, however, do not consider the whole nature of the electric field, which is a complex vector field; instead, it is simplified to a real and scalar field component. Furthermore, most of the approaches in the literature are system-specific, limiting the applicability of the proposed methods to specific configurations. In this paper, we propose an antenna excitation optimization scheme applicable to a variety of configurations and present the results of a convolutional neural network (CNN)-based approach for two different configurations. The data set for CNN training is collected by superposing the information obtained from individual antenna elements. The results of the CNN models outperform the look-up table results. The proposed approach is promising, as the phase-only optimization and phase–power-combined optimization show a 27% and 4% lower hotspot-to-target energy ratio, respectively, than the look-up table results for the linear MH applicator. The proposed deep-learning-based optimization technique can be utilized as a protocol to be applied on any MH applicator for the optimization of the antenna excitations, as well as for a comparison of MH applicators.

1. Introduction

Microwave breast cancer hyperthermia (MH) is a treatment modality aiming at a non-invasive temperature increase in a malignant breast tumor using electromagnetic (EM) radiation in microwave frequencies [1]. The hyperthermia procedure can be used with other modalities to increase the effectiveness of the cancer therapy [2,3]. Depending on the procedure, a target temperature rise above 39–45 °C is expected [4]. Many MH applicator designs have been proposed [5,6]. After deciding on the applicator, in order to effectively increase the temperature of the malignant tumor and prevent hot spots in the healthy tissue, focusing the microwave energy on the target is essential. Focusing, also called hyperthermia treatment planning (HTP), is achieved through the optimization of the antenna excitations. To this end, many different studies are reported in the literature.
In one of the earlier studies of breast MH, two microwave wave guides were used as the radiation source [7]. During the treatment, Fenn et. al adjusted the excitation phase and amplitude in real-time with a connected phase shifter using the feedback obtained from the invasive measurements of the electric field amplitude and local temperature of the tissue. The time reversal (TR) technique is one of the most used methods in hyperthermia applications due to the general validity of its principle. However, the time-reversal of the energy from the desired target point does not enable regulation of the side lobes. Hence, the technique creates hot spots, especially in lossy media, where TR invariance is no longer valid [8,9,10,11,12,13].
Another proposed approach is to optimize the field distribution in the target region. In [14,15,16,17], the scalar field constrained optimization problem is tackled using convex programming (CP) strategies. For vector fields, the proposed optimization problem becomes a non-deterministic polynomial-time hard (NP-hard) problem, and the authors introduce constrained optimization problem approaches for vector fields in [17,18]. The advantage of constrained focusing over TR is the minimization of the side lobes, since multi-objective optimization minimizes the field outside of the target. These studies show successful results on homogeneous or piece-wise homogeneous scenarios; hot spots are decreased, yet not completely vanished. Due to the nonlinear nature of the problem, the objective function is separated into sub-functions, the optimization is conducted in parallel, and assumptions, such as neglecting the imaginary part of the electric field component, are made.
Nguyen et al. utilized particle swarm optimization (PSO) on 2D and 3D simulation cases, as well as experimental phantom studies [19,20,21]. Antenna array excitations are initially calculated to focus the energy on the target, and then PSO is implemented to adjust the focusing of both energy and temperature distributions with the hybrid utilization of an EM solver and MATLAB. However, the utilized technique has restrictions that prevent its large-scale applicability. For instance, the phase difference is calculated with the distance between antenna arrays, requiring the algorithm to be altered for the application of a different antenna system.
Deep learning has been employed as a tool for solving the medical diagnostics and therapeutics problems in the past decade, such as the registration of multi-modality diagnostic images [22], tissue type classification [23], the optimization of elements in ultrasound thermometry [24], MH monitoring [25], and many more, and it continues to extend its validity. One of the indispensable applications of deep learning is the antenna array selection and excitation optimization problem in beamforming, which is a high-cost problem [26,27,28]. In [28], CNN performs well even in the presence of antenna array imperfections. In [26], an arbitrary radiation pattern was learnt with the use of a deep neural network on antenna excitation phase values.
In this study, a CNN-based approach is proposed for the optimization of antenna excitations in order to enable the focusing of microwave energy in a realistic breast medium. To carry this out, data sets of the possible breast heat distributions and the corresponding antenna excitations using the superposition property are produced. Next, a CNN-based approach is implemented in two steps: first, a CNN is designed to optimize the antenna phases, and, then, in order to optimize the antenna power, the second CNN is designed. In particular, the contributions of this paper can be summarized as follows;
  • We propose a CNN-based optimization of the antenna excitation parameters, which can be used as a hyperthermia treatment protocol. The proposed approach is applicable to any MH applicator since it learns directly from the generated dataset. The proposed approach is independent of system parameters such as operation frequency, antenna type, medium, or breast type; therefore, it enables the fair comparison of different MH applicator designs or operation parameters.
  • The proposed optimization approach does not depend on the initial value assignment, which may yield a different local best each time it is performed.
  • HTP requires multiple cost optimizations and the available optimization techniques solely rely on the given cost function. Combining different cost functions increases the complexity; therefore, most of the techniques do not take these multiple cost functions into consideration. The proposed method does not depend on a cost function, but on a simple mask that substitutes the desired heating map directly.
  • We demonstrated the applicability of the proposed CNN-based method with two MH applicator configurations; that is, linear array and circular MH applicators. We used a heterogeneously dense realistic digital breast phantom, which is a difficult breast type to focus the energy. The successful focusing on this breast type demonstrates the capability of the proposed approach.
  • CNN models are created offline, but they can be used online for different targets without any time or computational requirements.
  • To the best of the author’s knowledge, this is the first paper to utilize deep learning for optimizing the antenna excitations for MH application.
  • Finally, this work proposes a fast and simple data generation approach.
The rest of the paper is divided into the following sections: Section 2 lays an overview of the hyperthermia problem, Section 3 gives the details of the followed methodology, Section 4 depicts the results of the proposed approach, along with a comparison to look-up table results, and the conclusions are drawn in Section 5.

2. Overview of Hyperthermia Problem

2.1. Bio-Heat Equation

The microwave hyperthermia phenomenon is essentially the microwave heat transfer problem within the biological tissues. Penne’s bio-heat equation governs this problem [29]:
C p ρ T t = · ( K T ) + A 0 + Q 0 B ( T T b )
where C p is the specific heat capacity, ρ is the density, K is the thermal conductivity, T is the temperature, T b is the blood temperature, A 0 is the metabolic heat generation, and B is the capillary blood perfusion coefficient. These parameters are tissue-specific terms. Q 0 is the heating potential (HP) and is proportional to the square of the electric field amplitude, and Q 0 = 0.5 σ | E | 2 Wm 3 , where E is the electric field and σ (S/m) is the electrical conductivity. It is shown by Iero et al. [30] that the maxima of HP and the temperature are located at the same position, assuming that K and B are constants and in a steady-state, via Green’s function approach. Based on the reported work in [30], this paper aims to focus the energy on the target within the HP distribution in order to reach the desired temperature at the target.

2.2. Optimization

The total electric field vector inside the breast with N antenna excitations can be written as [31]:
E t o t ( r ) = i N a i E i ( r ) e j ϕ i
where E i ( r ) is the electric field vector inside the breast when only the ith antenna is excited with unitary excitation, and a i e j ϕ i is the ith excitation coefficient with ϕ i phase difference. The corresponding HP is
Q 0 ( r ) = 0.5 σ ( r ) | E t o t ( r ) | 2 W / m 3
at any location in the breast. The focusing problem requires the maximization of the energy at the target while minimizing it at the healthy tissue; such an objective function Ω can be written as follows [31]:
max a i , ϕ i Ω = t a r g e t σ ( r ) | E t o t ( r ) | 2 b r e a s t σ ( r ) | E t o t ( r ) | 2 .
The electric field is a complex vector with three components in 3D geometry, | E t o t ( r ) | 2 = | E x 2 ( r ) + E y 2 ( r ) + E z 2 ( r ) | and E x 2 ( r ) = ( Re ( E x ) + j Im ( E x ) ) 2 . Thus, the optimization problem in (4) is non-linear and a challenging task. In the literature, generally, some assumptions are made, such as Im ( E x ) = 0 [18], so that the problem is simplified. This work proposes a method to find the optimum antenna excitations without making any assumptions.

3. Methods

3.1. Antenna Systems and Numerical Test Bed

Two different antenna configurations, namely hyperthermia applicators, were used in this work: linear and circular. Antipodal Vivaldi antennas, whose frequency range is given in Figure 1a, were used as sources. A 2.45 GHz operation frequency was chosen as it is one of the ISM bands. Figure 1b shows the linear antenna system (linear applicator), where 6 antennas are placed linearly 2 cm apart on one side of the breast and the remaining 6 antennas are placed on the opposite side of the breast. Although there are 12 antennas, we treated 3 successive antennas as an array with same excitation, and N = 4 excitations took place for 4 antenna arrays. Consequently, 4 phase and 4 amplitude variables were defined. Please see [6] for a detailed explanation of the antenna configuration and the excitation scheme. Among the 4 phase variables, one of them should be defined as a reference, ϕ 1 = 0 , in order to obtain a unique phase set. From the remaining phase variables, two of them were given a solution space of [ 0 , 2 π ) and, finally, the 4th phase variable was defined as a function of the previous two phase variables, ϕ 4 = ϕ 2 + ϕ 3 .
The applicator where the antennas are placed with a circular orientation around the breast tissue is shown in Figure 1c. Antennas were placed into the applicator circularly with 30 angular separation and numbered as shown in the figure. In the circular applicator, there were a total of 12 antennas and the number of antenna excitations was N = 12 . Even-numbered antennas were allowed to take phase values varying between [ 0 , 2 π ) , and the odd-numbered antenna phases were assigned as the summation of two adjacent antennas to lower the degrees of freedom in order to ensure convergence and enable rapid training. Please note that the phase value of 1st antenna was always kept as 0 for reference.
In hyperthermia studies, it is assumed that the patient has been scanned with an imaging modality such as X-ray mammography or magnetic resonance imaging (MRI), and that it is decided that the patient should undergo hyperthermia therapy. It is also assumed that the dielectric properties of the breast is obtained from these imaging modalities. In [32,33], the authors registered the corresponding breast tissues (glandular, fat, skin) to the MRI data and also provided the Cole–Cole and Debye parameters for these tissues. In this study, heterogeneously dense breast with ID 062204 given in [32,33] was used. The dielectric property, namely the relative permittivity ( ϵ r ) and electrical conductivity ( σ ) distributions at 2.45 GHz, were calculated using the Debye parameters given in [33]. This is a healthy breast model. Figure 1d,e display the relative permittivity and electrical conductivity from the central slice with a tumor inclusion of the said breast phantom, respectively.

3.2. Data Generation

Given the linearity in EM radiation with a single frequency, the superposition property in (2) was used for data generation. One option for data generation is simulation of the whole system with N antennas for every potential excitation voltage and phase value. However, both the time and computation cost of said method is high. Therefore, instead, each antenna was excited separately with unitary excitation in a finite element method (FEM)-based multiphysics simulation software (COMSOL Multiphysics) using the RF module. While one antenna is excited, remaining N 1 antennas are kept in the system to capture their effect. Electric field ( E ) distributions at the central axial slice of the breast, as well as the electrical conductivity σ distributions, were exported for each antenna; that is, a total of N simulations. All possible electric field vectors and heating potential distributions can be constructed using (2) and (3).
The 3D model of the breast and the electrical properties were imported to COMSOL Multiphysics. Antipodal Vivaldi antennas were also imported and positioned as in Figure 1b,c. Note that both the applicator and the said phantom were placed in free space and uniform lumped ports with 50 Ω impedance were used to excite the antennas. During the first set of simulations, for the circular applicator, 1st antenna was excited with 1 volt and 0 phase difference, whereas excitation option of the remaining N 1 ports was chosen as Off. The input power was calculated as P = V 2 / R = ( 1 V ) 2 / ( 50 Ω ) = 0.02 W. This process was repeated for N = 12 excitations. For the linear applicator, on the other hand, all 3 ports of the 3 successive antennas included in the 1st antenna array were excited with 1 volt and 0 phase difference, for the first set of simulations, whereas the ports of the remaining antenna arrays were kept as Off. This process was repeated for N = 4 excitations. Note that, Electromagnetic Waves, Frequency Domain physics, Frequency Domain option at single frequency of 2.45 GHz was used throughout this study.
Four cases of applicator and breast were studied: (i) linear applicator and breast without tumor, (ii) linear applicator and breast with tumor, (iii) circular applicator and breast without tumor, and (iv) circular applicator and breast with tumor. During simulations with tumor, a sphere with 5 mm radius was placed on the central slice of the breast phantom. Tumor inclusion had ϵ r = 40 and σ = 2.0 S/m, which is very close to the maximum electrical conductivity level in the breast [34]. Note that, in the cases (ii) and (iv), it was assumed that the patient was diagnosed with cancer, and that the tumor location, as well as the breast dielectric properties distributions, were known.
Data sets for each simulation case were built using (2). The central slice of the breast was utilized; that is, a data set composed from 2D data. First, only phase optimization was considered, in which, the antenna excitation voltages were equal. For the linear system, 2000 E distributions were produced with unitary excitations using integer phase pairs that were randomly chosen. Electric fields were then converted to HP distributions using (3). HPs were normalized such that the highest energy level was 1 and lowest energy level was 0. Produced HP data were labeled with the corresponding phase pairs. Note that, instead of using the phase values directly, sine and cosine of the phase were utilized for robustness. As can bee seen in Figure 2, these HP data with size 71 × 91, along with the labels, were used for training the CNN-1, where CNN-1 is the first step of the CNN model fed with the data set, in which, only the phase of the antennas change. CNNs were modeled on Jupyter Notebook using Python’s Keras and TensorFlow modules on an Intel Xeon CPU with 3.10 GHz.
Another data set with 2000 HP distributions was built with optimized phase values obtained from the CNN-1 and varying integer voltage values randomly chosen between 0 and 9. Obtained HP data were then normalized and labeled with the corresponding excitation voltage values. CNN-2, second step of the CNN model, was trained with this data set.
For the circular system, 50,000 normalized HP distributions and corresponding phases were used for training of CNN-1. Using the optimized phase values obtained from CNN-1, another 50,000 HP distributions and corresponding voltages were produced to train CNN-2. Produced data sets were split for training and validation of CNN with 80–20% ratio.

3.3. CNN Models

The designed sequential CNN had 3 convolution layers with 3 × 3 filter size and 16, 64, and 128 filters at respective layers, each followed by a maximum pooling operator of 2 × 2 as seen in Figure 2. These numbers were selected from common practise examples and adjusted by trial-and-error to meet requirements of this study, which is to build a fast, accurate, and robust optimization scheme. Convolution layers had ReLu activation. Then, batch normalization and flatten layers were applied. CNN model ended with 3 dense layers. The CNN optimizers and parameters were assigned as follows: optimizer was “Adam” optimizer, loss function was “Mean Absolute Error”, batch size was 100 for linear applicator (200 for circular applicator), and learning rate was 0.0001.
The same structure was used for CNN-1 and CNN-2 models. Only difference was the output size of the last dense layer: for linear applicator data set, output size was 4, whereas, for the circular applicator data set, output size was 12. CNNs were trained successfully using the generated data sets. An example of training and validation loss graphic for CNN-2—that is, for circular system voltage level optimization with increasing epoch—is given in Figure 3a. The flowchart for excitation optimization approach is given in Figure 3b.
The exact HP distribution in the breast medium is unknown. To represent the desired HP in the breast medium, a masked HP input was generated. The masked input contains a square region with a 10 mm side length centered at the target point. The target point location coincides with the tumor center if the handled case has a tumor. Since the goal is to maximize the HP on the target and minimize it in the healthy tissue, the value of the square and the remaining region were assigned as 1 and 0, respectively. This masked HP distribution was used as the input to both trained CNN-1 and CNN-2 models, and the outputs were the sine and cosine of the excitation phases for CNN-1 and excitation voltages for CNN-2. Note that the outputs are not necessarily from the data set; since we used CNN for regression, the outputs can take any value within the acceptable range. Obtained excitation voltage levels were then converted to power for convenience.

3.4. Evaluation Metrics

The objective function given in (4) was used as an evaluation metric of this study for the discrete data as shown below:
Ω t a r g e t ( Θ , V ) = t a r g e t σ ( r ) | E t o t ( r , Θ , V ) | 2 b r e a s t σ ( r ) | E t o t ( r , Θ , V ) | 2 100 %
where Θ and V represent the phase and the voltage excitation vectors. Since the tumor radius is 5 mm, the target heating domain was chosen as 10 mm × 10 mm square at the desired location.
In hyperthermia, minimizing the hotspots is almost as important as focusing the energy on the target domain. Since Equation (5) does not account for the hotspots, another metric, named hotspot-to-target ratio, was also utilized in this work. The hotspot-to-target ratio is defined as follows [31]:
Ψ ( Θ , V ) = Ω h o t s p o t ( Θ , V ) Ω t a r g e t ( Θ , V ) .
In the case of multiple hotspots, the most dominant hotspot was used to evaluate this metric.
Another important parameter is the total input power. In this study, total input power of all of the antennas was fixed to 6 W for all cases, and the results are given accordingly. With the constant total input power of 6 W, the average power deposition at the target domain can be calculated as follows:
P a v ( Θ , V ) = t a r g e t σ ( r ) | E t o t ( r , Θ , V ) | 2 target area
where the target area was chosen in accordance with the tumor size similar to the earlier target area : 10 mm × 10 mm square at the desired location.

4. Results and Discussion

The results of the four applicator and breast cases mentioned previously are given. First, the linear applicator was analyzed with the breast without a tumor inclusion. The position of ( x , y , z ) = (26, 12, 0) mm was targeted for energy focusing. The CNN-1 model for phase estimation was successfully implemented. The estimated phase values for each antenna array, in order to focus the energy at the target position, are given in Table 1 (shown with A.i). The CNN-2 was trained using these phase values as explained in Section 3.3. The predicted antenna input powers, which were scaled such that the total input power was 6W, are given in Table 1 (shown with A.ii). Note that there are three antennas in each array in the linear applicator, and the input powers are given for each antenna in the corresponding antenna array. The obtained HP distributions after CNN-1 and CNN-2 are given in Figure 4a,b, respectively. Note that the HP distributions are generated with the scaled input power values. The calculated evaluation metric Ω t a r g e t is 8.42% after CNN-1 and 10.20% after CNN-2. The hotspot-to-target ratio decreases from Ψ = 1.28 to Ψ = 0.89 points after CNN-2 as Ω t a r g e t increases, whereas the Ω h o t s p o t decreases. P a v decreases from 14.89 kWm 3 to 12.01 kWm 3 .
In order to evaluate the effectiveness of the CNN-based antenna excitation optimization, a comparison was performed with the results obtained from look-up tables. For the linear antenna system, two phase values ( ϕ 2 , ϕ 3 ) were varied to focus the energy on to the target [6]. The HP distributions were calculated for all possible integer phase values (in degrees), and 360 × 360 = 129,600 HP distributions were obtained. For each HP, the evaluation metric of the target, Ω t a r g e t , was calculated in a simple loop. The phase pair with the highest Ω t a r g e t was recorded. Phase values for each antenna element are given in Table 1 (shown with B.i). The obtained Ω t a r g e t is 8.69%. The corresponding HP distribution is displayed in Figure 4c. Using the phases obtained from the first look-up table, the antenna voltage excitations vary between 0 V and 1 V, with 0.025 V increments, 41 × 41 × 41 × 41 = 2,825,761 HP distributions were calculated in a simple loop, and the voltage levels that gave the highest Ω t a r g e t were recorded. Next, the voltage levels were converted to power and are given in Table 1 (shown with B.ii). The HP distribution obtained from the second look-up table is shown in Figure 4d.
For the phase-only optimizations, the evaluation metric for the target position ( x , y , z ) = (26, 12, 0) mm obtained using the look-up table is higher than the CNN metric by 0.27%. However, the hotspot-to-target ratio ( Ψ ) is also higher than the CNN result by 0.63 points, which is not desired in the hyperthermia applications. Since the look-up table is formed by only weighing the evaluation metric at the target location, the hotspots are neglected. On the other hand, well-trained CNN models are known to generalize, and, when the masked input is entered, the CNN model naturally gives the excitations for an HP that is maximized at the target but also minimized at the rest.
An additional power level adjustment improves the evaluation metrics for both CNN and look-up table methods. This second stage not only increases Ω t a r g e t but also decreases Ω h o t s p o t , consequently boosting the hotspot-to-target ratio, Ψ , considerably. CNN-2 optimization provides a 1.78% higher Ω t a r g e t and 0.39 point lower Ψ than CNN-1; however, P a v decreases from 14.89 kW/m 3 to 12.01 kW/m 3 .
Second, the linear applicator was analyzed using the breast with a tumor inclusion. The tumor has a 5 mm radius and is positioned at ( x , y , z ) = (26, 12, 0) mm. The obtained phase values for each antenna array for focusing the energy at the tumor position are given in Table 1 (shown with C.i). The predicted antenna input powers, which are scaled, are shown in Table 1 (shown with C.ii). The HP distributions after CNN-1 and CNN-2 are given in Figure 5a,b, respectively. The calculated evaluation metric Ω t a r g e t ( P ) is 9.57% after CNN-1 and 12.43% after CNN-2. The hotspot-to-target ratio decreases from Ψ = 0.91 to Ψ = 0.68 points in the second stage as Ω t a r g e t increases, whereas the Ω h o t s p o t decreases. Two-stage CNN optimization provides a 2.57% higher Ω t a r g e t and 0.25 point lower Ψ than the first stage; however, P a v decreases from 22.72 kW/m 3 to 19.55 kW/m 3 .
The phase values obtained from the look-up table for each antenna array are given in Table 1 (shown with D.i) with corresponding Ω t a r g e t = 13.67%. The HP distributions are displayed in Figure 5c,d for the first and the second look-up tables, respectively. For the phase only optimizations, the evaluation metric of the target position ( x , y , z ) = (26, 12, 0) mm for the look-up table is higher than the CNN-1 metric by 1.04%; however, the hotspot-to-target ratio ( Ψ ) is also higher than that of CNN-1 by 0.25 points.
The comparison of the obtained results from CNN and the look-up table reveals that using CNN models is a more effective method. Specifically, two-stage CNN has a higher Ω t a r g e t and P a v , and lower Ψ than a two-stage look-up table. Regarding computational costs, for the linear antenna system, the training of CNN-1 and CNN-2 models takes ∼2 min. and ∼4 min., respectively, on the central processing unit (CPU) only, whereas the look-up table search lasts ∼1 min. and ∼29 min., respectively, for the phase and power search using simple loops. Note that neither of the methods are adjusted for time optimization.
Metrics for the breast with a tumor are better than the metrics of the breast without a tumor: higher Ω t a r g e t , lower Ψ , and higher P a v values. This is expected, since the tumor region has a higher conductivity, 2 S/m, than the background conductivity, which varies between 1.00 S/m and 1.88 S/m, and the HP is proportional to conductivity according to Equation (3).
Although the linear applicator metrics obtained via CNN and look-up table methods are compared, the look-up table was not implemented for the circular applicator due to the sheer number of variable combinations. Note that 5 independent phase and 12 independent power values were optimized for the circular applicator. Look-up tables for phase and power require 360 5 6 × 10 12 and 41 12 2.25 × 10 19 loops, respectively. Since the CNN outperformed the look-up table in both evaluation metrics, Ω t a r g e t and Ψ , for the linear antenna system, only the CNN method was chosen to optimize the circular applicator parameters.
CNN-1 and CNN-2 models were created for the case with the circular applicator and the breast phantom without a tumor. The parameters obtained from the two CNNs for a target position ( x , y , z ) = (7, −11, 0) mm are given in Table 2 (shown with A.). The evaluation metrics are calculated as Ω t a r g e t = 14.31%, Ω h o t s p o t = 7.81%, and Ψ = 0.55 for CNN-1, and Ω t a r g e t = 15.42%, Ω h o t s p o t = 7.79%, and Ψ = 0.51 for CNN-2. CNN-2 has a 1.11% higher Ω t a r g e t than phase-only optimization and a 0.04 points lower hotspot-to-target ratio. The P a v increased from 13.10 kW/m 3 to 18.09 kW/m 3 with CNN-2.
The parameters obtained for another target position (−11, −7, 0) mm are given in Table 2. (shown with B.). The evaluation metrics for CNN-1 are: Ω t a r g e t = 12.42%, Ω h o t s p o t = 7.95%, and Ψ = 0.64. The evaluation metrics for CNN-2 are: Ω t a r g e t = 15.07%, Ω h o t s p o t = 4.87%, and Ψ = 0.32. P a v increased from 10.99 kW/m 3 to 12.30 kW/m 3 with the second stage of CNN.
The circular applicator with the breast containing a tumor at ( x , y , z ) = (11, −14, 0) mm position is considered. The tumor location is given as the target to CNN models. The phase values and the scaled antenna input powers acquired from CNN-1 and CNN-2 are given in Table 2. (shown with C.). The evaluation metrics are calculated as Ω t a r g e t = 12.31%, Ω h o t s p o t = 7.47%, and Ψ = 0.61 for CNN-1, and Ω t a r g e t = 19.47%, Ω h o t s p o t = 10.51%, and Ψ = 0.54 for CNN-2. After the additional excitation voltage optimization stage, the hotspot-to-target ratio decreased by 0.7 points and P a v increased from 9.76 kW/m 3 to 22.83 kW/m 3 . The resulting HPs are given in Figure 6c,f for phase-only and phase and voltage optimizations, respectively.
In [35], five hyperthermia treatment planning optimization techniques are compared to each other in terms of capabilities. The authors concluded that PSO and genetic algorithm (GA) or differential evaluation (DE) [36] optimization techniques are superior to Nelder–Mead simplex [37] and pattern search algorithms and TR in terms of a lower hotspot-to-target SAR ratio, and, further, DE is superior to PSO in terms of the target-to-breast SAR ratio and the average power deposition in the target region. PSO and DE algorithms are dependent on the initial values and are prone to finding a local best solution, as well as the issue of obtaining a different solution each time the techniques are used. Antenna excitation parameter optimization is a multi-objective optimization, and the higher the antenna number, the more complex the optimization becomes. Moreover, these optimization techniques are dependent on the cost function of choice, and HTP requires multiple cost functions to be optimized at the same time. The proposed method, on the other hand, presents a simpler solution, with the usage of a simple mask representing the desired HP distribution. A comparison of the mentioned techniques and the proposed method will be conducted in more detail in a later study. Another future work would consist of a 3D optimization study, and simultaneous phase and power optimization.

5. Conclusions

In this paper, we propose an alternative approach for finding the optimum antenna excitations for energy focusing in microwave breast hyperthermia. Optimization algorithms proposed so far on this subject generally deal with linear and real functions. On the other hand, the optimization of non-linear and complex functions, such as heating potential, requires mathematical simplifications to ensure convergence. There is a need for a method to tackle the problem completely, without assumptions. Moreover, there is a need for a protocol of extracting the optimum antenna excitation parameters, also known as the input power and the phase, for any MH system with an arbitrary applicator, matching medium, etc. To this end, we exploited the learning ability of convolutional neural networks and let CNN models learn the best fit for any MH system. Linear and circular MH applicators were used to show the generality of the proposed method, along with healthy and tumorous numeric breast phantoms. A heterogeneously dense breast phantom was used as a challenge. Data sets for phase and power optimization were created offline for training, validation, and testing. A step input data highlighting the desired focusing region was utilized for online optimization. Based on the comparison of the proposed method and look-up table results on the linear MH applicator, CNN-optimized excitation parameters produce HP distributions with a smaller hotspot-to-target ratio. It was also demonstrated that our approach performs well on the circular applicator, which has a challenging optimization problem due to the high number of variables.

Author Contributions

Conceptualization, G.Y. and M.N.A.; methodology, G.Y., H.Y., M.N.A.; formal analysis, G.Y. and T.Y.; investigation, I.E.U. and Y.D.; resources, T.Y. and I.A.; data curation, H.Y., I.E.U. and Y.D.; writing—original draft preparation, G.Y.; writing—review and editing, T.Y.; supervision, M.N.A., T.Y. and I.A.; funding acquisition, T.Y. and I.A. All authors have read and agreed to the published version of the manuscript.

Funding

This work has received funding from Scientific and Technological Research Council of Turkey under grant agreement 118S074 and COST Action grant agreement CA17115.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
MHMicrowave Hyperthermia
SARSpecific Absorption Rate
CNNConvolutional Neural Network
EMElectromagnetic
TRTime Reversal
CPConvex Programming
NPNon-deterministic Polynomial-time
PSOParticle Swarm Optimization
HPHeating Potential
ISMIndustrial Scientific Medical
MRIMagnetic Resonance Imaging
FEMFinite Element Method
CPUCentral Processing Unit

References

  1. Paulides, M.; Dobsicek Trefna, H.; Curto, S.; Rodrigues, D. Recent Technological Advancements In Radiofrequency- and Microwave-Mediated Hyperthermia For Enhancing Drug Delivery. Adv. Drug Deliv. Rev. 2020, 163–164, 3–18. [Google Scholar] [CrossRef] [PubMed]
  2. Androulakis, I.; Mestrom, R.M.C.; Christianen, M.E.M.C.; Kolkman-Deurloo, I.-K.K.; van Rhoon, G.C. Simultaneous ThermoBrachytherapy: Electromagnetic Simulation Methods for Fast and Accurate Adaptive Treatment Planning. Sensors 2022, 22, 1328. [Google Scholar] [CrossRef] [PubMed]
  3. Sumser, K.; Bellizzi, G.G.; van Rhoon, G.C.; Paulides, M.M. The Potential of Adjusting Water Bolus Liquid Properties for Economic and Precise MR Thermometry Guided Radiofrequency Hyperthermia. Sensors 2020, 20, 2946. [Google Scholar] [CrossRef] [PubMed]
  4. Datta, N.; Ordóñez, S.; Gaipl, U.; Paulides, M.; Crezee, H.; Gellermann, J.; Marder, D.; Puric, E.; Bodis, S. Local Hyperthermia Combined With Radiotherapy And-/Or Chemotherapy: Recent Advances And Promises For The Future. Cancer Treat. Rev. 2015, 41, 742–753. [Google Scholar] [CrossRef] [PubMed]
  5. Ferrero, R.; Androulakis, I.; Martino, L.; Nadar, R.; van Rhoon, G.C.; Manzin, A. Design and Characterization of an RF Applicator for In Vitro Tests of Electromagnetic Hyperthermia. Sensors 2022, 22, 3610. [Google Scholar] [CrossRef] [PubMed]
  6. Altintas, G.; Akduman, I.; Janjic, A.; Yilmaz, T. A Novel Approach on Microwave Hyperthermia. Diagnostics 2021, 11, 493. [Google Scholar] [CrossRef]
  7. Fenn, A.J. An adaptive microwave phased array for targeted heating of deep tumours in intact breast: Animal study results. Int. J. Hyperth. 1999, 15, 45–61. [Google Scholar] [CrossRef]
  8. Fuchs, B.; Fuchs, J. Optimal Polarization Synthesis of Arbitrary Arrays With Focused Power Pattern. IEEE Trans. Antennas Propag. 2011, 59, 4512–4519. [Google Scholar] [CrossRef]
  9. Kosmas, P.; Zastrow, E.; Hagness, S.C.; Van Veen, B.D. A Computational Study of Time Reversal Techniques for Ultra-Wideband Microwave Hyperthermia Treatment of Breast Cancer. In Proceedings of the IEEE Statistical Signal Processing Workshop, Madison, WI, USA, 26–29 August 2007; pp. 312–316. [Google Scholar]
  10. Zastrow, E.; Hagness, S.; Van Veen, B.; Medow, J. Time-Multiplexed Beamforming For Noninvasive Microwave Hyperthermia Treatment. IEEE Trans. Biomed. Eng. 2011, 58, 1574–1584. [Google Scholar] [CrossRef] [Green Version]
  11. Stang, J.; Haynes, M.; Carson, P.; Moghaddam, M. A Preclinical System Prototype For Focused Microwave Thermal Therapy of The Breast. IEEE Trans. Biomed. Eng. 2012, 59, 2431–2438. [Google Scholar] [CrossRef] [Green Version]
  12. Trefna, H.; Togni, P.; Shiee, R.; Persson, M. Time-reversal system for microwave hyperthermia. In Proceedings of the 4th EuCAP, Barcelona, Spain, 12–16 April 2010; pp. 1–3. [Google Scholar]
  13. Yavuz, M.; Teixeira, F. Frequency Dispersion Compensation In Time Reversal Techniques For UWB Electromagnetic Waves. IEEE Geosci. Remote Sens. Lett. 2005, 2, 233–237. [Google Scholar] [CrossRef]
  14. Iero, D.; Isernia, T.; Morabito, A.; Catapano, I.; Crocco, L. Optimal Constrained Field Focusing for Hyperthermia Cancer Therapy: A Feasibility Assessment on Realistic Phantoms. Prog. Electromagn. Res. 2010, 102, 125–141. [Google Scholar] [CrossRef] [Green Version]
  15. Isernia, T.; Panariallo, G. Optimal focusing of scalar fields with arbitrary upper bounds. In Proceedings of the Atti XI Riunione Nazionale di Elettromagnetismo (Italian), (XI RiNEm), Florence, Italy, 28 September–1 October 1998. [Google Scholar]
  16. Iero, D.; Isernia, T.; Crocco, L. Focusing Time Harmonic Scalar Fields In Non-Homogenous Lossy Media: Inverse Filter vs. Constrained Power Focusing Optimization. Appl. Phys. Lett. 2013, 103, 093702. [Google Scholar] [CrossRef]
  17. Iero, D.; Isernia, T.; Crocco, L. Focusing Time-Harmonic Scalar Fields In Complex Scenarios: A Comparison. IEEE Antennas Wirel. Propag. Lett. 2013, 12, 1029–1032. [Google Scholar] [CrossRef]
  18. Iero, D.; Crocco, L.; Isernia, T. Constrained Power Focusing Of Vector Fields: An Innovative Globally Optimal Strategy. J. Electromagn. Waves Appl. 2015, 29, 1708–1719. [Google Scholar] [CrossRef]
  19. Nguyen, P.; Abbosh, A.; Crozier, S. Microwave Hyperthermia For Breast Cancer Treatment Using Electromagnetic And Thermal Focusing Tested On Realistic Breast Models And Antenna Arrays. IEEE Trans. Antennas Propag. 2015, 63, 4426–4434. [Google Scholar] [CrossRef]
  20. Nguyen, P.; Abbosh, A.; Crozier, S. Three-Dimensional Microwave Hyperthermia For Breast Cancer Treatment in A Realistic Environment Using Particle Swarm Optimization. IEEE Trans. Biomed. Eng. 2017, 64, 1335–1344. [Google Scholar] [CrossRef]
  21. Nguyen, P.; Abbosh, A.; Crozier, S. 3-D Focused Microwave Hyperthermia For Breast Cancer Treatment With Experimental Validation. IEEE Trans. Antennas Propag. 2017, 65, 3489–3500. [Google Scholar] [CrossRef]
  22. Miao, S.; Wang, Z.; Liao, R. A CNN Regression Approach For Real-Time 2D/3D Registration. IEEE Trans. Med. Imaging 2016, 35, 1352–1363. [Google Scholar] [CrossRef]
  23. Oliveira, B.L.; Godinho, D.; O’Halloran, M.; Glavin, M.; Jones, E.; Conceição, R.C. Diagnosing Breast Cancer with Microwave Technology: Remaining Challenges and Potential Solutions with Machine Learning. Diagnostics 2018, 8, 36. [Google Scholar] [CrossRef] [Green Version]
  24. Kim, Y.; Audigier, C.; Ellens, N.; Boctor, E.M. Low-Cost Ultrasound Thermometry for HIFU Therapy Using CNN. In Proceedings of the 2018 IEEE International Ultrasonics Symposium (IUS), Kobe, Japan, 22–25 October 2018; pp. 1–9. [Google Scholar]
  25. Yilmaz, T.; Akinci, M.N.; Girgin, E.; Önal, H. A Real-time Breast Hyperthermia Monitoring Scheme Based on Processing of Microwave Scattering Parameters with Deep Learning. TechRxiv, 2022, submitted.
  26. Kim, J.; Choi, S. A Deep Learning-Based Approach For Radiation Pattern Synthesis Of An Array Antenna. IEEE Access 2020, 8, 226059–226063. [Google Scholar] [CrossRef]
  27. Elbir, A.; Mishra, K. Joint Antenna Selection And Hybrid Beamformer Design Using Unquantized and Quantized Deep Learning Networks. IEEE Trans. Wirel. Commun. 2020, 19, 1677–1688. [Google Scholar] [CrossRef] [Green Version]
  28. Sallam, T.; Attiya, A. Convolutional Neural Network For 2D Adaptive Beamforming of Phased Array Antennas With Robustness To Array Imperfections. Int. J. Microw. Wirel. Technol. 2021, 13, 1096–1102. [Google Scholar] [CrossRef]
  29. Pennes, H. Analysis of Tissue and Arterial Blood Temperatures in the Resting Human Forearm. J. Appl. Physiol. 1998, 85, 5–34. [Google Scholar] [CrossRef]
  30. Iero, D.; Crocco, L.; Isernia, T. Thermal And Microwave Constrained Focusing For Patient-Specific Breast Cancer Hyperthermia: A Robustness Assessment. IEEE Trans. Antennas Propag. 2014, 62, 814–821. [Google Scholar] [CrossRef]
  31. Canters, R.; Wust, P.; Bakker, J.; Van Rhoon, G. A Literature Survey On Indicators For Characterisation And Optimisation Of SAR Distributions In Deep Hyperthermia, A Plea For Standardisation. Int. J. Hyperth. 2009, 25, 593–608. [Google Scholar] [CrossRef]
  32. Zastrow, E.; Davis, S.; Lazebnik, M.; Kelcz, F.; Van Veen, B.; Hagness, S. Development Of Anatomically Realistic Numerical Breast Phantoms With Accurate Dielectric Properties For Modeling Microwave Interactions With The Human Breast. IEEE Trans. Biomed. Eng. 2008, 55, 2792–2800. [Google Scholar] [CrossRef] [Green Version]
  33. UWCEM-Phantom Repository. Available online: https://uwcem.ece.wisc.edu/phantomRepository.html (accessed on 10 November 2020).
  34. Lazebnik, M.; Popovic, D.; McCartney, L.; Watkins, C.; Lindstrom, M.; Harter, J.; Sewall, S.; Ogilvie, T.; Magliocco, A.; Breslin, T.; et al. A Large-Scale Study of The Ultrawideband Microwave Dielectric Properties Of Normal, Benign And Malignant Breast Tissues Obtained From Cancer Surgeries. Phys. Med. Biol. 2007, 52, 6093–6115. [Google Scholar] [CrossRef]
  35. Baskaran, D.; Arunachalam, K. Optimization techniques for hyperthermia treatment planning of breast cancer: A comparative study. In Proceedings of the IEEE MTT-S International Microwave and RF Conference (IMARC), Mumbai, India, 13–15 December 2019. [Google Scholar]
  36. Cappiello, G.; Mc Ginley, B.; Elahi, M.A. Differential Evolution Optimization of the SAR Distribution for Head and Neck Hyperthermia. IEEE Trans. Biomed. Eng. 2017, 64, 1875–1885. [Google Scholar] [CrossRef]
  37. Curto, S.; Garcia-Miquel, A.; Suh, M.; Vidal, N.; Lopez-Villegas, J.M.; Prakash, P. Design and characterisation of a phased antenna array for intact breast hyperthermia. Int. J. Hyperth. 2018, 34, 250–260. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Microwave hyperthermia (MH) applicator configurations: (a) S11 parameter vs. frequency graph of a single Vivaldi antenna. (b) Linear antenna system, (b) circular antenna system with a tumor. Dielectric properties of the central slice of the breast with tumor: (d) relative permittivity, (e) electrical conductivity (S/m).
Figure 1. Microwave hyperthermia (MH) applicator configurations: (a) S11 parameter vs. frequency graph of a single Vivaldi antenna. (b) Linear antenna system, (b) circular antenna system with a tumor. Dielectric properties of the central slice of the breast with tumor: (d) relative permittivity, (e) electrical conductivity (S/m).
Sensors 22 06343 g001aSensors 22 06343 g001b
Figure 2. CNN-1 model for the linear system. In order to train the CNN-1 model of the linear system, 2000 data with the size of 71 × 91 from HP data set was used along with 2000 corresponding labels with the size of 4 × 1 . Labels include the sine and cosine of the two phase values that are optimized in the linear applicator. To utilize the trained CNN-1 model for phase optimization, masked input indicating the desired focus region with a size of 71 × 91 was given as input, and an estimated 4 × 1 output was obtained, which has the same structure as the labels.
Figure 2. CNN-1 model for the linear system. In order to train the CNN-1 model of the linear system, 2000 data with the size of 71 × 91 from HP data set was used along with 2000 corresponding labels with the size of 4 × 1 . Labels include the sine and cosine of the two phase values that are optimized in the linear applicator. To utilize the trained CNN-1 model for phase optimization, masked input indicating the desired focus region with a size of 71 × 91 was given as input, and an estimated 4 × 1 output was obtained, which has the same structure as the labels.
Sensors 22 06343 g002
Figure 3. (a) Training and validation loss with increasing epoch. (b) System flowchart.
Figure 3. (a) Training and validation loss with increasing epoch. (b) System flowchart.
Sensors 22 06343 g003
Figure 4. Heating potential (Wm 3 ) distributions for the linear antenna system and the breast without a tumor, target at (26, 12, 0) mm position. Parameters obtained from CNN: (a) phase-only optimization, (b) phase and power optimization. Excitation parameters obtained from look-up table: (c) phase-only optimization, (d) phase and power optimization.
Figure 4. Heating potential (Wm 3 ) distributions for the linear antenna system and the breast without a tumor, target at (26, 12, 0) mm position. Parameters obtained from CNN: (a) phase-only optimization, (b) phase and power optimization. Excitation parameters obtained from look-up table: (c) phase-only optimization, (d) phase and power optimization.
Sensors 22 06343 g004
Figure 5. Heating potential (Wm 3 ) distributions for the linear antenna system and the breast with a tumor at (26, 12, 0) mm position. Excitation parameters obtained from CNN: (a) phase-only optimization, (b) phase and power optimization. Parameters obtained from look-up table: (c) phase-only optimization, (d) phase and power optimization.
Figure 5. Heating potential (Wm 3 ) distributions for the linear antenna system and the breast with a tumor at (26, 12, 0) mm position. Excitation parameters obtained from CNN: (a) phase-only optimization, (b) phase and power optimization. Parameters obtained from look-up table: (c) phase-only optimization, (d) phase and power optimization.
Sensors 22 06343 g005
Figure 6. Heating potential distributions (Wm 3 ) for circular antenna system with excitation parameters obtained from CNN. Phase-only optimization of (a) breast without a tumor, target at ( 7 , 11 , 0 ) mm position, (b) breast without a tumor, target at ( 11 , 7 , 0 ) mm position, and (c) breast with a tumor at ( 11 , 14 , 0 ) mm position. Phase and power optimization of (d) breast without a tumor, target at ( 7 , 11 , 0 ) mm position, (e) breast without a tumor, target at ( 11 , 7 , 0 ) mm positionm and (f) breast with a tumor at ( 11 , 14 , 0 ) mm position.
Figure 6. Heating potential distributions (Wm 3 ) for circular antenna system with excitation parameters obtained from CNN. Phase-only optimization of (a) breast without a tumor, target at ( 7 , 11 , 0 ) mm position, (b) breast without a tumor, target at ( 11 , 7 , 0 ) mm position, and (c) breast with a tumor at ( 11 , 14 , 0 ) mm position. Phase and power optimization of (d) breast without a tumor, target at ( 7 , 11 , 0 ) mm position, (e) breast without a tumor, target at ( 11 , 7 , 0 ) mm positionm and (f) breast with a tumor at ( 11 , 14 , 0 ) mm position.
Sensors 22 06343 g006
Table 1. Estimated linear antenna excitation parameters for target at (26, 12, 0) mm.
Table 1. Estimated linear antenna excitation parameters for target at (26, 12, 0) mm.
StudyExcitationAntenna Array No. Ω target Ω hotspot Ψ P av
CaseParameters1234%% (kWm 3 )
A. CNN,i. Phase (deg)0.00−48.46−178.10133.448.4210.781.2814.89
without tumorii. Power (W)0.440.270.101.1910.209.040.8912.01
B. Lookup T.i. Phase (deg)0.00−100.00138.0038.008.6916.641.9110.67
without tumorii. Power (W)0.200.000.331.4710.5612.711.2012.06
C. CNN,i. Phase (deg)0.00−43.10135.7392.6312.6311.440.9122.72
with tumorii. Power (W)0.150.100.031.7215.2010.080.6619.55
D. Lookup T.i. Phase (deg)0.00−100.00140.0040.0013.6716.051.1717.11
with tumorii. Power (W)0.330.00.01.6715.1010.240.6818.62
Table 2. Estimated circular antenna excitation parameters.
Table 2. Estimated circular antenna excitation parameters.
StudyExcitationAntenna No.
CaseParameters (deg, W)123456789101112
A. CNNi. Phase0.0098.57−15.76−114.3170.8−74.84−40.7334.11−62.28−96.39−108.0−11.60
without tumor 1ii. Power0.050.280.010.320.150.341.091.220.150.860.760.79
B. CNNi. Phase0.00126.03−61.00172.9797.59−75.38−94.68−19.31−59.18−39.8896.33136.21
without tumor 2ii. Power0.340.150.000.150.900.900.820.201.840.250.460.00
C. CNNi. Phase0.00−31.33138.53169.8652.28−117.60.42118.029.80−88.19−157.3−69.07
with tumor 3ii. Power0.020.400.110.190.690.020.000.010.391.851.041.26
Targets at: 1 (−7, 11, 0) mm, 2 (−11, −7, 0) mm, 3 (11, −14, 0) mm positions.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Yildiz, G.; Yasar, H.; Uslu, I.E.; Demirel, Y.; Akinci, M.N.; Yilmaz, T.; Akduman, I. Antenna Excitation Optimization with Deep Learning for Microwave Breast Cancer Hyperthermia. Sensors 2022, 22, 6343. https://doi.org/10.3390/s22176343

AMA Style

Yildiz G, Yasar H, Uslu IE, Demirel Y, Akinci MN, Yilmaz T, Akduman I. Antenna Excitation Optimization with Deep Learning for Microwave Breast Cancer Hyperthermia. Sensors. 2022; 22(17):6343. https://doi.org/10.3390/s22176343

Chicago/Turabian Style

Yildiz, Gulsah, Halimcan Yasar, Ibrahim Enes Uslu, Yusuf Demirel, Mehmet Nuri Akinci, Tuba Yilmaz, and Ibrahim Akduman. 2022. "Antenna Excitation Optimization with Deep Learning for Microwave Breast Cancer Hyperthermia" Sensors 22, no. 17: 6343. https://doi.org/10.3390/s22176343

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop