Next Article in Journal
A Robust Controller Based on Extension Sliding Mode Theory for Brushless DC Motor Drives
Next Article in Special Issue
Cracking the Core: Hardware Vulnerabilities in Android Devices Unveiled
Previous Article in Journal
Analysis of Optimal Diversity Combining with Imperfect Channel State Information for Cooperative Jamming-Aided Internet of Things Security
Previous Article in Special Issue
Machine Learning-Based Intrusion Detection Methods in IoT Systems: A Comprehensive Review
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Novel Electromagnetic Sensing Generative Adversarial Network for Uniaxial Objects

1
Department of Electrical and Computer and Engineering, Tamkang University, New Taipei City 251301, Taiwan
2
School of Engineering, San Francisco State University, San Francisco, CA 94117-1080, USA
*
Author to whom correspondence should be addressed.
Electronics 2024, 13(20), 4027; https://doi.org/10.3390/electronics13204027
Submission received: 29 August 2024 / Revised: 3 October 2024 / Accepted: 12 October 2024 / Published: 13 October 2024
(This article belongs to the Special Issue Artificial Intelligence Empowered Internet of Things)

Abstract

:
Electromagnetic imaging achieves enhanced resolution by leveraging the advanced sensing and data analysis capabilities of Internet of Things (IoT) systems. This paper introduces a novel learning approach for generative adversarial networks (GANs) to tackle significant challenges in electromagnetic sensing. The proposed method involves deploying additional transmitters and receivers to irradiate TM (transverse magnetic) and TE (transverse electric) polarization waves around uniaxial objects to capture the scattered field in free space. Subsequently, scattered field generative adversarial networks (SF-GANs) are utilized to simulate and learn the characteristics of Maxwell’s equations. Numerical simulations and experimental results demonstrate the superior performance of the SF-GANs compared to backpropagation generative adversarial networks (BP-GANs). Furthermore, it is worth noting that our method is capable of reconstructing high-dielectric-constant objects.

1. Introduction

Electromagnetic sensing technology is a powerful tool that can analyze the shapes and properties of unknown objects by studying reflected signals. It significantly enhances the capabilities of sensing, data collection, and communication systems when integrated with the Internet of Things (IoT). This collaboration between electromagnetic sensing and IoT facilitates the development of more intelligent, automated systems that find applications in a wide range of scenarios, including smart cities and industrial automation [1,2,3,4,5]. Although methods like the Born approximation [6] and backpropagation [7] offer a fast solution by using simplified linear models, they normally depend on prior information and struggle with the inherent nonlinearity and ill-posed nature of inverse scattering problems (ISPs) [8]. As a result, more robust solutions are explored in nonlinear iterative algorithms to deal with the full-wave models. Common examples include the distorted Born iterative method [9], contrast source inversion [10], and subspace-based optimization method [11]. These techniques provide high-quality reconstructions, but are generally more time-intensive due to their computational demands.
ISP algorithms are primarily developed to create a nonlinear mapping between the scattered field and the unknown constitutive parameters of the scatterers. Neural networks have shown great potential in constructing such nonlinear mappings. However, these approaches often highly depend on prior knowledge of the scatterers. Recently, the impressive representational power of deep neural networks [12,13,14] has led to their use in solving ISPs, with convolutional neural networks (CNNs) being particularly effective. Deep learning-based approaches to ISPs can generally be divided into two categories. The first seeks to replace the most complex aspects of traditional nonlinear iterative algorithms with trained neural networks [5,15]. The second approach treats ISPs as an image-to-image translation problem [4,16]. It involves refining coarse images generated from the scattered fields using non-iterative methods into high-resolution CNN reconstructions. This paper focuses on the second approach.
The second approach is promising for high-resolution CNN reconstructions, which is still in the early stages of development. Researchers have been actively working on improving imaging quality in recent years, mainly focusing on refining the objective function by adding regularization terms to enhance the accuracy and robustness of the reconstruction. In 2020, Huang introduced a new method to improve the quality and generalization capability of a trained model to reconstruct dielectric images. He combined the structural similarity (SSIM) loss function with the mean squared error (MSE) loss. The results showed that this proposal can effectively enhance imaging quality and improve the model’s ability to adapt to new information [17]. Guo introduced novel generative adversarial networks (GANs) that enhanced the resolution of initial images in 2021, surpassing traditional optimization methods in terms of computational performance and resolution [18]. Building upon these advancements, Xu proposed an end-to-end scalable cascaded CNN in 2022, utilizing scattered information to create high-resolution images for solving ISPs [19]. This method reconstructed high-resolution images in a timely manner with high performance, making it particularly useful in biomedical fields. Xu integrated a weighted loss function with GANs and a self-attention mechanism in 2023, resulting in good generalization ability and stability [20]. Finally, in 2024, a contrastive learning-based subspace optimization and semantic segmentation-assisted reconstruction scheme was proposed by Yao to significantly improve the permittivity reconstruction performance compared to existing alternatives [21]. At the same time, Yao introduced a new method called the conditional deep convolutional generative adversarial network to solve difficult image processing challenges by inputting the scattered field to the GANs. This method took into account the differences between the generated contrast images and the true images, as well as the differences between the scattered field produced by the generated contrast images and the input scattered field. The results of the analysis showed that the conditional deep convolutional generative adversarial network was able to reconstruct high-contrast scatterers effectively [22]. Table 1 summarizes papers relevant to ISPs that apply algorithms with deep learning techniques.
We input the measured scattered fields into the generator network of the GANs to generate the permittivity of the image by simulating Maxwell’s equations in this paper. The permittivity from the generator network is then assessed by the discriminator network. Based on the numerical findings, our proposed method is capable of effectively reconstructing uniaxial objects after repeated training.
Our contributions are summarized as follows.
(1)
Based on our current understanding, no research has used the scattered field from TE incident waves as input to GANs for the electromagnetic imaging of uniaxial objects. Briefly speaking, our results demonstrate that the introduced scheme is capable of accurately and efficiently reconstructing high-permittivity uniaxial objects in real time.
(2)
Uniaxial scatterers possess dielectric constant components oriented along different lateral directions. The nonlinearity for TE polarized waves is more severe than for TM polarized waves, making reconstruction using scattered fields in the TE case relatively challenging. Nonetheless, we are pleased to report that our numerical findings have demonstrated the effectiveness of our proposed method.
(3)
We have developed a different generation network from [22] and analyzed TE and TM waves separately. Our experimental findings indicate that in the case of TE, the x and y components of the received scattered field will couple with each other, affecting the imaging quality. Therefore, we use a more precise angle of incidence to overcome this phenomenon.
Section 2 gives the formulation. The SF-GAN architecture is explained in Section 3, followed by the analysis of numerical results in Section 4. Section 5 concludes the findings.

2. Theory and Formulation

We posit that an unknown object is positioned along the z-axis in free space, as illustrated in Figure 1. ε ̿ r denotes the dielectric constant tensor of the object. μ 0 represents the magnetic permeability. The corresponding x-, y-, and z-direction diagonal components of ε ̿ r are expressed as ε x ( x , y ) , ε y ( x , y ) , and ε z x , y , respectively. Tx is the transmitter antenna, Rx is the receiver antenna, and D is the domain of interest.
We focus on reconstructing uniaxial objects in free space, assuming a time dependence of e j ω t . We examine two distinct types of incident waves, as detailed below.
  • Transverse magnetic waves
In the TM case, the formula for the incident electric field can be expressed as follows:
E ¯ i ρ = E z i ρ z ^ = e j k 0 ( x cos + y sin ) z ^
Let us consider an incident wave that only has a z component and a scatterer that extends infinitely in the z direction. The total and scattered electric fields can be represented as E ¯ = E z z ^ and E ¯ s = E z s z ^ , respectively. The respective scalar equations for the scattered electric and total fields can be obtained as follows:
E z ρ = s G ρ ,   ρ ε z ρ 1 E z ρ d s + E z i ρ ,   ρ , ρ D
E z s ρ = s G ρ , ρ ε z ρ 1 E z ρ d s ,   ρ D , ρ D
The two-dimensional free-space Green’s function is given by the equation G ρ , ρ = j k 0 2 4 H 0 2 k 0 ρ ρ , where H 0 2 denotes the zero-order Hankel function of the second kind. D is the object domain.
2.
Transverse electric waves
In the case of TE waves, the equations given by the E x i ρ and E y i ρ incident waves are:
E x i ( ρ ) = sin e j k 0 ( x cos + y sin )
E y i ( ρ ) = cos e j k 0 ( x cos + y sin )
E x and E y are interdependent. By applying the vector potential technique, the incident field E ¯ i ρ = E x i ρ x ^ + E y i ρ y ^ is used to estimate the scattered fields. The external scattered field E ¯ s ρ = E x s ρ x ^ + E y s ρ y ^ and the total field E ¯ ρ = E x ρ x ^ + E y ρ y ^ can be expressed by Equations (6)–(9).
E x ρ = 2 x 2 + k 0 2 s G ρ , ρ ε x ρ 1 E x ρ d s + 2 x y s G ρ , ρ ε y ρ 1 E y ρ d s + E x i ρ
E y ρ = 2 x y s G ρ , ρ ε x ρ 1 E x ρ d s + 2 x 2 + k 0 2 s G ρ , ρ ε y ρ 1 E y ρ d s + E y i ρ
E x s ρ = 2 x 2 + k 0 2 s G ρ , ρ ε x ρ 1 E x ρ d s + 2 x y s G ρ , ρ ε y ρ 1 E y ρ d s
E y s ρ = 2 x y s G ρ , ρ ε x ρ 1 E x ^ ρ d s + 2 x 2 + k 0 2 s G ρ , ρ ε y ρ 1 E y ^ ρ d s
In the case of TM for the direct problem, we assume that the distribution of the dielectric constant is known. Equations (1)–(3) can be used to determine both the scattered and total electric fields in the z axis. Likewise, for the TE case, we can employ Equations (4)–(9) to ascertain the scattered fields and total in the x and y axes.

3. Scattered Field Generative Adversarial Networks

The GANs are made up of a generator and a discriminator that are trained in a mutually resisting manner. This model has shown remarkable success in various applications, such as style migration, image generation, and image-to-image translation. Despite their success, training GANs poses significant challenges caused by vanishing gradients as well as instability. To overcome these challenges, researchers have proposed various GAN models with improved stability and scalability to address a wider range of applications. The GANs illustrated in Figure 2 designate the generator as G θ and the discriminator as D . Here, θ and ∅ are used to symbolize the unknown parameters of the generator and discriminator, respectively. In this paper, we feed measured scattered fields into the training model. Then, the generator ( G θ ) repeatedly generates images for the discriminator ( D ) to determine the authenticity of the image (i.e., real and fake). Through this process, each neural parameter is trained, and accurate electromagnetic image reconstruction is achieved. We use a DRCNN (deep residual convolutional neural network) as the generation network for the SF-GANs. This network is designed to process and analyze complex, dispersed field information. The architecture of the DRCNN includes three convolutional layers, each of which is followed by a ReLu activation function. Figure 3 shows the architecture of the GAN generator. The final step in the process involves accurately reconstructing the dielectric constant distribution using fully connected and reshaped layers. The architecture of the discriminator consists of repeatedly adding convolutional layers, batch normalization layers, and ReLu layers, as depicted in Figure 4. The discriminator analyzes the image generated by the generator and provides a score, thereby determining whether the generator should adjust its training weights. This iterative procedure persists until an optimal equilibrium is established.
The generator’s loss function, L G A N G , is expressed as follows:
L G A N G θ | = L R M S E θ + γ L A θ |
In this context, L R M S E ( θ ) quantifies the discrepancy between the restored image and the ground truth image. γ is the weight of L A in the generator loss function. The root mean square error (RMSE) is defined by the following formula:
L R M S E = 1 M i = 1 M ε ̿ r ε ̿ r r F ε ̿ r F
Here, ε ̿ r and ε ̿ r r denote the true and restored permittivity, respectively. F symbolizes the Frobenius norm, and M represents the number of tests conducted.
L A θ | = 1 N i = 1 N D G θ X i 1 1
L A acts as the scoring mechanism for the discriminator, evaluating the accuracy of the entire reconstructed image. N denotes the batch number, and X i denotes the trained data.
The discriminator’s loss function can be formulated as follows:
L G A N D θ | = 1 2 N i = 1 N D Y i 1 2 2 + D G θ X i 2 2
In this context, represents the unknown parametric data, while θ is the weight parameter. Y i refers to the true data. The optimization process alternates between focusing on D and G θ in an adversarial manner until a Nash equilibrium is achieved. Essentially, the process continues until the generator G θ X produces a closely resembling image, making it indistinguishable from the authentic data by the discriminator D .

4. Numerical Results

In our study, we place a two-dimensional uniaxial object in free space with transmitters and receivers positioned evenly around the object. We emit TM waves and TE waves from various directions to illuminate the object and collect the scattered field. The collected data are then input into the SF-GANs for training, with the aim of eventually generating precise electromagnetic images.

4.1. Configuration of the Scattering System

In our research, we divide the edge of the scatterer into segments of a constant size equal to 0.2 λ 0 ε r . λ 0 and ε r represent the wavelength in free space and the relative dielectric constant of the uniaxial object, respectively. The scatterer’s dielectric coefficient varies from 1 to 8, and the frequency of the incident wave is set at 3 GHz. For the simulation, we set up a uniform configuration of 32 transmitting and 32 receiving antennas. To mimic real-world conditions, we add 5% and 20% noise in our simulation.

4.2. Training Detail

During the training, we use the scattered field as input for the SF-GANs to allow the neural network to emulate Maxwell’s equations and generate electromagnetic imaging. In the realm of artificial intelligence (AI), the 80–20 principle is applied to the training and testing sets. We then use an adaptive moment estimation (ADAM) optimizer to train the neural network, with a learning rate of 0.0002, a maximum epoch of 200, and a mini-batch size of 32.
We use Equation (14) below to measure the performance of each scenario.
R M S E = 1 M t i = 1 M t ε ̿ r ε ̿ r r F ε ̿ r F
ε ̿ r is the true permittivity, while ε ̿ r r is the reconstructed relative permittivity. M t denotes the number of tests conducted. F represents the Frobenius norm. The structural similarity index measure (SSIM) is then defined to compare the simulated results for different cases.
S S I M = 2 μ y ~ μ y + C 1 2 σ y ~ y + C 2 μ y ~ 2 + μ y 2 + C 1 σ y ~ 2 + σ y 2 + C 2 ,
Here, y and y ~ denote the true and reconstructed relative permittivity profiles, respectively. μ y represents the mean of y. σ y ~ 2 and σ y ~ y are the variance of y and the covariance of y ~ and y, respectively. Two small constraints, C 1 = K 1 D 2 and C 2 = K 2 D 2 , are added to prevent a zero denominator, with K 1 = 0.01 and K 2 = 0.03 as the two hyperparameters. D is the dynamic range of pixels for image y.

4.3. Relative Permittivity from 1 to 1.5

In this simulation, we focus on establishing a distribution of dielectric constants ranging from 1 to 1.5. Our analysis involved 10 scatterers, each characterized by a unique dielectric constant distribution. These scatterers are positioned within the measurement area, with the flexibility to move to 50 different locations. To simulate real-world conditions, we introduce 20% noise into the environment. Using the scattered field data, we employ SF-GANs to iteratively train and reconstruct accurate electromagnetic images. The ground truth of ε z and ε x for relative permittivity ranges from 1 to 1.5 can be found in Figure 5. The reconstructed results of ε z and ε x by BP-GANs and SF-GANs can be found in Figure 6 and Figure 7, respectively. Table 2 offers an overview of the performance metrics related to the reconstruction process. When comparing BP-GANs to SF-GANs under the same noise, it is evident that the image quality of GANs with backpropagation is notably inferior in terms of clarity and sharpness.

4.4. Relative Permittivity from 1.5 to 2

In this simulation, we focus on finding the range of dielectric constants from 1.5 to 2. Ten scatterers with unique dielectric constant distributions are studied. The scatterers are positioned at up to 50 different locations for measurement. To mimic real-world conditions, 5% noise is added. We apply SF-GANs to train the collected scattered fields and create accurate electromagnetic images. The accurate permittivity values for ε z and ε x ranging from 1.5 to 2 are shown in Figure 8. The reconstructed results for ε z and ε x using BP-GANs and SF-GANs can be found in Figure 9 and Figure 10, respectively. Table 3 provides an overview of the performance metrics for the reconstruction process.

4.5. MNIST from 2 to 2.5

The Modified National Institute of Standards and Technology (MNIST) database contains a large set of handwritten digits that is commonly used for training various image processing systems. The MNIST database has 60,000 training images and 10,000 testing images, each measuring 28 × 28 pixels. The dataset is organized so that every 50 consecutive images represent a different style of handwriting, each shown at 50 different angles. The MNIST database is widely used to train neural network architectures for image processing due to its simplicity. In this case, we simulate an environment with 32 transmitters and 32 receivers and distribute the dielectric coefficient from 2 to 2.5. We add 5% noise to each transmitter–receiver pair. To create a dataset for training, we randomly select 50 images of each handwritten digit (0–9) from the MNIST dataset, resulting in a total of 500 images for each case. This dataset is then split into two subsets—80% for training and 20% for testing—to speed up the process. The relative permittivity for ε z and ε x ranging from 2 to 2.5 is shown in Figure 11. The reconstructed results for ε z and ε x using BP-GANs and SF-GANs are shown in Figure 12 and Figure 13, respectively. Table 4 provides an overview of the performance metrics for the reconstruction process.
Nonlinear phenomena in electromagnetic imaging have long been an unsolved challenge that has garnered significant attention. Unlike the TM case, the TE case is influenced by both x and y components, making the nonlinear situation more intricate and leading to a substantial impact on image resolution. Our numerical findings indicate that our proposed method can effectively address the nonlinear problem in electromagnetic imaging. In this research, though we do observe that the nonlinearity will become significant as the dielectric coefficient distribution grows larger, satisfactory reconstruction results may still be achieved. In our simulation, we utilized a personal computer equipped with a 3.4 GHz Intel Core i7 processor, 64 GB of RAM, and an NVIDIA GeForce RTX 40 series GPU. Training the SF-GANs on this setup takes approximately 26 min, while testing with the proposed SF-GANs takes less than one second.

5. Conclusions

We propose SF-GANs to solve ISPs for uniaxial objects in this research. Because the dielectric constant components will propagate in different directions, the nonlinear phenomenon of TE waves will be more pronounced than that of TM waves. This makes the reconstruction using the scattered fields challenging. Numerical simulations and experimental results show that SF-GANs have overwhelming advantages in reconstructing uniaxial objects. Our investigation concludes that the proposed SF-GANs architecture eligibly handles complex TE scenarios and successfully overcomes the diverse challenges encountered in ISPs. In the future, we plan to focus on integrating attention-based neural network architectures into the SF-GAN framework and implementing them in more intricate situations, such as the reconstruction of buried objects in half-space. Furthermore, we will also explore the possibility of combining the SF-GAN architecture with the switch transformer model to further enhance the quality of reconstructed images.

Author Contributions

Conceptualization, H.J.; methodology, P.-H.C. and B.-Y.S.; software, B.-Y.S.; validation, C.-C.C.; formal analysis, H.J.; investigation, C.-C.C.; resources, H.J.; data curation, P.-H.C.; writing—original draft preparation, P.-H.C.; writing—review and editing, C.-C.C.; visualization, P.-H.C.; supervision, C.-C.C.; project administration, C.-C.C.; funding acquisition, H.J. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Science and Technology Council of Taiwan (grant NSTC 112-2221-E-032-014-MY2).

Data Availability Statement

Data are contained within the article.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Uecker, M.; Hohage, T.; Block, K.T.; Frahm, J. Image reconstruction by regularized nonlinear inversion-joint estimation of coil sensitivities and image content. Magn. Reson. Med. 2008, 60, 674–682. [Google Scholar] [CrossRef] [PubMed]
  2. Deisboeck, T.; Kresh, J.Y. Complex Systems Science in Biomedicine; Springer Science & Business Media: New York, NY, USA, 2007. [Google Scholar]
  3. Song, L.-P.; Yu, C.; Liu, Q.H. Through-wall imaging (TWI) by radar: 2-D tomographic results and analyses. IEEE Trans. Geosci. Remote Sens. 2005, 43, 2793–2798. [Google Scholar] [CrossRef]
  4. Chen, X.; Wei, Z.; Li, M.; Rocca, P. A review of deep learning approaches for inverse scattering problems. Prog. Electromagn. Res. 2020, 167, 67–81. [Google Scholar] [CrossRef]
  5. Sanghvi, Y.; Kalepu, Y.; Khankhoje, U.K. Embedding deep learning in inverse scattering problems. IEEE Trans. Comput. Imaging 2019, 6, 46–56. [Google Scholar] [CrossRef]
  6. Habashy, T.M.; Groom, R.W.; Spies, B.R. Beyond the Born and Rytov approximations: A nonlinear approach to electromagnetic scattering. J. Geophys. Res. Solid Earth 1993, 98, 1759–1775. [Google Scholar] [CrossRef]
  7. Belkebir, K.; Chaumet, P.C.; Sentenac, A. Super resolution in total internal reflection tomography. J. Opt. Soc. Am. A 2005, 22, 1889–1897. [Google Scholar] [CrossRef]
  8. Chen, X. Computational Methods for Electromagnetic Inverse Scattering; Wiley-IEEE Press: New York, NY, USA, 2018. [Google Scholar]
  9. Chew, W.C.; Wang, Y.-M. Reconstruction of two-dimensional permittivity distribution using the distorted Born iterative method. IEEE Trans. Med. Imaging 1990, 9, 218–225. [Google Scholar] [CrossRef]
  10. Van den Berg, P.M.; Kleinman, R.E. A contrast source inversion method. Inverse Probl. 1997, 13, 1607. [Google Scholar] [CrossRef]
  11. Chen, X. Subspace-based optimization method for solving inverse scattering problems. IEEE Trans. Geosci. Remote Sens. 2010, 48, 42–49. [Google Scholar] [CrossRef]
  12. Krizhevsky, A.; Sutskever, I.; Hinton, G.E. Imagenet classification with deep convolutional neural networks. Proc. Adv. Neural Inf. Process. Syst. 2012, 25, 1097–1105. [Google Scholar] [CrossRef]
  13. Simonyan, K.; Zisserman, A. Very deep convolutional networks for large-scale image recognition. arXiv 2014. [Google Scholar] [CrossRef]
  14. Du, J.; Xu, Y. Hierarchical deep neural network for multivariate regression. Pattern Recognit. 2017, 63, 149–157. [Google Scholar] [CrossRef]
  15. Guo, R.; Jia, Z.; Song, X.; Li, M.; Yang, F.; Xu, S.; Abubakar, A. Pixel-and model-based microwave inversion with supervised descent method for dielectric targets. IEEE Trans. Antennas Propag. 2020, 68, 8114–8126. [Google Scholar] [CrossRef]
  16. Song, T.; Kuang, L.; Han, L.; Wang, Y.; Liu, Q.H. Inversion of rough surface parameters from SAR images using simulation-trained convolutional neural networks. IEEE Geosci. Remote Sens. Lett. 2018, 15, 1130–1134. [Google Scholar] [CrossRef]
  17. Huang, Y.; Song, R.; Xu, K.; Ye, X.; Li, C.; Chen, X. Deep Learning-Based Inverse Scattering with Structural Similarity Loss Functions. IEEE Sens. J. 2021, 21, 4900–4907. [Google Scholar] [CrossRef]
  18. Guo, L.; Song, G.; Wu, H. Complex-Valued Pix2pix—Deep Neural Network for Nonlinear Electromagnetic Inverse Scattering. Electronics 2021, 10, 752. [Google Scholar] [CrossRef]
  19. Xu, K.; Zhang, C.; Ye, X.; Song, R. Fast Full-Wave Electromagnetic Inverse Scattering Based on Scalable Cascaded Convolutional Neural Networks. IEEE Trans. Geosci. Remote Sens. 2022, 60, 1–11. [Google Scholar] [CrossRef]
  20. Xu, K.; Qian, Z.; Zhong, Y.; Su, J.; Gao, H.; Li, W. Learning-Assisted Inversion for Solving Nonlinear Inverse Scattering Problem. IEEE Trans. Microw. Theory Tech. 2023, 71, 2384–2395. [Google Scholar] [CrossRef]
  21. Wu, Z.; Peng, Y.; Wang, P.; Wang, W.; Xiang, W. A Physics-Induced Deep Learning Scheme for Electromagnetic Inverse Scattering. IEEE Trans. Microw. Theory Tech. 2024, 72, 927–947. [Google Scholar] [CrossRef]
  22. Yao, H.M.; Jiang, L.; Ng, M. Enhanced Deep Learning Approach Based on the Conditional Generative Adversarial Network for Electromagnetic Inverse Scattering Problems. IEEE Trans. Antennas Propag. 2024, 72, 6133–6138. [Google Scholar] [CrossRef]
  23. Wang, Y.M.; Chew, W.C. An iterative solution of the two-dimensional electromagnetic inverse scattering problem. Int. J. Imaging Syst. Technol. 1989, 1, 100–108. [Google Scholar] [CrossRef]
  24. Pastorino, M.; Massa, A.; Caorsi, S. A microwave inverse scattering technique for image reconstruction based on a genetic algorithm. IEEE Trans. Instrum. Meas. 2000, 49, 573–578. [Google Scholar] [CrossRef]
  25. Agarwal, K.; Chen, X. Application of Differential Evolution in 2- Dimensional Electromagnetic Inverse Problems. In Proceedings of the IEEE Congress on Evolutionary Computation, Singapore, 25–28 September 2007; pp. 4305–4312. [Google Scholar]
  26. Pastorino, M. Stochastic optimization methods applied to microwave imaging: A review. IEEE Trans. Antennas Propag. 2007, 55, 538–548. [Google Scholar] [CrossRef]
  27. Ran, P.; Qin, Y.; Lesselier, D. Electromagnetic imaging of a dielectric micro-structure via convolutional neural networks. In Proceedings of the IEEE 2019 27th European Signal Processing Conference (EUSIPCO), Coruña, Spain, 1–5 September 2019. [Google Scholar]
  28. Fajardo, J.E.; Galván, J.; Vericat, F.; Carlevaro, C.M.; Irastorza, R.M. Phaseless microwave imaging of dielectric cylinders: An artificial neural networks-based approach. Prog. Electromagn. Res. 2019, 166, 95–105. [Google Scholar] [CrossRef]
  29. Wei, Z.; Chen, X. Deep-learning schemes for full-wave nonlinear inverse scattering problems. IEEE Trans. Geosci. Remote Sens. 2019, 57, 1849–1860. [Google Scholar] [CrossRef]
  30. Yao, H.M.; Wei, E.I.; Jiang, L. Two-step enhanced deep learning approach for electromagnetic inverse scattering problems. IEEE Antennas Wirel. Propag. Lett. 2019, 18, 2254–2258. [Google Scholar] [CrossRef]
  31. Guo, R.; Song, X.; Li, M.; Yang, F.; Xu, S.; Abubakar, A. Supervised descent learning technique for 2-D microwave imaging. IEEE Trans. Antennas Propag. 2019, 67, 3550–3554. [Google Scholar] [CrossRef]
  32. Chen, G.; Shah, P.; Stang, J.; Moghaddam, M. Learning-assisted multi-modality dielectric imaging. IEEE Trans. Antennas Propag. 2019, 68, 2356–2369. [Google Scholar] [CrossRef]
  33. Sun, Y.; Xia, Z.; Kamilov, U.S. Efficient and accurate inversion of multiple scattering with deep learning. Opt. Express 2018, 26, 14678–14688. [Google Scholar] [CrossRef]
  34. Li, L.; Wang, L.G.; Teixeira, F.L.; Liu, C.; Nehorai, A.; Cui, T.J. DeepNIS: Deep neural network for nonlinear electromagnetic inverse scattering. IEEE Trans. Antennas Propag. 2019, 67, 1819–1825. [Google Scholar] [CrossRef]
  35. Li, L.; Wang, L.G.; Teixeira, F.L. Performance analysis and dynamic evolution of deep convolutional neural network for electromagnetic inverse scattering. IEEE Antennas Wirel. Propag. Lett. 2019, 18, 2259–2263. [Google Scholar] [CrossRef]
  36. Xiao, J.; Li, J.; Chen, Y.; Han, F.; Liu, Q.H. Fast electromagnetic inversion of inhomogeneous scatterers embedded in layered media by born approximation and 3-D U-Net. IEEE Geosci. Remote Sens. Lett. 2019, 17, 1677–1681. [Google Scholar] [CrossRef]
  37. Khoshdel, V.; Ashraf, A.; LoVetri, J. Enhancement of multimodal microwave-ultrasound breast imaging using a deep-learning technique. Sensors 2019, 19, 4050. [Google Scholar] [CrossRef] [PubMed]
  38. Khoo, Y.; Ying, L. SwitchNet: A neural network model for forward and inverse scattering problems. SIAM J. Sci. Comput. 2019, 41, A3182–A3201. [Google Scholar] [CrossRef]
Figure 1. The configuration of 2D electromagnetic imaging.
Figure 1. The configuration of 2D electromagnetic imaging.
Electronics 13 04027 g001
Figure 2. GAN architecture.
Figure 2. GAN architecture.
Electronics 13 04027 g002
Figure 3. Generator of GAN architecture.
Figure 3. Generator of GAN architecture.
Electronics 13 04027 g003
Figure 4. Discriminator of GAN architecture.
Figure 4. Discriminator of GAN architecture.
Electronics 13 04027 g004
Figure 5. Ground truth for case 4.3. (a) ε z . (b) ε x .
Figure 5. Ground truth for case 4.3. (a) ε z . (b) ε x .
Electronics 13 04027 g005
Figure 6. Result of case 4.3 through BP-GANs. (a) ε z . (b) ε x .
Figure 6. Result of case 4.3 through BP-GANs. (a) ε z . (b) ε x .
Electronics 13 04027 g006
Figure 7. Result of case 4.3 through SF-GANs. (a) ε z . (b) ε x .
Figure 7. Result of case 4.3 through SF-GANs. (a) ε z . (b) ε x .
Electronics 13 04027 g007
Figure 8. Ground truth for case 4.4. (a) ε z . (b) ε x .
Figure 8. Ground truth for case 4.4. (a) ε z . (b) ε x .
Electronics 13 04027 g008
Figure 9. Result of case 4.4 through BP-GANs. (a) ε z . (b) ε x .
Figure 9. Result of case 4.4 through BP-GANs. (a) ε z . (b) ε x .
Electronics 13 04027 g009
Figure 10. Result of case 4.4 through SF-GANs. (a) ε z . (b) ε x .
Figure 10. Result of case 4.4 through SF-GANs. (a) ε z . (b) ε x .
Electronics 13 04027 g010
Figure 11. Ground truth for case 4.5. (a) ε z . (b) ε x .
Figure 11. Ground truth for case 4.5. (a) ε z . (b) ε x .
Electronics 13 04027 g011
Figure 12. Result of case 4.5 through BP-GANs. (a) ε z . (b) ε x .
Figure 12. Result of case 4.5 through BP-GANs. (a) ε z . (b) ε x .
Electronics 13 04027 g012
Figure 13. Result of case 4.5 through SF-GANs. (a) ε z . (b) ε x .
Figure 13. Result of case 4.5 through SF-GANs. (a) ε z . (b) ε x .
Electronics 13 04027 g013
Table 1. Summary of papers for ISPs.
Table 1. Summary of papers for ISPs.
TypeCategoriesMethod
AlgorithmDeterministicDistorted Born iterative method [23]
Contrast source inversion [10]
Subspace-based optimization method [11]
StochasticGenetic optimization [24]
Differential evolution [25]
Particle swarm optimization [26]
Deep learningDirect learning approachDiagnostic of a dielectric micro-structure [27]
Parameters extraction of dielectric cylinders [28]
Direct inversion using U-Net [29]
Two-step inversion [30]
Learning-assisted objective function approachSupervised descent method for microwave imaging [31]
Complex mapping function from magnetic resonance images [32]
CS-Net for the total contrast source [15]
Physics-assisted learning approachBackpropagation-based scheme [29,33,34,35]
Three-dimensional reconstruction [36]
Ultrasound-assisted contrast source inversion [37]
Dominant contrast current method [29]
SwitchNet with sparse connections [38]
Table 2. Reconstructed performance of case 4.3 with 20% noise.
Table 2. Reconstructed performance of case 4.3 with 20% noise.
Performance ε z ε x
BP-GANsRMSE
SSIM
3.43%1.66%
93.41%97.8%
SF-GANsRMSE
SSIM
0.63%0.65%
99.32%99.03%
Table 3. Reconstructed performance of case 4.4 with 5% noise.
Table 3. Reconstructed performance of case 4.4 with 5% noise.
Performance ε z ε x
BP-GANsRMSE
SSIM
2.43%2.19%
98.75%99.03%
SF-GANsRMSE
SSIM
0.76%0.85%
98.51%98.95%
Table 4. Reconstructed performance of case 4.5 with 5% noise.
Table 4. Reconstructed performance of case 4.5 with 5% noise.
Performance ε z ε x
BP-GANsRMSE
SSIM
5.96%5.21%
95.13%95.39%
SF-GANsRMSE
SSIM
1.96%3.96%
95.43%96.04%
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Chiu, C.-C.; Chen, P.-H.; Jiang, H.; Shi, B.-Y. A Novel Electromagnetic Sensing Generative Adversarial Network for Uniaxial Objects. Electronics 2024, 13, 4027. https://doi.org/10.3390/electronics13204027

AMA Style

Chiu C-C, Chen P-H, Jiang H, Shi B-Y. A Novel Electromagnetic Sensing Generative Adversarial Network for Uniaxial Objects. Electronics. 2024; 13(20):4027. https://doi.org/10.3390/electronics13204027

Chicago/Turabian Style

Chiu, Chien-Ching, Po-Hsiang Chen, Hao Jiang, and Bo-Yu Shi. 2024. "A Novel Electromagnetic Sensing Generative Adversarial Network for Uniaxial Objects" Electronics 13, no. 20: 4027. https://doi.org/10.3390/electronics13204027

APA Style

Chiu, C.-C., Chen, P.-H., Jiang, H., & Shi, B.-Y. (2024). A Novel Electromagnetic Sensing Generative Adversarial Network for Uniaxial Objects. Electronics, 13(20), 4027. https://doi.org/10.3390/electronics13204027

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop