Blank Strip Filling for Logging Electrical Imaging Based on Multiscale Generative Adversarial Network
Abstract
:1. Introduction
- The proposed method utilizes generative adversarial network architecture with U-Net as the generator to enhance the feature extraction capability of the network. In addition, two discriminators, i.e., global and local discriminators, are introduced to capture the overall image and local texture information of complex electrical imaging, respectively, which leads to better texture details in the completed image.
- The introduction of residual networks enhances gradient propagation and addresses the issue of network degradation with increasing depth, thereby improving the quality of the electrical imaging image filling.
- The use of dilated convolution instead of conventional convolution in neural networks helps to better preserve the spatial features of the image, thus improving the reconstruction of complex electric logging images, especially in terms of contour features.
2. Construction of the Blank Strip Filling Model
2.1. Improved U-Net-Based Model
2.2. Residual Network Structure
2.3. Dilated Convolution
3. The Algorithm of Blank Stripe Filling Based on Multiscale Generative Adversarial Network
3.1. Algorithm Principle
3.2. Algorithm Flow
Algorithm 1 Training procedure of the ResGAN-Unet |
1: while iterations < do |
2: Sample a minibatch of images from training data. |
3: Input masks for each image in the minibatch. |
4: if < then |
5: Update the generation with the weighted MSE |
Loss (Equation (4)) using (). |
6: else |
7: Generate masks with random hole for each |
image in the minibatch. |
8: Update the discriminators with the binary cross |
entropy loss with both ((),) and (). |
9: if > + then |
10: Update the generative network with the |
joint loss gradients (Equation (6)) using (), and . |
11: end if |
12: end if |
13: end while |
4. Experimental Results and Analysis
4.1. Experimental Environment
4.2. Experiment on Natural Image Inpainting
4.2.1. Introduction to the Dataset
4.2.2. Experimental Results and Analysis
4.3. Experiment on Electrical Logging Image Inpainting
4.3.1. Introduction to the Dataset
4.3.2. Experimental Results and Analysis
5. Conclusions
- (1)
- The introduction of residual networks helps to preserve the integrity of information and solve the problem of network degradation. It better captures the overall structure of the image and, thus, more accurately fills in the overall content of the image;
- (2)
- The incorporation of the multiscale discriminator ensures the global and local consistency of the image. The global discriminator is better at filling in the overall image in a global sense, while the introduction of a local discriminator better fills in the texture details of the image.
Author Contributions
Funding
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Hassan, S.; Darwish, M.; Tahoun, S.S.; Radwan, A.E. An integrated high-resolution image log, sequence stratigraphy and palynofacies analysis to reconstruct the Albian–Cenomanian basin depositional setting and cyclicity: Insights from the southern Tethys. Mar. Pet. Geol. 2022, 137, 105502. [Google Scholar] [CrossRef]
- Gao, J.; Jiang, L.; Liu, Y.; Chen, Y. Review and analysis on the development and applications of electrical imaging logging in oil-based mud. J. Appl. Geophys. 2019, 171, 103872. [Google Scholar] [CrossRef]
- Zhang, Z.B.; Xu, W.; Liu, Y.H.; Zhou, G.Q.; Wang, D.S.; Sun, B.; Feng, J.S.; Liu, B. Understanding the Complex Channel Sand Reservoir from High-Definition Oil-Base Mud Microresistivity Image Logs: Case Study from Junggar Basin. In Proceedings of the Offshore Technology Conference, Houston, TX, USA, 2–5 May 2022. [Google Scholar]
- Zhou, F.; Oraby, M.; Luft, J.; Guevara, M.O.; Keogh, S.; Lai, W. Coal seam gas reservoir characterisation based on high-resolution image logs from vertical and horizontal wells: A case study. Int. J. Coal Geol. 2022, 262, 104110. [Google Scholar] [CrossRef]
- Luo, X.; Pang, X.; Dongxu, S.U.; Hui, L.U.; Zhang, N.; Wang, G. Recognition of Complicated Sandy Conglomerate Reservoir Based on Micro-Resistivity Imaging Logging: A Case Study of Baikouquan Formation in Western Slope of Mahu Sag, Junggar Basin. Xinjiang Pet. Geol. 2018, 39, 1. [Google Scholar]
- El-Gendy, N.H.; Radwan, A.E.; Waziry, M.A.; Dodd, T.J.; Barakat, M.K. An integrated sedimentological, rock typing, image logs, and artificial neural networks analysis for reservoir quality assessment of the heterogeneous fluvial-deltaic Messinian Abu Madi reservoirs, Salma field, onshore East Nile Delta, Egypt. Mar. Pet. Geol. 2022, 145, 105910. [Google Scholar] [CrossRef]
- Zhang, C.; Fan, T.; Meng, M.; Jun, W.U. Geological Interpretation of Ordovician Carbonate Reservoir in Tahe Oilfield: Application of Imaging Logging Technology. Xinjiang Pet. Geol. 2018, 39, 1. [Google Scholar]
- Ni, L.Q.; Xu, H.Q.; Li, Q.W.; Li, G.J.; Xu, C.H. Ultrasonic Logging Image Restoration Based on Texture. Well Logging Technol. 2010, 34, 4. [Google Scholar]
- He, K.; Lu, W.X.; Shen, C.N.; Huang, W.R. Exemplar-Based Inpainting Algorithm with Rotation and Scaling Transformation. Laser Optoelectron. Prog. 2018, 55, 031006. [Google Scholar]
- Ma, P.S.; Li, S.H.; Lu, C.S.; Huang, D.W.; Duan, D.P.; Lu, Y.; Ding, F.; Huang, X. Multi-point geostatistical method based on mode method clustering. J. Nat. Gas Geosci. 2020, 31, 9. [Google Scholar]
- Jing, M.; Wu, J. Fast image interpolation using directional inverse distance weighting for real-time applications. Opt. Commun. 2013, 286, 111–116. [Google Scholar] [CrossRef]
- Occorsio, D.; Ramella, G.; Themistoclakis, W. Lagrange–Chebyshev Interpolation for image resizing. Math. Comput. Simul. 2022, 197, 105–126. [Google Scholar] [CrossRef]
- Sun, J.M.; Zhao, J.P.; Lai, F.Q.; Chen, H. Methods to Fill in the Gaps Between Pads of Electrical Logging Images. Well Logging Technol. 2011, 35, 532–537. [Google Scholar]
- Jini, P.; Rajkumar, K. Image Inpainting Using Image Interpolation—An Analysis. Rev. Geintec-Gest. Inov. E Tecnol. 2021, 11, 1906–1920. [Google Scholar]
- Zhang, T.F. Filter-Based Training Pattern Classification for Spatial Pattern Simulation. Ph.D. Thesis, Stanford University, Stanford, CA, USA, 2006. [Google Scholar]
- Zhang, T. Reconstruction Method and Implementation of Porous Media Based on Multi-Point Geostatistics. Ph.D. Thesis, University of Science and Technology of China, Hefei, China, 2006. [Google Scholar]
- Hurley, N.F.; Zhang, T. Method to Generate Full-Bore Images Using Borehole Images and Multipoint Statistics. SPE Reserv. Eval. Eng. 2011, 14, 204–214. [Google Scholar] [CrossRef]
- Li, Y.L. Research and application of deep learning in image recognition. In Proceedings of the 2022 IEEE 2nd International Conference on Power, Electronics and Computer Applications, Shenyang, China, 21–23 January 2022. [Google Scholar]
- Zhang, J.; Li, C.; Yin, Y.; Zhang, J.; Grzegorzek, M. Applications of artificial neural networks in microorganism image analysis: A comprehensive review from conventional multilayer perceptron to popular convolutional neural network and potential visual transformer. Artif. Intell. Rev. 2023, 56, 1013–1070. [Google Scholar] [CrossRef]
- Gecer, B.; Aksoy, S.; Mercan, E.; Shapiro, L.G.; Weaver, D.L.; Elmore, J.G. Detection and classification of cancer in whole slide breast histopathology images using deep convolutional networks. Pattern Recognit. 2018, 84, 345–356. [Google Scholar] [CrossRef]
- Lin, C.J.; Li, Y.C.; Lin, H.Y. Using Convolutional Neural Networks Based on a Taguchi Method for Face Gender Recognition. Electronics 2020, 9, 1227. [Google Scholar] [CrossRef]
- Xiang, H.; Zou, Q.; Nawaz, M.A.; Huang, X.; Zhang, F.; Yu, H. Deep learning for image inpainting: A survey. Pattern Recognit. 2023, 134, 109046. [Google Scholar] [CrossRef]
- Gong, F.; Li, C.; Gong, W.; Li, X.; Song, T. A Real-Time Fire Detection Method from Video with Multifeature Fusion. Comput. Intell. Neurosci. 2019, 2019, 1939171. [Google Scholar] [CrossRef] [Green Version]
- Wang, Z.F.; Gao, N.; Zeng, R.; Du, X.F.; Du, X.R.; Chen, S.Y. A Gaps Filling Method for Electrical Logging Images Based on a Deep Learning Model. Well Logging Technol. 2019, 43, 578–582. [Google Scholar]
- Ulyanov, D.; Vedaldi, A.; Lempitsky, V. Deep Image Prior. In Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA, 21–26 July 2017. [Google Scholar]
- Zhang, H.; Sima, L.Q.; Wang, L.; Che, G.Q.; Guo, Y.H.; Yang, Q.Q. Blank Strip Filling Method for Resistivity Imaging Image Based on Convolution Neural Network. Prog. Geophys. 2021, 36, 2136–2142. [Google Scholar]
- Du, C.; Xing, Q.; Zhang, J.; Wang, J.; Liu, B.; Wang, Y. Blank strips filling for electrical logging images based on attention-constrained deep generative network. Prog. Geophys. 2022, 37, 1548–1558. [Google Scholar]
- Goodfellow, I.; Pouget-Abadie, J.; Mirza, M.; Xu, B.; Warde-Farley, D.; Ozair, S.; Courville, A.; Bengio, Y. Generative adversarial networks. Commun. ACM 2020, 63, 139–144. [Google Scholar] [CrossRef]
- Liu, M.; Wei, Y.; Wu, X.; Zuo, W.; Zhang, L. Survey on leveraging pre-trained generative adversarial networks for image editing and restoration. Sci. China Inf. Sci. 2023, 66, 151101. [Google Scholar] [CrossRef]
- Wang, Z.; Zhang, Z.; Dong, L.; Xu, G. Jitter Detection and Image Restoration Based on Generative Adversarial Networks in Satellite Images. Sensors 2021, 21, 4693. [Google Scholar] [CrossRef]
- Zhao, M.; Liu, X.; Liu, H.; Wong, K. Super-Resolution of Cardiac Magnetic Resonance Images Using Laplacian Pyramid based on Generative Adversarial Networks. Comput. Med. Imaging Graph. 2020, 80, 101698. [Google Scholar] [CrossRef]
- Belmeskine, R.; Benaichouche, A. Inpainting borehole images using Generative Adversarial Networks. arXiv 2023, arXiv:2301.06152. [Google Scholar]
- He, K.; Zhang, X.; Ren, S.; Sun, J. Deep Residual Learning for Image Recognition. In Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA, 26 June–1 July 2016. [Google Scholar]
- Mo, J.; Zhang, L.; Feng, Y. Exudate-based diabetic macular edema recognition in retinal images using cascaded deep residual networks. Neurocomputing 2018, 290, 161–171. [Google Scholar] [CrossRef]
- Zhou, Z.; Kuang, W.; Wang, Z.; Huang, Z.-L. ResNet-based image inpainting method for enhancing the imaging speed of single molecule localization microscopy. Opt. Express 2022, 30, 31766–31784. [Google Scholar] [CrossRef]
- Zhang, J.; Zheng, Y.; Qi, D.; Li, R.; Yi, X.; Li, T. Predicting citywide crowd flows using deep spatio-temporal residual networks. Artif. Intell. 2018, 259, 147–166. [Google Scholar] [CrossRef] [Green Version]
- Das, B.; Saha, A.; Mukhopadhyay, S. Rain Removal from a Single Image Using Refined Inception ResNet v2. Circuits Syst. Signal Process. 2023, 42, 3485–3508. [Google Scholar] [CrossRef]
- Yu, F.; Koltun, V. Multi-Scale Context Aggregation by Dilated Convolutions. In Proceedings of the 2016 International Conference on Learning Representations, San Juan, Puerto Rico, 2–5 May 2016. [Google Scholar]
- Wu, J.; Shi, Y.; Wang, W. Fault imaging of seismic data based on a modified u-net with dilated convolution. Appl. Sci. 2022, 12, 2451. [Google Scholar] [CrossRef]
- Jaderberg, M.; Simonyan, K.; Zisserman, A. Spatial transformer networks. Adv. Neural Inf. Process. Syst. 2015, 28, 2017–2025. [Google Scholar]
- Su, J.; Xu, B.; Yin, H. A survey of deep learning approaches to image restoration. Neurocomputing 2022, 487, 46–65. [Google Scholar] [CrossRef]
- Zhou, B.; Khosla, A.; Lapedriza, A.; Torralba, A.; Oliva, A. Places: An Image Database for Deep Scene Understanding. J. Vis. 2016, 17, 296. [Google Scholar] [CrossRef]
- Kingma, D.; Ba, J. Adam: A Method for Stochastic Optimization. arXiv 2014. [Google Scholar] [CrossRef]
Models | SSIM (%) | PSNR | MSE | FID |
---|---|---|---|---|
Basic Encoder–Decoder Model | 93.78 | 28.18 | 110.53 | 72.42 |
U-Net Model | 94.04 | 28.48 | 92.15 | 61.08 |
Res-Unet Model | 94.58 | 29.86 | 70.11 | 55.23 |
ResGAN-Unet Model | 94.77 | 29.89 | 66.61 | 50.12 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Sun, Q.; Su, N.; Gong, F.; Du, Q. Blank Strip Filling for Logging Electrical Imaging Based on Multiscale Generative Adversarial Network. Processes 2023, 11, 1709. https://doi.org/10.3390/pr11061709
Sun Q, Su N, Gong F, Du Q. Blank Strip Filling for Logging Electrical Imaging Based on Multiscale Generative Adversarial Network. Processes. 2023; 11(6):1709. https://doi.org/10.3390/pr11061709
Chicago/Turabian StyleSun, Qifeng, Naiyuan Su, Faming Gong, and Qizhen Du. 2023. "Blank Strip Filling for Logging Electrical Imaging Based on Multiscale Generative Adversarial Network" Processes 11, no. 6: 1709. https://doi.org/10.3390/pr11061709
APA StyleSun, Q., Su, N., Gong, F., & Du, Q. (2023). Blank Strip Filling for Logging Electrical Imaging Based on Multiscale Generative Adversarial Network. Processes, 11(6), 1709. https://doi.org/10.3390/pr11061709