Novel Spatio-Temporal Joint Learning-Based Intelligent Hollowing Detection in Dams for Low-Data Infrared Images

Concrete dams are prone to various hidden dangers after long-term operation and may lead to significant risk if failed to be detected in time. However, the existing hollowing detection techniques are few as well as inefficient when facing the demands of comprehensive coverage and intelligent management for regular inspections. Hence, we proposed an innovative, non-destructive infrared inspection method via constructed dataset and proposed deep learning algorithms. We first modeled the surface temperature field variation of concrete dams as a one-dimensional, non-stationary partial differential equation with Robin boundary. We also designed physics-informed neural networks (PINNs) with multi-subnets to compute the temperature value automatically. Secondly, we obtained the time-domain features in one-dimensional space and used the diffusion techniques to obtain the synthetic infrared images with dam hollowing by converting the one-dimensional temperatures into two-dimensional ones. Finally, we employed adaptive joint learning to obtain the spatio-temporal features. We designed the experiments on the dataset we constructed, and we demonstrated that the method proposed in this paper can handle the low-data (few shots real images) issue. Our method achieved 94.7% of recognition accuracy based on few shots real images, which is 17.9% and 5.8% higher than maximum entropy and classical OTSU methods, respectively. Furthermore, it attained a sub-10% cross-sectional calculation error for hollowing dimensions, outperforming maximum entropy (70.5% error reduction) and OTSU (7.4% error reduction) methods, which shows our method being one novel method for automated intelligent hollowing detection.