1. Introduction
Engineered bamboo is a new type of renewable engineering structural material with certain strength, stiffness, and durability, which has been widely used for large electromechanical packaging, as a building load-bearing material, and in other fields [
1]. Engineered bamboo is made of bamboo bundles or bamboo sheets. Due to the natural porous structure of bamboo and the inevitable bonding defects of engineered bamboo, the engineered bamboo structure may have visible cracks. Therefore, a reasonable assessment of the visible crack scale, crack development law, and tolerance of the structure needs to be conducted through fracture analysis [
2]. Fracture failure caused by crack propagation is the main failure mode of engineered bamboo. Initial crack propagation will cause the structure to fail below the yield stress of the material, making the bearing capacity, stiffness, and even the service life of the structure significantly lower than expected [
3,
4,
5,
6,
7]. Therefore, accurate identification of the crack tip position and crack propagation length can improve the reliability of engineered bamboo. This is the theoretical basis for establishing the strength theory, failure criteria, and durability and safety evaluations of engineered bamboo structures.
Digital image correlation technology is a non-contact modern optical measurement technology that has been gradually applied to the fracture analysis of engineered bamboo. By tracking speckle images of the object surface, measurement of crack propagation displacement during deformation can be realized [
8,
9,
10]. In the study of material fracture mechanisms, as the cracks in engineered bamboo are relatively small, it is necessary to use a high-performance camera to capture high-quality digital speckle images of the crack surface of the measured engineered bamboo before and after deformation, in order to obtain the displacement of each point on the surface of the measured object. In a low-quality digital speckle image, the cracks are blurred or may not be visible at all, making it difficult to accurately identify the crack tip position. Therefore, improving the quality of images has become a serious problem under limited hardware conditions.
Super-resolution reconstruction technology breaks these limitations, allowing for the reconstruction of low-resolution images into high-resolution images through algorithms, in order to obtain images containing more information. Traditional image super-resolution reconstruction methods mainly include interpolation-based super-resolution algorithms, such as bicubic interpolation and nearest neighbor interpolation; super-resolution algorithms based on degradation models, such as iterative back-projection and maximum a posteriori probability methods; and learning-based super-resolution algorithms, such as manifold learning and sparse coding methods [
11]. With the rapid development of deep learning theory and technology, deep learning has been introduced into the field of super-resolution reconstruction, achieving rapid development [
12,
13,
14]. Sun, N [
15] proposed an image super-resolution reconstruction method combining traditional algorithms with deep learning and applied it to the medical field. The algorithm is ideal for detail reconstruction, producing clear contours and high-quality images. Yang, TT [
16] applied a super-resolution convolutional neural network (SRCNN) to underwater image processing. The results indicated that the SRCNN method is superior to traditional super-resolution image reconstruction methods in improving the resolution of underwater images. Das, V [
17] conducted unsupervised super-resolution of OCT images based on generative adversarial networks to improve the diagnosis of age-related macular degeneration. Experimental results on clinical OCT images demonstrated that this method is superior to existing methods in terms of SR performance and calculation time. Super-resolution reconstruction techniques have also been used for crack detection. Tang, YL [
18] used a super-resolution convolutional neural network (SRCNN) to obtain high-resolution images and corresponding temperature and deformation fields, proving that SRCNN has potential value in detecting surface defects or cracks. Xiang, C [
19] proposed a micro-crack automatic detection method based on super-resolution reconstruction and semantic segmentation, in order to detect cracks in civil infrastructure. The results indicated that the method can achieve good results in detecting concrete cracks. However, in addition to our team, few people have studied the use of deep learning models for super-resolution reconstruction in the field of engineering bamboo speckle image DIC.
Based on super-resolution reconstruction technology and deep learning, this paper focuses on engineered bamboo speckle images, in order to identify the cracks in engineered bamboo. For this purpose, an attention-dense residual and generative adversarial network (ADRAGAN) model based on an attention-intensive residual structure and the relative mean value is proposed, which is trained using a comprehensive loss function, while network interpolation is used to balance the network parameters to suppress artifacts. The model provides a more reasonable structure for crack identification from engineered bamboo speckle images, effectively improving the engineered bamboo crack identification accuracy, providing effective support for fracture analysis of engineered bamboo, an effective means for calculation of the reliability of the fracture strain energy, and a theoretical basis for the reasonable design of mechanical and electrical packaging and building structures using engineered bamboo, ensuring the safety of the designed structure.
3. Results
This study was performed using the same hardware platform and software environment. The hardware platform configuration is detailed in
Table 2. The software environment settings are shown in
Table 3. In addition, this study used CUDA10.1 and CuDNN7604 to accelerate model training. The network parameters of each algorithm are shown in
Table 4. The residual scaling coefficient was set to 0.2 before the residual was added to the main path.
Comparing the improved algorithm with other algorithms, the number of test set images was 130 under the condition of ×4 scaling. We used the objective indices of peak signal to noise ratio (PSNR) and structural similarity (SSIM) and the subjective index mean opinion score (MOS) to compare the improved algorithm with other algorithms [
36]. PSNR is a full reference image quality evaluation index, providing an objective standard to measure the image distortion or noise level. The greater the PSNR value between two images, the more similar they are. SSIM is based on the similarity between two given images from the three aspects of brightness, contrast, and structure as a measure, where the mean value is used in the brightness evaluation, the standard deviation is used in the contrast evaluation, and the covariance is used in the structural similarity evaluation. The SSIM is provided as a value between 0 and 1. The larger the SSIM, the smaller the difference between the two images in these three aspects. The subjective index MOS involves consulting with professionals who study the engineered bamboo cracks and make a subjective qualitative evaluation of the image for the observer.
Table 5 provides the PSNR, SSIM, and MOS values of the five algorithms on the engineered bamboo speckle image dataset.
It can be seen, from
Table 5 that the ADRAGAN method used in this paper yielded higher index values in both objective and subjective indicators for super-resolution reconstruction on the engineered bamboo speckle image dataset. In particular, the SRResNet method was 4.02 dB higher than the traditional Bicubic B-spline interpolation method in the PSNR index, 0.212 higher than the traditional method in the SSIM index, and 1.29 higher than the traditional method in MOS value. Therefore, the super-resolution reconstruction method for engineered bamboo speckle images based on deep learning greatly improved the three indices, compared with the traditional method, indicating that the image super-resolution reconstruction effect based on deep learning provides a huge improvement. Compared with the SRResNet method, the PSNR index of the SRGAN method was increased by 3.4 dB, the SSIM index was increased by 0.018, and the MOS value was reduced by 0.08 points, indicating that the SRGAN method produced a slight improvement in the objective indices for the super-resolution reconstruction of engineered bamboo speckle images. In the image super-resolution task, it could form more abundant high-frequency information than the previous method; however, the SRGAN network model may produce artifacts, reducing the subjective evaluation value. In order to remove artifacts, we improved upon SRGAN in our method. Compared with the SRGAN method, the ADRAGAN method improved the PSNR index by 1.32 dB, the SSIM index by 0.024, and the MOS value by 0.11 points. Overall, the results for the ADRAGAN method were slightly better than those of the SRGAN method in the objective indices, while the subjective index value was greatly improved, indicating that the ADRAGAN method effectively removed artifacts and had an improved effect regarding the super-resolution reconstruction of engineered bamboo speckle images.
Figure 5 shows a comparison of the image reconstruction effects for each algorithm. It can be seen, from the figure, that under 4× scaling, the methods based on deep learning provided better images than the traditional method. The high-resolution image details and edge information reconstructed by the ADRAGAN and SRGAN networks were very rich. These results were not only better than the image quality when using the traditional method, but also better than the high-resolution image reconstructed using the SRResNet network. They provide output images with visual effect very close to that of the original high-resolution image, as can be seen in the figure. Therefore, the GAN network structure has certain advantages in restoring image visual effects. The SRGAN method performed relatively worse than the proposed method on the engineered bamboo speckle image dataset, often producing large-area artifacts. The ADRAGAN method, which uses network interpolation to balance the network parameters, avoided the problem of frequent artifacts, leading to good results and verifying the role of network interpolation. The ADRAGAN method also uses a comprehensive loss function to further improve the perceptual quality of the reconstructed image.
4. Discussion
The purpose of studying engineered bamboo speckle image super-resolution reconstruction methods is to capture the crack tip position of engineered bamboo more accurately, in order to obtain more accurate crack length data. The low-resolution images, original high-resolution images, and images generated by various algorithms of engineered bamboo were imported into DIC analysis software in batches. The pixel distance from the crack tip position to the vertical extensometer derived by the DIC analysis software was recorded as
pixels, while the actual distance from the pre-fabricated crack tip to the vertical extensometer was recorded as
, and the pixel distance from the prefabricated crack tip to the vertical extensometer measured by DIC analysis software was recorded as
. The relevant calculation dimensions for crack propagation length are shown in
Figure 6.
The actual distance,
, of the crack propagation length can be expressed as:
When the crack had not yet appeared in the early stage of crack propagation, due to the existence of software analysis errors, the crack tip position identification was unstable at this time. After data comparison and analysis, crack tip identification in the DIC analysis software started from the 223rd image. At this point, it was stable, so the data of images 223–1300 were used for further analysis and comparison.
The DIC analysis software was used to derive the pixel distance
from the crack tip position of the original high-resolution image and the image generated by each algorithm to the vertical extensometer, and the actual distance
of the crack propagation length was calculated, respectively. The differences
and
between the parameters obtained from the images generated by each algorithm and the original high-resolution image parameters were calculated, and the above operations were performed on images 223–1300. The average pixel distance
from the crack tip position of the image generated by each algorithm to the vertical extensometer, the average actual distance
of the crack propagation length, the average difference
between the pixel distance from the crack tip position to the vertical extensometer and that in the original high-resolution image, and the average difference
between the crack propagation length and that in the original high-resolution image were calculated.
Figure 7 depicts the comparison between images generated by the algorithms and the original high-resolution image.
Table 6 provides comparison results for each algorithm.
As shown in
Table 6, the average error between the actual crack propagation length in the low-resolution image, relative to the original high-resolution image, was −4.436 mm, while that for the bicubic B-spline interpolation method was 2.485 mm. Compared with the low-resolution image, although it was improved, the error was still large. The
of the SRResNet method was −1.179 mm, such that the restoration error was reduced by 52.6%, compared with the bicubic B-spline interpolation method. The value for the SRGAN method was −1.109 mm, and the error was reduced by 55.4%, compared with the bicubic B-spline interpolation method. The effect was more than doubled, indicating that methods based on deep learning have advantages over traditional methods. The reconstructed image output by the SRGAN method had an impact on the DIC calculation due to artifacts and, so, the calculation results were not obtained. However, the error value for the ADRAGAN method proposed in this paper was 0.205 mm, and the crack detection accuracy reached 99.65%. Compared with the traditional methods, the accuracy of the SRResNet and SRGAN methods was surpassed by the proposed method, indicating that the attention-intensive residual structure and the relative mean generative adversarial network model are very helpful for the restoration of the crack area in engineered bamboo speckle images, thus verifying the effectiveness of the improved algorithm proposed in this paper.
Overall, the proposed super-resolution reconstruction technology for engineered bamboo speckle image based on the generative adversarial network was used to obtain high-resolution images. These were directly imported into DIC analysis software to assess the crack detection accuracy, which was close to that of the image collected using high-performance equipment. Therefore, this paper demonstrates the potential of applying super-resolution reconstruction methods based on generative adversarial networks in the field of engineered bamboo DIC technology, which is of great value for improving measurement accuracy, reducing equipment requirements, and ensuring the safety of engineered bamboo structural parts.
5. Conclusions
In order to address the difficulty of determining the crack tip position and measuring the crack length in the process of measuring the crack propagation scale in engineered bamboo, a super-resolution reconstruction method for engineered bamboo speckle images based on the ADRAGAN network was proposed. ADRAGAN consists of a generative network of dense residual blocks with an attention mechanism, as well as a discriminant network using the reference relative mean. A comprehensive loss function was used for training, and network interpolation was utilized to balance the network parameters, thus suppressing artifacts. Then, the performance of various algorithms on a test set was evaluated using the evaluation indexes PSNR, SSIM and MOS. From the analysis of the objective and subjective evaluation indexes of image quality, the ADRAGAN method proposed in this study was 8.74 dB, 0.254, and 1.32 points higher than bicubic B-spline interpolation method; 4.72 dB, 0.042, and 0.03 points higher than SRResNet; and 1.32 dB, 0.024, and 0.11 points higher than SRGAN in PSNR, SSIM, and MOS, respectively. Therefore, the ADRAGAN method has obvious advantages over the other methods, in terms of speckle image super-resolution reconstruction. The images reconstructed by ADRAGAN have sharper edges and richer detail and are more realistic to the human eye. Finally, the super-resolution images generated by each algorithm were imported into DIC analysis software, and the crack propagation length was analyzed and compared. The crack error obtained by the ADRAGAN method was 0.205 mm. The results of this paper verify the superiority of the proposed algorithm and the application potential of image super-resolution reconstruction technology based on deep learning in the analysis of mechanical and fracture properties of engineered bamboo.