Next Article in Journal
The Effect of Circadian Photoreceptors Stimulation on the Stress Response of Subjects with High Anxiety: A Pilot Study
Previous Article in Journal
An Interpretable Fake News Detection Method Based on Commonsense Knowledge Graph
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Quantitative Detection Method for Surface Cracks on Slab Track Based on Infrared Thermography

1
Institute of Railway and Urban Mass Transit, Tongji University, Shanghai 201804, China
2
School of Urban Rail Transportation, Shanghai University of Engineering Science, Shanghai 201620, China
3
College of Urban Transportation and Logistics, Shenzhen Technology University, Shenzhen 518118, China
*
Authors to whom correspondence should be addressed.
Appl. Sci. 2023, 13(11), 6681; https://doi.org/10.3390/app13116681
Submission received: 19 March 2023 / Revised: 24 May 2023 / Accepted: 26 May 2023 / Published: 30 May 2023
(This article belongs to the Section Civil Engineering)

Abstract

:
Surface cracks are typical defects in high-speed rail (HSR) slab tracks, which can cause structural deterioration and reduce the service reliability of the track system. However, the question of how to effectively detect and quantify the surface cracks remains unsolved at present. In this paper, a novel crack-detection method based on infrared thermography is adopted to quantify surface cracks on rail-track slabs. In this method, the thermogram of a track slab acquired by an infrared camera is first processed with the non-subsampled contourlet transform (NSCT)-based image-enhancement algorithm, and the crack is located via an edge-detection algorithm. Next, to quantitatively detect the surface crack, a pixel-locating method is proposed, whereby the crack width, length, and area can be obtained. Lastly, the detection accuracy of the proposed method at different temperatures is verified against a laboratory test, in which a scale model of the slab is poured and a temperature-controlled cabinet is used to control the temperature-change process. The results show that the proposed method can effectively enhance the edge details of the surface cracks in the image and that the crack area can be effectively extracted; the accuracy of the quantification of the crack width can reach 99%, whilst the accuracy of the quantification of the crack length and area is 85%, which essentially meets the requirements of HSR-slab-track inspection. This research could open the possibility of the application of IRT-based track slab inspection in HSR operations to enhance the efficiency of defect detection.

1. Introduction

Slab tracks are widely used in newly built high-speed railways (HSRs) due to its significant advantages, such as high stability and low maintenance cost. However, under the joint effect of the large wheel–rail force induced by high-speed trains and the environmental factors in operation, slab tracks are prone to structural defects, such as surface cracks [1,2]. To prevent these cracks, the design cracking joint (DCJ), as a structural optimization measure, is adopted in some prefabricated concrete slabs [3,4]. However, according to the operation and maintenance practice in Chinese HSR, surface cracks can still occur in the non-DCJ areas on slabs [5]. More seriously, full cracks may develop, which is a hidden danger to the operational safety of HSRs. Although the maintenance specification of the Chinese HSR formulates standards for the inspection and maintenance of surface cracks, the timely detection of these cracks is challenging. This is mainly because the current methods of crack detection mainly depend on inefficient manual inspection within a narrow time window. Therefore, it is of great practical significance to develop an efficient surface-crack-detection method for HSR slab tracks.
The current detection methods for surface cracks can be classified into two categories: contact methods and non-contact methods. The contact methods, as traditional inspection methods, usually involve the placement of sensors on the track-slab surface to detect cracks. The main examples of these methods are the impact-echo method [6,7], the acoustic emission method [8,9], and the optical-fiber-sensing method [10,11]. These methods can accurately locate cracks and identify their sizes, but their detection efficiency is low and the requirement for operators is high. Therefore, these methods are applicable to the detection of key parts of slab tracks rather than the inspection of a whole line. In comparison, the non-contact methods are relatively new, based on the development of modern sensing technology. Characterized by high detection efficiency, these methods are increasingly applied in HSRs. In particular, the most efficient method is the use of the high-speed track-inspection train, whereby the service condition of the track structure, including some typical defects, can be detected at high speeds [12]. However, the inspection train cannot directly detect cracks on the surfaces of track slabs [13]. To solve this problem, some novel track-inspection trolleys equipped with ground-penetrating radar (GPR) [14], machine vision (with visible cameras) [15,16], and infrared thermography (IRT) [5,17,18] devices have been developed in recent years. However, because of the influence of the steel bars inside the reinforced track slab, the accuracy of the geological radar-imaging method is low. For the machine-vision-based method, the dark condition during the window time at night can significantly limit its application in HSRs. In comparison, infrared thermography, which is used to measure the temperature fields of track slabs and does not need additional illuminating devices, is more suitable for detecting surface cracks in track slabs. The existing studies are mainly exploratory discussions about the feasibility of identifying surface cracks using aging methods. There is still a lack of studies on how to effectively extract the features of slab-surface cracks and assess these cracks in a quantitative manner.
Therefore, this paper proposes a novel image-processing method, which can locate and quantify crack areas in track slabs using infrared thermography. Figure 1 illustrates the flowchart of the proposed method. The effectiveness of the proposed method at different temperatures is validated against a laboratory test, in which the temperature field of a scale model of a track slab with artificial cracks is studied. The remaining parts of this paper are as follows. The second part presents the image-enhancement and edge-detection methods in the processing of the infrared-thermography data. In the third part, an algorithm for quantitatively detecting the crack area based on the number of graphic pixels is presented. The fourth part analyzes the accuracy and effectiveness of the proposed algorithm by comparing the results of the laboratory test with the scaled model of the track slab. The last part gives the conclusions.

2. Infrared-Thermogram Processing

2.1. Acquisition of the Infrared Thermography

In this research, the Fluke IR camera (type: TIX620) was used to record the thermal image of slab surface. The key parameters of the camera are listed in Table 1. The experimental setup was presented in our previous research [5], as shown in Figure 2. The IR camera with a standard lens of 30 mm is installed on a metal bracket and the distance between the camera and slab surface is 0.75 m. The emissivity of the slab surface is 0.92.

2.2. Non-Subsampled Contourlet Transform (NSCT)-Based Image-Enhancement Algorithm

Key to the quantitative assessment of the surface cracks in track slabs is the quality of the infrared thermography of the rail track. In this regard, this section presents the image-enhancement and edge-detection methods used to process the original infrared thermography.
The non-subsampled contourlet transform (NSCT)-based image-enhancement algorithm is used to transform the infrared thermogram from time domain to frequency domain, and modifies the frequency-domain coefficients at different levels. It can highlight the crack edges and details in the thermal image of the track-slab surface. The NSCT is characterized by multiple scales and directions, compared with traditional methods, such as wavelet transform, which are based on the scale correlation of transformation coefficients. It is composed of non-subsampled pyramid (NSP) and non-subsampled directional filter banks (NSDFB) [19]. During image decomposition, NSP decomposes the raw image into high-frequency and low-frequency components, and then NSDFB decomposes the high-frequency component into multiple band-pass directional sub-bands. The multi-scale and multi-directional decomposition principle of NSCT is shown in Figure 3.
In the image-enhancement algorithm for infrared thermograms, it is necessary to select the appropriate threshold according to the transformation coefficient obtained from the original image after frequency-domain transformation. The threshold is used to distinguish the noise and effective edge details in the image, to avoid image distortion and the amplification of noise. In this paper, the threshold value is determined by the transformation coefficients at different scales and directions obtained from the original image after NSCT. The relationship between the threshold value and the standard deviation of the transformation coefficient is expressed as:
T k l = 1 2 1 M N m = 1 M n = 1 N ( W k l f ( m , n ) m e a n W k l ) 2
where T k l is the threshold value at the k-th directional sub-band of the l-th scale, W k l f ( m , n ) is the transformation coefficient at the k-th directional sub-band of the l-th scale at coordinates ( m , n ) , m e a n W k l is the mean value of all transformation coefficients in the k-th directional sub-band on the l-th scale, M   ×   N is the size of the sub-band image.
By using NSCT, the original image can be transformed to obtain transformation coefficients of multiple scales and directions. Next, the nonlinear enhancement function is adopted to modify the coefficients in the transformed domain. The enhancement function can be expressed as [19]:
f ( x ) = a [ s i g m ( c ( x   -   b ) )   -   s i g m ( - c ( x   + b ) ) ]
a   = 1 s i g m ( c ( 1   -   b ) )   -   s i g m ( - c ( 1   + b ) )
s i g m ( x ) = 1 1 +   e - x
where coefficient b controls the enhancement range, 0 < b < 1, c controls the enhancement intensity, and its variation range is (20, 50).
To avoid the influence of the grayscale of the original image on the coefficients a, b, and c in the enhancement function, the maximum transformation coefficient x m a x in the directional sub-band is used as the normalization factor to normalize the transformation coefficient.
It can be seen from Equations (2)–(4) that the domain of f ( x ) is [–1, 1], and f ( 0 ) = 0 , f ( 1 ) = 1 . The coefficient b in Equation (2) is determined by solving the nonlinear equation f ( x ) = x , and the enhancement function becomes:
f ( x ) = a x m a x [ s i g m ( c ( x x m a x b ) )   -   s i g m ( - c ( x x m a x + b ) ) ]
The thresholds at different scales and in different directions are selected in Equation (1) by using the transformation coefficients. However, if these thresholds are directly used to modify the transformation coefficients at a certain scale or in a certain direction without considering the correlation of the transformation coefficients at different scales, some key transformation coefficients may be considered as noise and set to zero. To consider the correlation between transformation coefficients at different scales, a multiscale product is introduced into the infrared-image-enhancement algorithm in this paper, which is expressed as:
P k l f ( m , n ) = W k l f ( m , n ) · W k l + 1 f ( m , n )
where P k l f ( m , n ) is the multiscale product of the k-th directional sub-band on the l-th scale at coordinates ( m , n ) , W k l f ( m , n ) is the transformation coefficient of the k-th directional sub-band on the l-th scale at coordinates ( m , n ) , and W k l + 1 f ( m , n ) is the transformation coefficient of the k-th directional sub-band on the (l+1)th scale at coordinates ( m , n ) .
It can be seen from Equation (6) that the multiscale product is the product of the transformation coefficients of the image in the same directional sub-bands of two adjacent scales. In this paper, the threshold is used to modify the multiscale product rather than the transformation coefficients to avoid the aforementioned problem. Thus, the infrared-image-enhancement algorithm can preserve more details of the original image while strengthening the crack edges and reducing the noise in the image.
The process of the proposed image-enhancement algorithm based on multiscale product is as follows:
Step 1. Use NSCT to decompose the original image to layer L, and obtain the transformation coefficients in sub-bands of i scales and 2 i directions.
Step 2. Determine the threshold values for sub-bands of different scales and directions according to Equation (1), and obtain the adaptive enhancement function f ( x ) according to Equation (5).
Step 3. Use Equation (6) to calculate the multiscale product P r j f ( m , n ) of sub-bands in each direction, where j [ 1 , i   -   1 ] ,   r [ 1 , 2 i ] . According to Equation (7), the threshold T r j is directly substituted for the multiscale product P r j f ( m , n ) to reduce the noise.
W ¯ r j f ( m , n ) = { W r j f ( m , n ) , P r j f ( m , n ) T r j 0 , P r j f ( m , n ) < T r j
where W r j f ( m , n ) is the transformation coefficient of the r-th directional sub-band on the j-th scale at coordinates ( m , n ) , P r j f ( m , n ) is the multiscale product of the i-th directional sub-band on the j-th scale at coordinates (m, n), T r j is the threshold value of the r-th directional sub-band on the j-th scale, and W ¯ r j f ( m , n ) is the new transformation coefficient at the coordinates ( m , n ) of the r-th directional sub-band on the j-th scale obtained after thresholding.
Step 4. Substitute W ¯ k l f ( m , n ) into the enhancement function f ( x ) to conduct image enhancement.
Step 5. Conduct inverse NSCT using the transformation coefficients of all scales and sub-bands in all directions after the enhancement processing to reconstruct the infrared image of the slab’s surface cracks.

2.3. Edge Detection of Infrared Thermogram

The current edge-detection methods for infrared thermograms are mainly based on the gray gradient of the image or the measurement standards on the gray space, so the effect of detection depends heavily on the grayscale and contrast of the image. However, in the infrared thermogram of the track slab with surface cracks, the difference between the grayscale at the crack edge and intact part is small and difficult to detect. To solve this problem, this paper adopts a crack-edge-detection algorithm based on phase congruency of the Fourier components of the infrared image of the slab-surface cracks, and sets the phase congruency with large values in the image as the feature points of the crack edge. Through these steps, the crack area in tan infrared image can be detected. Since the phase congruency is not affected by the gray gradient at the crack edge in the infrared image, it has a higher detection accuracy than the edge-detection algorithm based on gray gradient and gray space.
The Fourier expansion of one-dimensional signal t ( z ) can be obtained by Fourier transformation:
t ( z ) = d A d cos ( d ω z + φ d 0 ) = d A d cos ( φ d ( z ) )
where A d , φ d 0 , ω are the amplitude, initial phase, and angular frequency of the d -th Fourier component of the signal t ( z ) , respectively. The φ d ( z ) is the phase value of the d -th Fourier component at z .
According to the previous research on the phase characteristics of Fourier series of various signals [20], phase congruency can be defined as:
P C ( z ) = max φ ¯ ( z ) [ 0 , 2 π ] d cos [ φ d ( z ) φ ¯ ( z ) ] d A d
where φ ¯ ( z ) is the weighted average phase value of the Fourier components of the signal t ( z ) when P C ( z ) takes the maximum value at point z. It can be seen from Equation (9) that in order to maximize the phase congruency P C ( z ) , the sum of the differences between the phase φ d ( z ) and φ ¯ ( z ) of each Fourier component of signal t ( z ) must reach the minimum value. To solve problem of computation cost in Equation (9), Venkatesh et al. [21] introduced the concept of local energy. The relationship between local energy function, phase−congruency function, and Fourier components of the signal is shown in Figure 4.
It can be seen from Figure 4 that the local energy can be expressed as:
E ( z ) = t 2 ( z ) + H 2 ( z )
where H ( z ) is the Hilbert transform of t ( z ). It can also be seen from Figure 4 that the local energy E ( z ) is the sum of the projections of the Fourier components of the signal t ( z ) in the E ( z ) direction:
E ( z ) = d A d cos ( φ d ( z )   -   φ ¯ ( z ) )
The combination of Equations (9) and (11) yields:
P C ( z ) = E ( z ) d A d
Equation (12) shows that the phase congruency is the ratio between the local energy and the sum of the amplitudes of the Fourier components of the signal, and Equation (11) shows that the local energy is closely related to the phase of the Fourier components. It can be seen that the phase congruency is greater when the phase-angle values of the Fourier components of the signal are centrally distributed.
The principle of crack-edge detection is based on the fact that the distribution of the phase-angle value of each Fourier component at the crack edge is relatively concentrated, which means the phase congruency in the cracks is higher than those in the non-crack areas. The process of edge-detection algorithm of track-slab-surface cracks is as follows:
Step 1. Calculate the phase congruency of all pixels in the infrared thermogram of slab surface cracks.
Step 2. Multiply the phase congruency values of all pixels by 255, i.e., convert the phase−congruency values of each pixel into the corresponding grayscales, and obtain the phase−congruency image, as shown in Figure 5b.
Step 3. Use Otsu’s method to solve the segmentation threshold of the phase−congruency image of the slab-surface crack, obtain the area with a large gray value (i.e., phase−congruency value), and convert the segmented phase−congruency image into a binary image, as shown in Figure 5c.
Step 4. Use the morphological filter to solve the over-segmentation and under-segmentation problems caused by Otsu’s method. In the morphological filter, the dilation operation is used to connect the fracture points in the crack area and the open operation is used to eliminate the isolated noise points and maximumly preserve the structure of the crack area.
Furthermore, it should be noted that the track-slab surface is not smooth and features defilement, and there are temperature-distortion points in the collected infrared images, which can generate blocky pseudo-edge areas in the segmented images. By comparing the distribution of the pseudo-edge area and the crack area in the segmented images, it is found that the number of pixels occupied by the pseudo-edge area due to the defilement and temperature distortion is lower than the number of pixels in the crack area. Furthermore, the crack appears as a long and narrow strip area in the segmented image, while the pseudo-edge area appears as a block area, which means the length–width ratio of the crack area is greater than that of the pseudo-edge area.
In this regard, in this paper, the crack area and pseudo-edge area are marked in the binary image after morphological processing as connected domain { b w 1 , b w 2 , , b w s u m } , where s u m is the total number of crack areas and pseudo-edge areas. Next, the total number of pixels, and the lengths of the major axis and the minor axis of all connected domains are calculated. The major axis and the minor axis refer to the major and minor axis of the ellipse with the same standard second-order central moment as the area. Next, the total number of pixels, as well as the ratio of the length of the major axis to the minor axis of all connected domains, are sorted, and two sets V 1 , V 2 are formed, accordingly, by thresholding the number of pixels. The threshold value of V 1 is set to t h v 1 , i.e., the pseudo-edge area can be defined as the connected domain with the number of pixels less than t h v 1 ; the threshold value of V 2 is set to t h v 2 and t h v 2 = α m a x { V 2 } , where α is an empirical parameter and α∈ [ 0.4 ,   0.7 ] , i.e., the pseudo-edge area can be defined as the connected domain with a ratio of the length of the major axis to that of minor axis less than t h v 2 . After morphological processing and elimination of pseudo-edge areas, a full image of the crack area can be extracted from the segmented binary image, as shown in Figure 5d.
Step 5. Refine the crack area. It can be seen from Figure 5e that the crack area obtained in Step 4 is larger than the actual crack area in the infrared thermography, and the redundant part is the slab concrete near the crack edge, so the crack area obtained in the previous step needs to be refined.
Because the thermal conductivity of the air in the surface cracks is quite different from that of the concrete material, heat accumulates more easily inside the cracks, and the speed of heat dissipation is also slower than that in the non-crack areas, resulting in differences in temperature values and temperature gradients between the cracks and non-cracks on the slab surface. Since the thermal imager can convert the temperature value of the slab surface by detecting the infrared radiation emitted from the slab surface, a temperature-value matrix, which contains the temperature value of all pixels in the infrared thermogram, can also be obtained.
The temperature-value matrix of the infrared thermogram is defined as:
TEM = [ t e m 1 , 1 t e m 1 , c o l t e m r o w , 1 t e m r o w , c o l ]
where t e m 1 , c o l is the temperature value of the pixel at the coordinate ( 1 , c o l ) and r o w × c o l is the size of the image.
The transverse temperature-gradient matrix of infrared thermogram is defined as:
g r a d x = [ g d x 1 , 1 g d x 1 , c o l - 1 g d x r o w , 1 g d x r o w , c o l - 1 ]
where g d x r o w , c o l - 1 = t e m r o w , c o l - t e m r o w , c o l - 1 .
The vertical temperature-gradient matrix of infrared thermogram is defined as:
g r a d y = [ g d y 1 , 1 g d y 1 , c o l g d y r o w 1 , 1 g d y r o w 1 , c o l ]
where g d y r o w - 1 , c o l = t e m r o w , c o l - t e m r o w - 1 , c o l .
According to the pixel coordinates in the crack area obtained in Step 4, three scalar attributes are given to each pixel in the area, temperature value, transverse temperature gradient value, and vertical temperature-gradient value, so that a dataset with three-dimensional scalar attributes { A T 1 , A T 2 , } is formed. The “k-means” clustering algorithm [22] is used to classify all elements in the dataset, and the crack area is refined according to the classification results and the coordinates of the elements in the dataset. The effect of crack-edge extraction is shown in Figure 5f. Note that the category number c l u is set to 4 after several trials.
In Figure 5, the whole process of the crack-edge-detection algorithm based on phase congruency is presented. It can be observed that a complete binary image of cracks from the infrared thermogram of the track slab can be extracted, which can be used for subsequent measurement and analysis of surface cracks.

3. Quantitative Detection Method of Crack Area

To detect the surface crack in a quantitative manner, the pixel width, length, and total number of pixels in the connected area of the infrared thermogram are calculated and the pixel calibration is conducted to obtain the width, length, and area of the crack.

3.1. Pixel Length of the Crack

Since the slab-surface cracks appear uneven in the thickness direction, Zhang–Suen thinning method [23] is used to refine the extracted crack area into a crack skeleton composed of single-layer pixel points, as shown in Figure 6. The pixel length of the crack can then be calculated. Based on the skeleton graph, the pixel points on the crack skeleton are coded by 8-direction chain code proposed by Freeman [24]. The chain code is a method to describe a curve by using the coordinates of the starting point of the curve and the direction of the boundary point [24]. The coding process starts from the endpoint of the crack-skeleton map, and the pixel points in the crack skeleton are encoded according to the direction in Figure 7 until all the pixels on the skeleton have been scanned.
According to the 8-direction chain code of pixels on the crack-skeleton graph, the length of the crack skeleton, i.e., the pixel length of the crack, can be obtained as:
L e n c r a c k = w e i e v e n N u m e v e n + w e i o d d N u m o d d
where N u m e v e n and N u m o d d are the numbers of even chain codes and odd chain codes in pixel direction coding of the crack-skeleton image, respectively. In Figure 6, the direction of the even chain code is vertical or horizontal, and the segment length of the crack at the pixel point is the number of pixels, with a weight of w e i e v e n = 1 . The crack direction in the odd chain code is ± 45 ° , and the segment length of the crack at the pixel point is 2 times the number of pixels, with a weight of w e i o d d = 2 .

3.2. Pixel Area of the Crack

By counting the total number of pixel points in the crack area extracted from the infrared thermal image of the slab surface, the pixel area of the crack A r e a c r a c k can be obtained.

3.3. Pixel Width of the Crack

With the pixel length and area of the crack obtained in (1) and (2), the average pixel width w i d t h ¯ c r a c k of the crack area can be calculated as:
w i d t h ¯ c r a c k = A r e a c r a c k L e n c r a c k
The local pixel width of the crack can be calculated by the minimum-distance method, which involves the extraction of the crack area from the thermogram to obtain a single-layer edge curve for the crack, as shown in Figure 8. The upper crack-edge pixel in each column in the crack-edge area is taken as the center, and the minimum distance between the lower crack-edge pixel in the adjacent n a r r o u n d columns, which is defined as the pixel width of the column, can be calculated. Note that n a r r o u n d is generally taken to be between 3 and 5.

3.4. Pixel Calibration in Crack Region

Another important problem that needs to be solved is the false detection of DCJ, which is the designed component of the slab track, rather than the surface crack, as shown in Figure 9. Because the DCJ is more consistent and the boundary distinction is more obvious, the false joint area can probably be detected as the surface crack on the slab track. To distinguish DCJ from actual surface crack, this paper proposes an identification method for DCJ. Since the spacing between adjacent DCJs on the track slab is a fixed value, the pixel spacing between the centroids of adjacent connected domains at the DCJ is a fixed value H r e a l . Therefore, the pixel distance H p i x e l between adjacent connected areas at the DCJ is obtained by calculating the centroid coordinates of the connected areas at the two DCJs. The conversion coefficient K p i x e l between a single pixel and the physical length in the infrared thermal image is obtained by comparing the actual distance H r e a l and the pixel distance H p i x e l between adjacent DCJs in the infrared thermogram:
K p i x e l = H r e a l H p i x e l
where H r e a l is the actual distance between adjacent DCJs, H p i x e l is the pixel distance between adjacent DCJs, and K p i x e l is the physical distance of a single pixel. The conversion factor K p i x e l can be used to convert the pixel length, local pixel width, average pixel width, and pixel area of the crack area into the actual crack length, actual crack width, and actual crack area.

4. Case Study

4.1. Model Test

To verify the effectiveness of the proposed algorithm, we conducted a laboratory test, in which a slab-track model was used. Considering that the actual size of the slab track (6.45 m long, 2.95 m wide along the concrete base, and 0.53 m high) was large, a scaled model of the track slab which could reflect the real temperature field of the slab under different conditions was used.
(1)
Size of the scaled model
To determine the size of the scaled model, we used finite element (FE) simulation, though which the temperature field of the track slab was simulated. The relevant environmental parameters, boundary conditions, and model verification are given in [5]. A crack with a width of 0.2 mm and a depth of 20 mm was added to the slab surface, as shown in Figure 10.
For the length of the track model, the track slab was a longitudinal concrete structure, and the size of the track slab in the length direction was much larger than that in the height and width direction. Furthermore previous studies [25,26] also ignored the heat transfer in the longitudinal direction when studying the temperature field of slab-track structures and simplified it into a two-dimensional heat-transfer structure. In this regard, to determine the length of the track model, in this study, we performed a large number of trial calculations. Based on the results of the trial calculations and [27], the length of the track model was set to 1.272 m.
After the determination of the model length, the influence of the height and width on the temperature field of the track slab was further analyzed. In this study, the 1:3, 1:4, and 1:5 scale models (in both height and width direction) were chosen in the temperature calculation, and the other input parameters towered ran from [5]. The temperature values in the crack and non-crack areas on the track-slab surface at different times are shown in Figure 11.
It can be seen from Figure 11 that when the reduction ratio of the scaled model in the width direction or height direction was larger (i.e., 1:3 scale), the temperature in the crack and non-crack areas on the slab surface had smaller errors with the full-scale model; the error caused by the height reduction is greater than that caused by the width direction. Therefore, the scale in the width direction was set to 1:3, i.e., 0.85 m; the height of the model was set to 0.53 m, the same size as the full-scale model.
Table 2 lists the calculation results for the temperature with the scale model and the full-scale model, as well as the error of the scale model (compared with that of the full-scale model). It was found that the maximum error of the temperature in the scale model in the non-crack areas was 2.12%, and the average error was 1.41%; the maximum error in the scale model in the crack areas was 2.26%, and the average error was 1.46%. Therefore, it can be concluded that the scale model can effectively show the surface-temperature field of an actual slab track, and it can be used to validate the thermal imaging detection of surface cracks.
(2)
Track model and relevant experimental equipment
In this test, the scale model of the track slab was produced according to the parameters specified by the China High-Speed Railway. The materials of the track slab, bearing layer, and CA mortar layer and their corresponding coordination are listed in Table 3. Figure 12 shows the scale model after curing.
The temperature-control equipment used in the experiment was a temperature-controlled cabinet (type: UC27-60150-ES) with an internal size of 3 m × 3 m × 3 m, as shown in Figure 13. It can withstand a maximum load of 600 kg/m2 and can provide a temperature range of −60 to 150 °C. Furthermore, it can allow the setting of the temperature–time curve and temperature-change rate, whereby rapid temperature rises and drops can be simulated.
(3)
Temperature-change process and infrared thermogram
The slab-track-structure model was placed in the center of the bottom of the test box when heated, as shown in the right panel of Figure 13. The initial internal temperature was set to 20 °C, and the temperature-growth rate was set to 0.5 °C/min. After the temperature rose to 60 °C, it began to drop at a rate of 1 °C/min. During this process, the infrared thermogram was collected by a TIX620 thermal imager. The results of the temperature field on the slab surface are presented in Table 4 and Figure 14.

4.2. Results Analysis

To extract the crack features, the thermograms in Figure 14 were processed by the proposed image-processing algorithm, and the results are shown in Figure 15 and Figure 16. It can be observed that through the image enhancement by NSCT and the edge-detection algorithm based on phase congruency, two cracks on the slab surface were effectively identified.
Next, the detailed information about the cracks, including the lengths, widths, and areas, was calculated using the proposed quantitative crack-detection method. Since the two cracks were prefabricated with the same length and width, this paper only presents the quantitative detection results of one of them, as listed in Table 5.
It can be observed from Table 5 that the detection accuracy of the proposed algorithm for the crack width was higher than 98.5%, but the accuracy in the detection of the length and area was only about 85%. The main reason for this problem is that in the infrared thermogram, the surface temperature at the edge of the track slab was higher than that in the middle area, which may have reduced the contrast between the crack and non-crack areas at the edge of the track slab. As a result, it was difficult to detect the cracks on the edge of the slab and the calculated length was shorter than the actual length of the cracks. Nevertheless, according to the current slab-track maintenance rules for HSRs, the level of surface cracking was only determined by its width, with no relevant information on length. Therefore, although the accuracy of the proposed method is limited, to some degree, for predicting the lengths of slab-surface cracks, it can still meet the actual needs of HSR-slab-track maintenance due to its high performance in the prediction of crack width.

5. Concluding Remarks

In view of the actual condition of HSR maintenance within the relevant time window, infrared thermography can be an effective approach to detecting the surface cracks in track slabs. The aim of this paper was to solve the key problem of the quantitative detection of surface cracks based on the infrared thermogram of a slab track. The main contribution of this paper is the development of a thermographic processing method which can extract detailed information on surface cracks in slab tracks. It consists of two steps: feature extraction and quantitative detection. In the process of crack-feature extraction, this paper proposes a novel infrared-image-enhancement algorithm based on the NSCT multi-scale product-thresholding method and a phase−congruency-based crack-edge-detection method. In the quantitative detection process, the lengths, widths, and areas of surface cracks are obtained based on the calculation of pixel numbers in the crack areas. Finally, the proposed method was verified by a laboratory test, in which a scale track model was used. The main conclusions are as follows:
(1)
The proposed infrared-image enhancement algorithm can effectively solve the problem of fuzzy edge details and low contrast in the infrared thermograms of slab tracks and strengthen the crack-edge details in the image;
(2)
The crack area can be located from the infrared thermogram via the edge-detection algorithm and morphological processing algorithm; the morphological processing method can be used to effectively remove the isolated noise and false edge areas in the image;
(3)
The scale model of the track slab designed in this study can reflect the surface-temperature field of the original slab-track structure based on the results of the FE simulation of the slab-temperature field;
(4)
As verified by the laboratory test, the quantitative accuracy of the detection of crack width by the proposed algorithm can be higher than 90%, whilst the accuracy of the algorithm’s length and area detection is 85%, which essentially meets the requirements of current track maintenance for HSRs.
In summary, the proposed method can be used to improve the detection of surface cracks in HSR slab tracks based on thermal imaging, and its quantitative detection ability was verified. However, the actual operational condition of HSRs are much more complex than those in the laboratory. The combined effect of ambient temperature, rainwater, waterproof materials on the slab surface, and other external factors probably influence the accuracy with which surface cracks are detected. Future research may focus on how to further improve the effectiveness of IRT-based detection for slab tracks under the actual condition of HSRs. Furthermore, to improve the application of the proposed method in real HSR slab tracks, a track-inspection trolley equipped with an IR camera should be developed. However the parameters of the trolley, including the distance between the camera and the slab surface, the velocity of the trolley, and the frame rate, need further study to meet the requirements of crack inspection.

Author Contributions

Conceptualization, X.-Y.Y. and Y.-Y.L.; methodology, X.-Y.Y., Y.-Y.L. and Z.-W.L.; modeling, X.-Y.Y. and X.-Z.L.; validation, Z.-W.L. and X.-Z.L.; formal analysis, X.-Y.Y. and Y.-Y.L.; investigation, Z.-W.L. and X.-Z.L.; resources, Y.-Y.L. and X.-Z.L.; data curation, X.-Y.Y. and Z.-W.L.; writing—original draft preparation, X.-Y.Y. and X.-Z.L.; writing—review and editing, Y.-Y.L. and Z.-W.L.; visualization, X.-Z.L.; supervision, Y.-Y.L. and Z.-W.L.; project administration, Y.-Y.L.; funding acquisition, Y.-Y.L. and Z.-W.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Natural Science Foundation of China (grant nos. 52178430 and 52208441), Innovation Initiative Program of Shanghai (grant no. 20dz1203104), and Natural Science Foundation of Top Talent of SZTU (grant no. GDRC202128).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

All data, models, or code that support the findings of this study are available from the corresponding author upon reasonable request.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Liu, X.; Zhang, W.; Xiao, J.; Liu, X.; Li, W. Damage Mechanism of Broad-narrow Joint of CRTSII Slab Track under Temperature Rise. KSCE J. Civ. Eng. 2019, 23, 2126–2135. [Google Scholar]
  2. Wolf, H.E.; Qian, Y.; Edwards, J.R.; Dersch, M.S.; Lange, D.A. Temperature-induced curl behavior of prestressed concrete and its effect on railroad crossties. Constr. Build. Mater. 2016, 115, 319–326. [Google Scholar] [CrossRef]
  3. Zhong, Y.; Gao, L.; Zhang, Y. Effect of daily changing temperature on the curling behavior and interface stress of slab track in construction stage. Constr. Build. Mater. 2018, 185, 638–647. [Google Scholar] [CrossRef]
  4. Gautier, P. Slab track: Review of existing systems and optimization potentials including very high speed. Constr. Build. Mater. 2015, 92, 9–15. [Google Scholar] [CrossRef]
  5. ZLi, Z.-W.; Liu, X.-Z.; Lu, H.-Y.; He, Y.-L.; Zhou, Y. Surface Crack Detection in Precasted Slab Track in High-Speed Rail via Infrared Thermography. Materials 2020, 13, 4837. [Google Scholar]
  6. Tian, X.; Zhao, W.; Du, Y.; Wang, B. Detection of mortar defects in ballastless tracks of high-speed railway using transient elastic wave method. J. Civ. Struct. Health Monit. 2018, 8, 151–160. [Google Scholar] [CrossRef]
  7. Xu, J.; Wang, P.; An, B.; Ma, X.; Chen, R. Damage detection of ballastless railway tracks by the impact-echo method. Proc. Inst. Civ. Eng. Transp. 2018, 171, 106–114. [Google Scholar] [CrossRef]
  8. Janeliukstis, R.; Clark, A.; Papaelias, M.; Kaewunruen, S. Flexural cracking-induced acoustic emission peak frequency shift in railway prestressed concrete sleepers. Eng. Struct. 2019, 178, 493–505. [Google Scholar]
  9. Zhang, X.; Feng, N.; Wang, Y.; Shen, Y. Acoustic emission detection of rail defect based on wavelet transform and Shannon entropy. J. Sound Vib. 2015, 339, 419–432. [Google Scholar] [CrossRef]
  10. Wu, C.; Sun, K.; Xu, Y.; Zhang, S.; Huang, X.; Zeng, S. Concrete crack detection method based on optical fiber sensing network and microbending principle. Saf. Sci. 2019, 117, 299–304. [Google Scholar] [CrossRef]
  11. Chapeleau, X.; Sedran, T.; Cottineau, L.-M.; Cailliau, J.; Taillade, F.; Gueguen, I.; Henault, J.-M. Study of ballastless track structure monitoring by distributed optical fiber sensors on a real-scale mockup in laboratory. Eng. Struct. 2013, 56, 1751–1757. [Google Scholar] [CrossRef]
  12. Gibert, X.; Patel, V.M.; Chellappa, R. Deep Multitask Learning for Railway Track Inspection. IEEE Trans. Intell. Transp. Syst. 2017, 18, 153–164. [Google Scholar]
  13. Ai, C.; Qiu, S.; Xu, G.; Zhang, A.; Wang, K.C. A Nonballasted Rail Track Slab Crack Identification Method Using a Level-Set-Based Active Contour Model. Comput. Aided Civ. Infrastruct. Eng. 2018, 33, 571–584. [Google Scholar] [CrossRef]
  14. Yang, Y.; Zhao, W. Curvelet transform-based identification of void diseases in ballastless track by ground-penetrating radar. Struct. Control. Health Monit. 2019, 26, e2322. [Google Scholar]
  15. Tabatabaei SA, H.; Delforouzi, A.; Khan, M.H.; Wesener, T.; Grzegorzek, M. Automatic Detection of the Cracks on the Concrete Railway Sleepers. Int. J. Pattern Recognit. Artif. Intell. 2019, 33, 1955010. [Google Scholar] [CrossRef]
  16. Zhang, X.; Rajan, D.; Story, B. Concrete crack detection using context-aware deep semantic segmentation network. Comput.-Aided Civ. Infrastruct. Eng. 2019, 34, 951–971. [Google Scholar] [CrossRef]
  17. Kim, J. Non-Destructive Characterization of Railway Materials and Components with Infrared Thermography Technique. Materials 2019, 12, 4077. [Google Scholar] [CrossRef]
  18. Pathirathna, K.A.B.; Dhanushka, R.M.; Rathnayake, M.; Hathanguruge, W.; Fernando, G.D. Use of thermal imaging technology for locomotive maintenance in Sri Lanka Railways. In Proceedings of the 2018 International Conference on Intelligent Rail Transportation (ICIRT), Singapore, 12–14 December 2018; p. 20181-4. [Google Scholar]
  19. Da Cunha, A.L.; Zhou, J.; Do, M.N. The Nonsubsampled Contourlet Transform: Theory, Design, and Applications. IEEE Trans. Image Process. 2006, 15, 3089–3101. [Google Scholar]
  20. Morrone, M.C.; Owens, R.A. Feature detection from local energy. Pattern Recognit. Lett. 1987, 6, 303–313. [Google Scholar] [CrossRef]
  21. Venkatesh, S.; Owens, R.A. An energy feature detection scheme. In Proceedings of the International Conference on Image Processing, Warwick, UK, 18–20 July 1989; pp. 553–557. [Google Scholar]
  22. Li, Z.-W.; Liu, X.-Z.; Lu, H.-Y.; He, Y.-L. Narrowing longitudinally coupled prefabricated slab track maintenance duration with field data analysis of slab deformation under high temperature. Proc. Inst. Mech. Eng. Part F J. Rail Rapid Transit 2021, 235, 1099–1109. [Google Scholar] [CrossRef]
  23. Zhang, T.Y.; Suen, C.Y. A fast parallel algorithm for thinning digital patterns. Commun. ACM 1984, 27, 236–239. [Google Scholar] [CrossRef]
  24. Qu, Z.; Guo, Y.; Ju, F.-R.; Liu, L.; Lin, L.-D. The algorithm of accelerated cracks detection and extracting skeleton by direction chain code in concrete surface image. Imaging Sci. J. 2016, 64, 119–130. [Google Scholar] [CrossRef]
  25. Liu, D.; Su, C.; Ren, J.; Wang, L.; Kendrick, B.; Liu, X. Numerical analysis of new pre-installed steel modular railroad track assembly. Constr. Build. Mater. 2017, 134, 269–278. [Google Scholar] [CrossRef]
  26. Su, C.; Liu, D.; Ding, C.; Gong, C.; Zhao, P.; Liu, X. Experimental Study on Bond Performances of Track Slab and Mortar Based on DIC Technology. KSCE J. Civ. Eng. 2018, 22, 3546–3555. [Google Scholar] [CrossRef]
  27. Yakhot, V.; Orszag, S.A. Renormalization group analysis of turbulence. I. Basic theory. J. Sci. Comput. 1986, 1, 3–51. [Google Scholar] [CrossRef]
Figure 1. Flowchart of the proposed crack-detection method.
Figure 1. Flowchart of the proposed crack-detection method.
Applsci 13 06681 g001
Figure 2. Acquisition of the infrared thermography of slab track by IR camera: (a) experimental setup; (b) infrared thermography of slab track [5].
Figure 2. Acquisition of the infrared thermography of slab track by IR camera: (a) experimental setup; (b) infrared thermography of slab track [5].
Applsci 13 06681 g002
Figure 3. Principle of NSCT transform: (a) decomposition structure; (b) sub-bands on frequency plane.
Figure 3. Principle of NSCT transform: (a) decomposition structure; (b) sub-bands on frequency plane.
Applsci 13 06681 g003
Figure 4. Relationship between local energy function, phase−congruency function, and Fourier components of signal [21].
Figure 4. Relationship between local energy function, phase−congruency function, and Fourier components of signal [21].
Applsci 13 06681 g004
Figure 5. Crack-edge-detection process of infrared image of track-slab-surface crack: (a) Infrared image of slab surface crack; (b) phase congruency image; (c) binary image after segmentation; (d) processed binary image; (e) crack area (before refining); (f) refined crack area.
Figure 5. Crack-edge-detection process of infrared image of track-slab-surface crack: (a) Infrared image of slab surface crack; (b) phase congruency image; (c) binary image after segmentation; (d) processed binary image; (e) crack area (before refining); (f) refined crack area.
Applsci 13 06681 g005
Figure 6. Crack-edge-detection process of infrared image of track-slab-surface crack. (a) Extracted crack area. (b) Crack-skeleton graph.
Figure 6. Crack-edge-detection process of infrared image of track-slab-surface crack. (a) Extracted crack area. (b) Crack-skeleton graph.
Applsci 13 06681 g006
Figure 7. 8-direction Freeman chain code [24].
Figure 7. 8-direction Freeman chain code [24].
Applsci 13 06681 g007
Figure 8. Edge detection of crack area: (a) extracted crack area; (b) edge of crack area.
Figure 8. Edge detection of crack area: (a) extracted crack area; (b) edge of crack area.
Applsci 13 06681 g008
Figure 9. Slab-track structure and design cracking joint (DCJ).
Figure 9. Slab-track structure and design cracking joint (DCJ).
Applsci 13 06681 g009
Figure 10. Diagram of structural model of slab track with surface crack.
Figure 10. Diagram of structural model of slab track with surface crack.
Applsci 13 06681 g010
Figure 11. Temperature in crack and non-crack areas on the surface of track slab: (a) in non-crack areas with different width scales; (b) in crack areas with different width scales; (c) in non-crack areas with different height scales; (d) in crack areas with different height scales.
Figure 11. Temperature in crack and non-crack areas on the surface of track slab: (a) in non-crack areas with different width scales; (b) in crack areas with different width scales; (c) in non-crack areas with different height scales; (d) in crack areas with different height scales.
Applsci 13 06681 g011
Figure 12. Scale model of slab track.
Figure 12. Scale model of slab track.
Applsci 13 06681 g012
Figure 13. Slab-track-structure model in the temperature-controlled cabinet.
Figure 13. Slab-track-structure model in the temperature-controlled cabinet.
Applsci 13 06681 g013
Figure 14. Infrared thermograms of slab surface of model track at different times.
Figure 14. Infrared thermograms of slab surface of model track at different times.
Applsci 13 06681 g014
Figure 15. Infrared thermogram of track-slab surface at 100 min and crack-extraction results: (a) infrared thermogram; (b) extracted surface crack; (c) surface crack on infrared thermogram.
Figure 15. Infrared thermogram of track-slab surface at 100 min and crack-extraction results: (a) infrared thermogram; (b) extracted surface crack; (c) surface crack on infrared thermogram.
Applsci 13 06681 g015
Figure 16. Infrared thermogram of track-slab surface at 130 min and crack-extraction results: (a) infrared thermogram; (b) extracted surface crack; (c) surface crack on infrared thermogram.
Figure 16. Infrared thermogram of track-slab surface at 130 min and crack-extraction results: (a) infrared thermogram; (b) extracted surface crack; (c) surface crack on infrared thermogram.
Applsci 13 06681 g016
Table 1. Key specifications of the IR camera (Fluke TIX620).
Table 1. Key specifications of the IR camera (Fluke TIX620).
CategoryValue
Image resolution640 × 480 (307,200 pixels)
Instantaneous field of view (IFOV)0.85 mRad
Field of view (FOV) w/standard 30 mm lens32.7° × 24.0°
Frame rate (@ max. image resolution)30 and 9 Hz
Thermal sensitivity (NETD)<0.04 °C at 30 °C target temp (40 mK)
Measurement range−40 °C to 600 °C (−40 °F to 1112 °F)
Measurement accuracy±2 K or ±2%
PhotoApplsci 13 06681 i001
Table 2. Calculation results of slab-surface temperature using scale and full-scale models.
Table 2. Calculation results of slab-surface temperature using scale and full-scale models.
TimeScale ModelFull-Scale Model
Temperature in Non-Crack Areas/°CErrorTemperature in Crack Areas/°CErrorTemperature in Non-Crack Areas/°CTemperature in Crack Areas/°C
6:0033.000.07%33.480.04%26.7126.59
8:0042.960.45%43.660.48%35.9133.39
10:0052.230.59%53.061.00%47.341.13
12:0057.700.96%59.111.04%55.2346.16
14:0058.870.94%60.451.38%56.5346.7
16:0052.961.73%53.772.03%51.3242.55
18:0043.021.82%43.392.26%41.1435.46
20:0038.252.12%38.592.24%36.433.01
22:0035.342.07%35.562.19%34.2432.01
24:0033.542.04%33.662.19%32.8831.28
1:0033.231.95%33.491.75%32.3230.97
2:0032.961.85%33.321.39%31.8330.69
3:0032.711.75%33.181.02%31.3930.43
Table 3. Composition materials and mixture ratio of track slab, concrete base, and CA mortar layer (Unit: kg × m−3).
Table 3. Composition materials and mixture ratio of track slab, concrete base, and CA mortar layer (Unit: kg × m−3).
Ingredients Track SlabConcrete BaseCA Mortar
Concrete Grade: C55Concrete Grade: C15
Cement432140506
Fly ash4860-
Emulsified asphalt--265
Sand717830984
Gravel11211244-
Aluminium powder--0.06
Water125125158
Water reducer7.215.5
Expander--86
Defoamer--0.5
Table 4. The temperature in the crack and non-crack areas and DCJs on the slab surface.
Table 4. The temperature in the crack and non-crack areas and DCJs on the slab surface.
Time (min)Internal Temp. (°C)Temp. in Crack Areas (°C)Temp. in Non-Crack Areas (°C)Temp. Difference between Crack and Non-Crack Areas (°C)Temp. at DCJs (°C)
02019.619.6019.6
504024.323.730.5724.42
755027.927.240.6628.26
1006033.9632.541.4234.13
1155032.6931.790.932.91
1304031.6930.950.7431.73
1453028.4527.920.5328.84
1602026.9726.80.1727.03
1751023.6823.580.123.76
Table 5. Quantitative detection results of surface cracks at different times.
Table 5. Quantitative detection results of surface cracks at different times.
Time/minWidth Detected/mmActual Width/mmAcc.Length Detected/mmActual Length/mmAcc.Area Detected/mm2Actual Area/mm2Acc.
501.1931.299.4%68985780.4%821.91028.480.1%
751.18498.7%74987.4%886.886.2%
1001.19799.8%72284.2%864.284.0%
1151.19899.8%72184.1%863.884.0%
1301.19999.9%71983.9%862.183.8%
1451.19699.7%73185.3%874.385.0%
1601.18999.1%72084.0%856.183.2%
1751.19199.3%73886.1%878.985.5%
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Ye, X.-Y.; Luo, Y.-Y.; Li, Z.-W.; Liu, X.-Z. A Quantitative Detection Method for Surface Cracks on Slab Track Based on Infrared Thermography. Appl. Sci. 2023, 13, 6681. https://doi.org/10.3390/app13116681

AMA Style

Ye X-Y, Luo Y-Y, Li Z-W, Liu X-Z. A Quantitative Detection Method for Surface Cracks on Slab Track Based on Infrared Thermography. Applied Sciences. 2023; 13(11):6681. https://doi.org/10.3390/app13116681

Chicago/Turabian Style

Ye, Xuan-Yu, Yan-Yun Luo, Zai-Wei Li, and Xiao-Zhou Liu. 2023. "A Quantitative Detection Method for Surface Cracks on Slab Track Based on Infrared Thermography" Applied Sciences 13, no. 11: 6681. https://doi.org/10.3390/app13116681

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop