Comparative Analysis of Spectrogram-Based Transformations for Acoustic Classification of SMAW Weld Quality Using Machine Learning
Abstract
1. Introduction
2. Materials and Methods
2.1. Welding Materials
2.2. Weld Bead Classification
2.3. Acoustic Data Acquisition
2.4. Signal Processing and Image Generation
2.5. Statistical Analysis
2.6. Machine Learning Models
2.7. Spectral Feature Extraction
2.7.1. Spectral Energy
2.7.2. Band Energy
2.7.3. Spectral Centroid
2.7.4. Spectral Flatness
3. Evaluation of Classification Models Under Spectral Transformations
3.1. Comparative Statistical Analysis Between Transformations and Classes
3.2. Distribution of Spectral Variables Across Transformations and Classes
3.3. Performance of Classification Models According to Spectral Transformation
3.4. Comparative Results of Top Models by Transformation
4. Discussion
4.1. Physical Interpretation of Acoustic-Based Classification Results
4.2. Comparison with Related Acoustic-Based Welding Quality Studies
5. Future Works
6. Conclusions
Author Contributions
Funding
Data Availability Statement
Acknowledgments
Conflicts of Interest
Appendix A. Description of the Optimal Hyperparameters of the Models According to the Applied Transformations
| Transformation | Model | Score | n_est mean | Depth | Split | Leaf | Features | Weight |
|---|---|---|---|---|---|---|---|---|
| Parametros_CQT | ExtraTrees | 0.8539 | 671.9 | 31.40 | 5.40 | 1.73 | sqrt | balanced |
| Parametros_CQT | GNB | 0.7595 | ||||||
| Parametros_CQT | GradBoost | 0.8944 | 555.1 | 2.73 | ||||
| Parametros_CQT | LDA | 0.9440 | ||||||
| Parametros_CQT | LogReg | 0.9580 | balanced | |||||
| Parametros_CQT | MLP | 0.9537 | ||||||
| Parametros_CQT | RF | 0.8260 | 809.7 | 21.73 | 9.33 | 3.07 | log2 | balanced |
| Parametros_CQT | SVC | 0.9731 | balanced | |||||
| Parametros_cromatic | ExtraTrees | 0.8891 | 760.4 | 27.27 | 9.27 | 3.40 | sqrt | balanced |
| Parametros_cromatic | GNB | 0.8092 | ||||||
| Parametros_cromatic | GradBoost | 0.8773 | 471.3 | 4.27 | ||||
| Parametros_cromatic | LDA | 0.7776 | ||||||
| Parametros_cromatic | LogReg | 0.8568 | balanced | |||||
| Parametros_cromatic | MLP | 0.8880 | ||||||
| Parametros_cromatic | RF | 0.8881 | 650.5 | 23.47 | 13.73 | 3.93 | log2 | balanced |
| Parametros_cromatic | SVC | 0.8730 | balanced | |||||
| Parametros_MEL | ExtraTrees | 0.8618 | 698.0 | 34.80 | 5.53 | 2.93 | log2 | balanced |
| Parametros_MEL | GNB | 0.7434 | ||||||
| Parametros_MEL | GradBoost | 0.8718 | 533.1 | 4.07 | ||||
| Parametros_MEL | LDA | 0.9461 | ||||||
| Parametros_MEL | LogReg | 0.9279 | balanced | |||||
| Parametros_MEL | MLP | 0.9042 | ||||||
| Parametros_MEL | RF | 0.8562 | 636.5 | 25.20 | 7.67 | 3.13 | sqrt | balanced |
| Parametros_MEL | SVC | 0.9386 | balanced | |||||
| Parametros_MFFCS | ExtraTrees | 0.8353 | 767.2 | 36.40 | 6.87 | 3.27 | sqrt | balanced |
| Parametros_MFFCS | GNB | 0.5512 | ||||||
| Parametros_MFFCS | GradBoost | 0.8512 | 488.8 | 4.33 | ||||
| Parametros_MFFCS | LDA | 0.8976 | ||||||
| Parametros_MFFCS | LogReg | 0.9430 | balanced | |||||
| Parametros_MFFCS | MLP | 0.8750 | ||||||
| Parametros_MFFCS | RF | 0.8225 | 734.3 | 25.73 | 6.27 | 4.13 | log2 | balanced |
| Parametros_MFFCS | SVC | 0.9429 | balanced | |||||
| Parametros_Spectral_centroid | ExtraTrees | 0.7587 | 664.3 | 33.00 | 11.67 | 4.73 | log2 | balanced |
| Parametros_Spectral_centroid | GNB | 0.6492 | ||||||
| Parametros_Spectral_centroid | GradBoost | 0.7735 | 420.2 | 3.47 | ||||
| Parametros_Spectral_centroid | LDA | 0.7541 | ||||||
| Parametros_Spectral_centroid | LogReg | 0.7701 | balanced | |||||
| Parametros_Spectral_centroid | MLP | 0.8009 | ||||||
| Parametros_Spectral_centroid | RF | 0.7608 | 696.4 | 17.53 | 11.60 | 4.67 | log2 | balanced |
| Parametros_Spectral_centroid | SVC | 0.8011 | balanced | |||||
| Parametros_Spectral_Contrast | ExtraTrees | 0.9430 | 698.7 | 27.73 | 7.93 | 2.73 | log2 | balanced |
| Parametros_Spectral_Contrast | GNB | 0.8697 | ||||||
| Parametros_Spectral_Contrast | GradBoost | 0.9365 | 410.3 | 3.47 | ||||
| Parametros_Spectral_Contrast | LDA | 0.8912 | ||||||
| Parametros_Spectral_Contrast | LogReg | 0.9236 | balanced | |||||
| Parametros_Spectral_Contrast | MLP | 0.9344 | ||||||
| Parametros_Spectral_Contrast | RF | 0.9311 | 615.8 | 21.93 | 12.67 | 4.27 | sqrt | balanced |
| Parametros_Spectral_Contrast | SVC | 0.9419 | balanced | |||||
| Parametros_spectral_rollof | ExtraTrees | 0.7056 | 654.3 | 29.20 | 10.93 | 5.00 | sqrt | balanced |
| Parametros_spectral_rollof | GNB | 0.5977 | ||||||
| Parametros_spectral_rollof | GradBoost | 0.7105 | 439.9 | 4.27 | ||||
| Parametros_spectral_rollof | LDA | 0.6250 | ||||||
| Parametros_spectral_rollof | LogReg | 0.6584 | balanced | |||||
| Parametros_spectral_rollof | MLP | 0.7293 | ||||||
| Parametros_spectral_rollof | RF | 0.7151 | 711.0 | 18.20 | 12.20 | 5.33 | log2 | balanced |
| Parametros_spectral_rollof | SVC | 0.7279 | balanced | |||||
| Parametros_tonnetz | ExtraTrees | 0.7842 | 639.9 | 22.93 | 11.80 | 4.93 | sqrt | balanced |
| Parametros_tonnetz | GNB | 0.7301 | ||||||
| Parametros_tonnetz | GradBoost | 0.8104 | 508.8 | 3.60 | ||||
| Parametros_tonnetz | LDA | 0.7325 | ||||||
| Parametros_tonnetz | LogReg | 0.7890 | balanced | |||||
| Parametros_tonnetz | MLP | 0.8328 | ||||||
| Parametros_tonnetz | RF | 0.7680 | 853.3 | 17.93 | 11.07 | 4.93 | log2 | balanced |
| Parametros_tonnetz | SVC | 0.8338 | balanced |
Appendix B. Statistical Assumptions and Preliminary Test
| Variable | Group | Normality_p | Levene_p | ANOVA_p | Kruskal_p |
|---|---|---|---|---|---|
| total_energy | CQT_C0 | 0.07685572113681385 | 2.10 × 10−218 | 0.0 | 0.0 |
| total_energy | CQT_C1 | 3.81 × 107 | 2.10 × 10−218 | 0.0 | 0.0 |
| total_energy | Chromatic_C0 | 0.779979450858338 | 2.10 × 10−218 | 0.0 | 0.0 |
| total_energy | Chromatic_C1 | 0.6835282016466416 | 2.10 × 10−218 | 0.0 | 0.0 |
| total_energy | MEL_C0 | 1.01 × 109 | 2.10 × 10−218 | 0.0 | 0.0 |
| total_energy | MEL_C1 | 3.98 × 108 | 2.10 × 10−218 | 0.0 | 0.0 |
| total_energy | MFCCS_C0 | 3.66 × 108 | 2.10 × 10−218 | 0.0 | 0.0 |
| total_energy | MFCCS_C1 | 8.09 × 1010 | 2.10 × 10−218 | 0.0 | 0.0 |
| total_energy | SpectralCentroid_C0 | 0.2963680861956277 | 2.10 × 10−218 | 0.0 | 0.0 |
| total_energy | SpectralCentroid_C1 | 0.4504844899307815 | 2.10 × 10−218 | 0.0 | 0.0 |
| total_energy | Spectralcontrast_C0 | 0.007034148388686743 | 2.10 × 10−218 | 0.0 | 0.0 |
| total_energy | Spectralcontrast_C1 | 0.020095254931303836 | 2.10 × 10−218 | 0.0 | 0.0 |
| total_energy | spectralrollof_C0 | 0.005219045417306875 | 2.10 × 10−218 | 0.0 | 0.0 |
| total_energy | spectralrollof_C1 | 0.284173835471101 | 2.10 × 10−218 | 0.0 | 0.0 |
| total_energy | tonnetz_C0 | 8.17 × 108 | 2.10 × 10−218 | 0.0 | 0.0 |
| total_energy | tonnetz_C1 | 1.24 × 108 | 2.10 × 10−218 | 0.0 | 0.0 |
| low_band_energy | CQT_C0 | 8.50 × 109 | 1.60 × 10−145 | 0.0 | 0.0 |
| low_band_energy | CQT_C1 | 1.60 × 1010 | 1.60 × 10−145 | 0.0 | 0.0 |
| low_band_energy | Chromatic_C0 | 0.0015329708327085287 | 1.60 × 10−145 | 0.0 | 0.0 |
| low_band_energy | Chromatic_C1 | 1.98 × 1011 | 1.60 × 10−145 | 0.0 | 0.0 |
| low_band_energy | MEL_C0 | 2.85 × 109 | 1.60 × 10−145 | 0.0 | 0.0 |
| low_band_energy | MEL_C1 | 9.07 × 109 | 1.60 × 10−145 | 0.0 | 0.0 |
| low_band_energy | MFCCS_C0 | 3.11 × 108 | 1.60 × 10−145 | 0.0 | 0.0 |
| low_band_energy | MFCCS_C1 | 3.57 × 1010 | 1.60 × 10−145 | 0.0 | 0.0 |
| low_band_energy | SpectralCentroid_C0 | 0.29636808619566096 | 1.60 × 10−145 | 0.0 | 0.0 |
| low_band_energy | SpectralCentroid_C1 | 0.450484489930733 | 1.60 × 10−145 | 0.0 | 0.0 |
| low_band_energy | Spectralcontrast_C0 | 0.7307994578361743 | 1.60 × 10−145 | 0.0 | 0.0 |
| low_band_energy | Spectralcontrast_C1 | 0.9039817417815537 | 1.60 × 10−145 | 0.0 | 0.0 |
| low_band_energy | spectralrollof_C0 | 0.005219045417307363 | 1.60 × 10−145 | 0.0 | 0.0 |
| low_band_energy | spectralrollof_C1 | 0.284173835471101 | 1.60 × 10−145 | 0.0 | 0.0 |
| low_band_energy | tonnetz_C0 | 1.00 × 1011 | 1.60 × 10−145 | 0.0 | 0.0 |
| low_band_energy | tonnetz_C1 | 1.02 × 106 | 1.60 × 10−145 | 0.0 | 0.0 |
| low_mid_band_energy | CQT_C0 | 0.03145177200852019 | 4.12 × 10−146 | 0.0 | 0.0 |
| low_mid_band_energy | CQT_C1 | 7.99 × 106 | 4.12 × 10−146 | 0.0 | 0.0 |
| low_mid_band_energy | Chromatic_C0 | 0.0980333658487659 | 4.12 × 10−146 | 0.0 | 0.0 |
| low_mid_band_energy | Chromatic_C1 | 0.8434079587583541 | 4.12 × 10−146 | 0.0 | 0.0 |
| low_mid_band_energy | MEL_C0 | 1.59 × 1010 | 4.12 × 10−146 | 0.0 | 0.0 |
| low_mid_band_energy | MEL_C1 | 3.01 × 1010 | 4.12 × 10−146 | 0.0 | 0.0 |
| low_mid_band_energy | MFCCS_C0 | 3.01 × 107 | 4.12 × 10−146 | 0.0 | 0.0 |
| low_mid_band_energy | MFCCS_C1 | 3.62 × 1010 | 4.12 × 10−146 | 0.0 | 0.0 |
| low_mid_band_energy | SpectralCentroid_C0 | 0.29636808619562693 | 4.12 × 10−146 | 0.0 | 0.0 |
| low_mid_band_energy | SpectralCentroid_C1 | 0.450484489930733 | 4.12 × 10−146 | 0.0 | 0.0 |
| low_mid_band_energy | Spectralcontrast_C0 | 0.022923606898774703 | 4.12 × 10−146 | 0.0 | 0.0 |
| low_mid_band_energy | Spectralcontrast_C1 | 2.14 × 1011 | 4.12 × 10−146 | 0.0 | 0.0 |
| low_mid_band_energy | spectralrollof_C0 | 0.005219045417307843 | 4.12 × 10−146 | 0.0 | 0.0 |
| low_mid_band_energy | spectralrollof_C1 | 0.28417383547110175 | 4.12 × 10−146 | 0.0 | 0.0 |
| low_mid_band_energy | tonnetz_C0 | 4.40 × 109 | 4.12 × 10−146 | 0.0 | 0.0 |
| low_mid_band_energy | tonnetz_C1 | 3.09 × 109 | 4.12 × 10−146 | 0.0 | 0.0 |
| high_mid_band_energy | CQT_C0 | 0.03330512595903802 | 2.18 × 10−168 | 0.0 | 0.0 |
| high_mid_band_energy | CQT_C1 | 7.26 × 108 | 2.18 × 10−168 | 0.0 | 0.0 |
| high_mid_band_energy | Chromatic_C0 | 0.2941757833661728 | 2.18 × 10−168 | 0.0 | 0.0 |
| high_mid_band_energy | Chromatic_C1 | 0.27375377216669494 | 2.18 × 10−168 | 0.0 | 0.0 |
| high_mid_band_energy | MEL_C0 | 6.30 × 108 | 2.18 × 10−168 | 0.0 | 0.0 |
| high_mid_band_energy | MEL_C1 | 1.27 × 1010 | 2.18 × 10−168 | 0.0 | 0.0 |
| high_mid_band_energy | MFCCS_C0 | 2.64 × 108 | 2.18 × 10−168 | 0.0 | 0.0 |
| high_mid_band_energy | MFCCS_C1 | 6.17 × 1010 | 2.18 × 10−168 | 0.0 | 0.0 |
| high_mid_band_energy | SpectralCentroid_C0 | 0.23265754475765532 | 2.18 × 10−168 | 0.0 | 0.0 |
| high_mid_band_energy | SpectralCentroid_C1 | 0.27455263346455683 | 2.18 × 10−168 | 0.0 | 0.0 |
| high_mid_band_energy | Spectralcontrast_C0 | 0.006887546913658629 | 2.18 × 10−168 | 0.0 | 0.0 |
| high_mid_band_energy | Spectralcontrast_C1 | 0.0037015935519490928 | 2.18 × 10−168 | 0.0 | 0.0 |
| high_mid_band_energy | spectralrollof_C0 | 0.0041449789153463175 | 2.18 × 10−168 | 0.0 | 0.0 |
| high_mid_band_energy | spectralrollof_C1 | 0.43490362473328803 | 2.18 × 10−168 | 0.0 | 0.0 |
| high_mid_band_energy | tonnetz_C0 | 0.003386689916983998 | 2.18 × 10−168 | 0.0 | 0.0 |
| high_mid_band_energy | tonnetz_C1 | 0.0006779639189179362 | 2.18 × 10−168 | 0.0 | 0.0 |
| high_band_energy | CQT_C0 | 0.05028708819633208 | 4.25 × 10−197 | 0.0 | 0.0 |
| high_band_energy | CQT_C1 | 0.0001868864998049809 | 4.25 × 10−197 | 0.0 | 0.0 |
| high_band_energy | Chromatic_C0 | 0.0013525092373520963 | 4.25 × 10−197 | 0.0 | 0.0 |
| high_band_energy | Chromatic_C1 | 0.16189918629722083 | 4.25 × 10−197 | 0.0 | 0.0 |
| high_band_energy | MEL_C0 | 9.88 × 1010 | 4.25 × 10−197 | 0.0 | 0.0 |
| high_band_energy | MEL_C1 | 2.93 × 106 | 4.25 × 10−197 | 0.0 | 0.0 |
| high_band_energy | MFCCS_C0 | 2.68 × 109 | 4.25 × 10−197 | 0.0 | 0.0 |
| high_band_energy | MFCCS_C1 | 6.77 × 1010 | 4.25 × 10−197 | 0.0 | 0.0 |
| high_band_energy | SpectralCentroid_C0 | 0.4720458741626041 | 4.25 × 10−197 | 0.0 | 0.0 |
| high_band_energy | SpectralCentroid_C1 | 0.6308176122609515 | 4.25 × 10−197 | 0.0 | 0.0 |
| high_band_energy | Spectralcontrast_C0 | 1.43 × 1010 | 4.25 × 10−197 | 0.0 | 0.0 |
| high_band_energy | Spectralcontrast_C1 | 3.59 × 103 | 4.25 × 10−197 | 0.0 | 0.0 |
| high_band_energy | spectralrollof_C0 | 0.008206481445429797 | 4.25 × 10−197 | 0.0 | 0.0 |
| high_band_energy | spectralrollof_C1 | 0.14627545168661266 | 4.25 × 10−197 | 0.0 | 0.0 |
| high_band_energy | tonnetz_C0 | 0.9024525393794963 | 4.25 × 10−197 | 0.0 | 0.0 |
| high_band_energy | tonnetz_C1 | 5.04 × 107 | 4.25 × 10−197 | 0.0 | 0.0 |
| spectral_centroid_norm | CQT_C0 | 8.50 × 108 | 0.0 | 0.0 | 0.0 |
| spectral_centroid_norm | CQT_C1 | 0.025328926793166433 | 0.0 | 0.0 | 0.0 |
| spectral_centroid_norm | Chromatic_C0 | 0.003914239027021755 | 0.0 | 0.0 | 0.0 |
| spectral_centroid_norm | Chromatic_C1 | 0.053377487571919804 | 0.0 | 0.0 | 0.0 |
| spectral_centroid_norm | MEL_C0 | 6.29 × 107 | 0.0 | 0.0 | 0.0 |
| spectral_centroid_norm | MEL_C1 | 7.39 × 1010 | 0.0 | 0.0 | 0.0 |
| spectral_centroid_norm | MFCCS_C0 | 0.0025683285446002234 | 0.0 | 0.0 | 0.0 |
| spectral_centroid_norm | MFCCS_C1 | 1.71E+00 | 0.0 | 0.0 | 0.0 |
| spectral_centroid_norm | SpectralCentroid_C0 | 0.002193745607281003 | 0.0 | 0.0 | 0.0 |
| spectral_centroid_norm | SpectralCentroid_C1 | 1.16 × 108 | 0.0 | 0.0 | 0.0 |
| spectral_centroid_norm | Spectralcontrast_C0 | 0.08047385263158946 | 0.0 | 0.0 | 0.0 |
| spectral_centroid_norm | Spectralcontrast_C1 | 8.84 × 109 | 0.0 | 0.0 | 0.0 |
| spectral_centroid_norm | spectralrollof_C0 | 0.00030330369023544654 | 0.0 | 0.0 | 0.0 |
| spectral_centroid_norm | spectralrollof_C1 | 0.6799725371535247 | 0.0 | 0.0 | 0.0 |
| spectral_centroid_norm | tonnetz_C0 | 0.0010219367029789211 | 0.0 | 0.0 | 0.0 |
| spectral_centroid_norm | tonnetz_C1 | 9.57 × 109 | 0.0 | 0.0 | 0.0 |
| spectral_flatness | CQT_C0 | 1.53 × 107 | 1.19 × 10−96 | 0.0 | 0.0 |
| spectral_flatness | CQT_C1 | 6.48 × 103 | 1.19 × 10−96 | 0.0 | 0.0 |
| spectral_flatness | Chromatic_C0 | 0.24457907515523036 | 1.19 × 10−96 | 0.0 | 0.0 |
| spectral_flatness | Chromatic_C1 | 0.00020586022508651308 | 1.19 × 10−96 | 0.0 | 0.0 |
| spectral_flatness | MEL_C0 | 9.34 × 101 | 1.19 × 10−96 | 0.0 | 0.0 |
| spectral_flatness | MEL_C1 | 6.75 × 106 | 1.19 × 10−96 | 0.0 | 0.0 |
| spectral_flatness | MFCCS_C0 | 6.56 × 103 | 1.19 × 10−96 | 0.0 | 0.0 |
| spectral_flatness | MFCCS_C1 | 5.45 × 106 | 1.19 × 10−96 | 0.0 | 0.0 |
| spectral_flatness | SpectralCentroid_C0 | 2.64 × 109 | 1.19 × 10−96 | 0.0 | 0.0 |
| spectral_flatness | SpectralCentroid_C1 | 6.76 × 1010 | 1.19 × 10−96 | 0.0 | 0.0 |
| spectral_flatness | Spectralcontrast_C0 | 7.04 × 108 | 1.19 × 10−96 | 0.0 | 0.0 |
| spectral_flatness | Spectralcontrast_C1 | 0.9252678897617627 | 1.19 × 10−96 | 0.0 | 0.0 |
| spectral_flatness | spectralrollof_C0 | 3.61 × 109 | 1.19 × 10−96 | 0.0 | 0.0 |
| spectral_flatness | spectralrollof_C1 | 7.73 × 107 | 1.19 × 10−96 | 0.0 | 0.0 |
| spectral_flatness | tonnetz_C0 | 1.04 × 108 | 1.19 × 10−96 | 0.0 | 0.0 |
| spectral_flatness | tonnetz_C1 | 5.43 × 103 | 1.19 × 10−96 | 0.0 | 0.0 |
Appendix C. Post Hoc Analysis
| Post-Hoc | CQT_C0 | CQT_C1 | Chro_C0 | Chro_C1 | MEL_C0 | MEL_C1 | MFC_C0 | MFC_C1 | SpCen_C0 | SpeCen_C1 |
|---|---|---|---|---|---|---|---|---|---|---|
| CQT_C0 | 1.0 | 1.0 | 9.78 × 104 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |
| CQT_C1 | 1.0 | 1.0 | 0.0 | 3.31 × 108 | 7.13 × 102 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |
| Chro_C0 | 97,841.6 | 0.0 | 1.0 | 1.0 | 0.1 | 5.03 × 109 | 0.0 | 0.0 | 1.18 × 106 | 0.0 |
| Chro_C1 | 0.0 | 3.31 × 108 | 1.0 | 1.0 | 1.0 | 0.2 | 0.0 | 0.0 | 3.36 × 1010 | 0.4 |
| MEL_C0 | 0.0 | 7.13 × 102 | 0.1 | 1.0 | 1.0 | 1.0 | 0.0 | 0.0 | 0.0 | 1.0 |
| MEL_C1 | 0.0 | 0.0 | 5.04 × 1010 | 0.2 | 1.0 | 1.0 | 0.0 | 21.5 | 1.0 | 1.0 |
| MFC_C0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 1.0 | 1.0 | 1.09 × 105 | 0.0 |
| MFC_C1 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 21.5 | 1.0 | 1.0 | 3.70 × 106 | 0.4 |
| SpCen_C0 | 0.0 | 0.0 | 1.18 × 106 | 3.36 × 1010 | 0.0 | 1.0 | 1.09 × 105 | 3.70 × 107 | 1.0 | 1.0 |
| SpCen_C1 | 0.0 | 0.0 | 0.0 | 0.4 | 1.0 | 1.0 | 0.0 | 0.4 | 1.0 | 1.0 |
| SpCon_C0 | 0.1 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |
| SpCon_C1 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |
| Sprol_C0 | 7.81 × 104 | 0.0 | 1.0 | 1.0 | 0.1 | 5.90 × 1010 | 0.0 | 0.0 | 1.47 × 105 | 0.0 |
| Sprol_C1 | 0.0 | 1.0 | 0.7 | 0.0 | 1.52 × 109 | 1.41 × 104 | 0.0 | 0.0 | 0.0 | 6559.8 |
| ton_C0 | 0.0 | 1.55 × 105 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |
| ton_C1 | 0.0 | 5.12 × 105 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |
References
- Jan, Z.; Ahamed, F.; Mayer, W.; Patel, N.; Grossmann, G.; Stumptner, M.; Kuusk, A. Artificial intelligence for Industry 4.0: Systematic review of applications, challenges, and opportunities. Expert Syst. Appl. 2023, 216, 119456. [Google Scholar] [CrossRef]
- Ördek, B.; Borgianni, Y.; Coatanea, E. Machine learning-supported manufacturing: A review and directions for future research. Prod. Manuf. Res. 2024, 12, 2326526. [Google Scholar] [CrossRef]
- Rahman, M.A.; Shahrior, M.F.; Iqbal, K.; Abushaiba, A.A. Enabling Intelligent Industrial Automation: A Review of Machine Learning Applications with Digital Twin and Edge AI Integration. Automation 2025, 6, 37. [Google Scholar] [CrossRef]
- Kausik, A.K.; Rashid, A.B.; Baki, R.F.; Maktum, M.M.J. Machine learning algorithms for manufacturing quality assurance: A systematic review of performance metrics and applications. Array 2025, 26, 100393. [Google Scholar] [CrossRef]
- Benhanifia, A. Systematic review of predictive maintenance practices in manufacturing sector. Intell. Syst. Appl. 2025, 26, 200501. [Google Scholar] [CrossRef]
- Ani, O. Advanced Manufacturing with Machine Learning: Improving Predictive Maintenance, Quality Control, and Process Optimization. Rafidain J. Eng. Sci. 2024, 2, 280–300. [Google Scholar] [CrossRef]
- Delzendehrooy, F.; Akhavan-Safar, A.; Barbosa, A.; Beygi, R.; Cardoso, D.; Carbas, R.; Marques, E.; da Silva, L. A Comprehensive Review on Structural Joining Techniques in the Marine Industry; Elsevier: Amsterdam, The Netherlands, 2022. [Google Scholar] [CrossRef]
- Nelson, J.P.; Biddle, J.B.; Shapira, P. Applications and Societal Implications of Artificial Intelligence in Manufacturing: A Systematic Review. arXiv 2023, arXiv:2308.02025. [Google Scholar] [CrossRef]
- Zhou, J.; Mohammad, A.; Zeng, T.; Axinte, D.; Wright, I.; March, R. Teaching robots to weld by leveraging human expertise. Robot. Comput. Manuf. 2025, 95, 103027. [Google Scholar] [CrossRef]
- Kim, I.S.; Son, J.S.; Yang, Y.S.; Yaragada, P.K.D.V. Sensitivity analysis for process parameters in GMA welding processes using a factorial design method. Int. J. Mach. Tools Manuf. 2003, 43, 763–769. [Google Scholar] [CrossRef]
- Jin, C.; Rhee, S. Real-Time Weld Gap Monitoring and Quality Control Algorithm during Weaving Flux-Cored Arc Welding Using Deep Learning. Metals 2021, 11, 1135. [Google Scholar] [CrossRef]
- Liu, Y.K.; Zhang, W.J.; Zhang, Y.M. A tutorial on learning human welder’s behavior: Sensing, modeling, and control. J. Manuf. Process. 2014, 16, 123–136. [Google Scholar] [CrossRef]
- Fahle, S.; Prinz, C.; Kuhlenkötter, B. Systematic review on machine learning (ML) methods for manufacturing processes—Identifying artificial intelligence (AI) methods for field application. In Procedia CIRP; Elsevier: Amsterdam, The Netherlands, 2020; pp. 413–418. [Google Scholar] [CrossRef]
- Nor, M. Deep Learning-Empowered Digital Twin Using Acoustic Signal for Welding Quality Inspection. Sensors 2023, 23, 2643. [Google Scholar] [CrossRef] [PubMed]
- Sumesh, A.; Ramesh Kumar, K.; Mohandas, K.; Babu, R.S. Use of Machine Learning Algorithms for Weld Quality Monitoring using Acoustic Signature. Procedia Comput. Sci. 2015, 50, 316–322. [Google Scholar] [CrossRef]
- Koal, M.; Povel, C.; Furrer, J.; Wohlhaupter, M. Acoustic process monitoring during projection welding using airborne sound analysis and machine learning. Weld. World 2025, 69, 459–470. [Google Scholar] [CrossRef]
- Schmidt, L.; Römer, F.; Böttger, D.; Leinenbach, F.; Straß, B.; Wolter, B.; Schricker, K.; Seibold, M.; Bergmann, J.P.; Del Galdo, G. Acoustic process monitoring in laser beam welding. Procedia CIRP 2020, 94, 763–768. [Google Scholar] [CrossRef]
- Luo, Z.; Wu, D.; Zhang, P.; Ye, X.; Shi, H.; Cai, X.; Tian, Y. Laser welding penetration monitoring based on time-frequency characterization of acoustic emission and CNN-LSTM hybrid network. Materials 2023, 16, 1614. [Google Scholar] [CrossRef] [PubMed]
- National Instruments. Parseval’s Theorem. Available online: https://www.ni.com/docs/en-US/bundle/labwindows-cvi/page/advancedanalysisconcepts/lvac_parseval_s_theorem.html (accessed on 16 January 2026).
- Spectral Centroid—Engineering Definition. ScienceDirect Topics. Available online: https://www.sciencedirect.com/topics/engineering/spectral-centroid (accessed on 22 January 2026).
- Dwivedi, D.; Haragopal, V.V. Contrast between simple and complex classification algorithms. In Statistical Modeling in Machine Learning; Concepts and Applications; Dwivedi, D., Haragopal, V.V., Eds.; Elsevier: Amsterdam, The Netherlands, 2023; pp. 93–110. [Google Scholar] [CrossRef]
- Dubnov, S. Generalization of Spectral Flatness Measure for Non-Gaussian Linear Processes. IEEE Signal Process. Lett. 2004, 11, 698–701. Available online: https://ieeexplore.ieee.org/document/1316889 (accessed on 28 January 2026). [CrossRef]
- Gupta, S.; Srivastava, V.; Kumar, D. Environment Sound Classification Using Stacked Features and Convolutional Neural Network. In Proceedings of the 2024 Sixteenth International Conference on Contemporary Computing (IC3 2024), Noida, India, 8–10 August 2024. [Google Scholar] [CrossRef]
- Jang, S.; Lee, W.; Jeong, Y.; Wang, Y.; Won, C.; Lee, J.; Yoon, J. Machine Learning-Based Weld Porosity Detection Using Frequency Analysis of Arc Sound in the Pulsed Gas Tungsten Arc Welding Process. J. Adv. Join. Process. 2024, 10, 100231. [Google Scholar] [CrossRef]
- Zhang, H.; Wu, Q.; Tang, W.; Yang, J. Acoustic Signal-Based Defect Identification for Directed Energy Deposition-Arc Using Wavelet Time–Frequency Diagrams. Sensors 2024, 24, 4397. [Google Scholar] [CrossRef] [PubMed]









| Transformation | n_fft | Hop Length | Window | Specific Parameters | Notes |
|---|---|---|---|---|---|
| Mel Spectrogram | 2048 | 512 | Hann | n_mels = 128 | Based on STFT decomposition |
| MFCC | 2048 | 512 | Hann | n_mfcc = 20, Mel bands = 128 | Derived from Mel spectrogram |
| Constant-Q Transform (CQT) | — | 512 | Hann | n_bins = 84, bins_per_octave = 12 | Logarithmic frequency resolution |
| Chromagram | 2048 | 512 | Hann | n_chroma = 12 | Derived from STFT energy distribution |
| Tonnetz | — | — | — | 6 tonal centroid dimensions | Computed from chroma features |
| Spectral Contrast | 2048 | 512 | Hann | n_bands = 6, quantile = 0.02 | Spectral peak-valley analysis |
| Spectral Centroid | 2048 | 512 | Hann | — | Energy-weighted frequency center |
| Spectral Rolloff | 2048 | 512 | Hann | roll_percent = 0.85 | Frequency containing 85% energy |
| Parameter | Class | Count | Max | Mean | Min | Std | 25% | 50% | 75% |
|---|---|---|---|---|---|---|---|---|---|
| Total Energy | 1 | 1600 | 2.47 | −0.01 | −1.74 | 0.99 | −0.75 | 0.03 | 0.54 |
| 0 | 1688 | 2.20 | 0.01 | −1.71 | 1.01 | −0.72 | 0.03 | 0.52 | |
| Low-Band Energy | 1 | 1600 | 2.90 | −0.01 | −2.38 | 1.00 | −0.61 | −0.00 | 0.47 |
| 0 | 1688 | 2.43 | 0.01 | −2.39 | 0.99 | −0.57 | 0.02 | 0.35 | |
| Low–Mid-Band Energy | 1 | 1600 | 2.35 | −0.02 | −1.91 | 1.00 | −0.62 | −0.02 | 0.58 |
| 0 | 1688 | 2.03 | 0.02 | −1.89 | 0.99 | −0.49 | −0.01 | 0.63 | |
| High–Mid-Band Energy | 1 | 1600 | 2.25 | −0.00 | −2.01 | 0.98 | −0.42 | 0.01 | 0.55 |
| 0 | 1688 | 2.00 | 0.00 | −1.99 | 1.01 | −0.49 | 0.10 | 0.52 | |
| High-Band Energy | 1 | 1600 | 1.71 | 0.01 | −2.11 | 0.98 | −0.40 | 0.14 | 0.66 |
| 0 | 1688 | 1.69 | −0.01 | −2.11 | 1.01 | −0.53 | 0.09 | 0.67 | |
| Spectral Centroid | 1 | 1600 | 1.61 | 0.01 | −2.76 | 1.01 | 0.18 | 0.33 | 0.48 |
| 0 | 1688 | 1.50 | −0.01 | −2.75 | 0.98 | 0.18 | 0.29 | 0.474 | |
| Spectral Flatness | 1 | 1600 | 0.95 | 0.01 | −2.80 | 1.02 | 0.16 | 0.31 | 0.48 |
| 0 | 1688 | 0.92 | −0.01 | −2.77 | 0.97 | 0.10 | 0.27 | 0.43 |
| Item | Transform | Accuracy | F1 Macro | Precision Macro | Recall Macro | ROC_AUC |
|---|---|---|---|---|---|---|
| a | Spectral contrast | 0.901 ± 0.06 | 0.900 ± 0.06 | 0.909 ± 0.06 | 0.901 ± 0.06 | 0.955 ± 0.04 |
| b | MEL | 0.884 ± 0.09 | 0.882 ± 0.09 | 0.892 ± 0.09 | 0.884 ± 0.09 | 0.950 ± 0.05 |
| c | CQT | 0.883 ± 0.08 | 0.882 ± 0.08 | 0.887 ± 0.08 | 0.883 ± 0.08 | 0.949 ± 0.06 |
| d | MFCC | 0.847 ± 0.13 | 0.836 ± 0.15 | 0.860 ± 0.13 | 0.846 ± 0.13 | 0.921 ± 0.10 |
| e | Cromatic | 0.838 ± 0.07 | 0.837 ± 0.07 | 0.848 ± 0.07 | 0.839 ± 0.07 | 0.904 ± 0.06 |
| f | Tonnetz | 0.787 ± 0.09 | 0.785 ± 0.09 | 0.792 ± 0.09 | 0.787 ± 0.09 | 0.865 ± 0.08 |
| g | Spectral centroid | 0.781 ± 0.08 | 0.778 ± 0.08 | 0.794 ± 0.08 | 0.781 ± 0.08 | 0.857 ± 0.08 |
| h | Spectral rollof | 0.718 ± 0.09 | 0.714 ± 0.09 | 0.731 ± 0.10 | 0.719 ± 0.09 | 0.774 ± 0.09 |
| Transform | Model | Accuracy | f1_Macro | ROC_AUC | Max | Min |
|---|---|---|---|---|---|---|
| CQT | LogReg | 0.039 | 0.039 | 0.015 | 1 | 0.863 |
| MLP | 0.044 | 0.044 | 0.027 | 1 | 0.863 | |
| MEL | LDA | 0.055 | 0.055 | 0.030 | 1 | 0.811 |
| SVC | 0.064 | 0.064 | 0.026 | 1 | 0.772 | |
| Spectral Centroid | Extratrees | 0.080 | 0.081 | 0.060 | 0.967 | 0.636 |
| Grad-Boost | 0.063 | 0.063 | 0.050 | 0.967 | 0.725 |
| Transform | Model | Fit_Time_Sec | Exec_Time_Sec |
|---|---|---|---|
| CQT | LogReg | 0.072 | 15.019 |
| MLP | 4.621 | 48.443 | |
| MEL | LDA | 0.362 | 8.760 |
| SVC | 0.029 | 2.674 | |
| Spectral Contrast | Extra Trees | 2.146 | 25.160 |
| Grad Boost | 14.348 | 479.971 |
| Author/ Study | Type of Welding | Characteristics | Model ML | Metrics |
|---|---|---|---|---|
| Jang et al. (2024) [24] | GTAW pulsado | Sound of arc + FFT + EEMD | Machine Learning | F1 score > 0.91 |
| Ji & Norzalilah (2023) [14] | SMAW (digital twin acústico) | Acoustic signal, time-frequency representations | Hybrid CNN (SeCNN-LSTM) | Accuracy ≈ 0.91 |
| Zhang et al. (2024) [25] | DED-Arc | Wavelet time-frequency | CNN (ResNet, MobileNetV3) | Accuracy 0.96–0.98 |
| Actual Project | SMAW | Spectral contrast, MEL CQT | Extra Trees, GBoost, SVC, LDA | Accuracy ≈ 0.90–0.92; ROC AUC > 0.95 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Rodríguez, A.G.; Lara Munevar, S.E.; Morales, H.F.M.; Barriga Castellanos, C.C. Comparative Analysis of Spectrogram-Based Transformations for Acoustic Classification of SMAW Weld Quality Using Machine Learning. Technologies 2026, 14, 205. https://doi.org/10.3390/technologies14040205
Rodríguez AG, Lara Munevar SE, Morales HFM, Barriga Castellanos CC. Comparative Analysis of Spectrogram-Based Transformations for Acoustic Classification of SMAW Weld Quality Using Machine Learning. Technologies. 2026; 14(4):205. https://doi.org/10.3390/technologies14040205
Chicago/Turabian StyleRodríguez, Alejandro García, Sergio Eduardo Lara Munevar, Héctor Fabio Montaño Morales, and Christian Camilo Barriga Castellanos. 2026. "Comparative Analysis of Spectrogram-Based Transformations for Acoustic Classification of SMAW Weld Quality Using Machine Learning" Technologies 14, no. 4: 205. https://doi.org/10.3390/technologies14040205
APA StyleRodríguez, A. G., Lara Munevar, S. E., Morales, H. F. M., & Barriga Castellanos, C. C. (2026). Comparative Analysis of Spectrogram-Based Transformations for Acoustic Classification of SMAW Weld Quality Using Machine Learning. Technologies, 14(4), 205. https://doi.org/10.3390/technologies14040205

