Next Article in Journal
Assessment of Odour Emission During the Composting Process by Using Olfactory Methods and Gas Sensor Array Measurements
Previous Article in Journal
A Wireless Sensor Network-Based Combustible Gas Detection System Using PSO-DBO-Optimized BP Neural Network
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Research on Combustion State System Diagnosis Based on Voiceprint Technology

School of Energy, Power and Mechanical Engineering, North China Electric Power University, No. 2 Beinong Road, Huilongguan, Changping, Beijing 102206, China
*
Author to whom correspondence should be addressed.
Sensors 2025, 25(10), 3152; https://doi.org/10.3390/s25103152
Submission received: 6 April 2025 / Revised: 14 May 2025 / Accepted: 15 May 2025 / Published: 16 May 2025
(This article belongs to the Section Fault Diagnosis & Sensors)

Abstract

:
This study investigates a multi-scenario combustion state diagnosis system based on acoustic feature extraction techniques. In this study, the voiceprint technology is applied to combustion condition monitoring for the first time, and an integrated approach for monitoring and diagnosis is proposed by combining multiple acoustic features, such as acoustic pattern features, step index P, and frequency-domain monitoring. In this study, a premixed hydrogen combustion test bed was built to simulate common combustion faults, and the corresponding acoustic features were collected and extracted. In this study, step index P and acoustic features are used for parallel diagnostic analysis, and CNN, ANN, and BP models are used to train the four states of flameout, flameback, thermoacoustic oscillation, and stable combustion, and the training diagnostic performance of each model is compared and analyzed using a confusion matrix. It is found that CNN has the strongest classification ability, can accurately distinguish the four states, has the lowest misclassification rate, has very strong generalization ability, and has a diagnostic accuracy of 93.49%. The classification accuracy of ANN is not as good as that of CNN, and there are local fluctuations during the training process. The BP neural network has a slower convergence speed and a high error rate in recognizing the flameback and thermoacoustic oscillations. In summary, the combustion state diagnosis system based on CNN model combined with acoustic features has optimal performance, and the combination of step index P and frequency-domain monitoring in the flameback diagnosis can improve the accuracy of combustion state identification and safety control level, which provides an important theoretical basis and practical reference in the field of combustion state diagnosis and is of profound significance to ensure the safe and efficient operation of the combustion process.

1. Introduction

The proposal of the dual-carbon target has introduced groundbreaking demands for the energy industry [1]. To adapt to the rapid growth and high variability of renewable energy sources in the grid, as well as significant fluctuations in electricity demand [2], thermal power units must not only fulfill their social responsibility for power generation and heat supply but also undertake the tasks of deep peaking. Under deep peaking, thermal-power-generating units have frequent load changes, and combustion faults such as flameback [3] and thermoacoustic oscillations [4,5] occur frequently [6,7,8]. These issues require higher standards for the safe operation of equipment and low N O x operation. In recent years, the rapid development of various new sensor types and diagnostic and analytical methods has provided the prerequisites for the comprehensive intelligent development of boilers. There is a growing demand for intelligent monitoring systems that can comprehensively, efficiently, and accurately assess the combustion status of boilers. Current flame monitoring systems can be categorized into three types based on the form of the sensor: optical radiation [9,10], thermodynamic [11], and electrical detection technologies [12]. Among these, using the acoustic features of combustion to monitor the flame status is a method based on the thermodynamic properties of combustion. Diagnosing the flame combustion status through its acoustic features offers the advantages of being non-contact, having a flexible sensor arrangement, being low-cost, not producing electromagnetic signals, and not interfering with the normal operation of the equipment [13,14].
In the process of flame combustion, sound waves are generated along with the fluctuation of gas and heat, and the sound wave spectrum is closely related to the combustion status of the flame. Research using acoustic signals to diagnose the combustion status, such as flameback and thermoacoustic oscillations, has a long history and encompasses a wide range of directions. In 1980, Detriche extracted and analyzed the sound of combustion, establishing the relationship between the flame acoustic spectra and burner diameters [15]; Yu measured the acoustic features of the flame at different locations using independent piezoelectric sensors, analyzing the changes in burning sound pressure level and spectral changes [16]; Singh found that the combustion acoustic signals were mainly concentrated in the high-temperature region by measuring the acoustic features at different locations and parameters such as time-averaged and fluctuating temperatures [17]; Ahmed et al. analyzed and monitored the acoustic signals of methane flames and heat release pulsations, exploring the coupling relationship between the acoustic features of flame combustion and the heat release pulsations by analyzing the signals in both the time and frequency domains [18]; Mondal used acoustic signals, performed dynamic analysis after Fourier transforming the signals, and introduced time and sound pressure sequences to classify the ignition features of the flame, using this parameter to classify the flame into stable and unstable status [19]; and Chandrachur proposed a method based on the time- and frequency-domain features of the sound for predicting and classifying identification of flame-quenching, stable status, and thermoacoustic oscillations. Past studies have primarily focused on analyzing the status change of combustion and the prediction of combustion accidents by studying the signal variation rules of combustion acoustic signals in the time domain, frequency domain, power spectrum, etc., with a fixed amount of air and the coupling of parameters such as heat release rate. However, the inability of the time-domain signals to highlight frequency variations and the frequency domain to show time variations, as well as the lack of diagnostic studies related to flameback acoustics due to the more hazardous nature of the flameback experiments, mean that the existing acoustic monitoring studies are unable to meet the requirements of combustion monitoring in power plants. Utilizing more accurate and efficient diagnostic methods for acoustic characterization has become the focus of research.
With further development of sound extraction algorithms and artificial intelligence, voiceprint technology has begun to be applied in various scenarios, including speech recognition [20], electric motors [21], gas turbine combustor [22], bear [23], aero-engines [24], gasoline engines [25], and equipment status monitoring, among others. In voiceprint monitoring, good data features can guarantee efficient and fast recognition analysis by the recognition system. There are many voiceprint features, including time domain, frequency domain, time–frequency domain, Mel-Frequency Cepstral Coefficients [26] (MFCCs), Gammatone Frequency Cepstral Coefficients (GFCC), and so on. Among them, MFCC contains both time–frequency-domain feature information and can be analyzed as one-dimensional data for recognition and prediction. Compared with image recognition, MFCC can further reduce the consumption of computational resources and computation time. In the field of status recognition, MFCC features have demonstrated good recognition rates and robustness [27]. At the same time, combined with the acoustic characteristics of the time-domain envelope response combustion state changes, the frequency-domain response to its changes in the distribution together constitute a combustion sound-pattern diagnostic system.
This study focuses on investigating multiple acoustic pattern trends under combustion faults such as flameout, thermoacoustic oscillations, and flameback, comparing the similarities, and arriving at an acoustic pattern diagnostic eye on method that can be applied to most combustion detections. Firstly, the combustion acoustic mode diagnosis data set is established through the preset combustion state in the laboratory, and the step index set Pi is calculated according to the data set. At the same time, the material damage is judged, and the acoustic characteristics such as time domain, frequency domain, and the MFCC of the specific fault diagnosis data set are calculated. Secondly, the centralized combustion fault diagnosis encountered in this study is tested using the collected test set to observe whether it is able to diagnose its state changes sensitively and accurately. This study attempts to use acoustic features in the field of speech recognition to monitor changes in combustion conditions and diagnose in real time whether to perform feed breaks to maintain stable and safe combustion and further deepens the combustion diagnostic model by using a variety of acoustic features.

2. Feature Extraction Algorithm

MFCCs are commonly used for the identification of speaker in voice recognition systems. Davis and Mermelstein launched them in the 1980s and they have been cutting-edge ever since [28,29,30]. MFCCs can simulate the nonlinear features of the human ear with a Mel filter bank and are usually used to extract signal features in sound signal processing [31]. It is the main parameter for voiceprint recognition at present. MFCC is primarily based on Mel filters for feature extraction; a Mel filter bank is a type of biomimetic filter constructed according to the features of the human ear’s auditory mechanism. As the human ear is sensitive to low-frequency sounds and less so to high-frequency sounds, the Mel filter bank features a denser arrangement at low frequencies and a sparser one at high frequencies. For the flame sound information, which primarily concentrates in the low-frequency range, MFCC offers better extraction accuracy and robustness.

2.1. Data Preprocessing

The audio signal is passed through a low-pass filter to attenuate the high-frequency noise signal, and the cutoff frequency is set to 5000 Hz. The sound signal is pre-emphasized to balance the high-frequency spectrum, making the signal spectrum flatter across the full domain. Pre-emphasis is applied to the audio signal to attenuate high frequency signals. The attenuation factor α is 0.97
y ( n ) = x ( n ) α x ( n 1 ) ,   n = 1 , 2 , 3 N ,   N = 1024 ,  
x ( n ) is the signal corresponding to the nth sampling point of the original signal; y ( n ) is the signal corresponding to the nth sampling point after preprocessing; N is the number of points of the Fourier transform; and α is the attenuation coefficient.

2.2. MFCC Extraction Process

(1)
The pre-emphasized signal in the previous step is divided into frames and windowed using Hamming window.
W ( n ) = 0.54 0.46 cos 2 π n N 1 ,   0 n N 1 ,  
y ( n ) = y ( n ) × W ( n ) ,  
W ( n ) : the value of the window function at the nth sampling point, the value of the y ( n ) : the preprocessed signal.
N: the number of sample points (i.e., window length) contained in each frame.
(2)
The signal, now framed and windowed, is subjected to a Fast Fourier Transform, resulting in the frequency spectrum of the signal.
s ( k ) = n = 0 N 1 y ( n ) e j 2 π N k n ,   0 k N ,  
s ( k ) : Fourier coefficients of the kth frequency point.
N: the number of transformed points.
(3)
The energy spectrum is passed through a set of triangular filters designed according to the Mel scale. The frequency response of the triangular filters [ H m ( k ) ] and the response formula for Mel frequency to actual frequency f are given by Equation (7). After band-pass filtering, the results are corrected using a logarithmic function to adjust for the non-linearity of sound intensity, thus obtaining the logarithmic energy output for each filter group. In this study, three types are designed, with M = 19, 39, 57, with f ( m ) corresponding to linear frequency, s ( m ) indicating the logarithmic energy output of each filter group.
H m ( k ) = 0 , k f ( m 1 ) 2 ( k f ( m 1 ) ) ( f ( m + 1 ) f ( m 1 ) ) ( f ( m ) f ( m 1 ) ) , f ( m 1 ) k f ( m ) 2 ( f ( m + 1 ) k ) ( f ( m + 1 ) f ( m 1 ) ) ( f ( m ) f ( m 1 ) ) , f ( m ) k f ( m + 1 ) 0 , k f ( m + 1 ) ,  
m = 0 M 1 H m ( k ) = 1 ,  
M e l ( f ) = 2595 × log 10 ( 1 + f 700 ) ,  
s ( m ) = ln ( k = 0 N 1 s ( k ) 2 H m ( k ) ) ,   0 m M .
(4)
The cepstrum is computed through an Inverse Discrete Fourier Transformation, and the static MFCCs are derived from the logarithmic energy calculated in the previous step by applying a Discrete Cosine Transform (DCT). The formula for calculating static MFCC coefficients is as follows:
C ( n ) = M = 0 N 1 s ( m ) cos n π ( 2 m 1 ) 2 M n = 1 , 2 , , L m = 1 , 2 , , M ,  
M is the number of filter banks; H m ( k ) is the frequency response of the mth triangular filter; f ( m ) is the corresponding linear frequency; and q ( m ) is the logarithmic energy output from each filter bank.
In this paper, three filter bank schemes are designed, which include 19, 39, and 57 banks to accommodate different frequency distributions, respectively.
(5)
The calculation of the first-order derivative of MFCC is accomplished through differencing operations on the MFCCs. The formula for the first-order derivative of MFCC is as follows
δ c t = n = 1 N n ( c t + n c t n ) ,  
where ΔMFCC represents the first-order derivative of the Mel-Frequency Cepstral Coefficient (MFCC), N is the window size used for the differencing operation, and δ c t denotes the time index.

2.3. The Step Index P

The envelope is often used in the analysis of vibration signals, in which the envelope obtained from the calculation of the original vibration signal in the high-frequency signal is filtered out better and can reflect the time-domain signal contour change rule with time. In this paper, the step index P is obtained by calculating the envelope index of its time-domain signal, and the change in its step index can accurately reflect the state transformation of its time domain. The specific process of its feature extraction is as follows:
(1)
Obtain the original signal x ( n ) and perform the Hilbert transform on the original signal.
H { x ( t ) } = 1 π PV x ( τ ) t τ d τ ,
H { x ( t ) } is the Hilbert transform of the signal, PV denotes the principal value integral, and the singularity in the integral is taken into account.
(2)
An imaginary part of the signal is obtained by the Hilbert transform, which is combined with the original signal to form an analyzed signal x ˜ ( t )
x ˜ ( t ) = x ( t ) + j H { x ( t ) } .
(3)
The step index P is the amplitude of the resolved signal
P ( t ) = | x ˜ ( t ) | = x ( t ) 2 + H { x ( t ) } 2 .

3. Experimental

3.1. Experimental Apparatus

The fault combustion voiceprint test platform used in the research is shown in Figure 1, which consists of four parts. The first part is the material platform. The platform primarily includes air tank (providing a stable oxygen supply); hydrogen tank (main test gas); methane tank (responsible for igniting hydrogen flame and avoiding flameback); steam generator (inhibiting hydrogen combustion rate) and its storage tank; electronic gas flowmeter; and its control switch. The second part is the transportation pipeline platform, which is divided into two sides. One side is the gas pipeline input to the gas flowmeter, which is gradually adjusted to the required ratio and working condition through the gas flowmeter. The other side is the premixer, which premixes the gas in advance and fully premixes the gas to make it fully burn, wherein the burner is a 4 by 4 array burner with a burner tube diameter of 2 cm and a spacing of 5 cm between tube diameters. The gas fuel flow is measured by a flowmeter with an accuracy of ±1%, and its range is 0–300 SLM. Here, SLM is used to represent the flow rate per minute in standard conditions (0 °C, 1 atm). The accuracy of the device for measuring air is ±1%, and the range is 0–300 SLM gas flowmeter. SLM is a unit used to express liters per minute at standard conditions (0 °C, 1 atm). The third part is the combustion chamber, which contains an array burner in the middle. The last part is the voiceprint test platform, including the microphone acquisition device (using rode’s microphone, the model is RODE NT g4+, which can better suppress external noise), camera, data acquisition card (DAQ), computer, and a connecting cable. In order to avoid overheating the microphone, the microphone is 50 cm away from the flame center. Also, in order to ensure the accuracy and reliability of the experiment, the location of all the equipment was kept as unchanged as possible. There is an observation port on the side, which is convenient for observing the combustion state. The ventilation pipe is connected to the flue mouth to exhaust smoke in time. In this study, all equipment except microphones and computers were customized and produced in Beijing, China.

3.2. Experimental Design

The position of the flame combustion center fluctuates the most. The microphone is used to align the flame center position, and the sampling frequency is 44,000 Hz. The heat release rate of hydrogen combustion is much larger than the gas transport rate, which is more prone to combustion failures, such as flameback. Methane is supplied in the early stage of ignition to ensure stable combustion of the flame, and hydrogen supply is gradually increased. However, for safety testing, saturated water vapor is required to reduce the proportion of hydrogen and its reaction rate. The design and practice of this experiment are mainly to test two common combustion faults of flame flameback and thermoacoustic oscillation. By maintaining the stable operation of methane, air, and water vapor, the proportion of hydrogen is gradually increased, and the occurrence of hydrogen flameback and thermoacoustic oscillation and the change of voiceprint state under different ratios are tested. In order to ensure the reliability and safety of the sample, each group of working conditions was tested in two categories. Under the condition of keeping the flow rate of hydrogen and air constant, the flow rate of water vapor was changed to make it easier to temper and to verify the effect of two different water vapor flow rates on flameback production. At the same time, the emergency brake switch was installed under the gas flow controller. The hydrogen supply switch was turned off within two seconds of flameback, the air and water vapor were continuously supplied, and the residual gas in the pipeline and premixer was purged. This experiment is divided into five groups of working conditions, which represent their different ratios. The sampling classification is shown in Table 1, and the corresponding air coefficient is calculated. Therefore, using the mass flow rate of air and fuel ( M A and M F , respectively) to calculate the value of the air coefficient, ϕ = M A M F r e a l i t y / M A M F t h e o r e t i c a l . The fuel used in this study consisted of hydrogen at 99% purity and methane at 99% purity.
In this experiment, a total of 10 working conditions were designed, each of which can be divided into two categories. These two types keep the air coefficient constant and change the amount of water vapor in the pipe at the same time, which makes the experiment easier to flameback. In this study, water vapor mainly inhibits hydrogen combustion. Under the same ratio, in order to make the combustion more prone to flameback and thermoacoustic oscillation, the water vapor content is reduced to observe whether combustion failure becomes more likely. At the same time, water vapor also provides a safety mechanism for the occurrence of combustion faults. When flameback occurs, continuous supply of water vapor can further purge the gas supply pipeline, reduce the temperature of the burner and the experimental pipeline, and reduce the risk of deflagration of the burner.

3.3. Flow Chart of Combustion Voiceprint Intelligent Diagnosis System

The voiceprint intelligent diagnosis system studied in this paper is mainly divided into two steps. The detailed research route is shown in Figure 2. The first step is the laboratory combustion fault voiceprint data acquisition research. Through the laboratory preset combustion fault sound signal, the amplitude step index P and the corresponding voiceprint features are calculated and extracted. In this experiment, there are three states: pre-set and experimental, flameout state (distinguished from the state of non-ignition, which is transformed from combustion state or combustion fault state), and the thermoacoustic oscillation and flameback state. After the acquisition, the corresponding indexes are calculated respectively to form a step data set. By calculating the step index, it provides a data basis for the intelligent diagnosis system to judge whether to disconnect the combustion. At the same time, the sound signal of the fault state is preprocessed by noise reduction, and the frequency domain, time–frequency domain, and MFCC voiceprint features are extracted and constitute the data set of combustion fault voiceprint diagnosis as a whole. The second step is to run the combustion state diagnosis system in real time. The acoustic signal of combustion fault preset by the laboratory is used as the diagnostic training set, and the real-time acquisition signal is used as the test signal. The size range and various characteristics of P are judged separately, and multiple signal characteristics are fused to obtain the final combustion state and determine whether it is necessary to alarm.

3.4. Input Parameters of Combustion Voiceprint

The typical working condition 0.90–1 is selected as the main body of data analysis. In order to reflect the normal combustion state, the data within 10 s before and after are selected as the target data for the analysis. In order to obtain more accurate data, the microphone used in this experiment is a gun microphone, which has the characteristics of unidirectional acquisition and high frequency filtering. In order to unify the same conclusion under different ratios, all test data need to be normalized.

3.4.1. Amplitude Step Index P

The amplitude step index P, as the most important basis for fault diagnosis in this study, has the following characteristics. As shown in Figure 3, when thermoacoustic oscillation occurs during combustion, it has the following characteristics: First, when a combustion fault occurs, the amplitude of the time-domain signal reaches the limit of the device test; during normal combustion, the time-domain signal will remain within the device test limit. The second envelope value remains between 0 and 1 before the thermoacoustic oscillation occurs; when the thermoacoustic oscillation occurs, some signals will break through the limit of 1, but the duration is less than 0.1 s. When the thermoacoustic oscillation occurs, the envelope value will remain within the range of 0.3–2 and last for more than 0.1 s. As shown in Figure 3 and Figure 4, when flameback occurs during the combustion process, it also has the following characteristics: the first time-domain signal reaches the limit value of the equipment test, and the normal combustion is maintained within the equipment test limit, similar to the thermoacoustic oscillation time-domain signal. When the second envelope value is not tempered, its state is more stable than the thermoacoustic oscillation, and its value remains between 0 and 1; during the combustion flameback, the maximum value of the envelope value abruptly changes to more than 2, and the change in the value is maintained between 0 and 2.
Through the above analysis, it is found that the difference between flameback and thermoacoustic oscillation lies in whether there is an unstable state and the change range of envelope value on the eve of fault occurrence. The change in flameback envelope value is between 0 and 2, while the thermoacoustic oscillation is between 0.3 and 2.

3.4.2. Frequency-Domain Signal

Monitoring the change in the dominant frequency in the combustion frequency domain has been the mainstream monitoring method in recent years. For stable combustion, shown inn Figure 5, the signal is a broadband signal with multiple dominant frequency distributions. When the combustion state changes abruptly, the frequency-domain distribution becomes a single main frequency, and the main frequency becomes 238 Hz in the flameback state, as shown in Figure 6, and the main frequency becomes 221 Hz in the thermoacoustic oscillation state, as shown in Figure 7. By monitoring the change in its main frequency, the change in combustion state can be better judged. However, in experiments, with the change in the ratio and the different air intake of water vapor, it also causes a certain deviation of the thermoacoustic oscillation and flameback main frequency generated by different ratios, and the distribution of other sub-frequencies is different. The frequency-domain signal can determine whether the combustion is stable or unstable, but it cannot determine what kind of instability has occurred.

3.4.3. MFCC Feature

In this study, three common faults of combustion diagnosis—thermoacoustic oscillation, flameback, and flameout—were designed and studied. In the above research, the time-domain characteristic step index P can determine whether the fuel supply needs to be disconnected to avoid deflagration failure. The frequency distribution can better judge the difference between thermoacoustic oscillation, flameback, and normal combustion. However, only relying on the frequency distribution as the input signal not only increases the amount of diagnostic data, but also increases the recognition time. Under various ratios, the frequency distribution is similar but inconsistent, which increases the difficulty of recognition and reduces the accuracy of the model. In order to improve the performance of the model, the MFCC feature, as an acoustic feature that not only has time characteristics, but also can see its frequency distribution, has become the main force of model training.
Figure 8, Figure 9 and Figure 10 show the original data diagrams of thermoacoustic oscillation, flameback, and normal combustion, respectively. From these diagrams, it can be observed that the patterns differ under various states—particularly between thermoacoustic oscillation and flameback. Notable differences appear in MFCC frames 20–25 and 28–30, where the distribution deviates significantly from that of flameback. The MFCC feature distribution of stable combustion is clearly distinct from both thermoacoustic oscillation and flameback, with the voiceprint MFCC of stable combustion displaying a broadband pattern.

4. Results and Discussion

In order to build a more practical combustion monitoring system, this paper uses the step-order data set Pi for the diagnosis of combustion state. The other features are used as the training data set of the model for training and classification diagnosis in which the labels of all states are manually labeled, and the predicted values obtained by feeding the model training are the states diagnosed by the system.

4.1. The Training Performance of Different Models Under Different Working Conditions

In this study, three commonly used models, Backpropagation Neural Network (BP), Artificial Neural Network (ANN), and Convolutional Neural Network (CNN), were adopted. BP neural network is a multi-layer perceptron (MLP) based on gradient descent optimization algorithm, which uses error back propagation algorithm (BP algorithm) for training and model diagnosis. BP network is widely used in non-linear regression and classification tasks, but it easily falls into local optimum during model training, and the training time is long. At the same time, BP is sensitive to the selection of hyperparameters. The ANN model is one of the most basic neural network structures. It imitates the working mode of human brain neurons for information transmission and data processing. The ANN model is suitable for various data modeling tasks, but its learning ability is limited by the depth of the network. It struggles to handle high-dimensional complex data and faces challenges in training large-scale models for big data. Convolutional Neural Networks (CNNs) are a class of deep learning models particularly well suited for processing image and time-series data. They are capable of efficiently extracting local features and exhibit strong performance in training on both one-dimensional sequences and graph-structured data. In this study, various models were employed to train the experimental data sets, and a comparative analysis of their performance is presented in Figure 11 and Table 2.
From the training trend of the model, the convergence speed of the CNN model is relatively fast, the loss function can be stabilized in fewer training rounds, and its feature extraction ability is strong. The ANN model shows local fluctuations during the training process, indicating that there may be local optimal problems in the optimization process, and the single model can still converge well. The training convergence speed of BP neural network model is slow, and the loss decreases slowly during the training process. It may take longer training time to achieve the ideal accurate diagnosis effect.

4.2. Diagnosis Results of Different Models

In this study, three models of CNN, BP neural network, and ANN were used to classify and diagnose the four states of flameout, flameback, thermoacoustic oscillation, and stable combustion, and the performance of each model was compared and analyzed by confusion matrix. On the whole, the confusion matrix of the CNN shows that its classification ability is the best, the recognition rate is the highest on flameback and thermoacoustic oscillation, and it has excellent feature extraction and diagnosis ability. Both ANN and BP have a certain degree of misjudgment in the classification of flameback and thermoacoustic oscillations. Among them, BP has the highest number of misjudgments of thermoacoustic oscillations, indicating that its ability to distinguish complex categories of diagnosis is relatively weak. The final results show that CNN has the best diagnostic performance, and its training convergence speed is fast and stable. The CNN model can accurately distinguish between various combustion states, achieving a diagnostic accuracy as high as 93.49%. In comparison, although the BP neural network possesses some diagnostic capability, it suffers from a slow convergence speed, significant training fluctuations, and a high misclassification rate between flameback and thermoacoustic oscillation. The ANN model performs slightly better than BP in classifying thermoacoustic oscillation, but its overall generalization ability remains weak. All models are able to correctly identify flameout and stable combustion states; however, distinguishing between flameback and thermoacoustic oscillation remains the main challenge. A comprehensive analysis indicates that the CNN model demonstrates the best applicability for this monitoring task. The advantages and disadvantages of model diagnosis are shown in Figure 12 and Table 3.

5. Summary, Conclusions, and Future Work

In this study, the performance of CNN, ANN, and BP models in the combustion state diagnosis system was compared and analyzed, and their applicability was discussed in combination with the training trend. At the same time, a method for comprehensive utilization of voiceprint characteristics, step index P and frequency-domain monitoring is proposed to improve the accuracy of combustion state diagnosis. The main conclusions are as follows:
(1)
The step index P exhibits high specificity in the flameback state, allowing it to effectively distinguish abnormal changes in the combustion state. It serves as a decision-making tool to determine whether to disconnect the fuel supply, thereby enhancing combustion safety.
(2)
By monitoring the frequency-domain characteristics of the signal, the change in the burner state can be accurately identified. Compared to time-domain analysis, frequency-domain information provides a more intuitive reflection of the dynamic changes in combustion state, offering valuable insight for combustion stability analysis.
(3)
In the combustion state diagnosis system, CNN demonstrates the best classification ability, effectively distinguishing between the four states: flameout, flameback, thermoacoustic oscillation, and stable combustion. Its confusion matrix reveals the lowest misjudgment rate and the strongest generalization ability. While ANN performs slightly worse than CNN in classification accuracy, it exhibits some local fluctuations during the training process, potentially influenced by local optimization. The BP neural network, on the other hand, has a slow training convergence speed, a high misjudgment rate for flameback and thermoacoustic oscillation states, and relatively weak overall diagnostic performance. In summary, this study shows that the combustion state diagnosis system based on the CNN model combined with voiceprint features has the best performance, and the combination of step index P for flameback diagnosis and frequency-domain monitoring can further enhance the accurate identification and safety control of combustion state.
This study investigates the feasibility of applying acoustic pattern techniques to monitor the combustion process under laboratory conditions. The results show that acoustic features can effectively reflect the combustion state and provide a potential new method for real-time diagnosis of the combustion process. The data processing in this study was based on the experiments after which the feasibility of its acoustic pattern technique applied to practical diagnosis was explored. However, practical combustion monitoring needs to cope with challenges such as background noise interference and ensure that relevant acoustic features can be robustly extracted. In addition, there is a need to further establish clear correlations between acoustic features and combustion temperature control and product composition.

Author Contributions

J.Y.: Conceptualization, Investigation, Formal analysis, Writing—original draft. Y.W.: Conceptualization, Investigation, Formal analysis, Writing—original draft. L.A.: Conceptualization, Investigation, Formal analysis, Writing—original draft. G.S.: Conceptualization, Writing—review and editing. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Data will be made available on request.

Conflicts of Interest

It is declared that we have no conflicts of interest.

References

  1. Chen, X.; Zhou, W. Support carbon neutrality target—Which flexible power source is the best option for China? Energy 2023, 285, 128682. [Google Scholar] [CrossRef]
  2. Su, X.; Fang, Q.; Ma, L.; Yao, B.; Li, Y.; Zhao, X.; Mao, R.; Yin, C. Improving combustion and lowering NO emissions of an industrial coal swirl burner by optimizing its nozzle structure. Appl. Therm. Eng. 2023, 218, 119340. [Google Scholar] [CrossRef]
  3. Shao, X.; Shi, W.; Jia, H.; Yang, X.; Pei, B.; Pu, L.; Gao, J. Flameback identification and air intrusion prevention in small flow hydrogen flare stack emissions. Int. J. Hydrogen Energy 2024, 53, 717–727. [Google Scholar] [CrossRef]
  4. Ma, B.; Li, J.; Zhang, Z.; Xi, Y.; Zhao, D.; Wang, N. Experimental and theoretical studies on thermoacoustic limit cycle oscillation in a simplified solid rocket motor using flat flame burner. Acta Astronaut. 2021, 189, 26–42. [Google Scholar] [CrossRef]
  5. Chen, X.; Hemchandra, S.; Fathy, H.; O’connor, J. Linear control of thermoacoustic oscillations with flame dynamics modeled by a level-set method. Combust. Flame 2022, 237, 111686. [Google Scholar] [CrossRef]
  6. Kasthuri, P.; Pawar, S.A.; Gejji, R.; Anderson, W.; Sujith, R.I. Coupled interaction between acoustics and unsteady flame dynamics during the transition to thermoacoustic instability in a multi-element rocket combustor. Combust. Flame 2022, 240, 112047. [Google Scholar] [CrossRef]
  7. Zhou, H.; Huang, Y.; DING, F.; Wang, H.; Cen, K. Investigation on control effects of loudspeaker on the thermoacoustic instability in a Rijke combustor. J. Vib. Shock 2016, 35, 22. [Google Scholar]
  8. Ji, L.; Wang, J.; Zhang, W.; Li, D.; Hu, G.; Huang, Z. Nonlinear dynamic characteristics of self-excited thermoacoustic instabilities in premixed swirling flames. Exp. Therm. Fluid Sci. 2024, 150, 111033. [Google Scholar] [CrossRef]
  9. Yang, J.; Yan, S.; Gong, Y.; Guo, Q.; Ding, L.; Yu, G. Application study of Dynamic Mode Decomposition coupled with a high-speed imaging system in jet zone oscillation behavior diagnosis of impinging flames. Control Eng. Pract. 2023, 135, 105494. [Google Scholar] [CrossRef]
  10. Ming, Z.; Liu, H.; Cui, Y.; Wen, M.; Zhang, X.; Yao, M. Optical diagnosis study of fuel volatility on combustion characteristics of spray flame and wall-impinging flame. Fuel Process. Technol. 2023, 250, 107880. [Google Scholar] [CrossRef]
  11. He, L.; Guo, Q.; Gong, Y.; Wang, F.; Yu, G. Investigation of OH* chemiluminescence and heat release in laminar methane–oxygen co-flow diffusion flames. Combust. Flame 2019, 201, 12–22. [Google Scholar] [CrossRef]
  12. Butterworth, T.D.; Cha, M.S. Electric field measurement in electric-field modified flames. Proc. Combust. Inst. 2020, 38, 6651–6660. [Google Scholar] [CrossRef]
  13. Bhattacharya, C.; De, S.; Mukhopadhyay, A.; Sen, S.; Ray, A. Detection and Classification of Lean Blow-Out and Thermoacoustic Instability in Turbulent Combustors. Appl. Therm. Eng. 2020, 180, 115808. [Google Scholar] [CrossRef]
  14. Tang, L.; Tian, H.; Huang, H.; Shi, S.; Ji, Q. A survey of mechanical fault diagnosis based on audio signal analysis. Measurement 2023, 220, 113294. [Google Scholar] [CrossRef]
  15. Detriche, P.; Lanore, J.C. An acoustic study of pulsation features of fires. Fire Technol 1980, 16, 204–211. [Google Scholar] [CrossRef]
  16. Yu, M.; Gupta, A.; Bryden, K.M. Sensor Response and Sensor Network Development for Practical Combustors. In Proceedings of the 16th International Conference on Computer Communications and Networks, Honolulu, Hawaii, 13–16 August 2007. [Google Scholar]
  17. Singh, A.V.; Yu, M.; Gupta, A.K.; Bryden, K.M. Thermo-acoustic behavior of a swirl stabilized diffusion flame with heterogeneous sensors. Appl. Energy 2013, 106, 1–16. [Google Scholar] [CrossRef]
  18. Khalil, A.E.; Gupta, A.K. Acoustic and heat release signatures for swirl assisted distributed combustion. Appl. Energy 2017, 193, 125–138. [Google Scholar] [CrossRef]
  19. Mondal, S.; Bhattacharya, C.; Chattopadhyay, P.; Mukhopadhyay, A.; Ray, A. Prediction of Thermoacoustic Instabilities in a Premixed Combustor based on FFT-based Dynamic Characterization. In Proceedings of the 53rd AIAA/SAE/ASEE Joint Propulsion Conference, Atlanta, GA, USA, 20 October 2023. [Google Scholar]
  20. Hanifa, R.M.; Isa, K.; Mohamad, S. A review on speaker recognition: Technology and challenges. Comput. Electr. Eng. 2021, 90, 107005. [Google Scholar] [CrossRef]
  21. Shan, S.; Liu, J.; Wu, S.; Shao, Y.; Li, H. A motor bearing fault voiceprint recognition method based on Mel-CNN model. Measurement 2023, 207, 112408. [Google Scholar] [CrossRef]
  22. Li, X.; Xiao, J.; Gao, S.; Wang, F.; Wang, W.; Xia, J. Study on the acoustic features of a heavy-duty gas turbine combustor. J. Eng. Res. 2023, 11, 100068. [Google Scholar] [CrossRef]
  23. Yao, P.; Wang, J.; Zhang, F.; Li, W.; Lv, S.; Jiang, M.; Jia, L. Intelligent Rolling Bearing Imbalanced Fault Diagnosis Based on Mel-Frequency Cepstrum Coefficient and Convolutional Neural Networks. Measurement 2022, 205, 112143. [Google Scholar] [CrossRef]
  24. Luan, X.; Liu, G.; Sha, Y.; He, H.; Guo, X. Experiment study on traveling wave resonance of fatigue fracture of high-speed bevel gear in aero-engne based on acoustic measurement method. J. Sound Vib. 2021, 511, 116345. [Google Scholar] [CrossRef]
  25. Broatch, A.; Novella, R.; García-Tíscar, J.; Gomez-Soriano, J. On the shift of acoustic characteristics of compression-ignited engines when operating with gasoline partially premixed combustion. Appl. Therm. Eng. 2018, 146, 223–231. [Google Scholar] [CrossRef]
  26. Picone, J. Signal modeling techniques in speech recognition. Proc. IEEE 1993, 81, 1215–1247. [Google Scholar] [CrossRef]
  27. Chowdhury, A.; Ross, A. Fusing MFCC and LPC features using 1D triplet CNN for speaker recognition in severely degraded audio signals. IEEE Trans. Inf. Forensics Secur. 2019, 15, 1616–1629. [Google Scholar] [CrossRef]
  28. Rao, K.S.; Manjunath, K.E. Speech Recognition Using Articulatory and Excitation Source Features; Springer Nature: Dordrecht, The Netherlands, 2017. [Google Scholar] [CrossRef]
  29. Zheng, F.; Zhang, G.; Song, Z. Comparison of different implementations of MFCC. J. Comput. Sci. Technol. 2000, 16, 582–589. [Google Scholar] [CrossRef]
  30. Ganchev, T.; Fakotakis, N.; Kokkinakis, G. Comparative evaluation of various MFCC implementations on the speaker verification task. In Proceedings of the International Conference on Speech and Computer (SPECOM), Patras, Greece, 7–19 October 2005; pp. 191–194. [Google Scholar]
  31. Wang, Y.; Wu, J.; Yu, Z.; Hu, J.; Zhou, Q. A structurally re-parameterized convolution neural network-based method for gearbox fault diagnosis in edge computing scenarios. Eng. Appl. Artif. Intell. 2023, 126, 107091. [Google Scholar] [CrossRef]
Figure 1. Experimental diagram of combustion diagnosis system.
Figure 1. Experimental diagram of combustion diagnosis system.
Sensors 25 03152 g001
Figure 2. Research flow chart of combustion fault diagnosis.
Figure 2. Research flow chart of combustion fault diagnosis.
Sensors 25 03152 g002
Figure 3. Thermoacoustic oscillation time−domain and envelope diagram.
Figure 3. Thermoacoustic oscillation time−domain and envelope diagram.
Sensors 25 03152 g003
Figure 4. Flameback time−domain and envelope diagram.
Figure 4. Flameback time−domain and envelope diagram.
Sensors 25 03152 g004
Figure 5. Stable combustion schematic diagram.
Figure 5. Stable combustion schematic diagram.
Sensors 25 03152 g005
Figure 6. Flameback state frequency-domain diagram.
Figure 6. Flameback state frequency-domain diagram.
Sensors 25 03152 g006
Figure 7. Thermoacoustic oscillation frequency-domain diagram.
Figure 7. Thermoacoustic oscillation frequency-domain diagram.
Sensors 25 03152 g007
Figure 8. Combustion oscillation MFCC data diagram. (a) Thermoacoustic oscillation original MFCC data diagram; (b) thermoacoustic oscillation normalized MFCC data plot.
Figure 8. Combustion oscillation MFCC data diagram. (a) Thermoacoustic oscillation original MFCC data diagram; (b) thermoacoustic oscillation normalized MFCC data plot.
Sensors 25 03152 g008
Figure 9. Flameback MFCC data diagram. (a) The original MFCC data diagram of flameback state; (b) flameback normalized MFCC data graph.
Figure 9. Flameback MFCC data diagram. (a) The original MFCC data diagram of flameback state; (b) flameback normalized MFCC data graph.
Sensors 25 03152 g009
Figure 10. Normal combustion MFCC data diagram. (a) The original MFCC data of stable combustion; (b) stable combustion normalized MFCC data map.
Figure 10. Normal combustion MFCC data diagram. (a) The original MFCC data of stable combustion; (b) stable combustion normalized MFCC data map.
Sensors 25 03152 g010
Figure 11. Three models of neural network training performance trend chart. (a) ANN neural training performance chart; (b) BP neural training performance chart; (c) CNN neural training performance chart.
Figure 11. Three models of neural network training performance trend chart. (a) ANN neural training performance chart; (b) BP neural training performance chart; (c) CNN neural training performance chart.
Sensors 25 03152 g011
Figure 12. Different models’ monitoring confusion matrix diagrams.
Figure 12. Different models’ monitoring confusion matrix diagrams.
Sensors 25 03152 g012aSensors 25 03152 g012b
Table 1. Fault combustion experiment condition design table.
Table 1. Fault combustion experiment condition design table.
Condition H 2
(SLM)
O 2
(SLM)
H 2 O A
(SLM)
H 2 O B
(SLM)
Air
(SLM)
0.95–11125930.430.4171
0.95–21125922.430.4171
0.90–11126230.430.4173
0.90–21126221.430.4173
0.85–11126530.430.4176
0.85–21126520.430.4176
0.80–11126930.430.4180
0.80–21126919.430.4180
0.75–11127430.430.4185
0.75–21127418.430.4185
Table 2. Comparison table of training performance of different models.
Table 2. Comparison table of training performance of different models.
ModelFinal Accuracy RateLoss of Convergence SpeedStabilityGeneralization Ability
ANNAbout 90%The slowest convergence.Has a rather great fluctuation.Poor, lack of generalization ability.
BP91–93%The convergence is slow, and the first 10 rounds fluctuate greatly.Medium, but the loss fluctuates greatly.Good, but easy to fall into local optimum.
CNN93.49%The convergence is the fastest, and it is mostly stable after 10 rounds.The most stable, no obvious shock.Optimal, training error and test error minimum.
Table 3. Misclassification summary of three models.
Table 3. Misclassification summary of three models.
Misclassification ModeThe Misclassification Number of ANN ModelThe Misclassification Number of BP ModelThe Misclassification Number of CNN ModelAnalysis
Misclassification of misfire extinguishment 000All models can accurately classify the flameout state.
Flameback is mistaken for thermoacoustic oscillation12126CNN is the least, BP and ANN are more, indicating that BP/ANN has a weak ability to classify flameback.
Thermoacoustic oscillation is misjudged as flameback6129CNN has fewer misjudgments, and ANN performs slightly better than BP in this category.
Thermoacoustic oscillation is mistaken for flameout220CNN did not have this problem, and BP and ANN made misjudgments.
Misclassification of stable combustion000All models can accurately classify stable combustion states.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Yan, J.; Wang, Y.; An, L.; Shen, G. Research on Combustion State System Diagnosis Based on Voiceprint Technology. Sensors 2025, 25, 3152. https://doi.org/10.3390/s25103152

AMA Style

Yan J, Wang Y, An L, Shen G. Research on Combustion State System Diagnosis Based on Voiceprint Technology. Sensors. 2025; 25(10):3152. https://doi.org/10.3390/s25103152

Chicago/Turabian Style

Yan, Jidong, Yuan Wang, Liansuo An, and Guoqing Shen. 2025. "Research on Combustion State System Diagnosis Based on Voiceprint Technology" Sensors 25, no. 10: 3152. https://doi.org/10.3390/s25103152

APA Style

Yan, J., Wang, Y., An, L., & Shen, G. (2025). Research on Combustion State System Diagnosis Based on Voiceprint Technology. Sensors, 25(10), 3152. https://doi.org/10.3390/s25103152

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop