Next Article in Journal
A Novel Integrated Subjective-Objective MCDM Model for Alternative Ranking in Order to Achieve Business Excellence and Sustainability
Previous Article in Journal
Efficient Lattice CP-ABE AC Scheme Supporting Reduced-OBDD Structure for CCN/NDN
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Novel Isomap-SVR Soft Sensor Model and Its Application in Rotary Kiln Calcination Zone Temperature Prediction

School of Electronic and Information Engineering, University of Science and Technology Liaoning, No. 185, Qianshan, Anshan 114051, Liaoning, China
*
Author to whom correspondence should be addressed.
Symmetry 2020, 12(1), 167; https://doi.org/10.3390/sym12010167
Submission received: 13 December 2019 / Revised: 6 January 2020 / Accepted: 10 January 2020 / Published: 14 January 2020

Abstract

:
Soft sensing technology has been proved to be an effective tool for the online estimation of unmeasured or variables that are difficult to directly measure. The performance of a soft sensor depends heavily on its convergence speed and generalization ability to a great extent. Based on this idea, we propose a new soft sensor model, Isomap-SVR. First, the sample data set is divided into training set and testing set by using self-organizing map (SOM) neural network to ensure the fairness and symmetry of data segmentation. Isometric feature mapping (Isomap) method is used for dimensionality reduction of the model input data, which could not only reduce the structure complexity of the proposed model but speed up learning speed, and then the Support Vector Machine Regression (SVR) is applied to the regression model. A novel bat algorithm based on Cauchy mutation and Lévy flight strategy is used to optimize parameters of Isomap and SVR to improve the accuracy of the proposed model. Finally, the model is applied to the prediction of the temperature of rotary kiln calcination zone, which is difficult to measure directly. The simulation results show that the proposed soft sensor modeling method has higher learning speed and better generalization ability. Compared with other algorithms, this algorithm has obvious advantages and is an effective modeling method.

1. Introduction

In petrochemical, chemical, iron, and steel metallurgy and other process industries, due to economic or technical constraints, there are often some process variables that cannot be measured online or are difficult to measure using real sensors. However, these variables are usually key process parameters or quality indicators. These variables are usually determined by off-line sample analysis in the laboratory, so it is difficult to use them in the feedback signal of online control system. Online monitoring of these variables is an important guarantee to ensure safety, smooth production, efficient operation, and greater economic benefits. The main problem of quality control in the process industry is how to realize the estimation of these unpredictable variables online. Soft sensors are usually used to solve these problems. Soft sensor technology uses the idea of indirect measurement, multiple regression analysis, support vector machine, neural network, and other technical means to estimate the dominant variable through a certain correlation between the auxiliary variable and the dominant variable. It has the advantages of less investment, simple maintenance, and fast response.
Rotary kiln is the main production equipment of iron ore pellet, and the temperature of calcination zone is one of the key technical indexes to determine the quality of finished pellet. Increasing the temperature control level of calcination zone is of great significance to improving the quality of finished pellet. However, when the rotary kiln is running, Thermocouple signal transmission slip-ring is prone to poor contact and the temperature measurement signal is unstable. In addition, the thermocouple has an extremely short service life under the strong oxidation and high temperature environment. Therefore, to replace the faulty thermocouple, the rotary kiln must stop running, which seriously affects the production. Other non-contact temperature measurement methods (such as infrared temperature measurement, etc.) have extremely low accuracy under the harsh environment. Therefore, it is of great significance to establish a soft sensor model to predict the temperature of rotary kiln calcining zone. Due to the complex mechanism of pellet roasting, strong coupling, and nonlinear characteristics, conventional mechanism modeling and regression analysis methods are difficult to establish an accurate temperature measurement model. Intelligent modeling methods such as neural network, support vector machine and rough set are effective methods to solve the problem of soft measurement of key process variables in complex nonlinear systems. For soft sensor of calcining zone temperature of rotary kiln, literature [1] established a soft sensor model of calcining zone temperature of rotary kiln by using an improved limit learning machine. Literature [2] adopted a soft sensor model of calcining zone temperature of rotary kiln based on multi-model fusion technology based on least square support vector machine, and optimized the model structure with PSO algorithm. Literature [3] used t-s fuzzy neural network and model transfer method to establish a soft sensor model of calcining zone temperature of rotary kiln. Support Vector machine (SVR) is an effective tool for nonlinear modeling of complex systems. Currently, SVR algorithm has been widely used in the research field of soft sensing. Literature [4] used Gaussian SVR and cat mapping prediction, cloud model, and hybrid particle swarm optimization algorithm to establish the urban traffic flow prediction model, achieving better prediction effect than the SVR prediction method alone. Literature [5] established a soft sensor model of ethylene polymerization process by using PCA method. First, PCA method was used to reduce the dimension of sample data, and then particle swarm optimization algorithm was used to optimize the parameters of the SVR model. Literature [6] studies a time-dependent regression algorithm for online support vector machines (SVM), which overcomes the time-varying characteristics of the object. Simulation and industrial applications show that it has good accuracy. Literature [7] studied an evolutionary fuzzy SVR soft sensor model and successfully applied it to the prediction of welding residual stress. Soft sensor modeling is essentially a data-driven modeling method. Data preprocessing and model parameter selection will affect the model accuracy. The SVR algorithm has been improved and the prediction accuracy has been improved in the above literature; however, the data preprocessing and the model optimization process have not been combined, so the model accuracy still has some room for improvement. This paper proposes an Isomap-SVR soft sensing model based on improved bat algorithm optimization and applies the soft sensor model to the prediction of rotary kiln calcination zone temperature. The model uses Isomap method to reduce the dimension of the sample data. The parameter K of the Isomap and the structure of SVR model are joint optimized using an improved bat algorithm. The simulation results verify the effectiveness of the proposed method.

2. Pellet Production Process and Soft Sensor Model

2.1. Pellet Production Process

Pellet production equipment is generally composed of grate, rotary kiln [8] and ring cooler. The pellets with diameters of 9~16 mm obtained in the pelleting process were preheated in the grate and then entered the rotary kiln from the kiln tail. The ball will move towards the kiln head with the rotation of the rotary kiln. The calcination flame is injected from the kiln head to the kiln tail, and the raw ball is solidified by the roasting of the high temperature flame and the action of the heat radiation in the kiln [9]. After calcination, the pellets enter the ring cooler from the kiln head for cooling, and the hot smoke generated by the ring cooler returns to the grate as a heat source for preheating the raw pellets. In normal operation of rotary kiln, the temperature of calcination belt should be controlled at 1250 °C, to ensure the quality of pellets and avoid the damage of the kiln body. The temperature of rotary kiln calcination zone is difficult to be measured stably. Currently, the fuel quantity and other operating parameters of the system are generally adjusted by manual fire observation. As a result, the product quality is greatly affected by human factors, and the mass of finished pellet [10] fluctuates greatly.

2.2. Soft Sensor Model Structure

The soft sensor method is an effective solution to the problem of temperature prediction of rotary kiln calcination zone [11]. In this paper, based on the mechanism of rotary kiln process characteristics and heat balance [12], we select 13 process variable related to the rotary kiln calcination zone temperature which are easily detected as the soft sensor input. They are coal injection amount, chain grate machine material thickness, the chain grate machine preheating section of the hood I temperature, chain grate machine preheating section II hood temperature, kiln head temperature and temperature of preheater, ring I period of air temperature, cold machine ring cooler II period of air temperature, drum cover specific temperature, convulsions hood temperature, cold chain grate machine speed, rotating speed of rotary kiln and ring pattern in speed. The output of the soft sensor model is the temperature of calcination zone, and the temperature signal obtained when the slip-ring thermocouple temperature transmitter works steadily. The lower the data dimension, the simpler the model structure, in order to simplify the model structure and realize the joint optimization of parameters K of the Isomap algorithm and the structure SVR model, we have designed the model structure as shown in Figure 1.

3. Data Dimension Reduction Processing Based on Isomap

Compared with traditional linear dimension reduction methods such as PCA [13] and MDS [14], Isomap is a globally optimized nonlinear dimension reduction algorithm. It replaces the Euclidean distance by geodesic distance, and extracts hidden nonlinear manifolds from high-dimensional data while retaining the inherent geometric characteristics of data. It is easier to achieve nonlinear reduction of high-dimensional data [15,16]. The implementation steps of Isomap [16] algorithm are as follows:
Step 1: For input sample X = { x i } i = 1 S , x i R p , p and S are dimension and rows of sample X, respectively. Set the neighborhood parameter K, Constructing k -Neighborhood Graph G . Calculate the Euclidean distance between each sample point and the remaining sample points D i j E ( i j ) , if x j is one of the closet to k points of x i , E i j is an edge of G and the length is D i j E , finally the neighborhood weighting graph G is obtained.
Step 2: Calculating Geodetic Distance Matrix DM. The geodesic distance on a manifold is approximated by the shortest distance between the points, Obtain the geodetic distance matrix DM = DG, the shortest distance D i j G can be obtained by Floyd iterative algorithm [17,18].
Step 3: Construct q dimension embedding. Use MDS Method to Find Transform Matrix τ G .
τ G = H S H 2 = H ( ( D i j M ) 2 ) H 2
where:
H = ( h i j ) = { 1 1 / S , i = j 1 / S , i j
The eigenvalues of τ G are sorted in descending order. If the matrix of the eigenvectors corresponding to the previous q eigenvalues is U , the q dimension embedding result of the output is as follows:
T H = d i a g ( λ 1 1 / 2 , λ 2 1 / 2 , ,   λ q 1 / 2 ) U T
In the Isomap algorithm, the neighborhood parameter K determines the result of dimensionality reduction, and then affects the accuracy of the soft sensor model. The value of K must be selected reasonably.

4. SVR Soft Sensor Modeling Optimized by Improved Bat Algorithm

4.1. SVR Algorithm

The core idea of Support Vector Machine Regression (SVR) [19] for nonlinear prediction is to find the optimal hyperplane so that the distance between sample data and the plane is the shortest. For the nonlinear sample set { x i , y i } i = 1 N (yi is the output of xi, N is the number of samples). SVR solves the nonlinear relationship between x i and y i by mapping input vector x i into high-dimensional feature space through nonlinear mapping ϕ ( ) and linear regression [20]. Its high-dimensional linear regression function is:
f ( x ) = ω T ϕ ( x ) + b
ω is a high-dimensional weight vector, b is offset. If the penalty coefficient C is introduced, the relaxation factors ξ i and ξ i * , and the insensitive parameters ε , ω and b can be obtained by minimizing the objective function:
m i n J = 1 2 ω 2 + C i = 1 N ( ξ i + ξ i * )
s . t . { y i ω T ϕ ( x ) b ε + ξ i * ω T ϕ ( x ) + b y i ε + ξ i ξ i * 0 , ξ i 0
The Lagrange multiplier is introduced to solve the quadratic programming problem with inequality constraints, Available:
f ( x ) = i = 1 N ( α i * α i ) K ( x i , x j ) + b
In the formula: α i and α i are Lagrangian coefficients obtained by Lagrange multiplier [21] method, K ( x i , x j ) is a nonlinear kernel function, In this paper, the Gauss function [22] is chosen as the kernel function:
K ( x i , x j ) = e x p ( x i x j 2 2 δ 2 )
The main parameters affecting the accuracy of SVR model are penalty coefficient C and kernel function width δ .

4.2. Bat Algorithm and Its Improvement

4.2.1. Bat Algorithm

Bat Algorithm (BA) is a new intelligent optimization algorithm proposed by Yang in 2010 to simulate the bat echolocation behavior. It has been successfully applied in many function optimization problems [23]. For the optimization problem that the solution variable is X = ( x 1 , x 2 , , x d ) T and the objective function is f (X). The implementation steps of the BA algorithm are as follows:
Step 1: Initial population number M, maximum pulse loudness A0, maximum pulse frequency R0, position moving range and initial velocity V0 of each bat, search pulse frequency range [fmin, fmax], loudness attenuation factor α , frequency enhancement factor γ , maximum iteration number T and search precision ε of the algorithm. The initial position vector { X i 0 } i = 1 M of each bat is randomly determined. Set the current iterations t = 1.
Step 2: Calculate the current optimal solution vector X * t according to the fitness function. Update the search pulse frequency, speed, and position of each bat. The update formulas are as follows:
f i = f min + ( f max f min ) β i
V i t = V i t 1 + [ X i t X * t ] f i
X i t = X i t 1 + X i t
where β is a M dimensional random vector uniformly distributed on [0, 1], fi is an acoustic frequency.
Step 3: Generate a random parameters Rrand between [0, 1]. For each bat, if Rrand > Ri, performs a local search, and X i t performs a random perturbation to generate a new solution:
n e w X i t = X * t + η A t
where: η is a M -dimensional random vector uniformly distributed on [−1, 1], A t is the average loudness of the current bat population.
Step 4: Generate a random parameters Arand between [0, 1]. If Arand < Ai, and f ( n e w X i t ) < f ( X * t ) , accept the new solution n e w X i t , then update R i t and A i t according to the following formula:
A i t + 1 = α A i t
R i t + 1 = R i t [ 1 exp ( γ t ) ]
where: α is the loudness attenuation coefficient, γ is the frequency increase coefficient.
Step 5: If the minimum fitness meets the optimization requirement or the number of iterations is greater than T , the optimal fitness value and the optimal solution are output. Otherwise t = t + 1, and return to Step 2.
From the perspective of the algorithm itself, the basic BA achieves position update through speed update. There is no effective mechanism to escape from the local extremum. The algorithm is easy to premature and the search accuracy is poor [24,25,26].

4.2.2. Lévy Flight Strategy

To solve the shortcomings of the basic BA, this paper first introduces Lévy flight mechanism to improve the speed update formula of the basic BA. The 3D figure of Lévy flight process is shown in Figure 2.
From Figure 2, it can be observed that frequently small steps and occasional large step occur alternately during the process of Lévy flight, which will help the algorithm jump out of local minima.
Formula (15) is a new velocity update formula instead of Formula (10).
{ V i t = V i t 1 + [ X i t ( 1 c ) X * t c X b t ] f i κ κ = μ s i g n ( r a n d 0.5 ) L e v y
where X b t is the current optimal value and X * t is the global optimal value. c and μ are random parameters between [0, 1], s i g n ( ) is a symbol function, symbol is point multiplication, and random step length Lévy is from Lévy distribution:
L e v y ~ u = t λ ( 1 < λ 3 )
Formula (15) takes the optimal value of the current generation as one of the parameters of speed update, which can effectively reduce the attraction intensity of bats to the global optimal value. At the same time, the Lévy flight mechanism can effectively avoid the premature of the algorithm.

4.2.3. Cauchy Mutation Strategy

Secondly, there is no mutation mechanism in BA. At the later stage of search, almost all individuals will gather around the optimal solution. If this solution is local optimal solution, the algorithm will fall into local minimum. In this paper, adaptive mutation mechanism is introduced to avoid premature.
The specific method is that if the fitness value does not change within K (K = 3) generation, it means that the algorithm falls into local optimum, and then produces a random number ω r a n d between [0, 1], If ω r a n d < p t (Cauchy mutation probability), the individual bat carries out Cauchy mutation according to the formula (17).
X i = X i + X i × C ( 0 , 1 )
The C ( 0 , 1 ) in the formula is the standard Cauchy distribution. Since the Cauchy distribution is more prone to generate random numbers far from the origin than the Gaussian distribution, the range of mutation is larger, and it is easier to jump out of the local optimum.
The Cauchy mutation probability is:
P t = 0.3 1 ( T t T ) 2
The probability of mutation increases as the increase of iterations t, which is more conducive to overcoming the local optimum.
Finally, to overcome the shortcomings of poor local search accuracy of BA, a variable step size local search strategy is proposed. Formula (12) is modified to:
n e w X i n + ( T t T ) 2 η A t
where T is the max iterations of the algorithm, and t is the current iterations. As the increase of iterations, the step length of local search will be smaller and smaller, and the precision of local search will be improved continuously. In this paper, the improved bat algorithm is named IBA.
The proposed IBA is evaluated on 6 typical test functions which listed in Table 1. It compared with two classical optimization algorithm (i.e., BA and Particle swarm optimization algorithm (PSO) [27]), and two other recently improved BAs (i.e., EBA [28] and dBA [29]).
The functions are divided into three classes, f1 and f2 are unimodal functions, f3 to f4 are multimodal functions, f5 and f6 are rotated and shifted functions. The corresponding dimensions D, range, global minimum values fopt of the functions are also listed in Table 1.
The parameters settings of the algorithms used in the comparisons are listed in Table 2.
To make a fair comparison, all algorithms were tested using the same population size M = 30 and the same maximum number of iteration T = 500. For each trail, each algorithm was run 30 times independently on each test function. The convergence comparisons of all algorithms are graphically shown in Figure 3.
It can be seen from Figure 3 that the convergence speed and accuracy of the IBA algorithm are significantly better than that of BA, PSO, EBA, and dBA algorithm on f1 to f5. IBA has satisfactory performance on f6, and only loses in dBA algorithm. It indicates that the overall performance of IBA is much better than other algorithms.

4.3. Soft Sensor Model Optimization Based on IBA Algorithm

As mentioned above, parameter K of the Isomap algorithm, penalty coefficient C and kernel function width δ of the SVR model determines the performance of the soft sensor model. In this paper, the parameters K, C and δ are of the proposed soft sensor model are obtained by the IBA. The optimization process is as follows:
Step 1: Initialize the parameters of the BA, randomly generate the initial position x i 0 = { K i 0 , C i 0 , δ i 0 } of each bat, use the initial position of each bat as the parameter of the soft sensor model, apply the training data to train the SVR model, and calculate the fitness value. To ensure the robustness and fitting ability of the model and avoid overlearning, we select the determination coefficient R2 and 5-fold cross verification accuracy Q2cv5 as fitness function, namely:
f i t n e s s = 1 R 2 Q 2 c v 5
where R 2 = 1 i = 1 L ( y ( i ) y ( i ) ) 2 i = 1 L ( y ( i ) y ¯ ) 2 , Q c v 5 2 = 1 i = 1 L ( y c v 5 ( i ) y c v 5 ( i ) ) 2 i = 1 L ( y c v 5 ( i ) y ¯ ) 2 L is the number of training samples.   y ( i ) , y ^ i and y - are the measured values, predicted values and average values of the measured values respectively.   y c v 5 ( i ) ,   y ^ c v 5 ( i ) and y - are the mean values of the measured values of the cross validation set, the predicted value and the measured values of the training set respectively.
Step 2: Enter the BA iterative search process. An optimized search of the bat’s speed and position is based on the IBA.
Step 3: Termination condition judgment: If the number of iterations is greater than the specified maximum number of iterations or the fitness value meets the requirements, the algorithm ends and outputs the optimal bat position (the optimal parameters K, C and δ). Otherwise return to Step 2 to continue the search. Figure 4 shows the overall implementation flow chart of the algorithm.

5. Simulation Analysis

To verify the effectiveness of the proposed method, we collected the production data of a 2 million ton/year pellet production line. First, we use 3δ criterion to eliminate [30] the anomaly data, and then standardize them [31]. Finally, we obtain 500 sets of modeling data.
(1) Simulation process and result in an experiment
a. Modeling dataset classification
To ensure the fairness of the model, the training data space is required to cover the testing data space as much as possible. Therefore, we use SOM neural network with clustering function [32] to divide the sample data set. First, a SOM neural network is established, the SOM neural network has 13 inputs and 16 hidden layer nodes. After 300 times of iterative training, the classification results of SOM network are shown in Figure 5.
Then, we randomly select 80% of the data in each hidden node of SOM neural network as model training data and the rest as model test data.
Figure 6 shows the distribution of training data, test data, and modeling data using SOM classification method in an experiment.
It can be seen from Figure 5 that the space of training data basically covers that of the test data.
b. Joint Optimization of Soft Sensor Models
Parameter K of the Isomap algorithm, penalty coefficient C and kernel function width δ of the SVR model determines the performance of the soft sensor model. When SVR model is trained, the allowable error of the model ε = 1.25 (that is, the values can satisfy R2 and Q2cv5 are both greater than 0.8). When using BA to optimize parameters of Isomap and SVR, the range of K is [1, 100], the range of C is [1, 100], and that of δ is [1, 100]. The initial parameters of the BA are: Bat population size M = 30, algorithm maximum search times N = 100, loudness attenuation coefficient α = 0.95 , search frequency enhancement coefficient γ = 0.95 , search frequency range [−2, 2], bat speed range [−5, 5], bat individual position range [1, 100]. When optimizing the model, we select variables whose standard deviation of output variables of Isomap algorithm is greater than 0.05 as SVR model inputs.
After optimization, we get the following results: The best fitness value is 1.34, model fitting accuracy index R2 = 0.887 and model robustness index Q2cv5 = 0.841. (it is generally believed that R2 > 0.7 and Q2cv5 > 0.7 can establish a robust and reliable soft measurement model). K = 28, C = 76.235, δ = 2.014.
c. Result in this experiment
Figure 7 and Figure 8 respectively show the predicted value and prediction error curves of the calcination zone temperatures with the BA and IBA algorithm proposed in this paper.
It can be seen from Figure 7 and Figure 8 that the prediction accuracy of the proposed algorithm is significantly higher than that of the SVR model optimized by the basic Bat algorithm. The temperature prediction error of proposed algorithm is basically distributed in [−22.5 C, 22.5 C]. In production, the measuring range of thermocouple is 0~1500 °C, and the accuracy level is 1.5, so the maximum measurement error is 22.5. For this experiment, the prediction error of the proposed algorithm basically meets the actual measurement requirements.
(2) Statistical analysis
a. Compared with other algorithms
To verify the advantages of the proposed algorithm, we compared it with other algorithms (Each algorithm running 30 times independently, and SOM neural network is used to divide the sample data into training sample and test sample for each run), and the results are shown in Table 3.
In Table 3, R a A D < 22.5   ° C and R a A D < 37.5   ° C represent the proportion of test samples with absolute deviations less than 22.75 °C (Meet the demand of instrument with accuracy class of 1.5) and 37.5 °C (Meet the index of instrument with accuracy class of 2.5) in 30 tests; R2 represents the fitting ability of the model. The larger is R2, the stronger learning ability of the model to the training sample. Min_R2, Max_R2 and Mean_R2, represent the maximum, minimum, and average values of R2 of each algorithm in 30 experiments, respectively. Q2CV5 represents the robustness of the model. The larger is Q2CV5, the better robustness of the model. Q2ext represents the prediction ability of the model for independent external test samples, and the value range is [0, 1]. The larger the is Q2ext, the stronger external prediction ability of the model. The formula of Q2ext is:
Q e x t 2 = 1 i = 1 V ( y ( i ) y ( i ) ) 2 i = 1 V ( y ( i ) y ¯ ) 2
where V is the number of test samples; y ( i ) is the actual output of test samples, y ^ ( i ) is the model predictive output of test samples; y ¯ is the average output of training samples. Min_Q2ext, Max_Q2ext and Mean_Q2ext, represent the maximum, minimum, and average values of Q2ext of each algorithm in 30 experiments, respectively.
From the statistical results in Table 1, we can draw the following conclusions:
(1)
For Isomap data segmentation method, the value of R2, Q2CV5 and Q2ext of the IBA-SVR algorithm proposed in this paper are better than those of the comparison algorithm. Therefore, the optimization performance of IBA algorithm for SVR model is better than that of other comparison algorithms.
(2)
By comparing the dimensionality reduction methods of Isomap and PCA data under IBA-SVR model, we can see that the model performance of dimensionality reduction using Isomap algorithm is better.
(3)
The joint to optimization of Isomap and SVR model using IBA algorithm effectively improves the prediction accuracy of the model. 98.6% of the prediction results meet the accuracy requirements of level 1.5 instruments, and 97.7% of the prediction results meet the accuracy requirements of level 2.5 instruments.
b. Comparison of Data Segmentation Methods
To prove the superiority of SOM neural network in segmenting sample data, we compared it with the method of randomly segmenting under the proposed Isomap-SVR model. We have carried out 30 experiments, and the experimental results are shown in Table 4.
From the statistical results in Table 4, we can draw the following conclusions:
(1)
Considering the fitting ability, different data segmentation methods have little influence on the fitting ability of the model.
(2)
Considering the robustness of the model, the model established by the method of randomly segmented data fluctuates more than that established by the method of SOM neural network.
(3)
Considering the external prediction ability of the model, the external prediction ability of the model established by the method of SOM neural network segmentation data is more stable.
Therefore, the SOM neural network data segmentation method is more suitable to build a stable soft sensor model of rotary kiln temperature.

6. Conclusions

In this paper, a novel Isomap-SVR soft sensor modeling method is presented and the calcination zone temperature of the rotary kiln is chosen for simulation. The sample data of rotary kiln system are divided into training data and test data by SOM neural network, which ensures the fairness of modeling data. An IBA is studied, and its advantages are verified by a set of representative test functions. It is used to jointly optimize parameters of Isomap and SVR models to ensure the rationality of parameters of the soft sensor model. The simulation results show that the proposed algorithm has the advantages of good fitting ability, strong robustness, and generalization ability compared with the comparison algorithms. The algorithm has a good application prospect. Applying the algorithm to the prediction of the calcination zone temperature of the rotary kiln can obtain a higher accuracy, which has an important guiding significance for the safe production and optimal operation of the pellet production process.

Author Contributions

All authors contributed equally to the manuscript. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Boateng, A.A.; Barr, P.V. A Thermal-Model for the Rotary Kiln Including Heat-Transfer within the Bed. Int. J. Heat Mass Transf. 1996, 39, 2131–2147. [Google Scholar] [CrossRef]
  2. Tian, Z.; Li, S.; Wang, Y.; Wang, X. A multi-model fusion soft sensor modelling method and its application in rotary kiln calcination zone temperature prediction. Trans. Inst. Meas. Control. 2015, 38, 110–124. [Google Scholar]
  3. Zhang, L.; Gao, X.W.; Wang, J.S.; Zhao, J. Soft-Sensing for Calcining Zone Temperature in Rotary Kiln Based on Model Migration. J. Northeast. Univ. 2011, 32, 175–178. [Google Scholar]
  4. Li, M.W.; Hong, W.C.; Kang, H.G. Urban traffic flow forecasting using Gauss–SVR with cat mapping, cloud model and PSO hybrid algorithm. Neurocomputing 2013, 99, 230–240. [Google Scholar] [CrossRef]
  5. Shi, X.; Chi, Q.; Fei, Z.; Liang, J. Soft-Sensing Research on Ethylene Polymerization Based on PCA-SVR Algorithm. Asian J. Chem. 2013, 25, 4957–4961. [Google Scholar] [CrossRef]
  6. Kaneko, H.; Funatsu, K. Application of online support vector regression for soft sensors. AIChE J. 2014, 60, 600–612. [Google Scholar] [CrossRef]
  7. Edwin, R.D.J.; Kumanan, S. Evolutionary fuzzy SVR modeling of weld residual stress. Appl. Soft Comput. 2016, 42, 423–430. [Google Scholar] [CrossRef]
  8. Hou, Y.; Wei, S. Method for Mass Production of Phosphoric Acid with Rotary Kiln. U.S. Patent 10,005,669, 26 June 2018. [Google Scholar]
  9. Phummiphan, I.; Horpibulsuk, S.; Rachan, R.; Arulrajah, A.; Shen, S.-L.; Chindaprasirt, P. High calcium fly ash geopolymer stabilized lateritic soil and granulated blast furnace slag blends as a pavement base material. J. Hazard. Mater. 2018, 341, 257–267. [Google Scholar] [CrossRef]
  10. Konrád, K.; Viharos, Z.J.; Németh, G. Evaluation, ranking and positioning of measurement methods for pellet production. Measurement 2018, 124, 568–574. [Google Scholar] [CrossRef] [Green Version]
  11. Tian, Z.; Li, S.; Wang, Y.; Wang, X. SVM predictive control for calcination zone temperature in lime rotary kiln with improved PSO algorithm. Trans. Inst. Meas. Control. 2017, 40, 3134–3146. [Google Scholar]
  12. Yin, Q.; Du, W.-J.; Ji, X.-L.; Cheng, L. Optimization design and economic analyses of heat recovery exchangers on rotary kilns. Appl. Energy 2016, 180, 743–756. [Google Scholar] [CrossRef]
  13. Kim, K.I.; Jung, K.; Kim, H.J. Face recognition using kernel principal component analysis. IEEE Signal Process. Lett. 2002, 9, 40–42. [Google Scholar]
  14. Bengio, Y.; Paiement, J.; Vincent, P.; Delalleau, O.; Roux, N.; Ouimet, M. Out-of-sample extensions for lle, isomap, mds, eigenmaps, and spectral clustering. In Advances in Neural Information Processing Systems; 2004; pp. 177–184. Available online: https://dl.acm.org/doi/10.5555/2981345.2981368 (accessed on 12 December 2019).
  15. Hannachi, A.; Turner, A.G. Isomap nonlinear dimensionality reduction and bimodality of Asian monsoon convection. Geophys. Res. Lett. 2013, 40, 1653–1658. [Google Scholar] [CrossRef] [Green Version]
  16. Hannachi, A.; Turner, A. Monsoon convection dynamics and nonlinear dimensionality reduction vis Isomap. In Proceedings of the EGU General Assembly Conference, Vienna, Austria, 22–27 April 2012; EGU General Assembly Conference Abstracts. p. 8534. [Google Scholar]
  17. Jing, L.; Shao, C. Selection of the Suitable Parameter Value for Isomap. J. Softw. 2011, 6, 1034–1041. [Google Scholar] [CrossRef]
  18. Orsenigo, C.; Vercellis, C. Linear versus nonlinear dimensionality reduction for banks’ credit rating prediction. Knowl. Based Syst. 2013, 47, 14–22. [Google Scholar] [CrossRef]
  19. Smola, A.J.; Schölkopf, B. A tutorial on support vector regression. Stat. Comput. 2004, 14, 199–222. [Google Scholar] [CrossRef] [Green Version]
  20. Sammon, J.W. A nonlinear mapping for data structure analysis. IEEE Trans. Comput. 1969, 100, 401–409. [Google Scholar] [CrossRef]
  21. Bertsekas, D.P. Constrained Optimization and Lagrange Multiplier Methods; Academic Press: Cambridge, MA, USA, 2014. [Google Scholar]
  22. Golub, G.H.; Welsch, J.H. Calculation of Gauss Quadrature Rules. Math. Comput. 1969, 23, 221–230. [Google Scholar] [CrossRef]
  23. Yang, X.S. A New Metaheuristic Bat-Inspired Algorithm. Comput. Knowl. Technol. 2010, 284, 65–74. [Google Scholar]
  24. Subsequently. A Novel Hybrid Bat Algorithm with Harmony Search for Global Numerical Optimization. J. Appl. Math. 2013, 2013, 233–256. [Google Scholar]
  25. Yang, X.S.; Deb, S. Cuckoo Search via Lévy Flights. In Proceedings of the World Congress on Nature & Biologically Inspired Computing (NaBIC), Coimbatore, India, 9–11 December 2009; IEEE: Piscataway, NJ, USA, 2010; pp. 210–214. [Google Scholar]
  26. Wang, G.-G.; Gandomi, A.H.; Zhao, X.; Chu, H.C.E. Hybridizing harmony search algorithm with cuckoo search for global numerical optimization. Soft Comput. 2014, 20, 273–285. [Google Scholar] [CrossRef]
  27. Wang, Y.K.; Chen, X.B. Improved multi-area search and asymptotic convergence PSO algorithm with independent local search mechanism. Kongzhi Yu Juece/Control Decis. 2018, 33, 1382–1390. [Google Scholar]
  28. Ghanem, W.A.H.M.; Jantan, A. An enhanced Bat algorithm with mutation operator for numerical optimization problems. Neural Comput. Appl. 2019, 31, 617–651. [Google Scholar] [CrossRef]
  29. Chakri, A.; Khelif, R.; Benouaret, M.; Yang, X.-S. New directional bat algorithm for continuous optimization problems. Expert Syst. Appl. 2017, 69, 159–175. [Google Scholar] [CrossRef] [Green Version]
  30. Shen, X.; Fu, X.; Zhou, C. A combined algorithm for cleaning abnormal data of wind turbine power curve based on change point grouping algorithm and quartile algorithm. IEEE Trans. Sustain. Energy 2018, 10, 46–54. [Google Scholar] [CrossRef]
  31. Gupta, S.; Perlman, R.M.; Lynch, T.W.; McMinn, B.D. Normalizing Pipelined Floating Point Processing Unit. U.S. Patent 5,058,048, 15 October 1991. [Google Scholar]
  32. Pedrycz, W. Conditional fuzzy clustering in the design of radial basis function neural networks. IEEE Trans. Neural Netw. 1998, 9, 601–612. [Google Scholar] [CrossRef]
Figure 1. Soft sensor model structure.
Figure 1. Soft sensor model structure.
Symmetry 12 00167 g001
Figure 2. 3D figure of Lévy flight.
Figure 2. 3D figure of Lévy flight.
Symmetry 12 00167 g002
Figure 3. The convergence comparisons of all algorithms. (a) Convergence Curve of sphere Function (f1) (b) Convergence Curve of Schwefel 2.22 Function (f2) (c) Convergence Curve of Ackley Function (f3) (d) Convergence Curve of Griewank Function (f4) (e) Convergence Curve of Shifted Sum Square Function (f5) (f) Convergence Curve of Rotated Griewank Function (f6).
Figure 3. The convergence comparisons of all algorithms. (a) Convergence Curve of sphere Function (f1) (b) Convergence Curve of Schwefel 2.22 Function (f2) (c) Convergence Curve of Ackley Function (f3) (d) Convergence Curve of Griewank Function (f4) (e) Convergence Curve of Shifted Sum Square Function (f5) (f) Convergence Curve of Rotated Griewank Function (f6).
Symmetry 12 00167 g003aSymmetry 12 00167 g003b
Figure 4. Algorithm flow chart.
Figure 4. Algorithm flow chart.
Symmetry 12 00167 g004
Figure 5. SOM neural network classification results.
Figure 5. SOM neural network classification results.
Symmetry 12 00167 g005
Figure 6. Distribution of sample data, training data, and test data in an experiment.
Figure 6. Distribution of sample data, training data, and test data in an experiment.
Symmetry 12 00167 g006
Figure 7. Model Prediction Output Contrast Diagram.
Figure 7. Model Prediction Output Contrast Diagram.
Symmetry 12 00167 g007
Figure 8. Prediction error comparison chart.
Figure 8. Prediction error comparison chart.
Symmetry 12 00167 g008
Table 1. Benchmark functions.
Table 1. Benchmark functions.
NameFunctionDRangefopt
Shpere f 1 ( x ) = i = 1 D x i 2 30[−10,10]D0
Schwefel 2.22 f 2 ( x ) = i = 1 D | x i | + i = 1 D | x i | 30[−10,10]D0
Ackley f 3 ( x ) = 20 exp ( 0.2 1 / D i = 1 D x i 2 ) exp ( 1 D i = 1 D cos ( 2 π x i ) ) + 20 + e 30[−32,32]D0
Griewank f 4 ( x ) = 1 / 4000 i = 1 D x i 2 i = 1 D cos ( x i / i ) + 1 30[−600,600]D0
Shifted Sum Square f 5 ( x ) = i = 1 D i ( x i i ) 2 30[−100,100]D0
Rotated Griewank f 6 ( x ) = 1 / 4000 i = 1 D y i 2 i = 1 D cos ( y i / i ) + 1 , w h e r e y = M x   M   is   an   orthogonal   matrix 30[−600,600]D0
Table 2. Parameters settings of the algorithms used in the comparisons.
Table 2. Parameters settings of the algorithms used in the comparisons.
AlgorithmReferenceParameters
BARef. [23] α = 0.95 , γ = 0.95 , f min = 2 , f max = 2
PSORef. [27] c 1 = 2 , c 2 = 2 , ω max = 1.0 , ω min = 0.3
EBARef. [28] ξ i n i t = 0.6 , n = 3
dBARef. [29] r 0 = 0.1 , r = 0.7 , A 0 = 0.9 , A = 0.6
IBAPresent α = 0.95 , γ = 0.95 , f min = 2 , f max = 2
Table 3. Accuracy comparison of different modeling methods.
Table 3. Accuracy comparison of different modeling methods.
Dimensionality Reduction MethodIsomapPCA
Modeling MethodGA-SVRPSO-SVRBA-SVRIBA-SVRIBA-SVR
R a A D < 22.5   ° C 95.3%95.7%96.3%98.6%96.9%
R a A D < 37.5   ° C 98.3%98.8%98.8%99.7%99.1%
Min_R20.7940.8220.8160.8410.842
Max_R20.9110.9210.8910.9220.921
Mean_R20.8550.8530.8520.8620.859
Min_Q2CV50.7410.7570.7550.8130.786
Max_Q2CV50.8660.8390.8210.8710.857
Mean_Q2CV50.8210.8230.8290.8510.836
Min_Q2ext0.7310.8170.8220.8310.811
Max_Q2ext0.8320.8550.8690.8740.862
Mean_Q2ext0.8110.8310.8470.8510.836
Table 4. Influence of Data Segmentation Methods on Model Performance.
Table 4. Influence of Data Segmentation Methods on Model Performance.
Method of Data SegmentationRandomSOM
Training DataMin_R20.8350.841
Max_R20.9120.922
Mean_R20.8590.862
Min_Q2CV50.7530.813
Max_Q2CV50.8910.871
Mean_Q2CV50.8210.851
Test DataMin_Q2ext0.7410.831
Max_Q2ext0.8960.874
Mean_Q2ext0.8160.851

Share and Cite

MDPI and ACS Style

Liu, J.; Wang, Y.; Zhang, Y. A Novel Isomap-SVR Soft Sensor Model and Its Application in Rotary Kiln Calcination Zone Temperature Prediction. Symmetry 2020, 12, 167. https://doi.org/10.3390/sym12010167

AMA Style

Liu J, Wang Y, Zhang Y. A Novel Isomap-SVR Soft Sensor Model and Its Application in Rotary Kiln Calcination Zone Temperature Prediction. Symmetry. 2020; 12(1):167. https://doi.org/10.3390/sym12010167

Chicago/Turabian Style

Liu, Jialun, Yukun Wang, and Yong Zhang. 2020. "A Novel Isomap-SVR Soft Sensor Model and Its Application in Rotary Kiln Calcination Zone Temperature Prediction" Symmetry 12, no. 1: 167. https://doi.org/10.3390/sym12010167

APA Style

Liu, J., Wang, Y., & Zhang, Y. (2020). A Novel Isomap-SVR Soft Sensor Model and Its Application in Rotary Kiln Calcination Zone Temperature Prediction. Symmetry, 12(1), 167. https://doi.org/10.3390/sym12010167

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop