Next Article in Journal
Thermal Improvement in Pseudo-Plastic Material Using Ternary Hybrid Nanoparticles via Non-Fourier’s Law over Porous Heated Surface
Next Article in Special Issue
A Smart Building Resource Prediction, Navigation and Management System Supported by Radio Tomography and Computational Intelligence
Previous Article in Journal
Advanced Perspectives for Modeling Simulation and Control of Power Electronic Systems
Previous Article in Special Issue
Application of Electrical Tomography Imaging Using Machine Learning Methods for the Monitoring of Flood Embankments Leaks
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Logistic Regression with Wave Preprocessing to Solve Inverse Problem in Industrial Tomography for Technological Process Control

1
Research and Development Center, Netrix S.A., 20-704 Lublin, Poland
2
Faculty of Administration and Social Sciences, University of Economics and Innovation, 20-209 Lublin, Poland
3
Faculty of Management, Lublin University of Technology, 20-618 Lublin, Poland
4
Faculty of Transport and Computer Science, University of Economics and Innovation, 20-209 Lublin, Poland
*
Author to whom correspondence should be addressed.
Energies 2021, 14(23), 8116; https://doi.org/10.3390/en14238116
Submission received: 5 November 2021 / Revised: 27 November 2021 / Accepted: 1 December 2021 / Published: 3 December 2021

Abstract

:
The research presented here concerns the analysis and selection of logistic regression with wave preprocessing to solve the inverse problem in industrial tomography. The presented application includes a specialized device for tomographic measurements and dedicated algorithms for image reconstruction. The subject of the research was a model of a tank filled with tap water and specific inclusions. The research mainly targeted the study of developing and comparing models and methods for data reconstruction and analysis. The application allows choosing the appropriate method of image reconstruction, knowing the specifics of the solution. The novelty of the presented solution is the use of original machine learning algorithms to implement electrical impedance tomography. One of the features of the presented solution was the use of many individually trained subsystems, each of which produces a unique pixel of the final image. The methods were trained on data sets generated by computer simulation and based on actual laboratory measurements. Conductivity values for individual pixels are the result of the reconstruction of vector images within the tested object. By comparing the results of image reconstruction, the most efficient methods were identified.

1. Introduction

Tomography is a method of examining the interior of objects based on measurements taken at the edge of that object. It is a non-invasive method, which can be used to obtain a cross-section of the element—providing 2D images—or spatially—providing 3D images. The device for taking measurements is called a tomograph, and the image obtained from the measurements is called a tomogram. Mathematical operations and techniques called tomographic reconstruction are used to obtain the image. Different physical phenomena are used depending on the type of object under study. The carriers may be ultrasound, electron beams, electric currents or magnetic fields. Depending on the specificity of a given tomographic technique, we can observe both advantages and disadvantages in the areas of accuracy, frequency or resolution of reconstructed images. Familiarization with the characteristics of individual tomographic techniques allows for the proper selection of an image reconstruction method. Tomographic imaging offers a unique opportunity to study the complexity of a structure without interfering with the object [1,2]. There is an increasing demand for information about the behavior of the internal flows in process equipment. This information should be obtained in a non-invasive way with tomographic instrumentation. Typical measuring equipment is usually inadequate for the complicated process internal conditions, and sometimes its existence can interfere with the process. Industrial tomography is used to control measurement data. The facility to be monitored is a tomographically instrumented part of a manufacturing plant, where a device non-invasively collects data using excitatory electrical potentials on its surface. The instrument sends the raw data to a cloud computing system where an inverse problem (image reconstruction) is resolved. As a result, the state of the monitored object is classified using a machine learning algorithm. Figure 1 presents a general scheme of how the system works.
The presented solution enables tomographic sensor-based process control, Big Data analysis, multidimensional industrial process control, advanced human–machine interfaces and knowledge-based process monitoring. Sensor technology is mostly related to electrical tomography (ET) [3,4], which includes capacitive tomography (ECT) [5,6,7,8,9] and electrical resistive tomography (ERT) [10,11]. This solution allows the image to be reconstructed as the conductivity or permittivity distribution of the reservoir under study by measuring its boundary. Another method is optical coherence tomography (OCT), which is an optical technique that allows non-invasive imaging of specimens [12], and ultrasound tomography (UST) [13,14], which is a technique that uses the information included in the ultrasound signal after it has passed through the test object.
Electrical impedance tomography (EIT) is a non-destructive method for creating image reconstructions in various application areas. It is suitable for real-time visualization and the analysis of the electrical conductivity distribution inside the analyzed object [15]. EIT is now a widely used tomographic imaging technique and applies to many areas of everyday life. This technique has found applications in fields such as medical diagnostics [4], industrial process monitoring [13] and geophysical surveys [16]. Mathematical reconstruction of conductivity in EIT involves solving a nonlinear and ill-posed inverse problem from noisy data [17,18]. The current development of EIT algorithms is heavily biased towards machine learning methods [3], and for such an operation, the data must be prepared appropriately. It raises the need to check whether particular algorithms are better than classical ones and can be used. Compared to other known imaging modalities, impedance tomography has many advantages. However, EIT reconstruction can be unstable, and the disadvantage of solving a backward problem should be mentioned. Furthermore, the sensitivity of EIT solutions to measurement, numerical and model errors implies the need to adapt model parameters to specific cases. At the same time, it should be remembered that most reconstruction methods in 2D space are equally effective in 3D.
The article presents an improved method of monitoring and optimizing processes in heterogeneous tank reactors in which specific reactions occur. The method used relates to electrical tomography, and the innovation is the original way of using a hybrid module system in parallel, combining logistic regression with wavelet preprocessing. The significant difference of the presented method over other non-invasive solutions is the reliability of disturbances arising during measurements and the accuracy of imaging reconstruction. In addition, our proposed method enables the appropriate selection of wavelet preprocessing algorithms for image pixels. It results in better reconstruction quality and higher image resolution.
This paper consists of four sections. The architecture of the designed system, industrial processes and application platform is presented in Section 2. Machine learning methods used for image reconstruction, numerical models, tomographic devices and laboratory measurement systems are also discussed. The results of the research work are presented in Section 3 in the form of image reconstructions for synthetic and measured data. Section 4 contains a discussion of the results obtained. Finally, Section 5 summarizes the research work.

2. Materials and Methods

This section shows the tomographic algorithms, system architecture, industrial tomography, measurement hardware, mathematical algorithms and measurement models used to reconstruct images from real and synthetic data.
The research used the SmartEIT 1.0 (Netrix S.A., Lublin, Poland), our electrical impedance tomograph and a specially prepared tank with EIT measuring electrodes.
For preliminary analyses of numerical models, Python 3.6 (Python Software Foundation, Amsterdam, Netherlands) with NumPy, math, SciPy libraries were used. MATLAB 2020B (MathWorks, Natick, MA, USA) and EIDORS (Ver: 3.9) (Sourceforge, San Diego, CA, USA) [19] were implemented to construct the case generator and visualize the reconstructions. Using R software (The R Foundation, Vienna, Austria), structural parameters were estimated, ROC analysis was performed and the relationship between FPR and TPR was graphically represented. For this purpose, the following packages (The R Foundation, Vienna, Austria) were used: R.matlab (Ver: 3.6.2), doParallel (Ver: 1.0.15), foreach (Ver: 1.5.0), glmnet (Ver: 4.0-2), caret (Ver: 6.0-86), pRoc (Ver: 1.16.2), ggplot2 (Ver: 3.3.1) and plotROC (Ver: 2.2.1).

2.1. Novelty of the Proposed Solution

The novelty of the solution presented in this paper is the combination of logistic regression with wavelet preprocessing methods to reconstruct the output image in industrial tomography. The approach proposed by the authors consists in implementing an algorithm with multiple trained subsystems. After converting the predictors to a binary grid, image reconstruction is generated. Voltage drop measurements are used as input data.

2.2. Industrial Electrical Tomography

Industrial tomography is used to analyze the technological processes inside the studied facility [2,5]. This approach allows for better real-time process control. Data concentration profiles, phases and chemicals can be studied using fast data acquisition and image reconstruction. The resulting data can be used to monitor process response, improve quality, yield and flow rate. The imaging technique presented here exploits the respective electrical properties of various kinds of substances. Electrical tomography can be divided into impedance tomography and capacitive tomography for dielectric systems. In this method, a current or voltage source is connected to the test object, the voltage distribution at the edge of the test object is measured using a measurement system. An image reconstruction algorithm processes the data collected from the above measurements. The reconstructed image is called a tomogram. It is worth noting that tomography is characterized by low image resolution. This has to do with the number of measurements, which is limited by the nonlinear current flow through the tested element but is also caused by the low sensitivity of the measured voltage waveforms, which depends on the conductivity changes inside the area.

2.3. Measuring Device

The device’s design is based on the idea of electrical tomography, which is based on the non-invasive measurement of voltage drops from electrodes on the tested object (Figure 2). Based on measurements of voltages on electrodes directly adjacent to a given medium, it is possible to determine impedance’s spatial distribution and thus visualize its internal structure. Due to the built-in microcomputer, it is possible to perform EIT measurements and view the reconstructions created on their basis. In addition, the device has a network interface that allows data transfer to an external server. The tomograph measures voltages by switching channels according to the polar method. First, EXC and GND outputs are connected to two opposite electrodes using multiplexers. The intensity of current flow is programmed to a set value. Then, the signal input is connected successively to the remaining electrodes, on which the voltage is measured to the GND electrode. After completing measurements, the measuring information is disconnected, the forcing electrodes are switched to the next pair and the cycle is repeated.
Raspberry Pi sends and receives data from the measurement module using the SPI interface; Raspberry acts as Master by default, module as Slave. On receiving the command to start the sequence—the module starts measuring using the opposite method. Electrodes A and B force the flow of the alternating current of a sinusoidal waveform, where electrode A is connected via a multiplexer to the circuit of current intensity regulation, and electrode B is connected to GND of the circuit. The voltage is measured at successive electrodes to GND (Figure 3).

2.4. Measurement System

The measurement system consists of a sensor tank; devices with a model for data transmission, collection and analysis are connected to a communication interface whose task is to read the signal from the selected sensor, process it into a coherent form and then send the read and processed data to the acquisition module (Figure 4). For this solution, an application was prepared with an algorithm for image reconstruction, which, using learning data obtained by computer simulation from real models, was trained to solve the inverse problem. Conductivity values of the individual pixels of the output vector allow the obtaining of images of the interior of the studied objects.

2.5. Algorithms and Methods

This section presents the descriptions of the used algorithms. Industrial tomography also belongs to electromagnetic field inverse problems. An inverse problem is an optimization, identification or synthesis process where parameters are determined by domain-specific information. Such problems do not have straightforward solutions and are ill-conditioned. Finite element methods solved the forward problem.
There are many optimization methods, using both deterministic and statistical algorithms [20,21,22,23,24,25,26,27]. Machine learning is a group of methods that is gaining increasing popularity in various types of tomography, including EIT. Applying the above methods requires the 2D cross-section of the test object to be divided into pixels by the finite element method. Typically, a single algorithm converts a set of measurements into the pixels that make up a tomographic image. It can also train separate models to convert measurements to a single image pixel. It then needs to train as many models as the resolution of the tomographic image. It was the approach taken in the research presented here.
For logistic regression, the implementation probability of the output variable is calculated relative to the corresponding category, where the inclusion probability is estimated [28,29,30,31,32,33]. Thus, the implementation of logistic regression enables the resolution of the imaging domain to be determined. When creating a reconstruction for EIT, we must estimate conductivity for each finite element. In the presented case, we calculate the probability that finite elements belong to inclusion. For this purpose, we define a logistic regression model [28] for each finite element. Thus, the reconstruction based on logistic regression must be defined as a set of logistic regressions corresponding to finite elements.
For each finite element, we define a learning set D = { ( x i , y i ) : x i m ,   y i { 0 , 1 } ,   1 i n } , where the class membership is represented as y i { 0 , 1 } for 1 i n . In the analyzed case of inclusion for a pixel, we take yi = 1, whereas if the finite element does not contain an inclusion, we take yi = 0. By observing the signal received from the electrodes x m , we make a classification for each finite element. Logistic regression has been used to construct a classifier (mapping) f : m { 0 , 1 } .
Let ( Ω , , P ) be a probabilistic space and Y a random variable with a discrete distribution, where Y : Ω { 0 , 1 } . We determine P ( Y = y | X ) , where y ∈ {0,1}, x m . Chances are the ratio of the probability of being successful to the probability of failure.
θ ( x ) = P ( Y = 1 | X = x ) 1 P ( Y = 1 | X = x ) .
The logistic regression task is to estimate the probability of success P ( Y = 1 | X = x ) based on the realization x m and we assume P ( Y = 1 | X = x ) = p ( x ) .
We consider the relationship defined by the equation [28,29]
ln θ ( x ) = ln ( p ( β 0 , β , x ) 1 p ( β 0 , β , x ) ) = β 0 + x T β + ε ,
where ε is a random variable with normal distribution N ( 0 , σ 2 ) and β = ( β 1 , β 2 , , β m ) m . If there is an intercept in model (2), then we have
β 0 + x T β = ( 1 , x T ) ( β 0 β ) .
Below we adopt
( 1 x ) = def x ,   ( β 0 β ) = def β .
From Formula (2) we obtain
p ( β , x ) = def p ( x ) = e x T β 1 + e x T β
To estimate unknown parameter β we apply the Maximum Likelihood Estimation. Let Y { 0 , 1 } n and X n × ( m + 1 ) , where
Y = [ y 1 y 2 y n ] ,   X = [ 1 x 11 x 1 m 1 x 21 x 1 m 1 x n 1 x n m ] = [ x ( 1 ) x ( 2 ) x ( n ) ] .
The estimation of the parameters consists of solving the task
max β L ( β , Y , X ) ,
where the objective function L ( β , Y , X ) is given by the equation [28,29]
L ( β , Y , X ) = i = 1 N ( p ( β , x ( i ) ) y i ( 1 p ( β , x ( i ) ) ) 1 y i ) .
Replace task (5) with
max β ln L ( β , Y , X ) ,
whereby applying the Formula (3), we determine that the natural logarithm of the objective function (6) is following
l ( β ) = ln L ( β , Y , X ) = i = 1 N ( y i ln p ( β , x ( i ) ) + ( 1 y i ) ln ( 1 p ( β , x ( i ) ) ) ) = i = 1 N ( y i ln p ( β , x ( i ) ) 1 p ( β , x ( i ) ) + ln ( 1 p ( β , x ( i ) ) ) ) = i = 1 N ( y i x ( i ) β ln ( 1 + e x ( i ) β ) ) .
A necessary condition for the existence of an extremum is
l β ( β ) = 0 ,
where 0 = c o l ( 0 , 0 , , 0 ) m , while
l β ( β ) = X T z ( β )   and   z ( β ) = [ y 1 p ( β , x ( 1 ) ) y 2 p ( β , x ( 2 ) ) y n p ( β , x ( n ) ) ] .
The matrix of derivatives of order two is equal to
2 l β β T ( β ) = i = 1 n x i T x i h i ( β ) = X T Z ( β ) X ,
where Z ( β ) = d i a g ( h 1 ( β ) , h 2 ( β ) , , h n ( β ) ) and h i ( β ) = p ( β , x ( i ) ) ( 1 p ( β , x ( i ) ) ) for 1 i n .
The matrix of second derivatives defined by Equation (3) is negatively defined. For 1 j , k m
l ( β ) β j = i = 1 n ( y i p ( β , x ( i ) ) ) x i j = 0
and
2 l ( β ) β j β k = i = 1 n x i j x i k p ( β , x ( i ) ) ( 1 p ( β , x ( i ) ) ) .
We estimate the values of the β by the formula
β k + 1 = β k ( 2 l β β T ( β k ) ) 1 l β ( β k ) .
The main problem in EIT is the problem of collinearity of measurements obtained from electrodes (see, e.g., [3,9,10,12,16,24]). Extracting a set of stochastically independent features is impossible, so techniques such as Tikhonov regularization, LASSO, elastic net are usually used (see, e.g., [28,29]). Another approach can be used to reduce the redundant variables, such as the discrete wavelet transform [34,35,36]. It consists in determining the projection of the signal { x t } 1 t l e q m obtained from the electrodes to an orthogonal basis. In the considered case, we use the elastic net for feature reduction and decomposition using wavelet preprocessing.
Let Ψ ( t ) be an orthogonal wavelet basis (mother wavelet) (see, e.g., [34]). For j , we define a sequence { Ψ j k } k as follows:
Ψ j k ( t ) = 1 2 j 1 Ψ ( t 2 j k \ )
and sequence { ϕ j k } k
ϕ j k ( t ) = 1 2 j 1 ϕ ( t 2 j k ) ,
where ϕ ( t ) denotes scaling. Thus, the time series { x t } 1 t l e q m can be presented as follows [34,36]:
x t = k = c j k ϕ j k ( t ) + i = j k = d i k Ψ i k ( t ) ,
where the value c j k denotes the scaling coefficient, but d i k is the complex coefficient. Due to decomposition level j based on Formula (11), the sequence { x t } 1 t l e q m can be expressed in different forms. The functions Ψ j k ( t ) and ϕ j k ( t ) take non-zero values on a bounded interval. From above, the sequence { x t } 1 t m can be presented as follows:
x t = k = 0 s c j k ϕ j k ( t ) + i = 0 j k = 0 s d i k Ψ i k ( t ) ,
where s < < m . Accordingly, we define a projection operator for the time series { x t } 1 t m at level j on an orthogonal basis { ϕ j k ( t ) } 0 k s as follows:
P j x t = k = 0 n 2 j 1 c j k ϕ j k ( t )
In EIT, the sequence of scaling coefficients { c j k } of projection has been used as input variables for Logistic Regression.
We analyzed different types of wavelet (see, e.g., [34,35,36]): Daubechies (‘db1’–‘db18’), Coiflets (‘coif1’–‘coif5’), Symlets (‘sym1’–‘sym18’) and Biorthogonal (‘bior1.1’, ‘bior1.3’, ‘bior1.5’, ‘bior2.2’, ‘bior2.4’, ‘bior2.6’, ‘bior2.8’).

3. Results

A measuring system consisting of a SmartEIT tomograph and a measuring object with appropriate electrodes was used (Figure 5). A numerical model of the reservoir was built in order to generate a suitable learning data set. The finite element method was used to design the tank’s cross-sectional mesh and the sensor system with MATLAB and EIDORS tools. Methods have been developed to generate learning data to solve the forward problem. For each instance, there is a vector of measurements and an image created on a 2D pixel.
Several tens of measurements were made on such a physical model, adjusting the parameters of the mathematical model based on the generalized Laplace equation, which correctly generated measurement values based on a dense finite element mesh. Based on this model, a set of 50,000 cases containing both the measurements and the corresponding conductivity distributions was generated. In addition, Gaussian noise with standard deviation was added to each measurement value. Reference measurements were made several times with the tomograph. By analyzing the signals obtained from the electrodes, the noise was estimated, which averaged about 4% of the standard deviation of the reference measurements. Therefore, for reference, Gaussian white noise was added to the sonde generated from the electrodes in EIDORS, and then reconstructions were determined for the noisy signal using logistic regression models.
The basic properties of the reference model describe the field of view: number of electrodes: 16; type of electrodes: linear; number of nodes: 1338; number of finite elements: 2502. There are different types of wavelets. In this paper, we present the applications of the following wavelets: Daubechies ‘db1’, ‘db2’, ‘db7’; Coiflets, ‘coif1’, ‘coif2’; Symlets ‘sym1’, ‘sym2’); Biorthogonal ‘bior1.1’, ‘bior1.5’, ‘bior2.2’. Each finished element is a pixel of the tomographic image. The output image is, in fact, an illustration of the conductivity distribution of the individual mesh elements.
To assess the quality of the visual area reconstruction, below we present some basic Receiver Operating Characteristic (ROC) analyses [27]. For this purpose, the finite element that does not belong to the inclusions is described as a negative case (N) and interpreted as an element that belongs to the background. On the other hand, the finite element that belongs to the inclusions is taken as the positive case (P). Therefore, to determine the basic characteristics, the confusion matrix is first determined in the following way: TP (True Positive)—denotes the finite elements that correctly belong to the inclusion area; TN (True Negative)—the number of finite elements that are correctly recognized as belonging to the background; FP (False Positive)—the number of finite elements belonging to the background that are recognized as having belonged to the inclusion area (false alarm); FN (False Negative)—the number of finite elements belonging to the inclusion area but recognized as background.
We determine the basic coefficients as follows [27]:
A c c u r a c y = T P + T N T P + T N + F P + F N , S e n s i v i t y = T P T P + F N , S p e c i f i c i t y = T N T N + F P , P o s i t i v e P r e d i c t i v e V a l u e = T P T P + F P , N e g a t i v e P r e d i c t i v e V a l u e = T N T N + F N , D e t e c t i o n R a t e = T P T P + T N + F P + F N ,  
To determine the ability of a classifier based on the use of logistic regression [15], we determine a curve describing the Receiver Operating Characteristic (ROC) curve [27]. The ROC curve shows the relationship between True Positive Rate (sensitivity on the Y-axis) and False Positive Rate (1-specificity on the X-axis) for different settings of cut-off levels (levels of class membership discrimination). Using logistic regression in EIT, the ROC curve shows the detection ability of a binary classifier that determines the affiliation of finite elements to the region of the inclusion for different settings of probability levels. The most optimal models can be determined by analyzing the class of models (a set of classifiers) using the ROC analysis (characterized by a higher TPR value for each established FPR). In some cases, when analyzing the ROC curves, determining the optimal classifier is quite difficult, while as the optimal classifier, we choose the one for which the Area under the Curve (AUC) is the greatest. This quantity is also included in Table 1, Table 2 and Table 3 describing the reconstructions.
To assess the reliability of reconstruction (agreement between pattern and reconstruction), we estimate Cohen’s kappa ratio as follows:
κ = 2 ( T P · T N F N · F P ) ( T P + F P ) ( F P + T N ) + ( T P + F N ) ( F N + T N ) .
Generally, κ [ 0 , 1 ] . When kappa has the higher value, the agreement between pattern and reconstruction is higher, and when there is complete agreement κ = 1 .
To verify whether there is a significant disagreement between pattern and reconstruction, we apply McNemar’s test. This test compares the sensitivity and specificity of reconstruction. The McNemar’s test statistic is defined as follows:
χ 2 = ( F P F N ) 2 F N + F P
and has χ 2 distribution with 1 degree of freedom.
Three patterns are shown below with their reconstructions. The patterns were simulated in MATLAB, and signals were determined as voltage vectors from the electrodes using EIDORS. Figure 6, Figure 7, Figure 8, Figure 9, Figure 10 and Figure 11 summary the image reconstruction for the example 1. Figure 6, Figure 8 and Figure 10 show the results of these reconstructions, but Figure 7, Figure 9 and Figure 11 show the ROC curve for reconstructions presented in Figure 6, Figure 8 and Figure 10. Table 1, Table 2 and Table 3 present the basic coefficient of ROC analysis, Cohen’s kappa, McNemar’s test statistic and p-value.
In order to verify the performed numerical tests, measurements were made on a laboratory tank. The image reconstruction results based on logistic regression with elastic net and different wavelets decompositions are shown in Figure 12, Figure 13, Figure 14, Figure 15, Figure 16, Figure 17, Figure 18, Figure 19 and Figure 20.

4. Discussion

The monitoring system presented is designed to automate, analyze and optimize processes using industrial tomography to analyze without disturbing its interior. This solution allows for better monitoring and control of processes. The system was designed using electrical tomography, which is used to study technological processes. An image reconstruction algorithm then processes the collected data. The main challenge in electrical tomography is the construction of precise measurement devices and image reconstruction methods. The idea of the measurement system was based on tomographic sensors for data collection and gathering and through appropriate communication protocols for processing in the computing cloud.
One of the problems in EIT image reconstruction using binary classifiers is the selection of variables that significantly influence the classifier’s result. In this study, the elastic net technique and wavelet decomposition were used to reduce the dimensions of the signal obtained from the electrodes. To answer the question of which method gives the best reconstruction, the same patterns were simulated at the beginning. Next, the reconstructed images have been compared with the patterns. Since visual assessment is not objective enough, popular quantitative Receiver Operating Characteristics were estimated: Accuracy, Sensitivity, Specificity, Positive Predictive Value, Negative Predictive Value, Detection Rate and AUC. Additionally, the assessments described the reliability of reconstructions (Cohen’s kappa) and the tests of disagreement between pattern and reconstruction (McNemar’s test) were provided.
Analyzing such characteristics as accuracy (the proportion of the visual area that the model correctly recognized) and specificity (the proportion of correctly recognized finite elements belonging to the background) is quite accurate. Thus, the quality of reconstruction is quite good. Nevertheless, from sensitivity (the proportion of correctly recognized finite elements belonging to the inclusion) analysis, we see that the best reconstructions were obtained by applying “db1”, “db2”, “sym1”, “sym2” and “bior1.1” wavelet decompositions. An identical result is obtained by analyzing the values of Cohen’s kappa. Quite good reliability of reconstructions was obtained for “db1”, “db2”, “sym1”, “sym2” and “bior1.1” wavelet decompositions too. By analyzing the AUC values, the best reconstructions are obtained for the dimension reduction techniques: elastic net and signal decomposition using “db1”, “db2”, “coif1”, “sym1” and “bior1.1”.
Based on McNemar’s test, we can conclude that for examples 1–2 at a significance level of 0.05, the null hypothesis (pattern and reconstruction are consistent or disagreement is irrelevant) is rejected in favor of the alternative hypothesis (disagreement between pattern and reconstruction is significant) for “db7”, “coif2” and “bior1.5” wavelet decompositions, and “db7” and “coif1” wavelet decompositions for example 3.
When reconstructing for real data, visually satisfactory results were obtained for signal decomposition using wavelets “db1”, “db2”, “coif1”, “sym1”, “sym2”, “bior1.1” and “bior1.5”. Quite poor reconstructions for cases where more than one object in the visual area were obtained for decomposition using “coif2”.

5. Conclusions

This study aimed to develop algorithms based on Logistic Regression and Wavelet Preprocessing methods to solve the inverse problem in EIT. The research focused on the development and comparison of algorithms and models for image reconstruction. All the algorithms presented are well suited to practical implementations in EIT. Depending on the number of measuring sensors used and the analyzed patterns, the obtained quality of the reconstructed images varies in different methods. To perform the reconstruction in EIT, we estimate the conductance for each finite element typically. In the presented case, we calculate the probability that a finite element belongs to an inclusion. For this purpose, we create a logistic regression model for each finite element. In this way, a logistic regression-based reconstruction is defined as a set of logistic regression models resting on the finite elements.
The use of logistic regression for image reconstruction in EIT should be preceded by selecting independent variables for each finite element separately. In order to reduce the dimensions of the independent variables, the elastic net technique was used in this work, as well as wavelet decomposition of signals, which is a good alternative tool to the elastic net. However, in the case of several objects in the field of view, objects located in the center are recognized poorly.
Further work could focus on ROC analysis for finite elements located in the center of the field of view, determining the thresholding for binary classifiers for finite elements depending on the position of the element in the field of view, and improving reconstruction in the center of the field of view (improving classifiers for finite elements further away from the electrodes). For further research and analysis, the decompositions “db1”, “db2”, “coif1”, “sym1”, “sym2” and “bior1.1” will be used to reduce the over dimensionality of independent variables in logistic regression models. Additionally, we investigated the dependence of the fit quality of logistic models (e.g., using the Hosmer–Lemeshow test) at different locations in the field of view. It could be the subject of a larger study to improve the quality of the reconstruction further.
Thus, the presented research results contain essential information that may accelerate the development of machine learning methods in industrial tomography. Furthermore, the research contributes to improving the efficiency of tomographic imaging with the use of electrical properties.

Author Contributions

Development of the system concept, measurement methodology, image reconstruction and supervision, T.R.; development of machine learning methods and image reconstruction, E.K. and P.G.; development of the numerical methods and techniques, K.N.; development of a measurement concept in a real model, methodology, preparation of descriptions in the article, K.K. and S.S.-A.; literature review, formal analysis, general review and editing of the manuscript, J.M.W. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Wajman, R.; Banasiak, R.; Babout, L. On the Use of a Rotatable ECT Sensor to Investigate Dense Phase Flow: A Feasibility Study. Sensors 2020, 20, 4854. [Google Scholar] [CrossRef] [PubMed]
  2. Rybak, G.; Strzecha, K. Short-Time Fourier Transform Based on Metaprogramming and the Stockham Optimization Method. Sensors 2021, 21, 4123. [Google Scholar] [CrossRef]
  3. Rymarczyk, T.; Kłosowski, G.; Hoła, A.; Sikora, J.; Wołowiec, T.; Tchórzewski, P.; Skowron, S. Comparison of Machine Learning Methods in Electrical Tomography for Detecting Moisture in Building Walls. Energies 2021, 14, 2777. [Google Scholar] [CrossRef]
  4. Rymarczyk, T.; Nita, P.; Vejar, A.; Woś, M.; Stefaniak, B.; Adamkiewicz, P. Wearable mobile measuring device based on electrical tomography. Prz. Elektrotech. 2019, 95, 211–214. [Google Scholar]
  5. Romanowski, A.; Chaniecki, Z.; Koralczyk, A.; Wozniak, M.; Nowak, A.; Kucharski, P.; Jaworski, T.; Malaya, M.; Rozga, P.; Grudzien, K. Interactive Timeline Approach for Contextual Spatio-Temporal ECT Data Investigation. Sensors 2020, 20, 4793. [Google Scholar] [CrossRef] [PubMed]
  6. Mosorov, V.; Rybak, G.; Sankowski, D. Plug Regime Flow Velocity Measurement Problem Based on Correlability Notion and Twin Plane Electrical Capacitance Tomography: Use Case. Sensors 2021, 21, 2189. [Google Scholar] [CrossRef] [PubMed]
  7. Voss, A.; Pour-Ghaz, M.; Vauhkonen, M.; Seppanen, A. Retrieval of the saturated hydraulic conductivity of cement-based materials using electrical capacitance tomography. Cem. Concr. Compos. 2020, 112, 103639. [Google Scholar] [CrossRef]
  8. Shi, X.W.; Tan, C.; Dong, F.; dos Santos, E.N.; da Silva, M.J. Conductance Sensors for Multiphase Flow Measurement: A Review. IEEE Sens. J. 2021, 21, 12913–12925. [Google Scholar] [CrossRef]
  9. Midura, M.; Wróblewski, P.; Wanta, D.; Domański, G.; Stosio, M.; Kryszyn, J.; Smolik, W.T. The system for complex magnetic susceptibility measurement of nanoparticles with 3d printed carcass for integrated receive coils. Inform. Autom. Pomiary W Gospod. I Ochr. Śr. 2021, 11, 4–9. [Google Scholar] [CrossRef]
  10. Rymarczyk, T.; Kłosowski, G.; Tchórzewski, P.; Cieplak, T.; Kozłowski, E. Area monitoring using the ERT method with multisensor electrodes. Prz. Elektrotech. 2019, 95, 153–156. [Google Scholar] [CrossRef] [Green Version]
  11. Chen, B.; Abascal, J.; Soleimani, M. Extended Joint Sparsity Reconstruction for Spatial and Temporal ERT Imaging. Sensors 2018, 18, 4014. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  12. Ratheesh, K.M.; Seah, L.K.; Murukeshan, V.M. Spectral phase-based automatic calibration scheme for swept source-based optical coherence tomography systems. Phys. Med. Biol. 2016, 61, 7652. [Google Scholar] [CrossRef]
  13. Koulountzios, P.; Aghajanian, S.; Rymarczyk, T.; Koiranen, T.; Soleimani, M. An Ultrasound Tomography Method for Monitoring CO2 Capture Process Involving Stirring and CaCO3 Precipitation. Sensors 2021, 21, 6995. [Google Scholar] [CrossRef] [PubMed]
  14. Koulountzios, P.; Rymarczyk, T.; Soleimani, M. A triple-modality ultrasound computed tomography based on full-waveform data for industrial processes. IEEE Sens. J. 2021, 21, 20896–20909. [Google Scholar] [CrossRef]
  15. Dusek, J.; Mikulka, J. Measurement-Based Domain Parameter Optimisation in Electrical Impedance Tomography Imaging. Sensors 2021, 21, 2507. [Google Scholar] [CrossRef] [PubMed]
  16. Rymarczyk, T.; Kozłowski, E.; Kłosowski, G. Electrical impedance tomography in 3D flood embankments testing—Elastic net approach. Trans. Inst. Meas. Control. 2020, 42, 680–690. [Google Scholar] [CrossRef]
  17. Dušek, J.; Hladký, D.; Mikulka, J. Electrical Impedance Tomography Methods and Algorithms Processed with a GPU. In Proceedings of the 2017 Progress in Electromagnetics Research Symposium—Spring (PIERS), St. Petersburg, Russia, 22–25 May 2017; pp. 1710–1714. [Google Scholar]
  18. Liu, S.H.; Huang, Y.M.; Wu, H.C.; Tan, C.; Jia, J.B. Efficient Multitask Structure-Aware Sparse Bayesian Learning for Frequency-Difference Electrical Impedance Tomography. IEEE Trans. Ind. Inform. 2021, 17, 463–472. [Google Scholar] [CrossRef] [Green Version]
  19. Adler, A.; Lionheart, W.R. Uses and abuses of EIDORS: An extensible software base for EIT. Physiol. Meas. 2006, 27, 25–42. [Google Scholar] [CrossRef] [Green Version]
  20. Kozłowski, E.; Mazurkiewicz, D.; Żabiński, T.; Prucnal, S.; Sęp, J. Assessment model of cutting tool condition for real-time supervision system. Eksploat. I Niezawodn. 2019, 21, 679–685. [Google Scholar] [CrossRef]
  21. Sekulska-Nalewajko, J.; Gocławski, J.; Korzeniewska, E. A method for the assessment of textile pilling tendency using optical coherence tomography. Sensors 2020, 20, 3687. [Google Scholar] [CrossRef] [PubMed]
  22. Szczesny, A.; Korzeniewska, E. Selection of the method for the earthing resistance measurement. Prz. Elektrotech. 2018, 94, 178–181. [Google Scholar]
  23. Daniewski, K.; Kosicka, E.; Mazurkiewicz, D. Analysis of the correctness of determination of the effectiveness of maintenance service actions. Manag. Prod. Eng. Rev. 2018, 9, 20–25. [Google Scholar]
  24. Kłosowski, G.; Rymarczyk, T.; Wójcik, D.; Skowron, S.; Adamkiewicz, P. The Use of Time-Frequency Moments as Inputs of LSTM Network for ECG Signal Classification. Electronics 2020, 9, 1452. [Google Scholar] [CrossRef]
  25. Fiala, P.; Bartušek, K.; Dědková, J.; Dohnal, P. EMG field analysis in dynamic microscopic/nanoscopic models of matter. Inform. Autom. Pomiary W Gospod. I Ochr. Sr. 2019, 9, 4–10. [Google Scholar] [CrossRef]
  26. Rzasa, M.R.; Czapla-Nielacna, B. Analysis of the Influence of the Vortex Shedder Shape on the Metrological Properties of the Vortex Flow Meter. Sensors 2021, 21, 4697. [Google Scholar] [CrossRef]
  27. Fawcett, T. An Introduction to ROC Analysis. Pattern Recognit. Lett. 2006, 27, 861–874. [Google Scholar] [CrossRef]
  28. Yan, X.; Su, X.G. Linear Regression Analysis; World Scientific Publishing Co.: Singapore, 2009. [Google Scholar]
  29. Kuhn, M.; Johnson, K. Applied Predictive Modelling; Springer: Berlin/Heidelberg, Germany, 2016. [Google Scholar]
  30. Schonlau, M.; Zou, R.Y. The random forest algorithm for statistical learning. Stata J. 2020, 20, 3–29. [Google Scholar] [CrossRef]
  31. Ayyadevara, V.K. Gradient Boosting Machine. In Pro Machine Learning Algorithms; Apress: Berkeley, CA, USA, 2018. [Google Scholar]
  32. Urbanski, P. Principal component and partial least squares regressions in the calibration of nucleonic gauges. Appl. Radiat. Isot. 1994, 45, 659–667. [Google Scholar] [CrossRef]
  33. Liu, S.; Wu, H.; Huang, Y.; Yang, Y.; Jia, J. Accelerated Structure-Aware Sparse Bayesian Learning for 3D Electrical Impedance Tomography. IEEE Trans. Ind. Inform. 2019, 15, 5033–5041. [Google Scholar] [CrossRef]
  34. Walnut, D.F. An Introduction to Wavelet Analysis; Springer Science & Business Media: Berlin/Heidelberg, Germany, 2002. [Google Scholar]
  35. Daubechies, I. Orthonormal Bases of Compactly Supported Wavelets. Commun. Pure Appl. Math. 1992, 41, 909–996. [Google Scholar] [CrossRef] [Green Version]
  36. Percival, D.B.; Walden, A. Wavelet Methods for Time Series Analysis; Cambridge University Press: Cambridge, UK, 2000; Volume 4. [Google Scholar]
Figure 1. Model of a tomographic sensor platform with an analytical system.
Figure 1. Model of a tomographic sensor platform with an analytical system.
Energies 14 08116 g001
Figure 2. Photos showing the view of the SmartEIT scanner placed in the housing on the left (a) and the device connected to the probes and working—on the right (b).
Figure 2. Photos showing the view of the SmartEIT scanner placed in the housing on the left (a) and the device connected to the probes and working—on the right (b).
Energies 14 08116 g002
Figure 3. Acquisition method and measurement calculation (a), forcing electrodes A and B and measuring electrodes M and N (b).
Figure 3. Acquisition method and measurement calculation (a), forcing electrodes A and B and measuring electrodes M and N (b).
Energies 14 08116 g003
Figure 4. Measurement system with a model of data transmission, collection and analysis.
Figure 4. Measurement system with a model of data transmission, collection and analysis.
Energies 14 08116 g004
Figure 5. Measuring station with SmartEIT tomograph and physical model of the tank with electrodes and tubes immersed in water.
Figure 5. Measuring station with SmartEIT tomograph and physical model of the tank with electrodes and tubes immersed in water.
Energies 14 08116 g005
Figure 6. Image reconstruction for one object—example 1.
Figure 6. Image reconstruction for one object—example 1.
Energies 14 08116 g006
Figure 7. ROC analysis for example 1.
Figure 7. ROC analysis for example 1.
Energies 14 08116 g007
Figure 8. Image reconstruction for one object—example 2.
Figure 8. Image reconstruction for one object—example 2.
Energies 14 08116 g008
Figure 9. ROC analysis for example 2.
Figure 9. ROC analysis for example 2.
Energies 14 08116 g009
Figure 10. Image reconstruction for two objects—example 3.
Figure 10. Image reconstruction for two objects—example 3.
Energies 14 08116 g010
Figure 11. ROC analysis for example 3.
Figure 11. ROC analysis for example 3.
Energies 14 08116 g011
Figure 12. Image reconstruction with the centrally placed phantom.
Figure 12. Image reconstruction with the centrally placed phantom.
Energies 14 08116 g012
Figure 13. Image reconstruction with a phantom at electrode 1.
Figure 13. Image reconstruction with a phantom at electrode 1.
Energies 14 08116 g013
Figure 14. Image reconstruction with a phantom at electrode 13.
Figure 14. Image reconstruction with a phantom at electrode 13.
Energies 14 08116 g014
Figure 15. Image reconstruction with a phantom at electrode 5.
Figure 15. Image reconstruction with a phantom at electrode 5.
Energies 14 08116 g015
Figure 16. Image reconstruction with a phantom at electrode 9.
Figure 16. Image reconstruction with a phantom at electrode 9.
Energies 14 08116 g016
Figure 17. Image reconstruction with phantoms at electrodes 1 and 5.
Figure 17. Image reconstruction with phantoms at electrodes 1 and 5.
Energies 14 08116 g017
Figure 18. Image reconstruction with phantoms at electrodes 1 and 9.
Figure 18. Image reconstruction with phantoms at electrodes 1 and 9.
Energies 14 08116 g018
Figure 19. Image reconstruction with phantoms at electrodes 5 and 13.
Figure 19. Image reconstruction with phantoms at electrodes 5 and 13.
Energies 14 08116 g019
Figure 20. Image reconstruction with phantoms at electrodes 1, 5 and 9.
Figure 20. Image reconstruction with phantoms at electrodes 1, 5 and 9.
Energies 14 08116 g020
Table 1. Summary of reconstruction of pattern presented in Figure 6.
Table 1. Summary of reconstruction of pattern presented in Figure 6.
Elastic Netdb1db2db7coif1coif2sym1sym2bior1.1bior1.5bior2.2
Accuracy0.9840.9620.9670.9680.9620.9700.9620.9670.9620.9660.960
Sensitivity0.8300.5280.6510.3680.4720.4620.5280.6510.5280.4810.453
Specificity0.9900.9810.9810.9950.9840.9920.9810.9810.9810.9870.982
Pos Pred Value0.7930.5490.6050.7500.5680.7310.5490.6050.5490.6220.527
Neg Pred Value0.9920.9790.9850.9730.9770.9770.9790.9850.9790.9770.976
Detection Rate0.0350.0220.0280.0160.0200.0200.0220.0280.0220.0200.019
AUC0.9900.8270.9050.7570.7770.7810.8270.9050.8270.7960.780
κ 0.8020.5180.6100.4790.4960.5520.5180.6100.5180.5250.466
χ 2 0.3900.0940.59835.1123.07419.2530.0940.5980.0946.1511.941
p-value0.5320.7590.4400.0000.0800.0000.7590.4400.7590.0130.164
Table 2. Summary of reconstruction of pattern presented in Figure 8.
Table 2. Summary of reconstruction of pattern presented in Figure 8.
Elastic Netdb1db2db7coif1coif2sym1sym2bior1.1bior1.5bior2.2
Accuracy0.9920.9940.9930.9790.9940.9820.9940.9930.9940.9930.990
Sensitivity0.9400.8670.8550.3860.9040.4700.8670.8550.8670.8190.843
Specificity0.9940.9990.9981.0000.9970.9990.9990.9980.9990.9990.995
Pos Pred Value0.8390.9600.9220.9700.9150.9510.9600.9220.9600.9580.864
Neg Pred Value0.9980.9950.9950.9790.9970.9820.9950.9950.9950.9940.995
Detection Rate0.0310.0290.0280.0130.0300.0160.0290.0280.0290.0270.028
AUC0.9991.0000.9990.9910.9990.9921.0000.9991.0000.9990.999
κ 0.8820.9090.8840.5430.9060.6210.9090.8840.9090.8790.849
χ 2 4.0503.5001.38946.1730.00036.5433.5001.3893.5006.7220.042
p-value0.0440.0610.2390.0001.0000.0000.0610.2390.0610.0100.838
Table 3. Summary of reconstruction of pattern presented in Figure 10.
Table 3. Summary of reconstruction of pattern presented in Figure 10.
Elastic Netdb1db2db7coif1coif2sym1sym2bior1.1bior1.5bior2.2
Accuracy0.9610.9400.9310.9260.9390.9040.9400.9310.9400.9370.941
Sensitivity0.6620.5050.3540.1920.4440.2120.5050.3540.5050.4950.465
Specificity0.9870.9770.9810.9890.9820.9640.9770.9810.9770.9750.982
Pos Pred Value0.8140.6540.6140.5940.6770.3360.6540.6140.6540.6320.692
Neg Pred Value0.9710.9580.9460.9340.9540.9340.9580.9460.9580.9570.955
Detection Rate0.0520.0400.0280.0150.0350.0170.0400.0280.0400.0390.037
AUC0.9870.9320.9130.8540.9360.7550.9320.9130.9320.9360.938
κ 0.7860.5660.4240.3330.4860.2070.5660.4240.5660.5320.474
χ 2 0.2030.0250.04323.33817.1281.3080.0250.0430.0250.7294.380
p-value0.6530.8730.8350.0000.0000.2530.8730.8350.8730.3930.036
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Rymarczyk, T.; Niderla, K.; Kozłowski, E.; Król, K.; Wyrwisz, J.M.; Skrzypek-Ahmed, S.; Gołąbek, P. Logistic Regression with Wave Preprocessing to Solve Inverse Problem in Industrial Tomography for Technological Process Control. Energies 2021, 14, 8116. https://doi.org/10.3390/en14238116

AMA Style

Rymarczyk T, Niderla K, Kozłowski E, Król K, Wyrwisz JM, Skrzypek-Ahmed S, Gołąbek P. Logistic Regression with Wave Preprocessing to Solve Inverse Problem in Industrial Tomography for Technological Process Control. Energies. 2021; 14(23):8116. https://doi.org/10.3390/en14238116

Chicago/Turabian Style

Rymarczyk, Tomasz, Konrad Niderla, Edward Kozłowski, Krzysztof Król, Joanna Maria Wyrwisz, Sylwia Skrzypek-Ahmed, and Piotr Gołąbek. 2021. "Logistic Regression with Wave Preprocessing to Solve Inverse Problem in Industrial Tomography for Technological Process Control" Energies 14, no. 23: 8116. https://doi.org/10.3390/en14238116

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop