- freely available
- re-usable
Sensors 2013, 13(6), 7323-7344; doi:10.3390/s130607323
Published: 4 June 2013
Abstract
: Many applications of metal oxide gas sensors can benefit from reliable algorithms to detect significant changes in the sensor response. Significant changes indicate a change in the emission modality of a distant gas source and occur due to a sudden change of concentration or exposure to a different compound. As a consequence of turbulent gas transport and the relatively slow response and recovery times of metal oxide sensors, their response in open sampling configuration exhibits strong fluctuations that interfere with the changes of interest. In this paper we introduce TREFEX, a novel change point detection algorithm, especially designed for metal oxide gas sensors in an open sampling system. TREFEX models the response of MOX sensors as a piecewise exponential signal and considers the junctions between consecutive exponentials as change points. We formulate non-linear trend filtering and change point detection as a parameter-free convex optimization problem for single sensors and sensor arrays. We evaluate the performance of the TREFEX algorithm experimentally for different metal oxide sensors and several gas emission profiles. A comparison with the previously proposed GLR method shows a clearly superior performance of the TREFEX algorithm both in detection performance and in estimating the change time.1. Introduction
Detecting significant changes in the response of metal oxide (MOX) gas sensors is important for many applications such as gas leak detection in coal mines [1,2], large scale pollution monitoring [3,4] or the mapping of gas detection events [5]. A significant change (also frequently called an event) in the response of MOX sensors can indicate, e.g., the activity of a gas source or the sudden presence of specific compounds in a mixture of others. In the applications of interest, gas sensors are typically deployed in an OSS (open sampling system, i.e., directly exposed to the environment, without a sensing chamber and a sampling mechanism) since continuous monitoring is often crucial, and restrictions in costs and payload pose stringent limitations on the hardware that can be considered.
In this paper, we address the problem of detecting change points from the response of a MOX sensor or sensor array in OSS configuration. This problem is challenging because the sensor response deviates strongly from the “clean” signal that can be obtained in a controlled setting. The gas transport mechanisms in natural environments are dominated by turbulence and advection. This causes the sensor response to fluctuate continuously [6]. In addition, external factors such as humidity and temperature are also influencing the sensor readings [7]. Consequently, change point detection cannot be achieved by trivial threshold based methods.
The method introduced in this paper allows to interpret the response of MOX sensors in OSS configuration and to detect change points. This is important for a range of applications. Many locations of interest for monitoring of dangerous gases suffer from difficulties in wireless communication, e.g., in coal mines the radio signal is often unstable and of poor quality [1,2]. This poses problems in transferring lengthy data streams like time series obtained by MOX sensor readings collected with a wireless sensor network or mobile robots. Transferring small amounts of data representing only significant events rather than all sensor readings is more suitable for these scenarios. When gas sensors are mounted on a mobile robot, detection of change points in the signal is also important for detecting when the mobile robot enters or exits an odour plume or when the sensed chemical compound changes [8]. Finally, large scale pollution monitoring projects (such as CitiSense [3] and Air Quality Egg [4]) consider personal air-quality devices. Change point detection running locally on these devices can decrease energy consumption (continuous transfer of sensor readings is not necessary), and can help to address calibration issues [9].
In this paper we propose a change point detection algorithm explicitly designed for metal oxide (MOX) gas sensors. The aim of the proposed algorithm is to identify events such as the sudden exposure of the sensors to a gas, a sudden change of concentration of a gas or the change of gas to which the sensors are exposed. The detected change points can then be used as inputs by higher level estimation algorithm or decision systems. MOX gas sensors are the most common sensing technology for use in OSS because of their high sensitivity to a multitude of compounds, their simple operation and electronic interface, and their low price. MOX sensors are characterized by a slow response dynamics, and even slower recovery. Therefore, sudden changes in the exposure of a MOX sensor manifest as an exponential function in the sensor response. In this respect, a MOX sensor can be considered as a nonlinear asymmetric low pass filter, with different dynamics in the response and recovery phase. The TREnd Filtering with EXponentials (TREFEX) algorithm takes into account explicitly this characteristic behaviour of MOX sensors and tries to model the underlying trend of a sensor response as a piecewise exponential function. The proposed algorithm is very efficient from a computational viewpoint since it is formulated as a convex optimization problem. The TREFEX algorithm has one regularization parameter to be set by the user. In this article we also propose a method for setting the regularization parameter automatically, which requires few iterations of the algorithm. Finally, since MOX sensors are often deployed in arrays to achieve a level of selectivity that cannot be attained with a single sensor, we extend the proposed algorithm to be able to deal with a sensor array.
The rest of this paper is organized as follows. Section 2 presents related works in gas sensing with an OSS, change point detection in time series and trend filtering. The experimental setup with which the algorithms have been tested is described in Section 3, after which the proposed change point detection algorithm, the parameter selection strategy, and the extension to the sensor array configuration are explained in Section 4. Results are then presented in Section 5, first for the case of single sensor change point detection and then considering change point detection using multiple sensors. Finally, Section 6 concludes the paper and presents future work.
2. Related Works
Change detection in the activity of a gas source based on the response of an array of MOX gas sensors is related to the study of change point detection in the domain of the time series analysis. It has been studied for a wide range of applications such as quality control [10], climatology [11], image edge detection [12], and monitoring of land-cover changes [13]. The wide range of applications corresponds to very different solutions for the change point detection problem. Variations span from on-line to off-line algorithms and include multivariate or univariate approaches for detecting additive or multiplicative changes [14]. Keeping our area of applications in mind, we do not consider algorithms that require prior information about the position of the change point [15].
The first type of change detection solution is detecting deviations from normal behaviour based on a simple distance measure, e.g., for quality control applications [10] when the measurements fall out of a predefined range. A second category of algorithms analyse sequentially whether a change point exists by comparing the data before and after a hypothetical change point. These techniques often use statistical approaches both in a model-based and model-free fashion. Popular algorithms, inspired by frequentist statistics, include the Generalized likelihood Ratio (GLR) test [14], the Marginalized Likelihood Ratio (MLR) [16] and the CUmulative SUM (CUSUM) algorithm [14]. Instead of explicitly computing statistical parameters of the signal before and after an assumed change point, machine learning approaches such as one class Support Vector Machines were also suggested to detect change points [17]. Third, changes can be detected estimating the underlying trend of a signal as a piecewise function and then considering the connections between consecutive pieces as change points. Clearly these methods are model-based methods and rely on the assumption that the shape of the trend is known. Two examples are piecewise linear segmentation [18,19] and piecewise-constant segmentation [20]. These methods are usually off-line. The TREFEX algorithm proposed in this paper falls into the last category. Since the step response of MOX sensors can be approximated by an exponential function, the TREFEX algorithm segments a signal into a piecewise exponential trend.
3. MOX Sensors and Experimental Setup
In the following, we will discuss the characteristics of the sensors that we consider in this paper and present the setup of experiments used to obtain the data.
3.1. Metal Oxide (MOX) Gas Sensors
Metal oxide (MOX) gas sensors are, by far, the most widely used in electronic nose and mobile robotics olfaction applications. MOX gas sensors are conductometric sensors, where a change in the conductance of the oxide is measured when a gas interacts with the sensing surface. The change in conductance is approximately linearly proportional to the logarithm of the concentration of the gas over a range of concentrations [21]. There are two types of MOX sensors: n-type and p-type [22,23]. The response of a MOX sensor results from chemosorption and redox reactions at the surface. Since the rate of such reactions is dependent on the temperature and on the material of the surface, it is clear that the doping material of the sensing surface and the operating temperature considerably affect the sensor characteristics [21]. Typical temperatures for the sensing surface of MOX sensors lie between 300 °C and 500 °C.
One of the main drawbacks of MOX sensors for open sampling applications is the slow response time and the even slower recovery time. Figure 1 shows the response time and recovery time in a closed sampling system without disturbances like turbulence and advection of the airflow. The MOX sensor was exposed to a pulse of ethylene and the sudden variation in the exposure of the sensor generates exponentials in the response. Those exponentials have different time constants depending on whether the conductance of the sensor increases (faster) or decreases (slower). This observation forms the foundation of the proposed change point detection algorithm, even if in an OSS additional disturbances affect the signal.
3.2. Experiments and Data Collection
Experiments were carried out with static sensors in a 5 × 5 × 2 m^{3} closed room in which an artificial airflow of approximately 0.05 m/s was induced, see Figure 2. The airflow is created using two arrays of four fans, one placed on the floor and one on the wall. The gas source is an odour blender, a device developed by Nakamoto et al. [24], which allows fast switches in between different mixtures of compounds with a variable concentration. The outlet of the olfactory blender is placed on the floor 0.5 m upwind with respect to an array of 11 commercial metal oxide gas sensors from Figaro Engineering [25] (TGS2600 × 2, TGS2602, TGS2611, TGS2620) and e2v Technologies [26] (MiCS 5521 × 2, MiCS2610, MiCS2710, MiCS5121, MiCS5135). The selected sensors have overlapping sensitivity and they respond to a wide range of target compounds. The airflow at the outlet of the odour blender is set to 1 L/min. The sampling rate of the sensors is 4 Hz.
The two compounds selected for these experiments are ethanol and 2-propanol. Both ethanol (molecular weight 46 g/mol) and 2-propanol (molecular weight 60 g/mol) are heavier than air (average molecular weight 29 g/mol), and therefore will tend to create a plume at the ground level. The two substances have a similar saturated vapour pressure, namely 5.8 kPa for ethanol and 4.2 kPa for 2-propanol, which means that they have a similar tendency to evaporate. Moreover, the MOX gas sensors have a comparable sensitivity to the two substances. This is important in order to obtain similar sensor responses for both analytes, thus avoiding having to address a trivial instance of the change detection problem.
In order to create a database that allows studying the dynamic behaviour of the sensors when consecutively exposed to different analytes, seven different odour emitting profiles have been applied. For all these profiles the gas source emits clean air for two minutes and the signal of sensors during this period is assumed as a baseline. Also, at the end of all the experiments the source emits clean air for 2 min. Figure 3 shows the intensity profile for the gas source in the various emission strategies. A total of 54 experimental runs have been performed.
The control signal of the odour blender is used as ground truth for the change point time and provides the time at which the source changes the emission modality. However, in order to know the change point time at the sensors' location, we need to estimate the time it takes the gas to travel from the gas source to the sensor location. Since the sensors are placed 0.5 m away from the location of the source outlet and a steady air flow of 0.05 m/s is induced, the delay time between change times at source and sensor location is estimated to be 10 s. The estimation of the delay has been validated with a cross correlation analysis between the control signal of the odour blender and the signal of the MOX sensors in the Steps experiments (see Figure 3(a)).
4. Algorithm
The key idea behind the proposed change detection approach is that a change in the emission modality of a gas source appears as an exponential trend in the response of MOX sensors. MOX sensors, due to their long response and recovery times, can be modelled as a first order system whose step response is indeed an exponential [27]. The proposed method interprets the sensor response by fitting piecewise exponential functions with different time constants for the response and recovery phase. The number of exponentials is determined automatically using an approximate method based on l_{1}-norm regularization. This asymmetric exponential trend filtering problem is formulated as a convex optimization problem, which is particularly advantageous from the computational point of view. Section 4.1 presents an introductory discussion on piecewise linear trend filtering based on [18], Section 4.2 presents the change point detection algorithm for a single sensor, Section 4.3 presents a strategy for selecting the parameter of the algorithm, and Section 4.4 extends the algorithm to the case where a sensor array is available.
4.1. Piecewise Linear Trend Filtering
In this Section we introduce the main ideas behind piecewise linear trend filtering proposed in [18] to prepare the discussion of the TREFEX algorithm presented in the following sections. The method falls in the framework of regularized regression and solves the following optimization problem
λ ≥ 0 is a regularization parameter used to control the trade-off between the deviation of the estimated trend from the signal ${\Vert \mathit{\text{x}}-\mathit{\text{y}}\Vert}_{2}^{2}$ and the smoothness of the trend encoded by ║DDx║_{1}. For the case of piecewise linear filtering, smoothness is encoded as minimization of the second derivative, which for a line (assumed in linear trend filtering) is exactly equal to zero. The use of the l_{1}-norm in the regularization term is the main difference between the trend filtering method proposed in [18] and the well known Hodrick-Prescott filtering [28] that uses instead an l_{2}-norm regularizer. The l_{1}-norm is used to induce sparsity in the smoothness term, i.e., a solution for which the smoothness term is exactly zero for most of the points and greater than zero in few points. This results in a trend that is “mostly linear” with few sharp kink points, opposed to the trend found with a l_{2}-norm regularizer that intuitively never “bends too much” but is also not a perfect line (the l_{2}-norm does not induce sparsity). Figure 4 presents a toy problem that gives a practical example of this concept. Notice how the trend obtained with the l_{1}-norm preserves the piecewise linear shape, with clear kink points between the lines, while the l_{2}-norm trend is a smoothed-out version of the original trend where the break points between the line pieces are not clear. This is reflected in the residuals ║DDx║ that are equal to zero except at the kink points for the l_{1}-norm regularization, while for the l_{2}-norm regularization they are always very small but rarely exactly equal to zero. This makes l_{1}-norm regularization more suited to detect change points, as the change points can be detected by the non-zero elements in the kinks vector.
4.2. Single Sensor
In this paper we propose to model, instead of a piecewise linear trend, a piecewise exponential trend for capturing the sensor response induced by abrupt changes in the emission of the gas source. This is motivated by the response characteristics of MOX sensors, outlined in Section 3.1. Exponential functions are characterized by the following relationship:
The regularization term now encodes the tendency to fit an exponential by rewarding trends that comply with Equation (3). This formulation is however not suitable for MOX sensors since MOX sensors are slower in the recovery than in the response phase. Therefore it is needed to introduce exponentials with different time constants, namely τ_{+} and τ_{−}, for the response and recovery phase. These constants have to be known or determined experimentally for each sensor. The optimization problem can be then modified in the following way:
The vector of kinks k between subsequent exponentials can be trivially calculated as the sum of the arguments of the two l_{1}-norms in Equation (6):
Change points are declared when k > 0.01. Once a change point has been declared, no more change points will be declared until Dx < 0.0001. This is to avoid that once the signal is already changing, multiple alarms would be triggered for slight imperfections in the estimated trends. These two values are arbitrarily chosen small numbers introduced to cope with numerical inaccuracies and with the fact that l_{1}-norm is an approximation of the l_{0}-norm (the number of non-zero elements in a vector) that would make the values of k exactly zero for samples that are not considered change points.
The optimization problem (6) is a convex optimization problem that can be easily reformulated as a Quadratic Program (QP). This problem can be solved with standard convex optimization methods that are implemented by optimization packages available on-line such as CVX [29] or Gurobi [30].
4.3. Parameter Selection
The regularization parameter λ ≥ 0 is used to control the trade-off between how close the estimated trend reproduces the signal $({\Vert \mathit{\text{x}}-\mathit{\text{y}}\Vert}_{2}^{2})$ and the smoothness of the signal encoded by the regularization term ${\Vert \phantom{\rule{0.2em}{0ex}}(\mathit{\text{I}}+{\tau}_{+}\mathit{\text{D}}\phantom{\rule{0.2em}{0ex}}){\mathit{\text{d}}}_{+}\Vert}_{1}+{\Vert \phantom{\rule{0.2em}{0ex}}(\mathit{\text{I}}+{\tau}_{-}\mathit{\text{D}}\phantom{\rule{0.2em}{0ex}})\phantom{\rule{0.2em}{0ex}}(\mathit{\text{Dx}}-{\mathit{\text{d}}}_{+})\Vert}_{1}$. If λ = 0 the estimated trend x would be exactly equal to the signal y, while if λ → ∞ the estimated trend x would be the best fit (single) exponential to the signal y. Clearly, the appropriate values for λ lie between these two extrema. Figure 5(a) shows the curve obtained by plotting the two terms of the objective function for an experiment using the MiCS2610 sensor for various values of λ. An appropriate selection criterion for the parameter λ is to choose the λ for which the trade-off curve attains minimum Euclidean distance δ to the origin. Indeed, if for a value of λ the trade-off curve would pass through the origin, it would mean that there exists a perfectly smooth signal that passes through all the data points. As can be seen in Figure 5(b), the Euclidean distance shows a clear minimum and therefore it is an easy function to optimize.
Analogous to [18], we can show that there exists a λ_{MAX} at which the estimated trend becomes a single exponential. For values of λ beyond that point the solution does not change (this appears as a constant value for sufficiently large values of λ in Figure 5(b)). To derive λ_{MAX} we rewrite problem (6) as an equivalent QP and then make use of the KKT optimality conditions [31] in order to derive the following equation:
Given that we now know an interval [0, λ_{MAX}] that contains the optimal value of lambda λ_{∗}, we can use a standard bracket baseline search method like bisection or golden search [32] to minimize the distance of the trade-off curve from the origin.
In this work we choose the golden search method since it has the best worst case performance. This constitutes an efficient method for automatically selecting the only parameter of the algorithm, which implies the solution of few convex optimization problems. The proposed algorithm is then parameter free, which is a great advantage from the user point of view.
4.4. Sensor Array
Given their comparatively poor selectivity, MOX sensors are rarely deployed individually, but often they are included in a sensor array that can provide the desired selectivity as a whole. The proposed algorithm can be extended to be able to work on the response of a sensor array in the following way:
l_{1}-norm This norm forms the foundation of the well-known LASSO regression [33]. As already pointed out previously, the l_{1}-norm induces sparsity, which in this case means basing the change point decision on the least number of sensors. It is worth noticing that with this norm the trend components of the individual sensors can be estimated separately.
l_{2}-norm This norm is connected to the Group LASSO regression [34]. Compared with the l_{1}-norm aggregation, this formulation couples the regularization residuals obtained for each sensor at the same time index. Therefore the detected trend shows simultaneous changes in all the sensors at common kink points.
l_{∞}-norm This norm corresponds to taking the maximum of the regularization residuals obtained for each sensor at the same time index. It can be seen as an extreme case of the integration with l2-norm, since it means that all the sensors must detect a change for a certain time index.
Finally it is important to notice that the summations over time indices are equivalent to the calculation of an l_{1}-norm along the time dimension (the arguments of the sum are norms, and hence positive), preserving the sparsity of the kinks.
5. Results and Discussion
Before the TREFEX algorithm can be applied, the time constants (τ_{+} and τ_{−}) for each sensor need to be estimated. For this purpose, a series of 6 Step experiments (see Figure 3 (a)) per sensor were conducted. Three experiments were using ethanol as target compound while the other three used 2-propanol. The parameters were calculated by fitting an exponential to the observed transients. Since no significant variation of the time constants with respect to the concentration was observed, the mean of all the experiments is considered as a reliable estimator for the time constant of the sensors. For reference, the obtained values are shown in Table 1. These values were used in the experiments presented in the remainder of this paper.
Due to the differences in the sensing surface, different models of MOX sensors exhibit a different dynamic range. This means that some of the sensors, when responding, change their resistance value only a few Ohms while others vary hundreds or even thousands of Ohms. Thus, before running change point detection algorithms, we normalize the dynamic ranges of the sensor responses to the interval [0,1] using linear scaling.
To exemplify the proposed algorithm, Figure 6 shows the MiCS 2610 sensor response and the result of TREFEX. In the depicted experiment ethanol was emitted according to the Descending Stairway pattern (see Figure 3 (c)). The six change points are marked in the figure with a black dot. Five of them were correctly identified by the algorithm. An alarm is considered a true alarm (indicated in the figure by a green dot) when it is the closest alarm to a change point. All the other alarms are considered false alarms (indicated by red dots in the figure). Besides these five correctly identified change points, two errors are observed. On one hand, the change from 100% to 80% emission rate (time 238 s) is missed by the algorithm. A smaller value of λ would allow to detect this change point as well. On the other hand, a false alarm is raised at time 691 s (marked by the red dot). This error could be avoided by setting a larger λ. This is an example of the trade-off that needs to be tackled for selecting an appropriate value of the regularization parameter λ.
In the following sections, we perform a numerical evaluation of the TREFEX algorithm and compare it with the GLR method presented in [35] and summarized in Section 5.2. Single sensor (Section 5.3) and sensor array (Section 5.5) configurations are considered. The strategy for selecting the value of the regularization parameter λ is evaluated in Section 5.4.
5.1. Evaluation Methodology
The proposed change detection method returns a list of change points, which we will call alarms. Additionally, for our experiments the ground truth dataset that contains the time of the actual change points is available. A true alarm is defined as the closest alarm to a change point. An alarm that is not a true alarm is a false alarm. According to these definitions, TP (true positive) is given by the number of true alarms. FP (false positive) is given by the number of false alarms and FN (false negatives) is given by the number of change points minus the number of true alarms. From these numbers we compute the well-known performance metrics precision and recall:
A maximum precision value is achieved when all the alarms are true change points. A maximum recall value means that no true change point was missed by the algorithm. The perfect algorithm maximizes both values, i.e., detects all change points without raising false alarms.
A value of the regularization parameter λ corresponds the trade-off between precision and recall. A common method to formalize this trade-off is the harmonic mean of precision and recall, known as F-measure:
The F-measure can be used to compare points on the precision-recall curve, obtained for different values of λ. The F-measure is used as evaluation criterion in this paper; higher values correspond to a better performance.
Another evaluation criterion is based on how close (in time) the true alarms are to the change points. To this respect we define the Average Distance (AD) performance measure as sum of the distance between the true alarms and the corresponding change points divided by the number of true alarms.
${t}_{i}^{cp}$ indicates the time the i-th change point happened and ${t}_{i}^{ta}$ is the associated true alarm produced by the algorithm.
5.2. Generalized Likelihood Ratio
The Generalized Likelihood Ratio (GLR) approach is summarized here since it is compared with the TREFEX algorithm below. We compare against GLR, because, to our best knowledge, it is the only change point detection algorithm that was specifically applied to MOX sensors.
GLR calculates the likelihood ratio between the hypotheses of having a change point at sample j versus the hypothesis of not having a change point:
The likelihoods are based on a parametric probability distribution function, which is governed by a set of parameters θ. In this case we consider Gaussian distributions so θ is represented by mean and variance. θ_{0} denotes the mean/variance estimated using all samples in the time interval. θ_{1} denotes the mean/variance estimated using only the samples collected after a hypothetical change point j. If g_{k} is above a preselected threshold h, then a change point is declared and the data collected before the change point are not considered any longer to detect new change points.
5.3. Single Sensor Analysis
In Figure 7 an example of precision-recall curve comparing TREFEX and GLR for the MiCS 2610 sensor averaged over 54 experiments is shown. Qualitatively similar graphs were obtained for the other sensors. The maximum F-measure is attained at the point of the precision-recall curve that is closest to the upper right corner. It is clear from the figure that the maximum F-measure attained by the TREFEX algorithm is higher than the one obtained by GLR. Table 2 shows how TREFEX outperforms GLR for each of the considered sensors.
Additionally, the ranking of the sensors with respect to the F-measure provided in Table 2 shows that both approaches achieve the best results with the same three sensors (MiCS 2710, MiCS 5135 and MiCS 2610).
Moreover, Table 2 shows the average distance (AD) between true alarms and change points across all the 54 experiments. Also with respect to this performance measure, TREFEX clearly outperforms GLR since true alarms are in all cases much closer (only half the deviation) to the real change points. The principle behind the GLR algorithm is to accumulate enough evidence of changes before declaring an alarm, but the first steps after a change look no different than the old signal plus noise. Hence the change is detected somewhere on the slope of the exponential sensor response and this introduces some offset. In contrast, by fitting exponentials to the signal, TREFEX is able to pinpoint the time of the change more accurately.
5.4. Parameter Selection
Figure 8 shows how different values of the regularization parameter λ control the trade-off between preserving the signal in the estimated trend and representing it by a small number of exponential functions. In case of λ = 0.125 the estimated trend is very similar to the signal, making the identification of real change points hard. For λ = 512 the estimated trend misses many of the change points. With the parameter selection method discussed in Section 4.3 the selected λ for this experiment is 4. This value results in a trend that does not miss any of the change points and does not raise any false alarms.
Directly selecting the λ based on the F-measure is not possible for most applications, since it requires to know the change points' ground truth. We show that our substitute of minimizing the distance δ in the trade-off curve (see Section 4.3) is highly correlated to maximizing the F-measure. This means that points close to the origin in the trade-off curve (see Figure 5) correspond to a high F-measure. Using the available data, the distance δ and the F-measure were computed for 13 different values of λ (λ = [2^{−4}, 2^{−3},…, 2^{8}]). As can be seen in Table 3, the linear correlation analysis between both values was performed using the Pearson coefficient and showed a strong negative correlation. Hence, we conclude that the distance to the origin is a suitable heuristic to select the hyper-parameter λ.
5.5. Sensor Array Analysis
In general, the combination of multiple sensors aims at increasing the robustness and reliability of the overall change point detection. Here we present numerical results on how the different norms proposed in Section 4.4 perform for aggregating the response of sensors deployed in a sensor array. Table 4 reports the performance based on the maximum F-measure obtained for the sensor array (all 11 sensors) with l_{1}-norm, l_{2}-norm and l_{∞}-norm.
The best combination result for the sensor array was achieved using l_{2}-norm. The sensor array aggregation using the l2-norm achieves a higher F-measure than eight of the eleven sensors and slightly worse than the three best performing sensors (MiCS 2610, MiCS 2710, and MiCS 5135, see Table 2). The results for the sensor array are slightly worse than the best results obtained with a single sensor. A likely reason is that the p-norm couples the individually detected change points in a specific way that may either discard correct individual change point detections or consider too many erroneous change detections. Low values for the average difference between detected and ground truth change point time are achieved for all considered norms.
In Figure 9, we compare the sensor array results to single sensor performances. Figure 9(a) presents the case in which the single sensor (MiCS 5135) has a higher maximum F-measure than the sensor array results. Figure 9(b) shows the comparison with another single sensor (TGS 2600-1). In this case the results obtained aggregating the sensors with l_{2}-norm and l_{∞}-norm clearly outperform the single sensor.
Combining the sensors using l_{1}-norm, which corresponds to the sum of the individually calculated kink vectors, does not perform well in general, because it aggregates all the false alarms. This leads to lower precision values, as shown in Figure 9.
The evaluation of the parameter selection for the sensor array case has been done in a similar way for the single sensor parameter selection. Table 5 shows the Pearson correlation between the Euclidean distances to the origin of the trade-off curve and the F-measure for different norms. The Euclidean distance δ in the trade-off curve and the F-measure were computed for 13 different values of λ (λ = [2^{−4}, 2^{−3}, …, 2^{8}]). Again, the Pearson correlation coefficients show highly negative values, confirming the usefulness of the heuristic for the sensor array as well.
Table 6 reports the performance of TREFEX and GLR for some selected subsets of the sensor array. The selected subsets are the same as in [35]. Again, for the sensor array configuration the TREFEX algorithm outperforms GLR both with respect to the maximum F-measure and with respect to the average distance of the alarm from the change points.
6. Conclusions and Future Work
In this paper we introduced TREFEX, a novel change point detection algorithm, especially designed for MOX gas sensors in an open sampling system. TREFEX models the response of a MOX sensor as a piecewise exponential signal, and considers the junctions between consecutive exponentials as change points. TREFEX can be used for single MOX sensors or for arrays of MOX sensors. Moreover, since TREFEX is designed to detect exponential trends, it can be applied to any kind of first order sensor. Along with the proposed algorithm, a parameter selection method for choosing the regularization parameter is suggested. The performance of the algorithm is evaluated experimentally for different sensors and scenarios and compared with the previously proposed GLR method.
Our results show that solving the change detection problem for MOX gas sensors with the TREFEX algorithm is advantageous compared with the GLR method in several ways.
First, and most importantly, TREFEX outperforms the GLR method. The maximum F-measure is higher for all considered sensors and experiments. Second, the algorithm does not involve a tuning parameter that has to be set arbitrarily by the user. Instead, an automatic parameter selection step is provided with the algorithm. Third, the computational requirements for TREFEX are lower. While GLR scales quadratically with the length of the considered signal, TREFEX scales linearly. Last but not least, the estimate that TREFEX provides about the position of the change points in time is much more accurate. GLR requires accumulating enough evidence before it declares a change, while TREFEX, due to considering the whole signal, is able to detect the position of the change points more accurately.
One of the major improvement to the presented TREFEX algorithm will be its extension to an on-line version based on the work in the area of continuous-time trend filtering [18]. Another important step is its application to scenarios in uncontrolled outdoor environments. While for developing algorithms carefully controlled experiments are necessary, relevant applications for open sampling systems are far more challenging. Hence the next step for us is to apply the algorithm to sensors and sensor arrays mounted on a mobile robot platform and use the detected changes in the gas concentration to build maps with them [5].
Conflict of Interest
The authors declare no conflict of interest.
References
- Wang, X.R.; Lizier, J.T.; Obst, O.; Prokopenko, M.; Wang, P. Spatiotemporal Anomaly Detection in Gas Monitoring Sensor Networks. Lect. Note. Comput. Sci. 2008, 4913, 90–105.
- Li, M.; Liu, Y.; Chen, L. Non-Threshold based Event Detection for 3D Environment Monitoring in Sensor Networks. Proceedings of the 27th International Conference on Distributed Computing Systems, ICDCS'07, Toronto, Canada, 25–29 June 2007; p. 9.
- CitiSense. Available online: https://sosa.ucsd.edu/confluence/display/CitiSensePublic/CitiSense (accessed on 3 June 2013).
- Air Quality Egg. Available online: http://www.kickstarter.com/projects/edborden/air-quality-egg (accessed on 3 June 2013).
- Lilienthal, A.; Trincavelli, M.; Schaffernicht, E. It's always smelly around here! Modeling the Spatial Distribution of Gas Detection Events with BASED Grid MapsAccepted for publication in. Proceedings of International Symposium on Olfaction and Electronic Nose 2013, ISOEN'13, Daegu, Korea, 2–5 July 2013.
- Trincavelli, M. Gas discrimination for mobile robots. Künstliche Intell. 2011, 25, 351–354.
- Wang, C.; Yin, L.; Zhang, L.; Xiang, D.; Gao, R. Metal oxide gas sensors: Sensitivity and influencing factors. Sensors 2010, 10, 2088–2106.
- Bennetts, V.H.; Lilienthal, A.J.; Trincavelli, M. Creating True Gas Concentration Maps in Presence of Multiple Heterogeneous Gas Sources. Proceedings of 2012 IEEE Sensors, Taipei, Taiwan, 28–31 October 2012; pp. 554–557.
- Monroy, J.; Lilienthal, A.; Blanco, J.; Gonzalez-Jimenez, J.; Trincavelli, M. Calibration of MOX Gas Sensors in Open Sampling Systems Based on Gaussian Processes. Proceedings of 2012 IEEE Sensors, Taipei, Taiwan, 28–31 October 2012; pp. 1743–1746.
- Aroian, L.A.; Levene, H. The Effectiveness of Quality Control Charts. J. Am. Stat. Assoc. 1950, 45, 520–529.
- Baillie, R.T.; Chung, S.K. Modeling and forecasting from trend-stationary long memory models with applications to climatology. Int. J. Forecast. 2002, 18, 215–226.
- Tourneret, J.Y.; Doisy, M.; Lavielle, M. Bayesian off-line detection of multiple change-points corrupted by multiplicative noise: application to {SAR} image edge detection. Signal Process. 2003, 83, 1871–1887.
- Mas, J.F. Monitoring land-cover changes: A comparison of change detection techniques. Int. J. Remote Sens. 1999, 20, 139–152.
- Basseville, M.; Nikiforov, I.V. Detection of Abrupt Changes: Theory and Application; Prentice-Hall, Inc: Upper Saddle River, NJ, USA, 1993.
- Adams, R.P.; MacKay, D.J. Bayesian Online Changepoint Detection; University of Cambridge: Cambridge, UK, 2007.
- Gustafsson, F. The Marginalized Likelihood Ratio Test for Detecting Abrupt Changes. IEEE Trans. Autom. Control 1996, 41, 66–78.
- Desobry, F.; Davy, M.; Doncarli, C. An online kernel change detection algorithm. IEEE Trans. Signal Process. 2005, 53, 2961–2974.
- Seung-Jean, K.S.J.; Kwangmoo, K.K.; Boyd, S.P.; Gorinevsky, D.M. l_{1} trend filtering. SIAM Rev. 2009, 51, 339–360.
- Huang, X.; Matijas, M.; Suykens, J. Hinging hyperplanes for time-series segmentation. IEEE Trans. Neural Netw. Learn. Syst. 2013, 1.
- Sidiropoulos, N.D.; Bro, R. Mathematical programming algorithms for regression-based nonlinear filtering in RN. IEEE Trans. Signal Process. 1999, 47, 771–782.
- Ihokura, K.; Watson, J. The Stannic Oxide Gas Sensor: Principles and Applications; CRC Press: Boca Raton, FL, USA, 1994.
- Janata, J. Principles of Chemical Sensors; Springer: Dordrecht, The Netherlands, 2009.
- Barsan, N.; Simion, C.; Heine, T.; Pokhrel, S.; Weimar, U. Modeling of sensing and transduction for p-type semiconducting metal oxide based gas sensors. J. Electroceram. 2010, 25, 11–19.
- Nakamoto, T.; Yoshikawa, K. Movie with scents generated by olfactory display using solenoid valves. IEICE Trans. Fundam. Electron. Commun. Comput. Sci. 2006, E89-A, 3327–3332.
- Figaro Engineering, Inc. Available online: http://www.figarosensor.com/ (accessed on 3 June 2013).
- e2v Technologies, Inc. Available online: http://www.e2v.com/ (accessed on 3 June 2013).
- Monroy, J.G.; Gonzlez-Jimnez, J.; Blanco, J.L. Overcoming the slow recovery of MOX gas sensors through a system modeling approach. Sensors 2012, 12, 13664–13680.
- Leser, C.E.V. A simple method of trend construction. J. R. Stat. Soc. B 1961, 23, 91–107.
- CVX Research, I. CVX: Matlab Software for Disciplined Convex Programming. Available online: http://cvxr.com/cvx (accessed on 3 June 2013).
- Gurobi Optimization, I. Gurobi Optimizer Reference Manual. Available online: http://www.gurobi.com (accessed on 3 June 2013).
- Boyd, S.; Vandenberghe, L. Convex Optimization; Cambridge University Press: New York, NY, USA, 2004.
- Kiefer, J. Sequential minimax search for a maximum. Proc. Am. Math Soc. 1953, 4, 502–506.
- Tibshirani, R. Regression shrinkage and selection via the lasso. J. R. Stat. Soc. B 1996, 58, 267–288.
- Yuan, M.; Lin, Y. Model selection and estimation in regression with grouped variables. J. R. Stat. Soc. B 2006, 68, 49–67.
- Pashami, S.; Lilienthal, A.J.; Trincavelli, M. Detecting changes of a distant gas source with an array of MOX gas sensors. Sensors 2012, 12, 16404–16419.
Table 1. Time constants calculated of the rise and decay phase of each sensor. The sensors were used without any modifications to improve response and decay characteristics. |
Sensor | T.C. Response (s) | T.C. Decay (s) |
---|---|---|
MiCS 2610 | 4.96 | 14.92 |
MiCS 2710 | 17.18 | 23.69 |
MiCS 5521(1) | 2.43 | 5.54 |
MiCS 5121 | 5.97 | 10.72 |
MiCS 5135 | 5.37 | 14.65 |
MiCS 5521(2) | 3.13 | 5.20 |
TGS 2600(1) | 5.22 | 19.31 |
TGS 2611 | 3.52 | 7.36 |
TGS 2620 | 3.29 | 15.58 |
TGS 2600(2) | 5.19 | 19.74 |
TGS 2602 | 4.84 | 36.25 |
Table 2. Comparison between the TREFEX and the GLR algorithm. TREFEX outperforms GLR both in terms of the maximum F-measure and the average distance of the alarms from the change points. The value of the selected parameters (λ for TREFEX, h for GLR) are also given. The ranking of the sensors w.r.t. maximum F-measure shows good agreement between the two algorithms regarding which of the sensors are most suitable to detect change points for the given problem. |
Model | Exponential Trend Filtering | GLR Method | ||||||
---|---|---|---|---|---|---|---|---|
Rank | Maximum F-measure | λ | Average Distance(s) | Rank | Maximum F-Measure | h | Average Distance(s) | |
MiCS 2610 | 3 | 0.90 | 8 | 3.72 | 3 | 0.85 | 90 | 7.85 |
MiCS 2710 | 1 | 0.95 | 16 | 4.78 | 2 | 0.87 | 120 | 11.12 |
MiCS 5521(1) | 11 | 0.77 | 8 | 5.59 | 10 | 0.70 | 88 | 11.52 |
MiCS 5121 | 4 | 0.88 | 16 | 5.19 | 4 | 0.82 | 91 | 9.82 |
MiCS 5135 | 2 | 0.92 | 8 | 4.17 | 1 | 0.87 | 93 | 8.60 |
MiCS 5521(2) | 8 | 0.81 | 16 | 5.05 | 6 | 0.77 | 82 | 11.61 |
TGS 2600(1) | 6 | 0.83 | 4 | 6.05 | 7 | 0.72 | 107 | 11.14 |
TGS 2611 | 5 | 0.84 | 16 | 5.51 | 5 | 0.79 | 93 | 11.52 |
TGS 2620 | 9 | 0.80 | 4 | 5.89 | 8 | 0.72 | 93 | 12.26 |
TGS 2600(2) | 7 | 0.83 | 4 | 6.40 | 9 | 0.72 | 93 | 11.63 |
TGS 2602 | 10 | 0.78 | 0 | 6.57 | 11 | 0.56 | 65 | 13.42 |
Table 3. Pearson correlation coefficient between the Euclidean distance δ of the trade-off curve to the origin and F-measure for each sensor. The strong correlation shows that the distance to the origin is a suitable heuristic to select the hyper-parameter λ. |
Sensor | MiCS | TGS | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
2610 | 2710 | 5521(1) | 5121 | 5135 | 5521(2) | 2600(1) | 2611 | 2620 | 2600(2) | 2602 | ||
Correlation | −0.88 | −0.81 | −0.69 | −0.79 | −0.81 | −0.50 | −0.84 | −0.73 | −0.88 | −0.86 | −0.73 |
Table 4. Comparison of different norms used to combine the answers of the sensor array. |
Model | Exponential Trend Filtering | |||
---|---|---|---|---|
Rank | Maximum F-Measure | λ | Average Distance(s) | |
Multivariate - l_{1}-norm | 3 | 0.83 | 32 | 4.20 |
Multivariate - l_{2}-norm | 1 | 0.89 | 32 | 3.98 |
Multivariate -l_{∞}-norm | 2 | 0.88 | 64 | 3.92 |
Table 5. Pearson correlation between Euclidean distances δ to the origin of the trade-off curve and the F-measure for different norms. |
Model | Multivariate | ||
---|---|---|---|
l_{1}-norm | l_{2}-norm | l_{∞}-norm | |
Correlation | −0.72 | −0.67 | −0.66 |
Table 6. Maximum F-measure calculated by Multivariate TREFEX using l_{2}-norm and Multivariate GLR for selected subset of the array. The corresponding hyper-parameters and detection intervals of maximum F-measure are also presented. |
Model | Exponential Trend Filtering | GLR Method | ||||
---|---|---|---|---|---|---|
Maximum F-Measure | λ | Average Distance(s) | Maximum F-Measure | h | Average Distance(s) | |
MiCS 2710-MiCS 5521(2) | 0.91 | 16 | 4.23 | 0.87 | 232 | 9.13 |
MiCS 2710-TGS 2602 | 0.92 | 16 | 4.37 | 0.84 | 205 | 12.41 |
MiCS 2710-TGS 2602-MiCS 5521(2) | 0.90 | 16 | 4.11 | 0.86 | 209 | 8.68 |
MiCS 5521(2)-TGS 2602-MiCS 2610 | 0.86 | 32 | 3.43 | 0.84 | 182 | 8.08 |
MiCS 2610-TGS 2611-TGS 2602 | 0.88 | 16 | 3.81 | 0.85 | 220 | 8.16 |
© 2013 by the authors; licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution license (http://creativecommons.org/licenses/by/3.0/).