Next Article in Journal
Application of Machine Learning for the in-Field Correction of a PM2.5 Low-Cost Sensor Network
Previous Article in Journal
Assessing the Validity and Reliability of A Low-Cost Microcontroller-Based Load Cell Amplifier for Measuring Lower Limb and Upper Limb Muscular Force
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Robust Wavelength Selection Using Filter-Wrapper Method and Input Scaling on Near Infrared Spectral Data †

by
Divo Dharma Silalahi
1,
Habshah Midi
2,3,*,
Jayanthi Arasan
2,3,
Mohd Shafie Mustafa
2,3 and
Jean-Pierre Caliman
1
1
SMART Research Institute, PT. SMART TBK, Pekanbaru 28289, Riau, Indonesia
2
Institute for Mathematical Research, Universiti Putra Malaysia (UPM), Serdang 43400, Selangor, Malaysia
3
Department of Mathematics, Faculty of Science, Universiti Putra Malaysia (UPM), Serdang 43400, Selangor, Malaysia
*
Author to whom correspondence should be addressed.
The results of this study were presented at the 62nd International Statistical Institute-World Statistics Congress (ISI-WSC 2019), held in Kuala Lumpur (Malaysia), on 19 August 2019.
Sensors 2020, 20(17), 5001; https://doi.org/10.3390/s20175001
Submission received: 4 August 2020 / Revised: 28 August 2020 / Accepted: 30 August 2020 / Published: 3 September 2020
(This article belongs to the Section Chemical Sensors)

Abstract

:
The extraction of relevant wavelengths from a large dataset of Near Infrared Spectroscopy (NIRS) is a significant challenge in vibrational spectroscopy research. Nonetheless, this process allows the improvement in the chemical interpretability by emphasizing the chemical entities related to the chemical parameters of samples. With the complexity in the dataset, it may be possible that irrelevant wavelengths are still included in the multivariate calibration. This yields the computational process to become unnecessary complex and decreases the accuracy and robustness of the model. In multivariate analysis, Partial Least Square Regression (PLSR) is a method commonly used to build a predictive model from NIR spectral data. However, in the PLSR method and common commercial chemometrics software, there is no standard wavelength selection procedure applied to screen the irrelevant wavelengths. In this study, a new robust wavelength selection procedure called the modified VIP-MCUVE (mod-VIP-MCUVE) using Filter-Wrapper method and input scaling strategy is introduced. The proposed method combines the modified Variable Importance in Projection (VIP) and modified Monte Carlo Uninformative Variable Elimination (MCUVE) to calculate the scale matrix of the input variable. The modified VIP uses the orthogonal components of Partial Least Square (PLS) in investigating the informative variable in the model by applying the amount of variation both in X and y { SSX , SSY } , simultaneously. The modified MCUVE uses a robust reliability coefficient and a robust tolerance interval in the selection procedure. To evaluate the superiority of the proposed method, the classical VIP, MCUVE, and autoscaling procedure in classical PLSR were also included in the evaluation. Using artificial data with Monte Carlo simulation and NIR spectral data of oil palm (Elaeis guineensis Jacq.) fruit mesocarp, the study shows that the proposed method offers advantages to improve model interpretability, to be computationally extensive, and to produce better model accuracy.

1. Introduction

The selection of relevant wavelengths in chemometrics analysis in Near Infrared (NIR) spectral data is crucial to prevent the number of relevant variables to be removed in the analysis. Partial Least Square Regression (PLSR), a conventional method used in chemometrics, has no standard procedure. There are related studies of its application in oil and fat assessment in oil palm (Elaeis guineensis Jacq.). However, many researchers are still using the band partition experiments (see [1,2,3]) by manually segmenting the wavelengths into several bands: visible (400–700 nm), NIR (701–1100 nm), Shortwave Infrared 1 (SWIR1: 1101–1351 nm), SWIR2 (1400–1800 nm), and SWIR3 (2000–2500 nm). The selection procedure is commonly done based on trial and error [1] through the improvement in model accuracy attained. This observation is inefficient and requires advanced experience. Moreover, an in-depth analysis needs to be carried out to understand the NIR spectra signature based on its chemical information. A wavelength selection method is therefore required to assess the contribution of each wavelength. This selection will reduce the number of variables used in the model. In the interpretation, the selection method may give a better understanding of the underlying process of the sample studied.
In the review papers (see [4,5,6,7]), several recommended wavelength selection methods have been discussed. The researchers have highlighted the limitations and properties of each method presented. No one has suggested which method is better than the other. A convenient approach is to make a comparison between the methods and examine their superiority using the experimental simulation and real given problems. There are three main categories of variable selection methods: filter, wrapper, and embedded. The main differences between these categories are based on their processing steps. In the filter methods, relevant variables are ranked and selected according to the threshold on the relevancy index calculated from the fitted model [8,9]. The filter methods are considered fast and straightforward because no learning algorithm is required in the computational process. However, the filter methods do not take into account biasness in the learning model and neglect any conditional dependence (or independence) that might probably exist [10]. In the wrapper methods, the supervised learning approach adopts the search algorithm iteratively with either the deterministic or randomization [5]. The wrapper methods are known to be costly because in the evaluation criterion, a predefined learning algorithm and cross-validation procedure is performed [5]. In the embedded methods, the advantages of both the filter and wrapper methods are seized [7]. The embedded methods evaluate the quality of selected relevant variables during the model building without performing an evaluation process on the learning model [11]. This embedded strategy has motivated the current study to integrate the combination steps in the filter and wrapper methods with the objective to improve the performance of the PLSR model.
There are several methods associated with both the filter and the wrapper methods. In the filter methods, some selection procedures have been reported, such as the Stepwise Regression Coefficients [12], Loading Weights [13], Correlation Coefficient [14], and Variable Importance in Projection (VIP) [15]. Among these procedures, the VIP has earned considerable attention because of its stability and consistency to select the relevant wavelengths and its relatively low computational cost. Using different dataset matrix as simulation, the VIP outperforms the other selection methods (see [6,16]). In the classical VIP [17], the score is calculated by using the weight combination of the overall component variables of the squared PLSR weight. However, the score highlights the variation only in the predictive components without including the orthogonal components. An upgrade of the VIP score based on the Orthogonal Projections to Latent Structures (OPLS) [18] was then introduced. The OLPS-VIP score systematically includes and differentiates the variation both in the predictive and orthogonal components. In some studies (see [18,19]), the OPLS-VIP has shown its superiority to the classical VIP. In the wrapper methods, some selection methods have also been discussed, such as the Genetic Algorithm (GA) [20], Uninformative Variable Elimination (UVE) [21], Iterative Predictor Weighting [22], and Backward Variable Elimination [23]. Among these methods, the UVE method is the most consistent method to improve the PLSR performance [21,24].
Nonetheless, the leave-one-out validation procedure is still applied in the classical UVE. This procedure leads to overfitting and is time-consuming while acquiring the stability values for a large dataset. As an improvement, the Monte Carlo Uninformative Variable Elimination (MCUVE) method was proposed by Cai [25]. The MCUVE adopts the principle of Monte Carlo to evaluate the stability of the corresponding coefficients. However, the reliability coefficient and the cut-off criterion performed in the method to date is not robust enough. Therefore, this has motivated the current study to propose a slight improvement to make the MCUVE procedure more robust.
In practice, it is difficult to eliminate all the irrelevant wavelengths in spectra processing. A smaller number of wavelengths (as predictor variables) used in the model calibration will result in overfitting or underfitting. To overcome this, a new robust procedure to highlight the relevant wavelengths and to downgrade the influence of the irrelevant wavelengths in the PLSR model is needed. It has been investigated that the scaling method in the PLS model is also essential to improve the convergence speed of the algorithm [26,27]. In addition, the auto-scaling method using the mean centering and standard deviation, is a common scaling procedure in the data pre-processing step. Hence, another scaling strategy should be considered in the improvement.
The main objectives of this study are (1) to establish a new procedure for wavelengths selection called the modified VIP-MCUVE (mod-VIP-MCUVE) with input scaling strategy in the PLSR model; (2) to evaluate the performance of the proposed method with the standard auto-scaling procedure in the PLSR and the input scaling strategy using the classical VIP and MCUVE methods; (3) to apply the proposed method on the artificial data and NIR spectra of oil palm fruit mesocarp (fresh and dried ground).

2. Materials and Methods

2.1. Partial Least Square Regression

Partial Least Square Regression (PLSR) was firstly initiated by Wold [28] as the generalized statistical method and standard method used in the spectroscopy analysis. Let us define a multiple regression model that relates several m predictors X to a response variable y . In matrix form this can be written as
y = X b + e
where y is an n × 1 vector of the response variable, X is n × m matrix of predictors, b is a m × 1 vector of unknown parameters, and e is a n × 1 vector of random errors. The solution for the estimator b using the least-squares method is given as
b ^ = ( X T X ) 1 X T y
Here the data set problem is in condition with a large number of m predictors. Hence, there will be an infinite number of solutions for estimating b as X T X is singular, which does not meet the usual trivial theorem on rank in the regression. In this case, it is necessary to extract the new latent variables by maximizing a covariance criterion between predictor X and response y that link the central values of these two sets [29].
Initialize a starting n × 1 score vector of u from any single y as in Equation (1), there exists an outer relation for predictor X as
X = V P T + E
where P { p g = ( X T v g ) / ( v g T v g ) } g = 1 l is the matrix m × l consists of loading vector m × 1 , v g { v g = ( X w j ) / ( w j T w j ) } g = 1 l is the n × 1 column vector of scores x j in X involves w j { w j = ( X T u ) / ( u T u ) } j = 1 m as m × 1 vector of weight for X , V is a n × l matrix of n × 1 vector v g , and E is a n × m matrix of residual in outer relation for predictor X . Following these, the outer relation for the response y also can be defined as
y = u q T + f
where q is the loading l × 1 vector { q g = ( y T v g ) / ( v g T v g ) } g = 1 l and f is a n × 1 vector of residual in y . u { u = b g v g } g = 1 l is also called as linear inner relation between X and y block score, which simply can be written as
u = V b i n n e r + g
where b i n n e r { b g = u T v g / ( v g T v g ) } g = 1 l is a l × 1 vector of regression coefficient as Least Square solution on the decomposition of vector u , and g is a n × 1 vector of residual in the inner relation. Applying the normalization in P , W , and q as the process to improve the inner relation, the mixed relation of PLSR model by integrating Equations (4) and (5) results as
y = u q T + f y = V b i n n e r q T + g q T + f y = V b i n n e r q T + f y = V a T + f
where a { a T = b i n n e r q T } is the l × 1 vector coefficient and f { f = g q T + f } denotes n × 1 vector of residual in the mixed relation. Equation (6) holds a = V T y , and without loss of generality X = V P T as in Equation (3), the formulation in Equation (6) can be reconstructed by multiplying the two sides with weight matrix of W which is
y = X W a + f y = X W ( P T W ) 1 a + f
with V = X W and W = W ( P T W ) 1 .
Let us define b P L S R = W ( P T W ) 1 a as m × 1 vector coefficient of mixed relation in the PLSR, then Equation (7) is equivalent to
y = X b P L S R + f
where f has to be minimized. Applying the relation in Equations (3) and (4), so that W = X T u , P = X T V ( V T V ) 1 . Therefore, the estimator for the parameter b P L S R can be calculated as
b ^ P L S R = X T u ( V T X X T u ) 1 V T y , b ^ P L S R m × 1
b ^ P L S R denotes the m dimensional vector of regression coefficient in the PLSR model.

2.2. Variable Selection Methods

2.2.1. Variable Importance in Projection

In the classical VIP [17], the VIP score measures the contribution of each j th wavelength in the multivariate models based on the projection to the PLS components. The method becomes popular because of its simple procedure and less computational complexity [16]. The VIP score is formulized through the normalized loading weights v g { v g = w g / w g } and the explained sum of squares for the predictive component y . Mathematically, the VIP score for each j th wavelength in the PLS model with l components can be calculated as
VIP j 2 = m g = 1 l ( v g 2 SSY c o m p ; g ) g = 1 l SSY c o m p ; g
where m is the number of predictors, SSY c o m p ; g is the variance of y explained by the g th PLS component, and g = 1 l SSY c o m p ; g is the total variance summarized by the PLS model over l components. The criteria are the j th wavelength with VIP score > 1 is considered as the most relevant, while the VIP score < 0.5 is considered as irrelevant wavelength.

2.2.2. Uninformative Variable Elimination

The classical UVE method [21] uses the leave-one-out jackknife method and artificial random noise variables denoted as n × m matrix N to compute the statistic parameters. The reliability of each wavelength through variable selection criterion then is calculated based on the PLSR coefficient b P L S R = [ b 1 , b 2 , , b m ] . However, when handling a large dataset, this procedure becomes costly [25,30]. As a solution, the Monte Carlo method, which is based on random selection and probability statistics, is applied in the UVE and so-called as MCUVE [25]. In the MCUVE, some specific number of a subsample N t from the training set are randomly selected to build the r PLS sub-model. Then, it produces the number of set of PLSR coefficient b ^ P L S R as r × m matrix. The reliability c j is computed based on the fraction between the mean and standard deviation of m × 1 column vector of PLSR coefficient b i j in each j th wavelength from the i vectors of coefficients. The highest c j represents the most reliable wavelengths; otherwise, the class is as a less reliable wavelength.
c j = b ¯ j s ( b j ) b ¯ j = i = 1 r b i j r s ( b j ) = ( i = 1 r ( b i j b ¯ j ) 2 r 1 ) 1 2
The cut-off threshold criterion in MCUVE is defined through the maximum absolute value of the reliability c a r t i f of the artificial random noise variables matrix N . The wavelength with c j less than the artificial random noise c a r t i f is removed from the PLSR model.
| ( c j ) | < | max ( c a r t i f ) |

3. Input Scaling of Filter-Wrapper Method

Auto-scaling is a common input scale method used to standardize a dataset in the modeling process of PLSR. This auto-scaling transforms each numeric in the input variable into the same variance through its mean and standard deviation [31,32]. However, this method is observed disadvantageous when the original input variables are measured on the same scale. Moreover, it removes the interpretability related to the loadings [33]. Taking a particular concern in the intensity power of Near Infrared region, auto-scaling fails to keep useful interpretive information about the wavelength contribution since the low-intensity regions are enhanced to the same magnitude as like in the high intensity [34]. The scaling method is very crucial to correct for wavelengths-dependent scattering effects in the NIR spectra dataset [35,36]. To overcome this, a new alternative input scaling method based on the Filter and Wrapper methods is proposed. This method is then simply denoted as mod-VIP-MCUVE. Besides correcting the wavelengths-dependent scattering effects and preserving the chemical interpretive information in each wavelength, the proposed method will eliminate the influence of irrelevant wavelengths during the modeling process. In general, the three main computational steps of the mod-VIP-MCUVE method are the following.
  • Step 1: Calculate the OPLS-VIP [19] score as initial input variable scaling matrix.
  • Step 2: Run the modified MCUVE procedure using the scaled input matrix of OPLS-VIP to get the reliability scores.
  • Step 3: Re-scale the input matrix using the reliability scores as final scaled input matrix in the PLSR model.
In the OPLS-VIP [19], the VIP score is measured not only based on the projections to the PLS components but also included the orthogonal components. This score considers variations both in the predictor variable X ( SSX ) and the response variable y ( SSY ) . Here, the fourth variant of four versions of OPLS-VIP is preferred due to its interpretative information ability. The OPLS-VIP score uses the combinations { SSX , SSY } in the weighting parameters and normalized loadings v g . The total OPLS-VIP score then is used as the final VIP score as it is calculated based on the VIP p r e d (predictive components) and VIP o r t h o (orthogonal components).
Let us redefine g as the predictive component and g o as the orthogonal component, then l stands for the total number of predictive components, and l o stands for the total number of orthogonal components with m and m o are the total number of variables used in the predictive and orthogonal components, respectively. The formulation for OPLS-VIP score both in predictive and orthogonal can be written as
VIP p r e d = m 2 ( g = 1 l ( v g 2 SSX c o m p ; g ) SSX c u m + g = 1 l ( v g 2 SSY c o m p ; g ) SSY c u m )
VIP o r t h o = m o 2 ( g o = 1 l o ( v o g o 2 SSX c o m p ; g o ) SSX c u m + g o = 1 l o ( v o g o 2 SSY c o m p ; g o ) SSY c u m )
where, as in Equations (12) and (13), the sum of square ( SS ) both in variable y and variable X has subscript c o m p ; g and c o m p ; g 0 . The subscript c o m p ; g refers to the explained SS of g th component in the predictive, while the subscript c o m p ; g 0 refers to the explained SS of g o th component in the orthogonal. The SS with subscript c u m refers to the cumulative explained SS overall components in the model. The total of OPLS-VIP score (denotes as VIP-total) is then formulized as
VIP t o t a l = M 2 ( g o = 1 l o ( v o g o 2 SSX c o m p ; g o ) SSX c u m + g = 1 l ( v g 2 SSX c o m p ; g ) SSX c u m + g o = 1 l o ( v o g o 2 SSY c o m p ; g o ) SSY c u m + g = 1 l ( v g 2 SSY c o m p ; g ) SSY c u m )
where M is the sum of variables used both in the predictive and orthogonal components
{ m = M / ( SSX c u m ; g SSX c u m + SSY c u m ; g SSY c u m ) } ;   { m 0 = M / ( SSX c u m ; g o SSX c u m + SSY c u m ; g o SSY c u m ) }
The above total OPLS-VIP score is used to scale the original wavelength variables as the new input matrix. Let us define X ˜ as the scaled input variable that is calculated by using the OPLS-VIP score on predictor variable X which are initially not scaled. Mathematically it can be written as
X ˜ = X Ω Ω = diag ( λ 1 , λ 2 , , λ m )
where Ω is said to be a diagonal weight matrix with size m × m . The element λ j in the diagonal matrix Ω is a non-negative variable scaling factor for the j th input wavelength. The new scaled X ˜ is used as a new input matrix in the modified MCUVE.
In the modified MCUVE, the drawback of the classical cut-off threshold criterion in Equation (11) has been discussed by Centner (see [21]). As an alternative, a new modified robust cut-off criterion based on a one-sided tolerance interval from Natrella [37] is proposed with a better stable elimination on the irrelevant wavelengths. The cut-off value is calculated using the robust location and scale of the reliability coefficients obtained from the added artificial uninformative random variable. In addition, it includes the value of k factor as a function of the γ desired proportions, α as a level of error, and r number of repetition used in MC random subsample selection. Using the c a r t i f in Equation (11), then the new proposed cut-off criterion can be defined as
cut - off value = median ( ( c j ) a r t i f ) + k ( MAD ( c j ) a r t i f )
where k can be calculated as
k = z γ + z γ 2 a b a
With constant parameters { a = 1 z α 2 2 ( r 1 ) } and { b = z γ 2 z α 2 r } . This new cut-off criterion benefits from classifying the most ( c j > cut off value ) and less relevant variable for further interpretation. Applying the reliability c j of modified MCUVE as the element λ j in Ω , the new scaled input variable X ˜ for the PLSR model is then updated.

4. Monte Carlo Simulation Study

A simulation study was carried out to evaluate the performance of our proposed method and to compare its performance with some existing methods discussed in this study. Following the simulation study of Kim [26], the artificial dataset was generated randomly using the Uniform distribution (0,1) and included the added noise that follows the normal distribution. This dataset was applied in the linear combination equation with different scenarios. Five sample sizes ( n = 40, 60, 150, 400, and 600), three levels of number of predictor variables ( m = 41, 101, and 201), and five levels of number of important variables (IV = 0.10, 0.20, 0.40, 0.60, and 0.80) were considered. The 100 ( I V ) % of predictor variables were selected as important variables, and the remaining 100 ( 1 I V ) % were considered as less important. The formulation of this simulation can be defined as follows
m = m o + m e c j o ~ U ( 1 , 10 ) ( j o = 1 , 2 , , m o ) c e j e ~ U ( 5 , 20 ) ( j e = 1 , 2 , , m e ) e j ~ N ( 0 , 1 ) ( j = 0 , 1 , 2 , , m ) b ~ U ( 0 , 7 ) X = { c j o , c e j e } + e j ( j = 1 , 2 , , m ; j o = 1 , 2 , , m o ; j e = 1 , 2 , , m e ) i v = { i v 1 , i v 2 , , i v 100 ( I V ) % m } y = X b + e 0 ( i = 1 , 2 , , n ; j = i v 1 , i v 2 , , i v 100 ( I V ) % m )
where m is the total number of predictors, m o is the number of observable variables and the m e { m e = ( m 100 ( I V ) % m ) / 2 } is the number of artificial noise variable. These artificial variables are classified as less important variables in the dataset. In Equation (17), the c j o , c e j e , and e j are independent of each other while X and y are illustrated as observable variable. The c j o follows the Uniform distribution (1,10) with size n. The artificial noise variables c e j e are added to the predictor and follow the Uniform distribution (5,20) with size n. This c e j e is classified as a less important variable. The e j follows the standard normal distribution with size n and b represents a vector coefficient for selected important variables which follows the Uniform distribution (0,7) with size m. The i v as the set of selected important variables in m o and e 0 is added error in the linear combination of y . In the PLSR model, the number of PLS components is a principal indicator in the modeling since it is always viewed to be subjective.
In Figure 1, a re-sampling procedure called cross-validation, showing the lowest Root Mean Square Error of Prediction (RMSEP) is used to select the optimum number of PLS components. ‘Selection’ means the selected optimum number of PLS components suggested by cross-validation techniques (highlighted with the blue dashed line). While, the ‘Abs.minimum’ refers to the lowest RMSEP (highlighted with the gray dashed line). As the number of PLS components used in the PLSR model increases, the mean of RMSEP also decreases. The optimum number of PLS components depends on how well the specific number of original variables have contribution to the model. In the experiment using different levels of n , m , and I V , the proposed mod-VIP-MCUVE requires a smaller amount of PLS components to fit minimum RMSEP than the other methods (classical PLSR method with no input scaling applied, VIP and MCUVE). The results are consistent and satisfying. The MCUVE input scaling method is comparable to the proposed method, but it still produces higher RMSEP values. When accommodating fewer variables used as predictor, a faster computational speed will be attained. Based on the global minimum cross-validation, the proposed mod-VIP-MCUVE has succeeded in reducing the RMSEP and improving the accuracy of the PLSR model.
Several statistical measures as evaluation indices are used to assess the goodness of the methods: Root Mean Square Error (RMSE), Coefficient of Determination (R2), Ratio of Performance to Deviation (RPD), and Standard Error (SE). The RMSE indicates the absolute measure of fit, R2 measures the proportion of variation in the data explained by the model, RPD assess the reliability of the goodness of fit for model, and SE measures of the uncertainty in the NIRS prediction. In this section, the Monte Carlo simulation was run 10,000 repeated times, and the results are based on the average of statistical measures (see Table 1). Some scenarios using different treatments are applied to evaluate the PLSR model. According to the results, comparing the RMSE, R2, and SE values in all scenarios, the proposed mod-VIP-MCUVE produced better accuracy than the other methods. The reliability of proposed method based on its RPD is still outperformed. Downgrading the irrelevant variables in the fitting process, the performance of the proposed method is comparable to the classical PLSR method with full variables involved. This shows that the proposed mod-VIP-MCUVE with fewer numbers of variables is more efficient than the traditional PLSR model since it could obtain a similar accuracy.
The most relevant variables selected by the methods are classified based on their cut-off threshold criterion on the score values. To evaluate the interpretability, the calculations are plotted in Figure 2.
In Figure 2, the selection of variables in each method uses different cut-off criteria. The selection includes the use of the VIP total score because this procedure is also included in the proposed mod-VIP-MCUVE method. For selection, the classical VIP and the VIP total method use VIP score >1, while the MCUVE and the mod-VIP-MCUVE use cut-off threshold criterion. The VIP-total suggests a greater number of relevant variables than the classical VIP. The MCUVE uses standard cut-off threshold criterion then classifies a greater number of relevant variables than the classical VIP and the VIP-total. The proposed mod-VIP-MCUVE uses robust cut-off threshold (red line threshold) then collects a higher number of relevant variables than the MCUVE (green line threshold). The mod-VIP-MCUVE succeeds to downgrade (close to 0) the irrelevant variables and highlight the pertinent variables of the computational process. Using the proposed mod-VIP-MCUVE, the final subset of selected relevant variables guarantees the best prediction capabilities with better accuracy than the other methods.
The computing time performance during the fitting process was recorded to evaluate the efficiency of the proposed mod-VIP-MCUVE method. In Figure 3, the proposed mod-VIP-MCUVE method outperformed the others. Using different sample sizes and numbers of predictor use, the proposed method is still consistent in expediting the convergence speed. The PLSR has the worst performance due to its inefficient computing time even the auto-scaling is naturally applied using its mean and standard deviation in the procedure.

5. NIR Spectral Dataset

A total of 80 fruit bunches were collected from the site of breeding trial in Palapa Estate, PT. Ivomas Tunggal, Riau Province, Indonesia. The source of variability such as planting material (Dami Mas, Clone, Benin, Cameroon, Angola, Colombia), planting year (2010–2012) and ripeness level (unripe, under ripe, ripe, over ripe) were considered for covering as much as possible of the whole range of potential variation in the palm population. Right after harvest, the bunch samples were sent immediately to the laboratory for spectral measurement and wet chemistry analysis. The fruit mesocarp samples were collected from 12 sampling positions by considering the vertical and horizontal lines in a bunch (see Figure 4): bottom-front, bottom-left, bottom-back, bottom-right, equator-front, equator-left, equator-back, equator-right, top-front, top-left, top-back, and top-right. The spectral measurement was done by scanning (in contact) the oil palm fruit mesocarp using a Portable Handheld NIR spectrometer, QualitySpec Trek, from Analytical Spectral Devices (ASD Inc., Boulder, CO, USA). A dataset of NIR spectral data is shown in Figure 5 then was used in evaluating the proposed method. The spectral data as a result of the light absorbance in each j wavelength bands were adopted from Beer–Lambert Law [38] and presented in m × 1 column vector x j using the log base 10.
The spectra collection was measured three times in each fruit mesocarp sample. The averaged spectra were used in the computation (see Figure 5). There are two sample conditions with different parameters observed in this study: fresh fruit mesocarp and dried ground mesocarp. The fresh fruit mesocarp is used to estimate the percentage of Oil to Dry Mesocarp (%ODM) and Oil to Wet Mesocarp (%OWM), while the dried ground mesocarp is used to estimate the percentage of Fat Fatty Acids (%FFA). These parameters were analyzed through wet chemistry analysis using the standard test methods from the Palm Oil Research Institute of Malaysia (PORIM) [39,40]. The %ODM is calculated in dry matter basis, which removes the weight of water content, while the %OWM uses wet matter basis. As seen in Figure 6, the distribution of the %ODM is 56.38–86.9%, the %OWM is 19.75–64.81%, and the %FFA is 0.17–6.3%. These wide ranges of the distribution showed the possible actual range variation covered in the analysis.

5.1. Oil to Dry Mesocarp

In the spectral measurement on fresh fruit mesocarp sample (Figure 5a), each spectrum is composed of 489 wavelengths as data points (range 550–2500 nm: 4 nm interval) with a total spectrum collecting about 960 observations. Here, the importance of the wavelengths is generally unknown, and it needs to be investigated. The selection of the most informative wavelengths in the NIR spectral related to the %ODM in the fresh fruit mesocarp is crucial for further data interpretation. The summary of the fitting performance on the dataset using the calibration model with wavelength selection methods is presented in Table 2.
As seen in Table 2, the proposed mod-VIP-MCUVE is superior to the other methods. Using the auto-scaling method, the classical PLSR shows the worst performance compared to the other methods with wavelength selection and input scaling applied. The proposed mod-VIP-MCUVE and MCUVE use fewer PLS components than the classical PLSR and VIP method in the fitting process. The classical PLSR suffers overfitting due to the higher number of PLS components used in the model. The VIP method has low accuracy since there are many variables removed in the computation (see Figure 7). Unlike in the MCUVE method, the proposed mod-VIP-MCUVE has better performance and more efficient computationally because of a lower number of PLS components (26 PLS) in the model. The proposed method succeeds in highlighting the most relevant wavelengths and downgrades the influence of irrelevant wavelengths. This result confirms the usefulness of the wavelengths selection and input scaling applied in the input variables which leads to faster convergence speed.
In Figure 7, information regarding the relevant wavelengths related to the %ODM is presented. All the variable selection methods selected the same spectral region, which has the most relevant contribution to the response variable. The methods show a different cut-off threshold to remove the irrelevant wavelengths in the regions. It can be observed that the VIP, MCUVE, and VIP-total removed many irrelevant wavelengths in the model. As assumed earlier, the more wavelengths are excluded in the model the lower the accuracy in the prediction result. In the fourth plot of mod-VIP-MCUVE, the green line shows the old cut-off threshold using previous MCUVE (threshold = 5.486), while the red line is the new proposed robust cut-off threshold (threshold = 2.916). The proposed mod-VIP-MCUVE method shows better cut-off threshold since there is only a smaller number of wavelengths indicated as the most irrelevant wavelengths.
The diffuse selected reflectance [38] is important to identify the relevant wavelengths related to the %ODM. This exhibits their fundamental attribute to the overtone or combination bands involving the molecular stretching and bending absorption over a wide spectral range. The main absorption in the NIR spectral range is produced by the combination and overtone of C-H, O-H, N-H, and C=O groups. The relevant wavelength ranges are indicated through lowercase alphabet notation in the graphic. Based on Figure 7, it is feasible to observe that the well-defined absorption bands are from visible red color (a: 668–684 nm), CH2 of oil and O-H of water (b: 936–961 nm), C-H absorption by stretching-bending (c: 1232–1344 nm), first overtone (d: 1404–1444) of C-H stretch O-H of water and C-H of oil and its combinations (e: 1700–1776) of C-O oil and C-H stretching by first overtone, C=O absorption by stretching-bending (f: 1888–2008 nm), C-H second overtone of protein and oil (g: 2296–2360 nm), and corresponding to absorption which associated with the second overtone in C-H of oil (h: 2364–2496 nm).

5.2. Oil to Wet Mesocarp

Using a similar set of NIR spectral data from fresh mesocarp as in Section 5.1, the %OWM is used as a response variable. As indicated in Figure 6, the variability of the water content has impacted the shifting of distribution in the response variable. The summary of the fitting performance on the prediction results using different variable selection treatment is presented in Table 3. The comparison shows that the proposed mod-VIP-MCUVE could achieve superior performance than the other methods. It offers the accuracy improvement of RMSE and R2 to the VIP, MCUVE, and PLSR methods. Moreover, the number of selected optimal PLS components used in the calibrated model of the proposed mod-VIP-MCUVE is the smallest (17 PLS) which indicates that important information could still be attained even by using fewer variables. This also has proven the necessity to accomplish the wavelength selection before fitting the calibration model.
In Figure 8, the cut-off threshold in VIP and MCUVE has minimized many wavelengths which forces much important information to become lost. The proposed mod-VIP-MCUVE and new proposed cut-off (red line) succeeds to minimize only the most irrelevant variable and to retain rich information in the spectra. Using old cut-off (green line = 2.881), it has minimized a greater number of wavelengths than the new cut-off (red line = 4.270). From the highlighted wavelength information (mod-VIP-MCUVE) in Figure 8, it is possible to identify the essential molecules in raw NIR spectral and its chemical association to the parameter %OWM. The most relevant wavelengths are O-H of water and CH2 of oil (a: 890–950 nm), C-H second overtone and C=O stretch fourth overtone (b: 1140–1166 nm), first and second overtone of the C-H stretching mode (c: 1326–1370 nm), N-H stretch/C-H stretch first overtone (d: 1558–1650 nm), C-H stretch O-H of water and CH of oil and its combinations (e: 1782–1802 nm), O-H stretch/C-O stretch second overtone combination (f: 1830–1854 nm), and C-H stretch/C=O stretch combination of protein and oil (g: 2126–2184 nm).

5.3. Fat Fatty Acids

Another NIR spectral dataset (Figure 5b) using a total of 839 observations and 500 wavelengths (in the range 500–2500 nm: 4 nm interval) were collected from dried ground mesocarp sample. The importance of the wavelengths related to the %FFA is unknown. The summary of the fitting performance on the dataset using the calibration model with wavelength selection methods is presented in Table 4.
Similar to previous results, the proposed mod-VIP-MCUVE is superior to the classical VIP and the classical PLSR. The performance of the MCUVE is comparable to the mod-VIP-MCUVE. However, the proposed mod-VIP-MCUVE uses less PLS components (25 PLS) than MCUVE, the classical PLSR, and the VIP method in the fitting process. These have proven its efficiency in the computation. The classical PLSR is still suffering overfitting due to a higher number of PLS components used in the model. The VIP method also has low accuracy since there are many variables removed in the computation (see Figure 9). The MCUVE shows its performance is better than the classical PLSR and VIP; however, it is a non-robust method. Again, the proposed mod-VIP-MCUVE method has succeeded in highlighting the most relevant wavelengths and downgraded the influence of irrelevant wavelengths. These results confirmed the usefulness of the wavelengths selection method in the input scaling strategy to improve the classical PLSR model.
As shown in Figure 9, the cut-off threshold in the mod-VIP-MCUVE and MCUVE has succeeded in removing only the most irrelevant wavelengths and keeping the remaining of the relevant variables in the model. The VIP and the VIP-total has removed many variables in the model, and this yields the less relevant variables also included in the removal process. Hence, the less important variables were reduced in the fitting process. As shown in the fourth plot of the mod-VIP-MCUVE method, the old cut-off threshold using previous MCUVE represented as the green line is 8.071, while the new proposed cut-off threshold represented as the red line is 3.039. Based on these thresholds, the number of the irrelevant variables indicated in the mod-VIP-MCUVE is still less than the MCUVE.
The fundamental attribute of diffuse selected reflectance related to the %FFA is crucial to be investigated. The mod-VIP-MCUVE method is used to interpret the selected wavelength, which has well-defined absorption both in the visible and NIR regions. In Figure 9, the most relevant wavelengths are C=O stretch fourth overtone and C-H second overtone (a: 1176–1220 nm), O-H first overtone and C-H of oil (b: 1408–1436 nm), absorption by stretching and bending of C-H stretch first overtone (c: 1652–1688 nm), O-H stretch/C-O second overtone and C=O stretch second overtone (d: 1820–1896 nm), N-H second overtone of protein, absorption by stretching-bending N-H/Amide and C=O stretch second overtone (e: 1996–2040 nm), O-H bend/C-O stretch and C-O-O stretch third overtone, C-H stretch/C=O oil (f: 2116–2288 nm),C-H stretch and C-O of oil (g: 2324–2344 nm), and corresponding to absorption which associated with the second overtone in C-H and C-N-C stretch first overtone of protein (h: 2456–2500 nm).

6. Conclusions

In summary, the NIR spectral region contains rich and abundant information that warrants further interpretation using advanced chemometric techniques. The study has shown that the wavelength selection using input scaling method strategy to be promising, particularly with the application on a high dimension dataset such as the NIRS spectral data. The proposed method is robust since it uses robust reliability weight procedure to rescale the original input matrix. According to the evaluation indices, the proposed mod-VIP-MCUVE method confirmed its superiority to the classical PLSR, the VIP method, and the MCUVE method. Using the modified robust cut-off threshold, the proposed method succeeds to highlight the irrelevant wavelengths in the model. Moreover, the proposed method also has the benefit to reduce the data dimension and to improve the model accuracy and computational complexity. The proposed method has even investigated successfully the fundamental attribute of diffuse selected reflectance of the NIRS spectral absorption. This is essential in the improvement of the chemical interpretability. Further, the input scaling procedure using robust selection procedure on optimum number of PLS component is expected to get better improvement in the computational complexity.

Author Contributions

Conceptualization and methodology: D.D.S., H.M., J.A., M.S.M., J.-P.C.; Data Collection: D.D.S., H.M., J.-P.C.; Computational and Validation: H.M., J.A., M.S.M.; First draft preparation: D.D.S., H.M.; Writing up to review and editing: D.D.S., H.M., J.A., M.S.M., J.-P.C. All authors have read and agreed to the published version of the manuscript.

Funding

The present research was partially supported by the Universiti Putra Malaysia Grant under Putra Grant (GPB) with project number GPB/2018/9629700.

Acknowledgments

This work was supported by a research grant and scholarship from the Southeast Asian Regional Center for Graduate Study and Research in Agriculture (SEARCA). We are also grateful to SMARTRI, PT. SMART TBK for providing the portable handheld NIRS instrument, research site, and analytical laboratory services. We would like to thank Universiti Putra Malaysia for the journal publication fund support. Special thanks are also extended to all research staff and operators of SMARTRI for their cooperation and outstanding help with data collection.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Schowengerdt, R.A. Remote Sensing Models and Methods for Image Processing; Academic Press: Cambridge, MA, USA, 1997. [Google Scholar]
  2. Hourant, P.; Baeten, V.; Morales, M.T.; Meurens, M.; Aparicio, R. Oil and Fat Classification by Selected Bands of Near-Infrared Spectroscopy. Appl. Spectrosc. 2000, 54, 1168–1174. [Google Scholar] [CrossRef]
  3. Kasemsumran, S.; Thanapase, W.; Punsuvon, V.; Ozaki, Y. A Feasibility Study on Non-Destructive Determination of Oil Content in Palm Fruits by Visible–Near Infrared Spectroscopy. J. Near Infrared Spectrosc. 2012, 20, 687–694. [Google Scholar] [CrossRef]
  4. Chong, I.-G.; Jun, C.-H. Performance of some variable selection methods when multicollinearity is present. Chemom. Intell. Lab. Syst. 2005, 78, 103–112. [Google Scholar] [CrossRef]
  5. Saeys, Y.; Inza, I.; Larranaga, P. A review of feature selection techniques in bioinformatics. Bioinformatics 2007, 23, 2507–2517. [Google Scholar] [CrossRef] [Green Version]
  6. Mehmood, T.; Martens, H.; Sæbø, S.; Warringer, J.; Snipen, L. A Partial Least Squares based algorithm for parsimonious variable selection. Algorithms Mol. Biol. 2011, 6, 27. [Google Scholar] [CrossRef] [Green Version]
  7. Wang, S.; Tang, J.; Liu, H. Feature selection. In Encyclopedia of Machine Learning and Data Mining; Springer Science + Business Media: New York, NY, USA, 2016; pp. 1–9. [Google Scholar]
  8. Reunanen, J. Overfitting in making comparisons between variable selection methods. J. Mach. Learn. Res. 2003, 3, 1371–1382. [Google Scholar]
  9. Andersen, C.M.; Bro, R. Variable selection in regression—A tutorial. J. Chemom. 2010, 24, 728–737. [Google Scholar] [CrossRef]
  10. Guyon, I.; Elisseeff, A. An introduction to variable and feature selection. J. Mach. Learn. Res. 2003, 3, 1157–1182. [Google Scholar]
  11. Hira, Z.M.; Gillies, D.F. A Review of Feature Selection and Feature Extraction Methods Applied on Microarray Data. Adv. Bioinform. 2015, 2015. [Google Scholar] [CrossRef]
  12. Kokaly, R.F.; Clark, R.N. Spectroscopic Determination of Leaf Biochemistry Using Band-Depth Analysis of Absorption Features and Stepwise Multiple Linear Regression. Remote Sens. Environ. 1999, 67, 267–287. [Google Scholar] [CrossRef]
  13. Gidskehaug, L.; Anderssen, E.; Flatberg, A.; Alsberg, B.K. A framework for significance analysis of gene expression data using dimension reduction methods. BMC Bioinform. 2007, 8, 346. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Wu, W.; Walczak, B.; Massart, D.; Prebble, K.; Last, I. Spectral transformation and wavelength selection in near-infrared spectra classification. Anal. Chim. Acta 1995, 315, 243–255. [Google Scholar] [CrossRef]
  15. Oussama, A.; Elabadi, F.; Platikanov, S.; Kzaiber, F.; Tauler, R. Detection of Olive Oil Adulteration Using FT-IR Spectroscopy and PLS with Variable Importance of Projection (VIP) Scores. J. Am. Oil Chem. Soc. 2012, 89, 1807–1812. [Google Scholar] [CrossRef]
  16. Palermo, G.; Piraino, P.; Zucht, H.-D. Performance of PLS regression coefficients in selecting variables for each response of a multivariate PLS for omics-type data. Adv. Appl. Bioinform. Chem. 2009, 2, 57–70. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  17. Wold, S.; Johansson, E.; Cocchi, M. PLS—Partial Least-Squares Projections to Latent Structures. In 3D QSAR in Drug Design. Theory, Methods and Applications; Kubinyi, H., Ed.; ESCOM Science Publishers. B. V.: Leiden, The Netherlands, 1993; pp. 523–550. [Google Scholar]
  18. Trygg, J.; Wold, S. Orthogonal projections to latent structures (O-PLS). J. Chemom. 2002, 16, 119–128. [Google Scholar] [CrossRef]
  19. Galindo-Prieto, B.; Eriksson, L.; Trygg, J. Variable influence on projection (VIP) for orthogonal projections to latent structures (OPLS). J. Chemom. 2014, 28, 623–632. [Google Scholar] [CrossRef]
  20. Leardi, R.; González, A.L. Genetic algorithms applied to feature selection in PLS regression: How and when to use them. Chemom. Intell. Lab. Syst. 1998, 41, 195–207. [Google Scholar] [CrossRef]
  21. Centner, V.; Massart, D.-L.; De Noord, O.E.; De Jong, S.; Vandeginste, B.M.; Sterna, C. Elimination of Uninformative Variables for Multivariate Calibration. Anal. Chem. 1996, 68, 3851–3858. [Google Scholar] [CrossRef]
  22. Forina, M.; Casolino, C.; Pizarro Millan, C. Iterative predictor weighting (IPW) PLS: A technique for the elimination of useless predictors in regression problems. J. Chemom. Soc. 1999, 13, 165–184. [Google Scholar] [CrossRef]
  23. Guzmán, E.C.; Baeten, V.; Pierna, J.A.F.; García-Mesa, J.A. Application of low-resolution Raman spectroscopy for the analysis of oxidized olive oil. Food Control. 2011, 22, 2036–2040. [Google Scholar] [CrossRef]
  24. Wang, Z.X.; He, Q.P.; Wang, J. Comparison of variable selection methods for PLS-based soft sensor modeling. J. Process. Control. 2015, 26, 56–72. [Google Scholar] [CrossRef]
  25. Cai, W.; Li, Y.; Shao, X. A variable selection method based on uninformative variable elimination for multivariate calibration of near-infrared spectra. Chemom. Intell. Lab. Syst. 2008, 90, 188–194. [Google Scholar] [CrossRef]
  26. Kim, S.; Okajima, R.; Kano, M.; Hasebe, S. Development of soft-sensor using locally weighted PLS with adaptive similarity measure. Chemom. Intell. Lab. Syst. 2013, 124, 43–49. [Google Scholar] [CrossRef] [Green Version]
  27. Kim, J.; Kiss, B.; Lee, D. An adaptive unscented Kalman filtering approach using selective scaling. In Proceedings of the 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Budapest, Hungary, 9–12 October 2016; pp. 784–789. [Google Scholar]
  28. Wold, H. Multivariate Analysis; Krishnaiah, P.R., Ed.; Academic Press: New York, NY, USA, 1973; Volume 3, pp. 383–407. [Google Scholar]
  29. Martens, H.; Naes, T. Multivariate calibration. Math. Soc. 1992, 68, 337–404. [Google Scholar]
  30. Han, Q.-J.; Wu, H.-L.; Cai, C.-B.; Xu, L.; Yu, R.-Q. An ensemble of Monte Carlo uninformative variable elimination for wavelength selection. Anal. Chim. Acta 2008, 612, 121–125. [Google Scholar] [CrossRef]
  31. Gelman, A. Scaling regression inputs by dividing by two standard deviations. Stat. Med. 2008, 27, 2865–2873. [Google Scholar] [CrossRef]
  32. Saccenti, E.; Westerhuis, J.A.; Smilde, A.K.; Van Der Werf, M.J.; Hageman, J.A.; Hendriks, M.M.W.B. Simplivariate Models: Uncovering the Underlying Biology in Functional Genomics Data. PLoS ONE 2011, 6, e20747. [Google Scholar] [CrossRef] [Green Version]
  33. Vandeginste, B.G.M.; Massart, D.L.; De Jong, S.; Massaart, D.L.; Buydens, L.M.C. Handbook of Chemometrics and Qualimetrics: Part B; Elsevier BV: Amsterdam, The Netherlands, 1998. [Google Scholar]
  34. Bakeev, K.A. Process Analytical Technology: Spectroscopic Tools and Implementation Strategies for the Chemical and Pharmaceutical Industries; John Wiley & Sons: Hoboken, NJ, USA, 2010. [Google Scholar]
  35. Orso, A.; Shi, N.; Harrold, M.J. Scaling regression testing to large software systems. ACM SIGSOFT Softw. Eng. Notes 2004, 29, 241. [Google Scholar] [CrossRef]
  36. Berg, R.A.V.D.; Hoefsloot, H.C.J.; Westerhuis, J.A.; Smilde, A.K.; Van Der Werf, M.J. Centering, scaling, and transformations: Improving the biological information content of metabolomics data. BMC Genom. 2006, 7, 142. [Google Scholar] [CrossRef] [Green Version]
  37. Natrella, M.G. Experimental Statistics Handbook 91; US Government Printing Office: Washington, DC, USA, 1963.
  38. Stuart, B. Infrared Spectroscopy: Fundamentals and Applications; Wiley: Hoboken, NJ, USA, 2004; p. 78. [Google Scholar]
  39. Siew, W.L.; Tan, Y.A.; Tang, T.S. Methods of Test for Palm Oil and Palm Oil Products: Compiled; Lin, S.W., Sue, T.T., Ai, T.Y., Eds.; Palm Oil Research Institute of Malaysia: Selangor, Malaysia, 1995. [Google Scholar]
  40. Rao, V.; Soh, A.C.; Corley, R.H.V.; Lee, C.H.; Rajanaidu, N. Critical Reexamination of the Method of Bunch Quality Analysis in Oil Palm Breeding. PORIM Occasional Paper. 1983. Available online: https://agris.fao.org/agris-search/search.do?recordID=US201302543052 (accessed on 1 September 2020).
Figure 1. Global minimum cross-validation for the optimum number of PLS components on different dataset scenarios.
Figure 1. Global minimum cross-validation for the optimum number of PLS components on different dataset scenarios.
Sensors 20 05001 g001aSensors 20 05001 g001b
Figure 2. Comparison of the selected relevant variables based on the cut-off criteria in variable selection methods using different dataset scenarios.
Figure 2. Comparison of the selected relevant variables based on the cut-off criteria in variable selection methods using different dataset scenarios.
Sensors 20 05001 g002aSensors 20 05001 g002b
Figure 3. Time-consuming performances between methods during the fitting process using different dataset scenarios (n = number of samples, m = number of predictors, IV = number of important variables).
Figure 3. Time-consuming performances between methods during the fitting process using different dataset scenarios (n = number of samples, m = number of predictors, IV = number of important variables).
Sensors 20 05001 g003
Figure 4. Twelve sampling positions for fruit mesocarp samples of an oil palm fresh fruit bunch.
Figure 4. Twelve sampling positions for fruit mesocarp samples of an oil palm fresh fruit bunch.
Sensors 20 05001 g004
Figure 5. NIR spectra on oil palm fruit mesocarp: (a) fresh mesocarp, (b) dried ground mesocarp.
Figure 5. NIR spectra on oil palm fruit mesocarp: (a) fresh mesocarp, (b) dried ground mesocarp.
Sensors 20 05001 g005
Figure 6. Frequency distribution on response variable: %ODM (red), %OWM (green), and %FFA blue).
Figure 6. Frequency distribution on response variable: %ODM (red), %OWM (green), and %FFA blue).
Sensors 20 05001 g006
Figure 7. Comparison of selected wavelengths from different wavelength selection methods using spectral data of fresh fruit mesocarp on the %ODM.
Figure 7. Comparison of selected wavelengths from different wavelength selection methods using spectral data of fresh fruit mesocarp on the %ODM.
Sensors 20 05001 g007
Figure 8. Comparison of selected wavelengths from different wavelength selection methods using spectral data of fresh fruit mesocarp on the %OWM.
Figure 8. Comparison of selected wavelengths from different wavelength selection methods using spectral data of fresh fruit mesocarp on the %OWM.
Sensors 20 05001 g008
Figure 9. Comparison of selected wavelengths from different wavelength selection methods using spectral data of ground dried mesocarp on the %FFA.
Figure 9. Comparison of selected wavelengths from different wavelength selection methods using spectral data of ground dried mesocarp on the %FFA.
Sensors 20 05001 g009
Table 1. The RMSE, R2, RPD, and SE in variable selection methods using Monte Carlo Simulation with different dataset scenarios.
Table 1. The RMSE, R2, RPD, and SE in variable selection methods using Monte Carlo Simulation with different dataset scenarios.
nmIVMethodnPLSRMSER2RPDSE
404110%PLSR52.1300.99412.8242.164
VIP42.5240.99110.4882.567
MCUVE22.0160.99413.1332.050
mod-VIP-MCUVE22.0250.99413.0722.060
4010110%PLSR49.7150.9404.1309.839
VIP59.3680.9444.2839.487
MCUVE410.7050.9273.74810.841
mod-VIP-MCUVE44.3020.9889.3274.356
4020110%PLSRN/AN/AN/AN/AN/A
VIPN/AN/AN/AN/AN/A
MCUVE215.8430.8342.79716.044
mod-VIP-MCUVE26.3630.9708.3536.444
604120%PLSR84.4480.9747.0054.486
VIP64.8480.9736.3224.889
MCUVE55.2660.9675.8125.311
mod-VIP-MCUVE54.4430.9767.8734.447
6010120%PLSR510.2480.9685.60110.335
VIP416.7260.9143.43216.867
MCUVE713.5790.9434.22713.693
mod-VIP-MCUVE45.1430.99211.1605.187
6020120%PLSRN/AN/AN/AN/AN/A
VIPN/AN/AN/AN/AN/A
MCUVE233.1920.7352.54433.472
mod-VIP-MCUVE310.6780.96211.02810.768
1504140%PLSR66.3590.9715.9316.381
VIP77.1830.9635.2427.207
MCUVE57.0970.9645.3067.121
mod-VIP-MCUVE46.2910.9715.9336.297
15010140%PLSR98.9490.9797.3798.979
VIP812.9470.9585.04712.991
MCUVE611.0230.9705.85011.060
mod-VIP-MCUVE58.8580.9877.7618.861
15020140%PLSR514.7980.9756.40614.847
VIP527.1990.9173.48527.290
MCUVE523.7060.9373.99923.785
mod-VIP-MCUVE214.8090.9755.34714.852
4004160%PLSR59.4240.9675.5159.436
VIP910.0570.9625.15710.070
MCUVE79.9910.9635.20010.003
mod-VIP-MCUVE79.4230.9695.5499.435
40010160%PLSR614.2580.9726.02514.275
VIP916.2400.9645.29016.260
MCUVE715.4240.9685.57115.443
mod-VIP-MCUVE714.3100.9685.61114.329
40020160%PLSR1014.2580.9726.02514.275
VIP1416.2400.9645.29016.260
MCUVE1015.4240.9685.57115.443
mod-VIP-MCUVE714.3100.9685.61115.319
6004180%PLSR1010.7890.9665.46910.798
VIP811.0720.9655.32811.081
MCUVE811.1390.9645.29711.147
mod-VIP-MCUVE810.9850.9675.47110.994
60010180%PLSR1216.2640.9695.73716.278
VIP1016.9980.9675.49517.012
MCUVE917.0190.9675.48317.033
mod-VIP-MCUVE916.2100.9705.78116.223
60020180%PLSR1220.9880.9756.30521.005
VIP1222.2760.9715.94222.295
MCUVE822.5880.9715.85522.607
mod-VIP-MCUVE820.2950.9765.94020.314
Note: nPLS is a number of optimum PLS components used in the PLSR model.
Table 2. The RMSE, R2, RPD, and SE in variable selection methods using %ODM data.
Table 2. The RMSE, R2, RPD, and SE in variable selection methods using %ODM data.
DatasetMethodsnPLSRMSER2RPDSE
%ODMPLSR293.2670.6521.6073.269
VIP293.0110.6571.7023.013
MCUVE263.1070.6331.6503.108
mod-VIP-MCUVE263.0090.6591.7253.011
Note: nPLS is a number of optimum PLS components used in the PLSR model.
Table 3. The RMSE, R2, RPD, and SE in variable selection methods using %OWM data.
Table 3. The RMSE, R2, RPD, and SE in variable selection methods using %OWM data.
DatasetMethodsnPLSRMSER2RPDSE
%OWMPLSR204.5580.6511.693−0.067
VIP 204.5060.6591.7130.062
MCUVE184.4610.6661.730−0.016
mod-VIP-MCUVE174.4000.6751.7540.060
Note: nPLS is a number of optimum PLS components used in the PLSR model.
Table 4. The RMSE, R2, RPD, and SE in variable selection methods using %FFA data.
Table 4. The RMSE, R2, RPD, and SE in variable selection methods using %FFA data.
DatasetMethodsnPLSRMSER2RPDSE
%FFAPLSR280.2700.7301.9240.271
VIP 280.2660.7341.9320.267
MCUVE260.2640.7361.9460.265
mod-VIP-MCUVE250.2650.7351.9400.266
Note: nPLS is a number of optimum PLS components used in the PLSR model.

Share and Cite

MDPI and ACS Style

Silalahi, D.D.; Midi, H.; Arasan, J.; Mustafa, M.S.; Caliman, J.-P. Robust Wavelength Selection Using Filter-Wrapper Method and Input Scaling on Near Infrared Spectral Data. Sensors 2020, 20, 5001. https://doi.org/10.3390/s20175001

AMA Style

Silalahi DD, Midi H, Arasan J, Mustafa MS, Caliman J-P. Robust Wavelength Selection Using Filter-Wrapper Method and Input Scaling on Near Infrared Spectral Data. Sensors. 2020; 20(17):5001. https://doi.org/10.3390/s20175001

Chicago/Turabian Style

Silalahi, Divo Dharma, Habshah Midi, Jayanthi Arasan, Mohd Shafie Mustafa, and Jean-Pierre Caliman. 2020. "Robust Wavelength Selection Using Filter-Wrapper Method and Input Scaling on Near Infrared Spectral Data" Sensors 20, no. 17: 5001. https://doi.org/10.3390/s20175001

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop