Search Results (10)

Penalized regression methods are widely used for variable selection. Non-negative garrote (NNG) was one of the earliest methods to combine variable selection with shrinkage of regression coefficients, followed by lasso. About a decade after the introduction of lasso, adaptive lasso (ALASSO) was proposed to address lasso’s limitations. ALASSO has two tuning parameters ($\lambda$ and $\gamma$), and its penalty resembles that of NNG when $\gamma =1$, though NNG imposes additional constraints. Given ALASSO’s greater flexibility, which may increase instability, this study investigates whether NNG provides any practical benefit or can be replaced by ALASSO. We conducted simulations in both low- and high-dimensional settings to compare selected variables, coefficient estimates, and prediction accuracy. Ordinary least squares and ridge estimates were used as initial estimates. NNG and ALASSO ($\gamma =1$) showed similar performance in low-dimensional settings with low correlation, large samples, and moderate to high $R^2$. However, under high correlation, small samples, and low $R^2$, their selected variables and estimates differed, though prediction accuracy remained comparable. When $\gamma \ne 1$, the differences between NNG and ALASSO became more pronounced, with ALASSO generally performing better. Assuming linear relationships between predictors and the outcome, the results suggest that NNG may offer no practical advantage over ALASSO. The $\gamma$ parameter in ALASSO allows for adaptability to model complexity, making ALASSO a more flexible and practical alternative to NNG. Full article

In this paper, we first develop an active set identification technique, and then we suggest a modified nonmonotone line search rule, in which a new parameter formula is introduced to control the degree of the nonmonotonicity of line search. By using the modified line search and the active set identification technique, we propose a global convergent method to solve the NMF based on the alternating nonnegative least squares framework. In addition, the larger step size technique is exploited to accelerate convergence. Finally, a large number of numerical experiments are carried out on synthetic and image datasets, and the results show that our presented method is effective in calculating speed and solution quality. Full article

In marine ecological environment monitoring, the acquisition of node location information is crucial, and the absence of location information can render the collected data meaningless. Compared to the rest of the distance-based localization methods, the received signal strength (RSS)-based localization technique has gained significant interest due to its low cost and the absence of time synchronization. However, the acoustic signal propagates in the complex and changeable aqueous medium, and, in addition to the time-varying path loss factor (PLF), there is often a certain absorption loss, which seriously deteriorates the localization accuracy of the RSS-based technique. To address the above challenges, we propose a novel high-precision and high-robustness localization (NHHL) algorithm that introduces an estimation parameter to conjointly estimate the marine node location and the ambient PLF. Firstly, the original non-convex localization problem is converted into an alternating nonnegative constrained least squares (ANCLS) framework with the unknown PLF and absorption loss, and a two-step localization method based on the primitive dual interior point method and block co-ordinate update method is presented to find the optimal solution. In the first step, the penalty function is utilized to reformulate the localization problem and find an approximate solution. Nevertheless, due to inherent errors, it is unable to approximate the constraint boundary and the global optimum solution. Subsequently, in the second step, the original localization problem is further transformed into a generalized trust region sub-problem (GTRS) framework, and the approximate solution of the interior point method is utilized as the initial estimation, and then iteratively solved by block co-ordinate update to obtain the precise location and PLF conjointly. Furthermore, the closed-form expression of the Cramér–Rao lower bound (CRLB) for the case of the unknown path loss factor and absorption loss is derived to evaluate the our NHHL algorithm. Finally, the simulation results demonstrate the superiority of the presented NHHL algorithm compared with the selected benchmark methods in various marine simulation scenarios. Full article

Three-dimensional reconstruction in brightfield microscopy is challenging since a 2D image includes from in-focus and out-of-focus light which removes the details of the specimen’s structures. To overcome this problem, many techniques exist, but these generally require an appropriate model of Point Spread Function (PSF). Here, we propose a new images restoration method based on the application of Multivariate Curve Resolution (MCR) algorithms to a stack of brightfield microscopy images to achieve 3D reconstruction without the need for PSF. The method is based on a statistical reconstruction approach using a self-modelling mixture analysis. The MCR-ALS (ALS for Alternating Least Square) algorithm under non-negativity constraints, Wiener, Richardson–Lucy, and blind deconvolution algorithms were applied to silica microbeads and red blood cells images. The MCR analysis produces restored images that show informative structures which are not noticeable in the initial images, and this demonstrates its capability for the multiplane reconstruction of the amplitude of 3D objects. In comparison with 3D deconvolution methods based on a set of No Reference Images Quality Metrics (NR-IQMs) that are Standard Deviation, ENTROPY Average Gradient, and Auto Correlation, our method presents better values of these metrics, showing that it can be used as an alternative to 3D deconvolution methods. Full article

A Poisson distribution is commonly used as the innovation distribution for integer-valued autoregressive models, but its mean is equal to its variance, which limits flexibility, so a flexible, one-parameter, infinitely divisible Bell distribution may be a good alternative. In addition, for a parameter with a small value, the Bell distribution approaches the Poisson distribution. In this paper, we introduce a new first-order, non-negative, integer-valued autoregressive model with Bell innovations based on the binomial thinning operator. Compared with other models, the new model is not only simple but also particularly suitable for time series of counts exhibiting overdispersion. Some properties of the model are established here, such as the mean, variance, joint distribution functions, and multi-step-ahead conditional measures. Conditional least squares, Yule–Walker, and conditional maximum likelihood are used for estimating the parameters. Some simulation results are presented to access these estimates’ performances. Real data examples are provided. Full article

In this paper, we present a novel muscle synergy extraction method based on multivariate curve resolution–alternating least squares (MCR-ALS) to overcome the limitation of the nonnegative matrix factorization (NMF) method for extracting non-sparse muscle synergy, and we study its potential application for evaluating motor function of stroke survivors. Nonnegative matrix factorization (NMF) is the most widely used method for muscle synergy extraction. However, NMF is susceptible to components’ sparseness and usually provides inferior reliability, which significantly limits the promotion of muscle synergy. In this study, MCR-ALS was employed to extract muscle synergy from electromyography (EMG) data. Its performance was compared with two other matrix factorization algorithms, NMF and self-modeling mixture analysis (SMMA). Simulated data sets were utilized to explore the influences of the sparseness and noise on the extracted synergies. As a result, the synergies estimated by MCR-ALS were the most similar to true synergies as compared with SMMA and NMF. MCR-ALS was used to analyze the muscle synergy characteristics of upper limb movements performed by healthy (n = 11) and stroke (n = 5) subjects. The repeatability and intra-subject consistency were used to evaluate the performance of MCR-ALS. As a result, MCR-ALS provided much higher repeatability and intra-subject consistency as compared with NMF, which were important for the reliability of the motor function evaluation. The stroke subjects had lower intra-subject consistency and seemingly had more synergies as compared with the healthy subjects. Thus, MCR-ALS is a promising muscle synergy analysis method for motor function evaluation of stroke patients. Full article

Raman spectroscopy (RS), a non-invasive and label-free method, has been suggested to improve accuracy of cytological and even histopathological diagnosis. To our knowledge, this novel technique tends to be employed without concrete knowledge of molecular changes in cells. Therefore, identification of Raman spectral markers for objective diagnosis is necessary for universal adoption of RS. As a model study, we investigated human mammary epithelial cells (HMEpC) and breast cancer cells (MCF-7) by RS and employed various multivariate analyses (MA) including principal components analysis (PCA), linear discriminant analysis (LDA), and support vector machine (SVM) to estimate diagnostic accuracy. Furthermore, to elucidate the underlying molecular changes in cancer cells, we utilized multivariate curve resolution analysis–alternating least squares (MCR-ALS) with non-negative constraints to extract physically meaningful spectra from complex cellular data. Unsupervised PCA and supervised MA, such as LDA and SVM, classified HMEpC and MCF-7 fairly well with high accuracy but without revealing molecular basis. Employing MCR-ALS analysis we identified five pure biomolecular spectra comprising DNA, proteins and three independent unsaturated lipid components. Relative abundance of lipid 1 seems to be strictly regulated between the two groups of cells and could be the basis for excellent discrimination by chemometrics-assisted RS. It was unambiguously assigned to linoleate rich glyceride and therefore serves as a Raman spectral marker for reliable diagnosis. This study successfully identified Raman spectral markers and demonstrated the potential of RS to become an excellent cytodiagnostic tool that can both accurately and objectively discriminates breast cancer from normal cells. Full article

Detection of subsurface defects is undeniably a growing subfield of infrared non-destructive testing (IR-NDT). There are many algorithms used for this purpose, where non-negative matrix factorization (NMF) is considered to be an interesting alternative to principal component analysis (PCA) by having no negative basis in matrix decomposition. Here, an application of Semi non-negative matrix factorization (Semi-NMF) in IR-NDT is presented to determine the subsurface defects of an Aluminum plate specimen through active thermographic method. To benchmark, the defect detection accuracy and computational load of the Semi-NMF approach is compared to state-of-the-art thermography processing approaches such as: principal component thermography (PCT), Candid Covariance-Free Incremental Principal Component Thermography (CCIPCT), Sparse PCT, Sparse NMF and standard NMF with gradient descend (GD) and non-negative least square (NNLS). The results show 86% accuracy for 27.5s computational time for SemiNMF, which conclusively indicate the promising performance of the approach in the field of IR-NDT. Full article

The incipient damages of mechanical equipment excite weak impulse vibration, which is hidden, almost unobservable, in the collected signal, making fault detection and failure prevention at the inchoate stage rather challenging. Traditional feature extraction techniques, such as bandpass filtering and time-frequency analysis, are suitable for matrix processing but challenged by the higher-order data. To tackle these problems, a novel method of impulse feature extraction for vibration signals, based on sparse non-negative tensor factorization is presented in this paper. Primarily, the phase space reconstruction and the short time Fourier transform are successively employed to convert the original signal into time-frequency distributions, which are further arranged into a three-way tensor to obtain a time-frequency multi-aspect array. The tensor is decomposed by sparse non-negative tensor factorization via hierarchical alternating least squares algorithm, after which the latent components are reconstructed from the factors by the inverse short time Fourier transform and eventually help extract the impulse feature through envelope analysis. For performance verification, the experimental analysis on the bearing datasets and the swashplate piston pump has confirmed the effectiveness of the proposed method. Comparisons to the traditional methods, including maximum correlated kurtosis deconvolution, singular value decomposition, and maximum spectrum kurtosis, also suggest its better performance of feature extraction. Full article

This paper presents a new parameterized nonlinear least squares (PNLS) algorithm for unsupervised nonlinear spectral unmixing (UNSU). The PNLS-based algorithms transform the original optimization problem with respect to the endmembers, abundances, and nonlinearity coefficients estimation into separate alternate parameterized nonlinear least squares problems. Owing to the Sigmoid parameterization, the PNLS-based algorithms are able to thoroughly relax the additional nonnegative constraint and the nonnegative constraint in the original optimization problems, which facilitates finding a solution to the optimization problems . Subsequently, we propose to solve the PNLS problems based on the Gauss–Newton method. Compared to the existing nonnegative matrix factorization (NMF)-based algorithms for UNSU, the well-designed PNLS-based algorithms have faster convergence speed and better unmixing accuracy. To verify the performance of the proposed algorithms, the PNLS-based algorithms and other state-of-the-art algorithms are applied to synthetic data generated by the Fan model and the generalized bilinear model (GBM), as well as real hyperspectral data. The results demonstrate the superiority of the PNLS-based algorithms. Full article