Skip to Content

94 Results Found

  • Review
  • Open Access
595 Citations
44,179 Views
17 Pages

Mitigating the Multicollinearity Problem and Its Machine Learning Approach: A Review

  • Jireh Yi-Le Chan,
  • Steven Mun Hong Leow,
  • Khean Thye Bea,
  • Wai Khuen Cheng and ,
  • Seuk Wai Phoong,
  • Zeng-Wei Hong and
  • Yen-Lin Chen
  • + 2 authors+ 0 author

12 April 2022

Technologies have driven big data collection across many fields, such as genomics and business intelligence. This results in a significant increase in variables and data points (observations) collected and stored. Although this presents opportunities...

(This article belongs to the Special Issue Advances in Machine Learning, Optimization, and Control Applications)
  • Article
  • Open Access
16 Citations
3,270 Views
19 Pages

Some Modified Ridge Estimators for Handling the Multicollinearity Problem

  • Nusrat Shaheen,
  • Ismail Shah,
  • Amani Almohaimeed,
  • Sajid Ali and
  • Hana N. Alqifari

31 May 2023

Regression analysis is a statistical process that utilizes two or more predictor variables to predict a response variable. When the predictors included in the regression model are strongly correlated with each other, the problem of multicollinearity...

(This article belongs to the Special Issue Advances in Machine Learning and Applications)
  • Article
  • Open Access
4 Citations
2,528 Views
18 Pages

7 October 2024

The multiple regression model statistical technique is employed to analyze the relationship between the dependent variable and several independent variables. The multicollinearity problem is one of the issues affecting the multiple regression model,...

(This article belongs to the Special Issue Application of Regression Models, Analysis and Bayesian Statistics)
  • Article
  • Open Access
9 Citations
7,101 Views
11 Pages

The age–period–cohort problem has been studied for decades but without resolution. There have been many suggested solutions to make the three effects estimable, but these solutions mostly exploit non-linear specifications. Yet, these appr...

  • Article
  • Open Access
5 Citations
4,270 Views
16 Pages

Obtainment of Residual Stress Distribution from Surface Deformation under Continuity Constraints for Thinned Silicon Wafers

  • Haijun Liu,
  • Tao Yang,
  • Jiang Han,
  • Xiaoqing Tian and ,
  • Shan Chen and
  • Lei Lu
  • + 1 author+ 0 author

11 November 2021

Precision machining (e.g., fine grinding, polishing) induced residual stress is very small and often not constant across the wafer and it is difficult to be directly obtained by stress testing equipment or Stoney equation. The residual stress could b...

(This article belongs to the Section Material Processing Technology)
  • Article
  • Open Access
14 Citations
5,255 Views
19 Pages

16 October 2022

When developing prediction models for small or sparse binary data with many highly correlated covariates, logistic regression often encounters separation or multicollinearity problems, resulting serious bias and even the nonexistence of standard maxi...

(This article belongs to the Section D1: Probability and Statistics)
  • Article
  • Open Access
24 Citations
6,456 Views
13 Pages

An Aeromagnetic Compensation Method Based on a Multimodel for Mitigating Multicollinearity

  • Guanyi Zhao,
  • Qi Han,
  • Xiang Peng,
  • Pengyi Zou and ,
  • Haidong Wang,
  • Changping Du,
  • He Wang,
  • Xiaojun Tong,
  • Qiong Li and
  • Hong Guo
  • + 5 authors+ 0 author

3 July 2019

Aeromagnetic surveys play an important role in geophysical exploration and many other fields. In many applications, magnetometers are installed aboard an aircraft to survey large areas. Due to its composition, an aircraft has its own magnetic field,...

(This article belongs to the Special Issue Magnetic Sensing Technology, Materials and Applications)
  • Article
  • Open Access
35 Citations
6,404 Views
17 Pages

Mitigating Multicollinearity in Regression: A Study on Improved Ridge Estimators

  • Nadeem Akhtar,
  • Muteb Faraj Alharthi and
  • Muhammad Shakir Khan

27 September 2024

Multicollinearity, a critical issue in regression analysis that can severely compromise the stability and accuracy of parameter estimates, arises when two or more variables exhibit correlation with each other. This paper solves this problem by introd...

(This article belongs to the Special Issue Application of Regression Models, Analysis and Bayesian Statistics)
  • Article
  • Open Access
73 Citations
6,332 Views
16 Pages

6 November 2020

In a multiple linear regression model, the ordinary least squares estimator is inefficient when the multicollinearity problem exists. Many authors have proposed different estimators to overcome the multicollinearity problem for linear regression mode...

  • Article
  • Open Access
4 Citations
2,707 Views
9 Pages

18 January 2023

In the longitudinal data analysis we integrate flexible linear predictor link function and high-correlated predictor variables. Our approach uses B-splines for non-parametric part in the linear predictor component. A generalized estimation equation i...

(This article belongs to the Special Issue Contemporary Contributions to Statistical Modelling and Data Science)
  • Article
  • Open Access
6 Citations
1,913 Views
23 Pages

9 September 2024

Outliers are a common problem in applied statistics, together with multicollinearity. In this paper, robust Liu estimators are introduced into a partially linear model to combat the presence of multicollinearity and outlier challenges when the error...

(This article belongs to the Special Issue Nonparametric Regression Models: Theory and Applications)
  • Article
  • Open Access
31 Citations
4,763 Views
22 Pages

Modified Two-Parameter Liu Estimator for Addressing Multicollinearity in the Poisson Regression Model

  • Mahmoud M. Abdelwahab,
  • Mohamed R. Abonazel,
  • Ali T. Hammad and
  • Amera M. El-Masry

11 January 2024

This study introduces a new two-parameter Liu estimator (PMTPLE) for addressing the multicollinearity problem in the Poisson regression model (PRM). The estimation of the PRM is traditionally accomplished through the Poisson maximum likelihood estima...

(This article belongs to the Special Issue Computational Statistics and Its Applications)
  • Article
  • Open Access
4 Citations
1,110 Views
15 Pages

31 October 2025

Multicollinearity among predictor variables is a common challenge in modeling chemical and environmental datasets in physical sciences, often leading to collinearity issues and unreliable parameter estimates when fitting regression models. Ridge regr...

(This article belongs to the Section Mathematical Analysis)
  • Article
  • Open Access
7 Citations
2,970 Views
13 Pages

A New Quantile-Based Approach for LASSO Estimation

  • Ismail Shah,
  • Hina Naz,
  • Sajid Ali,
  • Amani Almohaimeed and
  • Showkat Ahmad Lone

16 March 2023

Regularization regression techniques are widely used to overcome a model’s parameter estimation problem in the presence of multicollinearity. Several biased techniques are available in the literature, including ridge, Least Angle Shrinkage Sele...

(This article belongs to the Special Issue Computational Statistics and Data Analysis)
  • Article
  • Open Access
3 Citations
2,022 Views
20 Pages

Enhanced Model Predictions through Principal Components and Average Least Squares-Centered Penalized Regression

  • Adewale F. Lukman,
  • Emmanuel T. Adewuyi,
  • Ohud A. Alqasem,
  • Mohammad Arashi and
  • Kayode Ayinde

12 April 2024

We address the estimation of regression parameters for the ill-conditioned predictive linear model in this study. Traditional least squares methods often encounter challenges in yielding reliable results when there is multicollinearity. Therefore, we...

(This article belongs to the Section B: Mathematics)
  • Article
  • Open Access
19 Citations
4,577 Views
13 Pages

A Correlation-Embedded Attention Module to Mitigate Multicollinearity: An Algorithmic Trading Application

  • Jireh Yi-Le Chan,
  • Steven Mun Hong Leow,
  • Khean Thye Bea,
  • Wai Khuen Cheng and ,
  • Seuk Wai Phoong,
  • Zeng-Wei Hong,
  • Jim-Min Lin and
  • Yen-Lin Chen
  • + 3 authors+ 0 author

8 April 2022

Algorithmic trading is a common topic researched in the neural network due to the abundance of data available. It is a phenomenon where an approximately linear relationship exists between two or more independent variables. It is especially prevalent...

(This article belongs to the Special Issue Applications and Mathematical Foundations of Machine Learning in Investments)
  • Article
  • Open Access
14 Citations
2,475 Views
18 Pages

An Adaptive Modeling-Based Aeromagnetic Maneuver Noise Suppression Method and Its Application in Mine Detection

  • Fengyi Bi,
  • Ping Yu,
  • Jian Jiao,
  • Longran Zhou and ,
  • Xiangcheng Zeng and
  • Shuai Zhou
  • + 1 author+ 0 author

18 September 2023

Aeromagnetic measurement plays an important role in mineral exploration, but unmanned aerial vehicles generate maneuvering noise during aerial flight, which negatively impacts the accuracy of aeromagnetic measurement data. Therefore, aeromagnetic com...

(This article belongs to the Topic Green Mining)
  • Article
  • Open Access
22 Citations
4,480 Views
27 Pages

Interpretable Machine Learning Framework for Corporate Financialization Prediction: A SHAP-Based Analysis of High-Dimensional Data

  • Yanhe Wang,
  • Wei Wei,
  • Zhuodong Liu,
  • Jiahe Liu and ,
  • Yinzhen Lv and
  • Xiangyu Li
  • + 1 author+ 0 author

6 August 2025

High-dimensional prediction problems with complex non-linear feature interactions present significant algorithmic challenges in machine learning, particularly when dealing with imbalanced datasets and multicollinearity issues. This study proposes an...

(This article belongs to the Special Issue Advances in Artificial Intelligence, Machine Learning and Optimization)
  • Article
  • Open Access
14 Citations
5,049 Views
20 Pages

Behavioral Intentions of Bank Employees to Implement Green Finance

  • Hung-Yu Chen,
  • Raofeng Guo,
  • Chin-Chao Hung,
  • Zong-Han Lin and
  • Mengshan Wu

29 July 2023

To understand the behavioral intentions of bank employees to implement green finance, this study explores the impact of attitude, subjective norm, and perceived behavioral control on behavioral intention based on the theory of planned behavior. In ad...

  • Article
  • Open Access
3 Citations
2,235 Views
17 Pages

20 September 2024

Despite stiff competition in the construction industry, housing quality remains a problem. From the consumer’s perspective, these quality problems are called defects. Homeowners experience inconvenience and suffering due to home defects, and de...

(This article belongs to the Section Chemical, Civil and Environmental Engineering)
  • Article
  • Open Access
15 Citations
5,138 Views
18 Pages

29 April 2019

A rainfall event, simplified by a rectangular pulse, is defined by three components: the rainfall duration, the total rainfall depth, and mean rainfall intensity. However, as the mean rainfall intensity can be calculated by the total rainfall depth d...

(This article belongs to the Special Issue Advances in Multivariate Analysis of Environmental Phenomena: Celebrating the 15th Anniversary of Copulas in Hydrology)
  • Article
  • Open Access
92 Citations
7,427 Views
31 Pages

Novel Machine Learning Approaches for Modelling the Gully Erosion Susceptibility

  • Alireza Arabameri,
  • Omid Asadi Nalivan,
  • Subodh Chandra Pal,
  • Rabin Chakrabortty and ,
  • Asish Saha,
  • Saro Lee,
  • Biswajeet Pradhan and
  • Dieu Tien Bui
  • + 3 authors+ 0 author

1 September 2020

The extreme form of land degradation caused by the formation of gullies is a major challenge for the sustainability of land resources. This problem is more vulnerable in the arid and semi-arid environment and associated damage to agriculture and alli...

(This article belongs to the Special Issue Monitoring and Modelling of Gully Erosion Using Remote Sensing Data and Spatial Modelling)
  • Article
  • Open Access
44 Citations
5,310 Views
21 Pages

15 November 2022

This paper revisited the link between intra-industry trade (IIT) between Portugal and Spain and Portuguese carbon dioxide (CO2) emissions. The research also considers the effects of foreign direct investment (FDI) on CO2 emissions, pondering the argu...

(This article belongs to the Special Issue Renewable Energy Consumption and Economic Growth)
  • Article
  • Open Access
6 Citations
2,338 Views
21 Pages

A Proposal for a New Python Library Implementing Stepwise Procedure

  • Luiz Paulo Fávero,
  • Helder Prado Santos,
  • Patrícia Belfiore,
  • Alexandre Duarte and ,
  • Igor Pinheiro de Araújo Costa,
  • Adilson Vilarinho Terra,
  • Miguel Ângelo Lellis Moreira,
  • Wilson Tarantin Junior and
  • Marcos dos Santos
  • + 4 authors+ 0 author

4 November 2024

Carefully selecting variables in problems with large volumes of data are extremely important, as it reduces the complexity of the model, improves the interpretation of the results, and increases computational efficiency, ensuring more accurate and re...

(This article belongs to the Special Issue Algorithms for Feature Selection (2nd Edition))
  • Article
  • Open Access
1 Citations
1,194 Views
31 Pages

Shrinkage Approaches for Ridge-Type Estimators Under Multicollinearity

  • Marwan Al-Momani,
  • Bahadır Yüzbaşı,
  • Mohammad Saleh Bataineh,
  • Rihab Abdallah and
  • Athifa Moideenkutty

20 November 2025

Multicollinearity is a common issue in regression analyses that occurs when some predictor variables are highly correlated, leading to unstable least squares estimates of model parameters. Various estimation strategies have been proposed to address t...

(This article belongs to the Special Issue Advances in Statistical Methods with Applications)
  • Article
  • Open Access
79 Citations
8,795 Views
28 Pages

The VIF and MSE in Raise Regression

  • Román Salmerón Gómez,
  • Ainara Rodríguez Sánchez,
  • Catalina García García and
  • José García Pérez

16 April 2020

The raise regression has been proposed as an alternative to ordinary least squares estimation when a model presents collinearity. In order to analyze whether the problem has been mitigated, it is necessary to develop measures to detect collinearity a...

(This article belongs to the Special Issue Quantitative Methods for Economics and Finance)
  • Article
  • Open Access
38 Citations
4,292 Views
27 Pages

3 November 2022

The Poisson maximum likelihood (PML) is used to estimate the coefficients of the Poisson regression model (PRM). Since the resulting estimators are sensitive to outliers, different studies have provided robust Poisson regression estimators to allevia...

(This article belongs to the Special Issue Computational Statistics & Data Analysis)
  • Article
  • Open Access
1,342 Views
17 Pages

2 June 2025

This paper proposes a novel control function approach to identify and estimate linear models with endogenous variables in the absence of valid instrumental variables. The identification strategy exploits time-varying volatility to address the multico...

(This article belongs to the Section E5: Financial Mathematics)
  • Article
  • Open Access
34 Citations
7,099 Views
16 Pages

10 March 2020

Ridge regression is a popular method to solve the multicollinearity problem for both linear and non-linear regression models. This paper studied forty different ridge regression t-type tests of the individual coefficients of a linear regression model...

(This article belongs to the Section Data Science, Machine Learning and Artificial Intelligence)
  • Article
  • Open Access
29 Citations
10,842 Views
12 Pages

12 January 2015

The process of urban-rural integration has led to severe ecological environmental pollution in rural areas of China, particularly in the economically-developed areas. This is an urgent issue to be solved. We select Jiangsu Province as a case study. F...

(This article belongs to the Special Issue Special issue of Sustainable Asia Conference 2014)
  • Article
  • Open Access
1 Citations
4,298 Views
34 Pages

Factor Investment or Feature Selection Analysis?

  • Jifang Mai,
  • Shaohua Zhang,
  • Haiqing Zhao and
  • Lijun Pan

24 December 2024

This study has made significant findings in A-share market data processing and portfolio management. Firstly, by adopting the Lasso method and CPCA framework, we effectively addressed the problem of multicollinearity among feature indicators, with th...

(This article belongs to the Special Issue Advanced Statistical Applications in Financial Econometrics)
  • Article
  • Open Access
8 Citations
3,378 Views
24 Pages

15 October 2021

In a host of business applications, biomedical and epidemiological studies, the problem of multicollinearity among predictor variables is a frequent issue in longitudinal data analysis for linear mixed models (LMM). We consider an efficient estimatio...

(This article belongs to the Special Issue Big Data Analytics and Information Science for Business and Biomedical Applications II)
  • Article
  • Open Access
189 Views
14 Pages

17 October 2026

Early childhood is the foundational stage of lifelong health management and is associated with long-term physical and developmental outcomes. Yet health problems are emerging at increasingly younger ages, while existing assessment systems remain frag...

  • Article
  • Open Access
25 Citations
5,317 Views
18 Pages

20 December 2021

The evaluation of corporation operation efficiency (especially innovation efficiency) has been always a hot topic. The currently popular evaluation methods are data envelopment analysis (DEA) and its improved methods. However, these methods have the...

(This article belongs to the Special Issue Quantitative Analysis and DEA Modeling in Applied Economics)
  • Feature Paper
  • Article
  • Open Access
44 Citations
6,974 Views
15 Pages

A Comparative Assessment of Variable Selection Methods in Urban Water Demand Forecasting

  • Md Mahmudul Haque,
  • Ataur Rahman,
  • Dharma Hagare and
  • Rezaul Kabir Chowdhury

3 April 2018

Urban water demand is influenced by a variety of factors such as climate change, population growth, socio-economic conditions and policy issues. These variables are often correlated with each other, which may create a problem in building appropriate...

  • Article
  • Open Access
10 Citations
7,847 Views
18 Pages

20 August 2023

The stock index is actively used for the realization of profits using derivatives and via the hedging of assets; hence, the prediction of the index is important for market participants. As market uncertainty has increased during the COVID-19 pandemic...

(This article belongs to the Special Issue Economic Model Analysis and Application)
  • Article
  • Open Access
15 Citations
4,206 Views
18 Pages

An Improved Artificial Bee Colony for Feature Selection in QSAR

  • Yanhong Lin,
  • Jing Wang,
  • Xiaolin Li,
  • Yuanzi Zhang and
  • Shiguo Huang

9 April 2021

Quantitative Structure–Activity Relationship (QSAR) aims to correlate molecular structure properties with corresponding bioactivity. Chance correlations and multicollinearity are two major problems often encountered when generating QSAR models. Featu...

  • Article
  • Open Access
16 Citations
3,461 Views
28 Pages

23 July 2021

The curse of dimensionality problem occurs when the data are high-dimensional. It affects the learning process and reduces the accuracy. Feature selection is one of the dimensionality reduction approaches that mainly contribute to solving the curse o...

(This article belongs to the Special Issue Novel Research and Application on Swarm Optimization and Bioinspired Optimization Algorithms)
  • Article
  • Open Access
14 Citations
4,366 Views
19 Pages

Forecasting concentration levels is important for planning atmospheric protection strategies. In this paper, we focus on the daily average surface ozone (O3) concentration with a short-time resolution (one day ahead) in the Grand Casablanca Region of...

(This article belongs to the Section Air Quality)
  • Article
  • Open Access
10 Citations
3,272 Views
10 Pages

9 January 2023

The heat generated by motors and bearings of machine tools has a significant impact on machining accuracy. Error modeling and compensation has proven to be effective ways to reduce thermal errors and improve accuracy. An improved fuzzy c-means (FCM)...

(This article belongs to the Topic Recent Advances in the Thermal Error of Precision Machine Tools)
  • Article
  • Open Access
6 Citations
5,204 Views
21 Pages

11 April 2017

Identifying the optimal structure of terrain dependent Rational Function Models (RFMs) not only decreases the number of Ground Control Points (GCPs) required, but also increases the accuracy of the model, by reducing the multi-collinearity of Rationa...

  • Article
  • Open Access
3 Citations
1,408 Views
22 Pages

4 July 2025

To enhance the accuracy of SOC prediction in EVs, which often suffers from significant discrepancies between displayed and actual driving ranges, this study proposes a data-driven model guided by an energy consumption framework. The approach addresse...

(This article belongs to the Section E1: Mathematics and Computer Science)
  • Article
  • Open Access
21 Citations
5,050 Views
18 Pages

Although many empirical studies have focused on R & D performance models for markets globally, the available financial information for R & D expenditure is limited. In other words, can we assume that the reported accounting information for R...

(This article belongs to the Special Issue Applications of Operational Research and Mathematical Models in Management)
  • Article
  • Open Access
6 Citations
4,282 Views
31 Pages

18 May 2020

The article tackles the problem of the most important institutional determinants of public expenditures. Within the traditions of public choice and institutional economics, it tests several theories ranging from the fiscal commons framework, Politica...

(This article belongs to the Section Economic and Business Aspects of Sustainability)
  • Article
  • Open Access
86 Citations
9,019 Views
34 Pages

An Explainable AI-Based Fault Diagnosis Model for Bearings

  • Md Junayed Hasan,
  • Muhammad Sohaib and
  • Jong-Myon Kim

13 June 2021

In this paper, an explainable AI-based fault diagnosis model for bearings is proposed with five stages, i.e., (1) a data preprocessing method based on the Stockwell Transformation Coefficient (STC) is proposed to analyze the vibration signals for var...

(This article belongs to the Special Issue Sensing Technologies for Fault Diagnostics and Prognosis)
  • Article
  • Open Access
39 Citations
10,150 Views
15 Pages

Predicting the Textural Properties of Plant-Based Meat Analogs with Machine Learning

  • Sezin Kircali Ata,
  • Jing K. Shi,
  • Xuesi Yao,
  • Xin Yi Hua and ,
  • Sumanto Haldar,
  • Jie Hong Chiang and
  • Min Wu
  • + 2 authors+ 0 author

11 January 2023

Plant-based meat analogs are food products that mimic the appearance, texture, and taste of real meat. The development process requires laborious experimental iterations and expert knowledge to meet consumer expectations. To address these problems, w...

(This article belongs to the Section Food Engineering and Technology)
  • Article
  • Open Access
4 Citations
2,390 Views
22 Pages

19 November 2021

Multicollinearity often occurs when two or more predictor variables are correlated, especially for high dimensional data (HDD) where p>>n. The statistically inspired modification of the partial least squares (SIMPLS) is a very popular technique...

  • Data Descriptor
  • Open Access
1,332 Views
10 Pages

28 April 2025

The problem of using accounting semi-identity-based (ASI) models in Econometrics can be severe in certain circumstances, and estimations from OLS regressions in such models may not accurately reflect causal relationships. This dataset was generated t...

  • Article
  • Open Access
18 Citations
3,903 Views
20 Pages

An Advanced Multipath Mitigation Method Based on Trend Surface Analysis

  • Zhiren Wang,
  • Wen Chen,
  • Danan Dong,
  • Chenglong Zhang and ,
  • Yu Peng and
  • Zhengqi Zheng
  • + 1 author+ 0 author

2 November 2020

Among various ways to eliminate the multipath effect in high-precision global navigation satellite system positioning, the multipath hemispherical map (MHM) is a typical multipath correction method based on spatial domain repeatability, which is suit...

  • Article
  • Open Access
8 Citations
3,039 Views
14 Pages

25 February 2022

It is imperative to use clean energy in order to achieve “carbon neutrality” and “carbon peaking”. This research aims to explore the impact of the agricultural mechanization level, the rural infrastructure construction level,...

(This article belongs to the Special Issue New Insights into Energy Economics and Sustainable Development)

of 2