Skip to Content

970 Results Found

  • Article
  • Open Access
51 Citations
13,449 Views
40 Pages

High-quality data are foundational to reliable environmental monitoring and urban planning in smart cities, yet challenges like missing values and outliers in air pollution and meteorological time series data are critical barriers. This study develop...

  • Article
  • Open Access
3 Citations
4,673 Views
20 Pages

19 January 2023

Outliers often occur during data collection, which could impact the result seriously and lead to a large inference error; therefore, it is important to detect outliers before data analysis. Gamma distribution is a popular distribution in statistics;...

(This article belongs to the Special Issue Computational Statistics & Data Analysis)
  • Article
  • Open Access
2 Citations
3,470 Views
12 Pages

Cross-Validation for Lower Rank Matrices Containing Outliers

  • Sergio Arciniegas-Alarcón,
  • Marisol García-Peña and
  • Wojtek J. Krzanowski

Several statistical techniques for analyzing data matrices use lower rank approximations to these matrices, for which, in general, the appropriate rank must first be estimated depending on the objective of the study. The estimation can be conducted b...

(This article belongs to the Section Applied Mathematics)
  • Article
  • Open Access
20 Citations
4,693 Views
14 Pages

NMF-Based Approach for Missing Values Imputation of Mass Spectrometry Metabolomics Data

  • Jingjing Xu,
  • Yuanshan Wang,
  • Xiangnan Xu,
  • Kian-Kai Cheng and ,
  • Daniel Raftery and
  • Jiyang Dong
  • + 1 author+ 0 author

24 September 2021

In mass spectrometry (MS)-based metabolomics, missing values (NAs) may be due to different causes, including sample heterogeneity, ion suppression, spectral overlap, inappropriate data processing, and instrumental errors. Although a number of methodo...

(This article belongs to the Special Issue Biomolecular NMR 2021)
  • Article
  • Open Access
11 Citations
3,974 Views
25 Pages

Robust Estimation for Bivariate Poisson INGARCH Models

  • Byungsoo Kim,
  • Sangyeol Lee and
  • Dongwon Kim

19 March 2021

In the integer-valued generalized autoregressive conditional heteroscedastic (INGARCH) models, parameter estimation is conventionally based on the conditional maximum likelihood estimator (CMLE). However, because the CMLE is sensitive to outliers, we...

(This article belongs to the Special Issue Time Series Modelling)
  • Article
  • Open Access
20 Citations
2,047 Views
17 Pages

16 January 2025

Outlier values and rankings are important for emphasizing data distribution variability, which improves the accuracy and effectiveness of variance estimations. To enhance the estimation of finite population variance in a two-phase sampling framework,...

  • Article
  • Open Access
53 Citations
9,237 Views
15 Pages

25 June 2019

One of the pillars of experimental science is sampling. Based on the analysis of samples, estimations for populations are made. There is an entire science based on sampling. Distribution of the population, of the sample, and the connection among thos...

(This article belongs to the Special Issue Symmetry in Applied Mathematics)
  • Article
  • Open Access
1,504 Views
24 Pages

COVAS: Highlighting the Importance of Outliers in Classification Through Explainable AI

  • Sebastian Roth,
  • Adrien Cerrito,
  • Samuel Orth,
  • Ulrich Hartmann and
  • Daniel Friemert

Understanding the decision-making behavior of machine learning models is essential in domains where individual predictions matter, such as medical diagnosis or sports analytics. While explainable artificial intelligence (XAI) methods such as SHAP pro...

(This article belongs to the Topic Opportunities and Challenges in Explainable Artificial Intelligence (XAI))
  • Article
  • Open Access
166 Views
29 Pages

5 November 2026

Missing values, outliers, out-of-order timestamps, unit inconsistencies and baseline drift degrade online monitoring data on drilling-fluid properties in deep wells. We validate an evaluation–marking–remediation–validation workflow...

(This article belongs to the Special Issue Cutting-Edge Developments in Optical Communications, Perception and Computing)
  • Article
  • Open Access
329 Views
33 Pages

10 October 2026

Early fault warning in lithium-ion battery packs is challenged by weak labels and changing operating conditions. This study combines cell-wise Local Outlier Factor (LOF) scoring with validity-gated Streaming Peaks-Over-Threshold (SPOT). Five descript...

(This article belongs to the Special Issue Advances in Data-Driven and Learning Methods Applied to Battery Technologies)
  • Article
  • Open Access
8 Citations
4,272 Views
14 Pages

Boscovich Fuzzy Regression Line

  • Pavel Škrabánek,
  • Jaroslav Marek and
  • Alena Pozdílková

23 March 2021

We introduce a new fuzzy linear regression method. The method is capable of approximating fuzzy relationships between an independent and a dependent variable. The independent and dependent variables are expected to be a real value and triangular fuzz...

(This article belongs to the Special Issue Recent Advances in Applications of Fuzzy Logic and Soft Computing)
  • Article
  • Open Access
8 Citations
6,492 Views
17 Pages

A K-Value Dynamic Detection Method Based on Machine Learning for Lithium-Ion Battery Manufacturing

  • Hekun Zhang,
  • Xiangdong Kong,
  • Yuebo Yuan,
  • Jianfeng Hua and ,
  • Xuebing Han,
  • Languang Lu,
  • Yihui Li,
  • Xiaoyi Zhou and
  • Minggao Ouyang
  • + 4 authors+ 0 author

During the manufacturing process of the lithium-ion battery, metal foreign matter is likely to be mixed into the battery, which seriously influences the safety performance of the battery. In order to reduce the outflow of such foreign matter defect c...

(This article belongs to the Section Battery Modelling, Simulation, Management and Application)
  • Review
  • Open Access
30 Citations
10,373 Views
24 Pages

Cleaning Big Data Streams: A Systematic Literature Review

  • Obaid Alotaibi,
  • Eric Pardede and
  • Sarath Tomy

In today’s big data era, cleaning big data streams has become a challenging task because of the different formats of big data and the massive amount of big data which is being generated. Many studies have proposed different techniques to overco...

(This article belongs to the Section Information and Communication Technologies)
  • Article
  • Open Access
156 Citations
12,039 Views
25 Pages

Early Prediction of Diabetes Using an Ensemble of Machine Learning Models

  • Aishwariya Dutta,
  • Md. Kamrul Hasan,
  • Mohiuddin Ahmad,
  • Md. Abdul Awal and ,
  • Md. Akhtarul Islam,
  • Mehedi Masud and
  • Hossam Meshref
  • + 2 authors+ 0 author

Diabetes is one of the most rapidly spreading diseases in the world, resulting in an array of significant complications, including cardiovascular disease, kidney failure, diabetic retinopathy, and neuropathy, among others, which contribute to an incr...

(This article belongs to the Special Issue Applications of Artificial Intelligence to Health)
  • Feature Paper
  • Article
  • Open Access
11 Citations
4,322 Views
21 Pages

Time series animation of choropleth maps easily exceeds our perceptual limits. In this empirical research, we investigate the effect of local outlier preserving value generalization of animated choropleth maps on the ability to detect general trends...

(This article belongs to the Special Issue Multimedia Cartography)
  • Article
  • Open Access
2 Citations
3,077 Views
18 Pages

15 October 2019

Here we propose an online method to explore the multiway nature of urban spaces data for outlier detection based on higher-order singular value tensor decomposition. Our proposal has two sequential steps: (i) the offline modeling step, where we model...

(This article belongs to the Special Issue Multivariate Data Analysis for Sensors and Sensor Arrays)
  • Article
  • Open Access
2 Citations
3,145 Views
17 Pages

28 August 2022

Estimating outstanding claims reserves in the non-life insurance business is often impaired by outlier-contaminated datasets. Widely used methods to eliminate outliers in non-life development triangles are either limiting the number of outliers by ro...

  • Proceeding Paper
  • Open Access
3 Citations
2,505 Views
10 Pages

Classification and clustering problems are closely connected with pattern recognition where many general algorithms have been developed and used in various fields. Depending on the complexity of patterns in data, classification and clustering procedu...

(This article belongs to the Proceedings of The 39th International Workshop on Bayesian Inference and Maximum Entropy Methods in Science and Engineering)
  • Article
  • Open Access
27 Citations
5,704 Views
22 Pages

16 June 2023

Navigating the intricate world of data analytics, one method has emerged as a key tool in confronting missing data: multiple imputation. Its strength is further fortified by its powerful variant, robust imputation, which enhances the precision and re...

(This article belongs to the Special Issue Recent Progress in Big Data and Artificial Intelligence: Modern Methods and Applications)
  • Article
  • Open Access
25 Citations
5,626 Views
18 Pages

Accurately predicting construction costs during the initial planning stages is crucial for the successful completion of construction projects. Recent advancements have introduced various machine learning-based methods to enhance cost estimation preci...

(This article belongs to the Special Issue Smart and Proactive Construction Safety Combined with AI, IoT, and Big Data)
  • Article
  • Open Access
45 Citations
5,370 Views
21 Pages

8 February 2020

In the subject of statistics for engineering, physics, computer science, chemistry, and earth sciences, one of the sampling challenges is the accuracy, or, in other words, how representative the sample is of the population from which it was drawn. A...

(This article belongs to the Special Issue Numerical Methods)
  • Article
  • Open Access
2,115 Views
15 Pages

19 October 2024

Outliers are typically identified using frequentist methods. The data are classified as “outliers” or “not outliers” based on a test statistic that measures the magnitude of the difference between a value and the majority part...

(This article belongs to the Special Issue Bayes and Empirical Bayes Inference)
  • Article
  • Open Access
29 Citations
7,391 Views
41 Pages

A Monte Carlo-Based Outlier Diagnosis Method for Sensitivity Analysis

  • Vinicius Francisco Rofatto,
  • Marcelo Tomio Matsuoka,
  • Ivandro Klein,
  • Maurício Roberto Veronez and
  • Luiz Gonzaga da Silveira

6 March 2020

An iterative outlier elimination procedure based on hypothesis testing, commonly known as Iterative Data Snooping (IDS) among geodesists, is often used for the quality control of modern measurement systems in geodesy and surveying. The test statistic...

(This article belongs to the Section Engineering Remote Sensing)
  • Article
  • Open Access
28 Citations
5,184 Views
28 Pages

Effective Outlier Detection for Ensuring Data Quality in Flotation Data Modelling Using Machine Learning (ML) Algorithms

  • Clement Lartey,
  • Jixue Liu,
  • Richmond K. Asamoah,
  • Christopher Greet and ,
  • Massimiliano Zanin and
  • William Skinner
  • + 1 author+ 0 author

10 September 2024

Froth flotation, a widely used mineral beneficiation technique, generates substantial volumes of data, offering the opportunity to extract valuable insights from these data for production line analysis. The quality of flotation data is critical to de...

(This article belongs to the Section Mineral Processing and Extractive Metallurgy)
  • Article
  • Open Access
4 Citations
3,059 Views
11 Pages

MEOD: Memory-Efficient Outlier Detection on Streaming Data

  • Ankita Karale,
  • Milena Lazarova,
  • Pavlina Koleva and
  • Vladimir Poulkov

12 March 2021

In this paper, a memory-efficient outlier detection (MEOD) approach for streaming data is proposed. The approach uses a local correlation integral (LOCI) algorithm for outlier detection, finding the outlier based on the density of neighboring points...

(This article belongs to the Special Issue Symmetry and Asymmetry in Communications Engineering)
  • Review
  • Open Access
23 Citations
7,987 Views
143 Pages

Important Medicinal and Food Taxa (Orders and Families) in Kenya, Based on Three Quantitative Approaches

  • Fredrick Munyao Mutie,
  • Yuvenalis Morara Mbuni,
  • Peninah Cheptoo Rono,
  • Elijah Mbandi Mkala and ,
  • John Mulinge Nzei,
  • Methee Phumthum,
  • Guang-Wan Hu and
  • Qing-Feng Wang
  • + 3 authors+ 0 author

2 March 2023

Globally, food and medicinal plants have been documented, but their use patterns are poorly understood. Useful plants are non-random subsets of flora, prioritizing certain taxa. This study evaluates orders and families prioritized for medicine and fo...

(This article belongs to the Section Phytochemistry)
  • Article
  • Open Access
30 Citations
4,013 Views
22 Pages

28 September 2022

The goal of this work is to show how machine learning models, such as the random forest, neural network, gradient boosting, and AdaBoost models, can be used to forecast the fatigue life (N) of plain concrete under uniaxial compression. Here, we devel...

(This article belongs to the Special Issue Fatigue, Performance, and Damage Assessment of Concrete)
  • Article
  • Open Access
6 Citations
1,688 Views
17 Pages

Outlier Identification of Concrete Dam Displacement Monitoring Data Based on WAVLET-DBSCAN-IFRL

  • Chunhui Fang,
  • Xue Wang,
  • Weixing Hu,
  • Xiaojun He and ,
  • Zihui Huang and
  • Hao Gu
  • + 1 author+ 0 author

28 February 2025

Monitoring data outliers comprises isolated mode outliers, cluster mode outliers, and normal points. To identify and distinguish the data hopping problems caused by outliers and environmental mutations in the displacement monitoring data of concrete...

(This article belongs to the Special Issue Intelligent Safety Diagnosis and Reinforcement of Water-Related Buildings)
  • Article
  • Open Access
4 Citations
2,837 Views
17 Pages

21 December 2022

The airborne array position and orientation measurement system (array POS) is a key device for high-resolution multi-dimensional real-time imaging motion compensation of military reconnaissance mapping. Abnormal values will appear in array POS inerti...

  • Article
  • Open Access
5 Citations
2,604 Views
16 Pages

Intelligent Identification and Order-Sensitive Correction Method of Outliers from Multi-Data Source Based on Historical Data Mining

  • Guangyu Chen,
  • Zhengyang Zhu,
  • Li Yang,
  • Wenhao Huang and ,
  • Yuzhuo Zhang,
  • Gang Lin and
  • Shengjie Zhang
  • + 2 authors+ 0 author

7 September 2022

In recent years, outliers caused by manual operation errors and equipment acquisition failures often occur, bringing challenges to big data analysis. In view of the difficulties in identifying and correcting outliers of multi-source data, an intellig...

(This article belongs to the Topic Recent Advances in Data Mining)
  • Article
  • Open Access
14 Citations
5,724 Views
10 Pages

A New Methodology Based on Imbalanced Classification for Predicting Outliers in Electricity Demand Time Series

  • Francisco Javier Duque-Pintor,
  • Manuel Jesús Fernández-Gómez,
  • Alicia Troncoso and
  • Francisco Martínez-Álvarez

14 September 2016

The occurrence of outliers in real-world phenomena is quite usual. If these anomalous data are not properly treated, unreliable models can be generated. Many approaches in the literature are focused on a posteriori detection of outliers. However, a n...

(This article belongs to the Special Issue Energy Time Series Forecasting)
  • Article
  • Open Access
21 Citations
4,038 Views
20 Pages

3 June 2019

The indoor localization method based on the Received Signal Strength (RSS) fingerprint is widely used for its high positioning accuracy and low cost. However, the propagation behavior of radio signals in an indoor environment is complicated and alway...

(This article belongs to the Section Intelligent Sensors)
  • Article
  • Open Access
1 Citations
3,104 Views
18 Pages

12 October 2023

When dealing with uncertain data, traditional model construction methods often ignore or filter out noise data to improve model performance. However, this simple approach can lead to insufficient data utilization, model bias, reduced detection abilit...

(This article belongs to the Special Issue Intelligent Analysis and Security Calculation of Multisource Data)
  • Article
  • Open Access
4 Citations
3,838 Views
17 Pages

Fair Outlier Detection Based on Adversarial Representation Learning

  • Shu Li,
  • Jiong Yu,
  • Xusheng Du,
  • Yi Lu and
  • Rui Qiu

9 February 2022

Outlier detection aims to identify rare, minority objects in a dataset that are significantly different from the majority. When a minority group (defined by sensitive attributes, such as gender, race, age, etc.) does not represent the target group fo...

  • Article
  • Open Access
10 Citations
4,099 Views
23 Pages

Multiple Outlier Detection Tests for Parametric Models

  • Vilijandas Bagdonavičius and
  • Linas Petkevičius

3 December 2020

We propose a simple multiple outlier identification method for parametric location-scale and shape-scale models when the number of possible outliers is not specified. The method is based on a result giving asymptotic properties of extreme z-scores. R...

(This article belongs to the Section D1: Probability and Statistics)
  • Article
  • Open Access
1,962 Views
20 Pages

Outlier Detection by Energy Minimization in Quantized Residual Preference Space for Geometric Model Fitting

  • Yun Zhang,
  • Bin Yang,
  • Xi Zhao,
  • Shiqian Wu and ,
  • Bin Luo and
  • Liangpei Zhang
  • + 1 author+ 0 author

Outliers significantly impact the accuracy of geometric model fitting. Previous approaches to handling outliers have involved threshold selection and scale estimation. However, many scale estimators assume that the inlier distribution follows a Gauss...

(This article belongs to the Special Issue Computational Imaging and Its Application)
  • Article
  • Open Access
26 Citations
12,822 Views
14 Pages

In order to detect outliers in temperature time series data for improving data quality and decision-making quality related to design and operation, we proposed an algorithm based on sliding window prediction. Firstly, the time series are segmented ba...

  • Article
  • Open Access
17 Citations
4,684 Views
21 Pages

17 June 2020

Outlier detection is one of the most important tasks in the analysis of measured quantities to ensure reliable results. In recent years, a variety of multi-sensor platforms has become available, which allow autonomous and continuous acquisition of la...

(This article belongs to the Special Issue Stochastic Models for Geodesy and Geoinformation Science)
  • Article
  • Open Access
5 Citations
3,566 Views
13 Pages

14 June 2024

This study introduces a novel algorithm tailored for the precise detection of lower outliers (i.e., data points at the lower tail) in univariate datasets, which is particularly suited for scenarios with a single cluster and similar data distribution....

  • Article
  • Open Access
7 Citations
4,193 Views
23 Pages

26 October 2022

The stock price is a culmination of numerous factors that are not necessarily quantifiable and significantly affected by anomalies. The forecasting accuracy of stock prices is negatively affected by these anomalies. However, very few methods are avai...

(This article belongs to the Section Computer Science & Engineering)
  • Article
  • Open Access
25 Citations
4,814 Views
20 Pages

Novel MIA-LSTM Deep Learning Hybrid Model with Data Preprocessing for Forecasting of PM2.5

  • Gaurav Narkhede,
  • Anil Hiwale,
  • Bharat Tidke and
  • Chetan Khadse

12 January 2023

Day by day pollution in cities is increasing due to urbanization. One of the biggest challenges posed by the rapid migration of inhabitants into cities is increased air pollution. Sustainable Development Goal 11 indicates that 99 percent of the world...

(This article belongs to the Section Algorithms for Multidisciplinary Applications)
  • Article
  • Open Access
1 Citations
3,352 Views
15 Pages

12 January 2024

Aiming to serve as a preliminary study for South Korea’s national GHG emission factor development, this study reviewed data treatment and sample size determination approaches to establishing the destruction and removal efficiency (DRE) of the s...

  • Article
  • Open Access
9 Citations
4,754 Views
17 Pages

26 April 2023

Outlier detection is of great significance in the domain of data mining. Its task is to find those target points that are not identical to most of the object generation mechanisms. The existing algorithms are mainly divided into density-based algorit...

(This article belongs to the Section Mathematical Analysis)
  • Article
  • Open Access
2 Citations
6,291 Views
13 Pages

Background: Cryo-electron microscopy (cryo-EM) has become a major technique for protein structure determination. However, due to the low quality of cryo-EM density maps, many protein structures derived from cryo-EM contain outliers introduced during...

  • Article
  • Open Access
28 Citations
8,165 Views
10 Pages

Evaluation of the Bitterness of Traditional Chinese Medicines using an E-Tongue Coupled with a Robust Partial Least Squares Regression Method

  • Zhaozhou Lin,
  • Qiao Zhang,
  • Ruixin Liu,
  • Xiaojie Gao and ,
  • Lu Zhang,
  • Bingya Kang,
  • Junhan Shi,
  • Zidan Wu,
  • Xinjing Gui and
  • Xuelin Li
  • + 5 authors+ 0 author

25 January 2016

To accurately, safely, and efficiently evaluate the bitterness of Traditional Chinese Medicines (TCMs), a robust predictor was developed using robust partial least squares (RPLS) regression method based on data obtained from an electronic tongue (e-t...

(This article belongs to the Special Issue E-noses: Sensors and Applications)
  • Article
  • Open Access
14 Citations
7,719 Views
30 Pages

18 December 2021

Over the past couple of years, machine learning methods—especially the outlier detection ones—have anchored in the cybersecurity field to detect network-based anomalies rooted in novel attack patterns. However, the ubiquity of massive con...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
4 Citations
2,917 Views
18 Pages

Gap Filling Method and Estimation of Net Ecosystem CO2 Exchange in Alpine Wetland of Qinghai–Tibet Plateau

  • Xiuying Wang,
  • Yuancang Ma,
  • Fu Li,
  • Qi Chen and ,
  • Shujiao Sun,
  • Honglu Ma and
  • Rui Zhang
  • + 2 authors+ 0 author

6 March 2023

The net ecosystem CO2 exchange (NEE) and water and energy fluxes at the alpine ecosystem level were obtained through the eddy covariance technique in an alpine wetland of the Longbao Region, Qinghai–Tibet Plateau. Our research used the NEE as t...

  • Article
  • Open Access
5 Citations
4,366 Views
18 Pages

Balancing Complex Signals for Robust Predictive Modeling

  • Fazal Aman,
  • Azhar Rauf,
  • Rahman Ali,
  • Jamil Hussain and
  • Ibrar Ahmed

18 December 2021

Robust predictive modeling is the process of creating, validating, and testing models to obtain better prediction outcomes. Datasets usually contain outliers whose trend deviates from the most data points. Conventionally, outliers are removed from th...

(This article belongs to the Special Issue Big Data Analytics in Internet of Things Environment)
  • Review
  • Open Access
83 Citations
12,513 Views
22 Pages

Review of Applicable Outlier Detection Methods to Treat Geomechanical Data

  • Behzad Dastjerdy,
  • Ali Saeidi and
  • Shahriyar Heidarzadeh

The reliability of geomechanical models and engineering designs depend heavily on high-quality data. In geomechanical projects, collecting and analyzing laboratory data is crucial in characterizing the mechanical properties of soils and rocks. Howeve...

  • Article
  • Open Access
362 Views
19 Pages

Geochemical gold datasets from shear zone-hosted systems frequently contain extreme outliers that distort statistical structure, shift population boundaries, and undermine the reliability of concentration–area (C–A) fractal modeling. Conv...

of 20