Sequential Multiple Concept Drifts and Change Point Detection for Regression Problems

This research advances the study of learning under non-stationary conditions by proposing a unified framework for concept drift detection and adaptive regression in evolving data streams. Unlike traditional batch models that assume static data distributions, the proposed approach operates sequentially, enabling real-time adaptation to drifting concepts in both time series and regression tasks. The method integrates Least Squares Support Vector Regression (LS-SVR) with Least Squares Support Vector Data Description (LS-SVDD) to jointly perform prediction and drift monitoring within a single kernel-based structure. LS-SVDD serves as a distributional drift detector, while LS-SVR incrementally updates model parameters to maintain predictive accuracy as data evolves. The framework accommodates both abrupt and gradual drifts, making it suitable for dynamic, high-dimensional environments. Experimental evaluations on synthetic data show that this proposal is able to outperform conventional batch and static methods in accuracy, responsiveness and computational efficiency. This method was compared using a real-world dataset, namely the high-dimensional Drosophila microarray time series, to demonstrate that the proposed approach is able to detect the meaningful change points using the whole data which is not doable using existing methods. Existing methods only used subsets of the dataset. These results highlight the potential of LS-SVR and LS-SVDD integration for real-time, adaptive learning across diverse domains where data distributions change over time.