Next Article in Journal
Wideband Millimeter-Wave MIMO Antenna with a Loaded Dielectric Cover for High-Gain Broadside Radiation
Next Article in Special Issue
Applying the Lombard Effect to Speech-in-Noise Communication
Previous Article in Journal
Deform2NeRF: Non-Rigid Deformation and 2D–3D Feature Fusion with Cross-Attention for Dynamic Human Reconstruction
Previous Article in Special Issue
Review of Advances in Speech Processing with Focus on Artificial Neural Networks
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Blind Source Separation with Strength Pareto Evolutionary Algorithm 2 (SPEA2) Using Discrete Wavelet Transform

by
Husamettin Celik
1,* and
Nurhan Karaboga
2
1
Department of Computer Technologies, Tercan Vocational School, Erzincan Binali YILDIRIM University, 24002 Erzincan, Turkey
2
Department of Electrical and Electronics Engineering, Erciyes University, 38039 Kayseri, Turkey
*
Author to whom correspondence should be addressed.
Electronics 2023, 12(21), 4383; https://doi.org/10.3390/electronics12214383
Submission received: 11 September 2023 / Revised: 16 October 2023 / Accepted: 19 October 2023 / Published: 24 October 2023
(This article belongs to the Special Issue Recent Advances in Audio, Speech and Music Processing and Analysis)

Abstract

:
This paper presents a new method for separating the mixed audio signals of simultaneous speakers using Blind Source Separation (BSS). The separation of mixed signals is an important issue today. In order to obtain more efficient and superior source estimation performance, a new algorithm that solves the BSS problem with Multi-Objective Optimization (MOO) methods was developed in this study. In this direction, we tested the application of two methods. Firstly, the Discrete Wavelet Transform (DWT) was used to eliminate the limited aspects of the traditional methods used in BSS and the small coefficients in the signals. Afterwards, the BSS process was optimized with the multi-purpose Strength Pareto Evolutionary Algorithm 2 (SPEA2). Secondly, the Minkowski distance method was proposed for distance measurement by using density information in the discrimination of individuals with raw fitness values for the concept of Pareto dominance. With this proposed method, the originals (original source signals) were estimated by separating the randomly mixed male and two female speech signals. Simulation and experimental results proved that the efficiency and performance of the proposed method can effectively solve BSS problems. In addition, the Pareto front approximation performance of this method also confirmed that it is superior in the Inverted Generational Distance (IGD) indicator.

1. Introduction

Blind Source Separation (BSS) has become an important analysis tool to differentiate signals from each other in subjects such as biomedical signal processing, image analysis and control systems [1]. BSS is the estimation of source signals from a set of mixed signals without knowledge of the source signals and their mixtures that make up this mixture [2]. Although single-objective and Multi-Objective Optimization (MOO) methods are used in this estimation process, the performance of single-objective optimization methods has not reached the desired level [3]. In BSS, efforts have been made to develop algorithms that perform well in different mixing models in order to obtain satisfactory separation performance [4]. Especially if there is noise in the source signals, the BSS process becomes much more difficult, so it has become compulsory to develop new techniques and algorithms [5].
In BSS, which is also a single-objective optimization method, the estimation of the source signals is provided by using the non-Gaussianity, sparsity and temporality properties of the signals. In single-objective optimization, while trying to reach a solution based on one of these features, the performance is increased by examining more than one feature with the use of Multi-Objective Optimization [6,7]. The performance of MOO methods used to separate mixed signals is often vital. Especially in biomedical signals, the accuracy of the signals separated using MOO methods is confirmed by at least two objective functions [8,9]. Many optimization algorithms have been proposed to separate the mixed signals with the BSS method. The mixed signals have been separated using the BSS method based on particle swarm optimization, but the convergence rate could not be brought to the desired level [10]. By basing the BSS method on the whale optimization algorithm, the complex parameter and convergence speed problem have been improved [11]. The artificial bee colony algorithm [12] and the hybrid invasive weed/biogeography-based optimization algorithm [13] have been actively applied to BSS problems. With the Multi-Objective BSS method (MO-BSS) [14], the ECG signal has been separated from the noise, and the performance rate of the algorithm in this area has subsequently been increased with the developed MO-BSS [15] by applying preprocessing. Shi et al. [16] have proposed an MOO algorithm using independent component analysis, and a different MOO algorithm technique using principal component analysis has been proposed by Xu et al. [17]. A new MOO method has been proposed for heart rate estimation, which is widely used in the biomedical field [18]. These are popular BSS methods, each based on a different MOO strategy. In addition to these studies, the Ensemble Empirical Mode Decomposition (EEMD) method has also been frequently used in signal separation in recent years [19].
In this study, simultaneously mixed speech sounds were separated. These speech sounds have been used as a guide in many areas that require analysis, such as communication, security, biomedical, control systems and intelligence. They are frequently used in applications such as coding and decoding speech signals for communication, speech sound recognition for security, disease diagnosis in biomedicine, speech disorders and correction, sound command control systems in the field of control and word capture in the field of intelligence. As a result of all these, we need to obtain the most original or closest-to-the-original speech signals in order to make a correct analysis. During speech or sound recording, noise interferes with signals due to many internal and external factors. Signals need to be separated from noise or other sounds for necessary analysis studies [20]. Although BSS operation is performed with SPEA2 in the method suggested by Pelegrina [14], the contributions of the present work are as follows:
  • Wavelet transform is applied to a Strength Pareto Evolutionary Algorithm 2 (SPEA2)-based BSS algorithm. Signals are analyzed on the frequency axis and applied to MOO. Thus, a performance increase was achieved in the separation of signals. With this developed algorithm, Discrete Wavelet Transform (DWT) is applied to the signals, and a suitable method for the analysis of non-stationary signals is obtained. Due to these processes, although the data size is reduced, the calculation cost of the proposed method also decreases [21].
  • Contrary to the traditional method, the distance between the points is calculated by the Minkowski distance in obtaining the Pareto curve. In the simulation results, it is seen that the use of Minkowski distance has a positive effect on the results.
  • The success rate has been proven with Inverted Generational Distance (IGD), Hypervolume (HV) and Spread (Δ or SP) metrics, which are frequently used in the performance measurement of optimization algorithms.
  • Extensive simulations are performed to compare the proposed scheme with some recent well-known BSS techniques in the literature, like EEMD. The proposed algorithm is also compared with a classical MOO-BSS algorithm.
The remainder of this paper is organized as follows. In Section 2, an overview of the BSS, MOO and SPEA2 algorithms is given. The proposed DWT approaches for BSS with MOO are described in Section 3, and the performance is analyzed in Section 4. Some concluding remarks are made in Section 5.

2. Materials and Methods

2.1. Blind Source Separation

BSS is defined as the estimation of each source signal by separating the mixed signals from each other, without any information about either the source signals or how they are mixed with each other. The aim here is to find statistically independent signals within a given data set. In order to perform this operation, it is assumed that the sources are statistically independent of each other. According to these formulas, the mathematical representation of the mixture of independent source signals is as follows [22,23].
x 1 x 2 x m = a 11 a 21 a m 1   a 12   a 22           a m 2 a 1 n a 2 n     a m n s 1 s 2 s n
where x , a and s are the observed/mixed signal vectors, the mixing matrix and the source signal vectors, respectively. Moreover, n and m indicate number of source signals and number of observed signals, respectively. BSS algorithms aim to find source signals from mixed signals. The BSS process is mathematically given by Equation (2) below:
y 1 y 2 y n = w 11 w 21 w n 1   w 12   w 22           w n 2 w 1 m w 2 m     w n m x 1 x 2 x m
where the vectors y and w are the estimated source signal vector and the mixing matrix, respectively. It is generally assumed that the number of signals observed in BSS algorithms is equal to the number of sources ( m = n ) . In this case, w is approximately the inverse of a [24].

2.2. Multi-Objective Optimization

Optimally designed MOO methods are used for successful separation of mixed signals. By optimizing multiple objective functions at the same time, MOO generates solutions that can improve one objective without worsening another. An MOO problem with k as the number of objective functions can be expressed as follows:
m i n   f z = f 1 z , f 2 z , , f k z
s u b j e c t   t o   z Ω
where k , Ω and z denote the number of objective functions, feasible solution space and decision variables, respectively.
Ω = z : g L z 0 ,   h C z = 0 ,   L = 1,2 , , v ; C = 1,2 , , u
where g L and h C are inequality and equality constraints, respectively, while v and u are the number of inequality and equality constraints, respectively. When there are at least two objectives, for two solutions p and q , p dominates q if and only if p is not worse than z in all objectives and better than q in at least one objective, if and only if
i : f i p f i q i : f i ( p ) < f i ( q )
A solution z * Ω is defined as a Pareto optimal solution if a solution z z * Ω does not exist that dominates z * [25,26,27,28].

2.3. SPEA2 and Minkowski Distance

The Strength Pareto Evolutionary Algorithm (SPEA) was developed by Zitzler et al. [29], which was then proposed as SPEA2 with necessary updates. The block diagram of this method is shown in Figure 1.
In the SPEA2 algorithm, density information of individuals is needed to evaluate only dominant and non-dominant individuals. In Equation (7), the fitness function F ( i ) of individuals is
F i = R i + D ( i )
where R ( i ) and D ( i ) represent the original fitness of the i-th individual and the density of the i-th individual, respectively. The original conformity is expressed as
R i = j P t P t * , i j S j
where P t , P t * and S ( j ) are the evolutionary population, external population and j-th individual’s strength value, respectively. This expression is mathematically defined as follows:
S i = j j P t P t * j i
where S ( i ) defines the number of dominated solutions. In Equation (7), the density function of individuals is defined as follows:
D i = 1 σ i k ( M , T ) + 2
where σ i k ( M , T ) represents the Minkowski distance between two individuals [30,31]. It is suggested that the k-nearest neighbor method expression, which should be found, is obtained by the Minkowski distance method. It is widely used, especially for the classification of signals or finding optimal correlation. For the solutions we found, the normalization distance measurement expression with the Minkowski method is as follows:
k ( M , T ) = i = 1 j m i t i ς 1 ς
M = m 1 , m 2 , , m j   a n d   T = t 1 , t 2 , , t j R j
where M and T are multidimensional points. ς is an integer and specifies the distance between two points of order ς [32,33].
After calculating the fitness of all solutions, the selection operator chooses an above-average solution, and standard steps are followed [29].

2.4. Objective Function Used in SPEA2

With the SPEA2 method, both objective functions are optimized simultaneously. The first of the two objective functions used in separating speech signals in SPEA2 is the function that handles the time-correlation properties of the signals. Optimization is provided by adapting this function to the minimization method. The aim here is to find the optimal solution by using the temporal feature of the resources with the first objective function (autocorrelation).
The second objective function is the l 1 -norm minimization method. This function is designed to consider the sparseness of resources. With sparseness, the goal is to deal with vectors where many elements are close to zero [14].

2.5. Ensemble Empirical Mode Decomposition (EEMD)

EEMD is a signal processing technique that has gained popularity in recent years due to its ability to decompose non-linear and non-stationary signals into their Intrinsic Mode Functions (IMFs). The basic function of EEMD is to generate multiple realizations of the signal by adding white noise to the original signal. Each realization is then decomposed using Empirical Mode Decomposition (EMD), which is a technique that extracts IMFs from a signal by iteratively sifting the signal and its envelopes. The IMFs are functions that have well-defined frequency ranges and represent the different scales of the signal.
The EMD process can be affected by noise and other artifacts, which can result in inaccurate decomposition. The addition of white noise in EEMD helps to overcome this problem by ensuring that each realization is different from the others, thus reducing the impact of noise and other artifacts on the decomposition.
A residue Υ ( η ) signal and the finite number of IMFs are decomposed as follows:
Υ ( η ) = i = 1 ϱ ϑ i + ξ ϱ
where Υ ( η ) is the final decomposed result, ϑ i is the i-th IMF and ξ ϱ is the residual component, which is the remaining item after the original signal has been reduced by the IMF [19,34,35,36].

2.6. Performance Metric

In order to quantitatively observe and evaluate the convergence of Multi-Objective Optimization (MOO) algorithms, Inverted Generational Distance IGD, Hypervolume (HV) and Spread (SP) methods are used as performance metrics [37]. Although each of the indicators in these methods is different, they all meet at a common point for convergence, spread and uniform distribution throughout the solution set [38].

2.6.1. Inverted Generational Distance

Let us assume that the IGD metric we use to measure the numerical performance of the algorithm has a set of properly distributed solutions P T on the real Pareto front. P O is the non-dominant set of solutions produced by the proposed method. The mean distance from P T to P O in IGD is defined as follows [37,39]:
I G D P T , P O = ν P T d i s t ( v , P O ) P T
where d i s t ( v , P O ) shows the minimum Euclidean distance between two points. The low calculated IGD value indicates the closeness of the distance between P T and P O [40,41].

2.6.2. Hypervolume

Hypervolume is one of the indicators that is frequently used in MOO algorithms and has a high computational cost due to its complexity [38,42]. The hypervolume performance metric is shown as follows:
H V = v o l u m e i = 1 P O δ i
where δ i is termed the dominant hypervolume with respect to the reference point [40].

2.6.3. Spread

Spread measures the distribution and extent of the spread between solutions. Specifically, it gives the average of the Euclidean distances of the neighboring Pareto optimal solutions obtained as a result of the spread of solutions. When the distribution of Pareto optimal solutions is uniform, the spread is equal to zero. Spread is defined as follows [37,43]:
= m = 1 M d m e + i = 1 φ d i d ¯ m = 1 M d m e + φ d ¯  
where d i , d ¯ and d m e denote the Euclidean distance between successive solutions, the mean of the Euclidean distance ( d i ) and the distance between the extreme solutions P O and P T , respectively [37].

3. Proposed Method

In signal separation applications, DWT can be used to separate features from time series and create an appropriate classification model [44]. It is a powerful and widely used signal processing tool for decomposing time-varying signals into frequency signals using scaling factors [45,46,47]. In the proposed algorithm, the mixed signals are filtered with DWT, and the Minkowski method is applied to measure the distance between two datasets on the Pareto front in SPEA2.
If all scales of the signals and the entire time span are used, the calculated coefficients will result in huge chunks of data. It becomes difficult to operate on all of these coefficients. In order to overcome this difficulty, conversion is made with the DWT method at a certain scale and position. The DWT method is expressed by Equation (17) [48] as follows:
D W T ( b , c ) = n Z x n ψ b , c [ n ]
where x [ n ] DWT is the observed data, b is the scaling and c is the translation parameter. If ψ is the main wavelet, it is defined as follows [49]:
ψ b , c = 1 b ψ n c b  
In DWT, approximation ( A j ) and detail ( D j ) coefficients of the signals are obtained with the help of low- and high-pass filters. The low- and high-pass filters are obtained with the help of a filter array during the scaling and transformation of the wavelet function. By increasing the conversion step, these processes continue until the desired separation level and the frequency resolution is thus increased [50]. When signals are filtered, data are lost. To minimize this loss, coefficients are determined to regain the original signal by using low- and high-pass filters. The approximation coefficients at the j level A j ( n ) and the detail coefficients D j ( n ) are defined as follows [49,51]:
A j n = k g k 2 n A j 1 k ,     j = 1,2 , , J
D j n = k h k 2 n A j 1 k ,     j = 1,2 , , J
where g and h are low-pass and high-pass filters, respectively. In this study, the “db1” wavelet type from Daubechies wavelets is used to decompose the mixed signals.

4. Experimental Results

In this study, the DWT-MO-BSS method, which we proposed for the separation of mixed signals using the SPEA2 method, and the MO-BSS method have been compared (both methods are evolutionary algorithms). As a result of examining the signals in the frequency domain with the proposed method while they are in the time domain in MO-BSS, the comparison of the method in terms of performance and working time has been reported. In this study, male and female speech signals were randomly mixed and applied to the DWT-MOBSS algorithm, and its performance was tested. For this purpose, to measure the stability of the proposed algorithm, 50 Monte Carlo experiments were carried out by changing the random mixing matrix at each signal separation step. Parameter values used in the proposed SPEA2 simulation were population size 100, external set size 50, crossover rate 50 and maximum number of iterations 60.
Figure 2 shows the original male and two female speech signals used, randomly mixed forms of these three signals, and sample sizes of 4000 for the estimated source signals separated as a result of the MO-BSS algorithm. The original sounds used are taken from [52].
Figure 3 shows the spectrogram of the estimated source signals as a result of separation with the original, mixed and proposed DWT-MOBSS method in the frequency space of the signals.
In this study, feature reduction was obtained by applying the DWT method, and an appropriate classification model was created. Signals subjected to the DWT method were decomposed into their components by multiplying with the main wavelet, and as a result, no loss was experienced in the signals. As a result, significant gains in computational cost were achieved. As a result of the application of DWT in the male and two female speech signals we used, since the approaches give the original signal and the details give low-scale information, the approaches were separated into frequency coefficients with a low-pass filter up to the desired level. BSS was performed by applying the new signals obtained to the SPEA2 method.
The SNR measure was used to evaluate the accuracy and success rates of the experimental results, and analyses were made with IGD, HV and Δ metrics to measure the performance of the algorithm. The SNR measure is defined as follows:
S N R d B = 10 l o g 10 P s P n
where P s and P n represent the signal and the noise, respectively [53].
Mixed speech signals were separated by the proposed method for sample sizes of 2000, 4000, 6000, 8000, 10,000, 12,000 and 14,000. Table 1 shows the SNR results of the proposed method, EEMD with MO-BSS, for male and two female speech signals. As the table shows, while increasing the sample size does not affect the separation performance in MO-BSS, it increases the separation performance in EEMD and the proposed method. However, it should not be forgotten that increasing the sample length increases the separation time. Looking at the length of any sample in the table (8000), the proposed method separated all sounds very successfully compared to other methods. Moreover, male voice separation performance is the best of all three methods. This may be related to the frequency characteristics and probability distributions of the male voice. According to the table, the proposed method provided the best separation, followed by EEMD and MO-BSS. When the values in the table are examined, it can be seen that the proposed method is highly successful in both speech signals.
In addition, it is understood that the proposed method gives more stable results compared to the sample sizes. As shown in Figure 4, the male voice is better separated from the two female voice.
It can be seen that the separated performance of MO-BSS is independent of the sample length. Monte Carlo analysis was performed by running these graphical algorithms 50 times with randomly selected mixing matrices [54]. Thus, the effect of different mixing matrices can be seen more clearly.
Performance metrics for MO-BSS are given in Table 2, EEMD in Table 3 and the proposed method in Table 4. The best, worst and average values of IGD, HV and SP are provided in these tables. In both algorithms, metric values have been obtained by running 50 times with sample sizes of 2000, 4000, 6000, 8000, 10,000, 12,000 and 14,000. Minimizing the performance metric in IGD and SP and maximizing the performance metric in HV shows the performance of the algorithm. According to the metrics, MO-BSS and EEMD performed worse than the proposed method. When looking at the average IGD, it increased with sample length. Similar rates can be seen in Table 2, Table 3 and Table 4. The different values in some sample sizes are related to the mixture matrices. For the HV metric, an increase was observed with sample length in all three tables. Increasing the sample length does not cause a change in the SP metric.
In the proposed method, although the processing load increased, a slight decrease in the calculation cost could be observed (Table 5). When these time values are interpreted with the increase in SNRs, it is clear that even the calculation cost for the proposed method is very advantageous. Table 5 shows that EEMD is quite advantageous in terms of computational cost. This is because EEMD can be considered a single-purpose optimization. It can be seen that the calculation times of MO-BSS and the proposed method are quite close to each other. The high calculation times for these methods are due to Multi-Objective Optimization. All these experiments were performed on MATLAB® R2021b.

5. Conclusions

Multi-Objective Optimization methods are used efficiently to increase the performance of blind resource allocation algorithms. This paper proposes both the DWT and the Minkowski distance method to separate mixed signals with the SPEA2 algorithm. At the same time, the proposed algorithm provides signal decomposition with two objective functions working simultaneously. The proposed DWT-MOBSS method has been found to be more efficient and advantageous when compared to the MO-BSS and EEMD algorithms. When the SNRs of the DWT-MOBSS algorithm are examined, its superiority is clearly revealed and the performance of the algorithm is supported by the performance metrics. Therefore, it can be used efficiently in BSS problems.

Author Contributions

Conceptualization, H.C.; methodology, H.C.; software, H.C.; validation, H.C. and N.K.; formal analysis, H.C. and N.K.; resources, H.C.; data curation, H.C.; writing—original draft preparation, H.C.; writing—review and editing, H.C. and N.K.; visualization, H.C.; project administration, N.K.; funding acquisition, H.C. and N.K. All authors have read and agreed to the published version of the manuscript.

Funding

The research was funded by the Erciyes University Scientific Research Projects Coordination Unit (FDK-2022-11706).

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Jukiewicz, M.; Buchwald, M.; Cysewska-Sobusiak, A. Finding optimal frequency and spatial filters accompanying blind signal separation of EEG data for SSVEP-based BCI. Int. J. Electron. Telecommun. 2018, 4, 439–444. [Google Scholar] [CrossRef] [PubMed]
  2. Mahé, G.; Suzumura, G.G.; Moisan, L.; Suyama, R. A non-intrusive audio clarity index (NIAC) and its application to blind source separation. Signal Process. 2022, 194, 108448. [Google Scholar] [CrossRef]
  3. Ilgin, F.Y. Threshold optimisation with Bayesian approach in covariance absolute value detection method. Int. J. Electron. 2022, 109, 1680–1694. [Google Scholar] [CrossRef]
  4. Pelegrina, G.D.; Duarte, L.T. A multi-objective approach for post-nonlinear source separation and its application to ion-selective electrodes. IEEE Trans. Circuits Syst. II Express Briefs 2018, 65, 2067–2071. [Google Scholar] [CrossRef]
  5. Ghazdali, A.; Ourdou, A.; Hakim, M.; Laghrib, A.; Mamouni, N.; Metrane, A. Robust approach for blind separation of noisy mixtures of independent and dependent sources. Appl. Comput. Harmon. Anal. 2022, 60, 426–445. [Google Scholar] [CrossRef]
  6. Pelegrina, G.D.; Duarte, L.T. A multi-objective approach for blind source extraction. In Proceedings of the 2016 IEEE Sensor Array and Multichannel Signal Processing Workshop (SAM), Rio de Janeiro, Brazil, 10–13 July 2016; pp. 1–5. [Google Scholar]
  7. Mokriš, M. The independent component analysis with the linear regression–predicting the energy costs of the public sector buildings in Croatia. Croat. Oper. Res. Rev. 2022, 13, 173–185. [Google Scholar] [CrossRef]
  8. Li, D.; Wong, W.E.; Pan, S.; Koh, L.S.; Li, S.; Chau, M. Automatic test case generation using many-objective search and principal component analysis. IEEE Access 2022, 10, 85518–85529. [Google Scholar] [CrossRef]
  9. Sahin, O.; Akay, B.; Karaboga, D. Archive-based multi-criteria Artificial Bee Colony algorithm for whole test suite generation. Eng. Sci. Technol. Int. J. 2021, 24, 806–817. [Google Scholar] [CrossRef]
  10. Erkoc, M.E.; Karaboga, N. A comparative study of multi-objective optimization algorithms for sparse signal reconstruction. Artif. Intell. Rev. 2022, 55, 1–29. [Google Scholar] [CrossRef]
  11. Chu, D.; Chen, H.; Chen, H. Blind source separation based on whale optimization algorithm. MATEC Web Conf. 2018, 173, 03052. [Google Scholar]
  12. Wang, R. Blind source separation based on adaptive artificial bee colony optimization and kurtosis. Circuits Syst. Signal Process. 2021, 40, 3338–3354. [Google Scholar] [CrossRef]
  13. Ma, B.; Zhang, T. An analysis approach for multivariate vibration signals integrate HIWO/BBO optimized blind source separation with NA-MEMD. IEEE Access 2019, 7, 87233–87245. [Google Scholar] [CrossRef]
  14. Pelegrina, G.D.; Attux, R.; Duarte, L.T. Application of multi-objective optimization to blind source separation. Expert Syst. Appl. 2019, 131, 60–70. [Google Scholar] [CrossRef]
  15. Celik, H.; Karaboga, N. Blind Source Separation with Multi-Objective Optimization for Denoising. Elektron. Ir Elektrotechnika 2022, 28, 62–67. [Google Scholar] [CrossRef]
  16. Shi, Y.; Zeng, W.; Wang, N.; Zhao, L. A new method for independent component analysis with priori information based on multi-objective optimization. J. Neurosci. Methods 2017, 283, 72–82. [Google Scholar] [CrossRef] [PubMed]
  17. Xu, Y.; Wu, Z. Parameter identification of unsaturated seepage model of core rockfill dams using principal component analysis and multi-objective optimization. Structures 2022, 45, 145–162. [Google Scholar] [CrossRef]
  18. Macwan, R.; Benezeth, Y.; Mansouri, A. Heart rate estimation using remote photo plethysmography with multi-objective optimization. Biomed. Signal Process. Control 2019, 49, 24–33. [Google Scholar] [CrossRef]
  19. Elouaham, S.; Dliou, A.; Laaboubi, M.; Latif, R.; Elkamoun, N.; Zougagh, H. Filtering and analyzing normal and abnormal electromyogram signals. Indones. J. Electr. Eng. Comput. Sci. 2020, 20, 176–184. [Google Scholar] [CrossRef]
  20. Mitianoudis, N. Underdetermined Audio Source Separation Using Laplacian Mixture Modelling. In Blind Source Separation: Advances in Theory, Algorithms and Applications; Springer: Berlin/Heidelberg, Germany, 2014; pp. 197–229. [Google Scholar]
  21. Syed, S.H.; Muralidharan, V. Feature extraction using Discrete Wavelet Transform for fault classification of planetary gearbox–A comparative study. Appl. Acoust. 2022, 188, 108572. [Google Scholar] [CrossRef]
  22. Xu, C.; Ni, Y.Q.; Wang, Y.W. A novel Bayesian blind source separation approach for extracting non-stationary and discontinuous components from structural health monitoring data. Eng. Struct. 2022, 269, 114837. [Google Scholar] [CrossRef]
  23. Kervazo, C.; Bobin, J.; Chenot, C. Blind separation of a large number of sparse sources. Signal Process. 2018, 150, 157–165. [Google Scholar] [CrossRef]
  24. Cheriyan, M.M.; Michael, P.A.; Kumar, A. Blind source separation with mixture models—A hybrid approach to MR brain classification. Magn. Reson. Imaging 2018, 54, 137–147. [Google Scholar] [CrossRef] [PubMed]
  25. Kim, S.; Kim, I.; You, D. Multi-condition multi-objective optimization using deep reinforcement learning. J. Comput. Phys. 2022, 462, 111263. [Google Scholar] [CrossRef]
  26. Hancer, E.; Xue, B.; Zhang, M.; Karaboga, D.; Akay, B. Pareto front feature selection based on artificial bee colony optimization. Inf. Sci. 2018, 422, 462–479. [Google Scholar] [CrossRef]
  27. Xue, Y.; Li, M.; Shepperd, M.; Lauria, S.; Liu, X. A novel aggregation-based dominance for Pareto-based evolutionary algorithms to configure software product lines. Neurocomputing 2019, 364, 32–48. [Google Scholar] [CrossRef]
  28. Li, W.; Wang, R.; Zhang, T.; Ming, M.; Li, K. Reinvestigation of evolutionary many-objective optimization: Focus on the Pareto knee front. Inf. Sci. 2020, 522, 193–213. [Google Scholar] [CrossRef]
  29. Song, Y.; Fang, X. An Improved Strength Pareto Evolutionary Algorithm 2 with Adaptive Crossover Operator for Bi-Objective Distributed Unmanned Aerial Vehicle Delivery. Mathematics 2023, 11, 3327. [Google Scholar] [CrossRef]
  30. Yuan, X.; Zhang, B.; Wang, P.; Liang, J.; Yuan, Y.; Huang, Y.; Lei, X. Multi-objective optimal power flow based on improved strength Pareto evolutionary algorithm. Energy 2017, 122, 70–82. [Google Scholar] [CrossRef]
  31. Khanra, M.; Nandi, A.K. Optimal driving based trip planning of electric vehicles using evolutionary algorithms: A driving assistance system. Appl. Soft Comput. 2020, 93, 106361. [Google Scholar] [CrossRef]
  32. Xu, H.; Zeng, W.; Zeng, X.; Yen, G.G. An evolutionary algorithm based on Minkowski distance for many-objective optimization. IEEE Trans. Cybern. 2018, 49, 3968–3979. [Google Scholar] [CrossRef]
  33. Fu, C.; Jianhua, Y. Granular Classification for Imbalanced Datasets: A Minkowski Distance-Based Method. Algorithms 2021, 14, 54. [Google Scholar] [CrossRef]
  34. Li, C.; Tao, Y.; Ao, W.; Yang, S.; Bai, Y. Improving forecasting accuracy of daily enterprise electricity consumption using a random forest based on ensemble empirical mode decomposition. Energy 2018, 165, 1220–1227. [Google Scholar] [CrossRef]
  35. Elouaham, S.; Dliou, A.; Latif, R.; Laaboubi, M.; Zougagh, H.; Elkhadiri, K. Analysis Electroencephalogram Signals Using Denoising and Time-Frequency Techniques. Extraction 2021, 13, 14. [Google Scholar]
  36. Yang, Z.-X.; Zhong, J.-H. A Hybrid EEMD-Based SampEn and SVD for Acoustic Signal Processing and Fault Diagnosis. Entropy 2016, 18, 112. [Google Scholar] [CrossRef]
  37. Akay, B. Synchronous and asynchronous Pareto-based multi-objective artificial bee colony algorithms. J. Glob. Optim. 2013, 57, 415–445. [Google Scholar] [CrossRef]
  38. Sandoval, C.; Cuate, O.; González, L.C.; Trujillo, L.; Schütze, O. Towards fast approximations for the hypervolume indicator for multi-objective optimization problems by Genetic Programming. Appl. Soft Comput. 2022, 125, 109103. [Google Scholar] [CrossRef]
  39. Long, Q.; Li, G.; Jiang, L. A novel non-dominated sorting genetic algorithm for multi-objective optimization. J. Comput. Sci. 2021, 23, 31–43. [Google Scholar]
  40. Sun, Y.; Yen, G.G.; Yi, Z. IGD indicator-based evolutionary algorithm for many-objective optimization problems. IEEE Trans. Evol. Comput. 2018, 23, 173–187. [Google Scholar] [CrossRef]
  41. Yen, G.G.; He, Z. Performance metric ensemble for multiobjective evolutionary algorithms. IEEE Trans. Evol. Comput. 2013, 18, 131–144. [Google Scholar] [CrossRef]
  42. Tang, W.; Liu, H.L.; Chen, L.; Tan, K.C.; Cheung, Y.M. Fast hypervolume approximation scheme based on a segmentation strategy. Inf. Sci. 2020, 509, 320–342. [Google Scholar] [CrossRef]
  43. Mirjalili, S.; Lewis, A. Novel performance metrics for robust multi-objective optimization algorithms. Swarm Evol. Comput. 2015, 21, 1–23. [Google Scholar] [CrossRef]
  44. Bahoura, M.; Ezzaidi, H.; Méthot, J.F. Filter group delays equalization for 2D discrete wavelet transform applications. Expert Syst. Appl. 2022, 200, 116954. [Google Scholar] [CrossRef]
  45. Naseer, R.A.; Nasim, M.; Sohaib, M.; Younis, C.J.; Mehmood, A.; Alam, M.; Massoud, Y. VLSI architecture design and implementation of 5/3 and 9/7 lifting Discrete Wavelet Transform. Integration 2022, 87, 253–259. [Google Scholar] [CrossRef]
  46. Devi, D.; Sophia, S.; Prabhu, S.B. Deep learning-based cognitive state prediction analysis using brain wave signal. In Cognitive Computing for Human-Robot Interaction; Academic Press: Cambridge, MA, USA, 2021; pp. 69–84. [Google Scholar]
  47. Bendahane, B.; Jenkal, W.; Laaboubi, M.; Latif, R. HDL Coder Tool for ECG Signal Denoising. In International Conference on Digital Technologies and Applications; Springer Nature: Cham, Switzerland, 2023; pp. 753–760. [Google Scholar]
  48. Mota-Carmona, J.R.; Pérez-Escamirosa, F.; Minor-Martínez, A.; Rodríguez-Reyna, R.M. Muscle fatigue detection in upper limbs during the use of the computer mouse using discrete wavelet transform: A pilot study. Biomed. Signal Process. Control 2022, 76, 103711. [Google Scholar] [CrossRef]
  49. Shen, M.; Wen, P.; Song, B.; Li, Y. An EEG based real-time epilepsy seizure detection approach using discrete wavelet transform and machine learning methods. Biomed. Signal Process. Control 2022, 77, 103820. [Google Scholar] [CrossRef]
  50. Yesilli, M.C.; Chen, J.; Khasawneh, F.A.; Guo, Y. Automated Surface Texture Analysis via Discrete Cosine Transform and Discrete Wavelet Transform. Precis. Eng. 2022, 77, 141–152. [Google Scholar] [CrossRef]
  51. Dolatabadi, S.; Seyedi, H.; Tohidi, S. A new method for loss of excitation protection of synchronous generators in the presence of static synchronous compensator based on the discrete wavelet transform. Electr. Power Syst. Res. 2022, 209, 107981. [Google Scholar] [CrossRef]
  52. Voice Sources. Available online: https://www.kecl.ntt.co.jp/icl/signal/sawada/demo/bss2to4/index.html (accessed on 22 August 2023).
  53. Erkoc, M.E.; Karaboga, N. Sparse signal reconstruction by swarm intelligence algorithms. Eng. Sci. Technol. Int. J. 2021, 24, 319–330. [Google Scholar] [CrossRef]
  54. Hartland, N.P.; Maltoni, F.; Nocera, E.R.; Rojo, J.; Slade, E.; Vryonidou, E.; Zhang, C. A Monte Carlo global analysis of the Standard Model Effective Field Theory: The top quark sector. J. High Energy Phys. 2019, 1–78. [Google Scholar] [CrossRef]
Figure 1. Block diagram of SPEA2 algorithm.
Figure 1. Block diagram of SPEA2 algorithm.
Electronics 12 04383 g001
Figure 2. Time-domain waveform of separated signals: (a) original signals, (b) mixture signals, and (c) estimated source signals.
Figure 2. Time-domain waveform of separated signals: (a) original signals, (b) mixture signals, and (c) estimated source signals.
Electronics 12 04383 g002
Figure 3. Spectrogram of separated signals: (a) original signals, (b) mixture signals, and (c) estimated source signals.
Figure 3. Spectrogram of separated signals: (a) original signals, (b) mixture signals, and (c) estimated source signals.
Electronics 12 04383 g003
Figure 4. SNR values of the MO-BSS and proposed algorithm.
Figure 4. SNR values of the MO-BSS and proposed algorithm.
Electronics 12 04383 g004
Table 1. SNR values of male and female voice signals according to different sample sizes.
Table 1. SNR values of male and female voice signals according to different sample sizes.
MaleFirst FemaleSecond Female
Number of SamplesMO-BSS
SNR (dB)
EEMD
SNR (dB)
Proposed SNR (dB)MO-BSS
SNR (dB)
EEMD
SNR (dB)
Proposed SNR (dB)MO-BSS
SNR (dB)
EEMD
SNR (dB)
Proposed SNR (dB)
2000263246212642222740
4000253049222648192545
6000223152202848203044
8000223050202747182546
10,000233352212949222847
12,000243653223148223247
14,000253754233350223449
Table 2. IGD, HV and SP metric values for the MO-BSS method.
Table 2. IGD, HV and SP metric values for the MO-BSS method.
IGDHVSP
Number of SamplesBestWorstMeanBestWorstMeanBestWorstMean
20000.000180.021530.007450.814740.026540.245430.735331.533241.24331
40000.000100.058410.007280.798330.024540.252730.718471.398191.14876
60000.000110.063780.008150.714330.031450.235330.634361.770031.14249
80000.000120.037910.012860.832850.047560.365410.628581.375101.13523
10,0000.000480.042540.013760.984530.025450.493640.735311.537161.16355
12,0000.005690.041760.015860.927350.058370.557470.848961.543311.15968
14,0000.002110.093560.017230.935270.053550.583730.845441.284891.16447
Table 3. IGD, HV and SP metric values for the EEMD method.
Table 3. IGD, HV and SP metric values for the EEMD method.
IGDHVSP
Number of SamplesBestWorstMeanBestWorstMeanBestWorstMean
20000.000210.019540.006350.825670.025240.257540.716431.526331.23755
40000.000110.042310.006720.799350.020120.269760.702431.383551.13908
60000.000100.053430.007640.738670.030020.247650.618651.749761.13523
80000.000230.031870.011770.873550.035640.381220.610671.393661.12894
10,0000.000390.037840.011120.992450.018550.513450.719641.515441.15743
12,0000.004240.032940.014970.938670.040860.594460.829661.517541.14764
14,0000.001210.070340.016180.949030.041760.598530.837601.314561.15345
Table 4. IGD, HV and SP metric values of the proposed method.
Table 4. IGD, HV and SP metric values of the proposed method.
IGDHVSP
Number of SamplesBestWorstMeanBestWorstMeanBestWorstMean
20000.000560.017440.004160.934530.012870.357430.619321.494731.00663
40000.000350.036430.005340.941430.017080.302620.620841.718431.01541
60000.000370.036480.003120.981190.011550.384490.794531.500241.00853
80000.000240.031540.003160.991090.011450.410360.703431.684331.09728
10,0000.000780.039870.003820.834700.011580.493530.721841.712071.09935
12,0000.000860.035210.005240.871230.015320.541030.683531.681241.02964
14,0000.000750.039110.006230.892380.012130.562920.693571.307541.04277
Table 5. Running times of algorithms according to different sample sizes.
Table 5. Running times of algorithms according to different sample sizes.
Number of
Samples
MO-BSS Avg,
Time (s)
EEMD Avg,
Time (s)
Proposed Avg,
Time (s)
20005.741.145.21
40007.571.467.04
60008.361.937.83
80009.132.358.12
10,00010.882.949.48
12,00011.683.4710.32
14,00013.053.3811.69
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Celik, H.; Karaboga, N. Blind Source Separation with Strength Pareto Evolutionary Algorithm 2 (SPEA2) Using Discrete Wavelet Transform. Electronics 2023, 12, 4383. https://doi.org/10.3390/electronics12214383

AMA Style

Celik H, Karaboga N. Blind Source Separation with Strength Pareto Evolutionary Algorithm 2 (SPEA2) Using Discrete Wavelet Transform. Electronics. 2023; 12(21):4383. https://doi.org/10.3390/electronics12214383

Chicago/Turabian Style

Celik, Husamettin, and Nurhan Karaboga. 2023. "Blind Source Separation with Strength Pareto Evolutionary Algorithm 2 (SPEA2) Using Discrete Wavelet Transform" Electronics 12, no. 21: 4383. https://doi.org/10.3390/electronics12214383

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop