1. Introduction
Spectrum maps provide convenience for spectrum management, interference detection, and planning [
1,
2,
3]. Currently, constructing accurate spectrum maps has attracted a lot of attention. Spectrum map fusion, which can improve the accuracy of spectrum maps, has gradually been widely applied in spectrum data analyzing and processing [
4]. Additionally, unmanned aerial vehicles (UAVs) are extensively applied in spectrum data sampling due to their convenience and flexibility [
5].
Fusing multiple spectrum maps can effectively mitigate the noises and measurement errors induced by a single spectrum receiver. The authors of [
6,
7] proposed a weighted fusion method for cooperative spectrum sensing, where they adopted the weighted fusion method to fuse spectrum maps. In [
8], the authors periodically used a combination of soft and hard decision-making methods for spectrum map fusion. In [
9], the authors employed a compressed sensing approach to solve the problem of three-dimensional compressed spectrum map fusion, and an orthogonal matching tracking algorithm based on three-dimensional subspace was proposed to restore the spectral situation of three-dimensional compressed spectrum map fusion. The authors of [
10,
11] proposed a data-driven spectrum map fusion methods by learning from experience and a learning-based fusion method (LBFM) for radio occupancy map estimation, respectively. In [
12], the authors used a compressed-sensing based method (CSBM) to complete the fusion of spectrum maps. However, spectrum maps constructed by these methods often suffer from performance degradation when spectrum data have strong correlation.
Most current spectrum maps are fused by constructing optimization problems solved by iterative algorithms. For instance, the authors of [
13] employed a clustering algorithm and used iterative operations to complete spectrum map fusion. In [
14], the authors proposed a Riemannian mean-based data fusion method and employed a gradient descent algorithm to calculate the Riemannian mean for fusing spectrum maps. The authors of [
15] fused spectrum maps through the affine projection algorithm and employed delayed input vectors to assist in completing the algorithm iteration process. In [
16], the authors exploited the strong directivity of directional antenna and used a channel propagation model to estimate the unknown spectrum data before spectrum map fusion. To demonstrate the effectiveness of their proposed method, they employed the ray-tracing technique to acquire the simulation data of the measurement area. The authors of [
17] designed a path planning algorithm for UAVs to implement the three-dimensions (3D) spectrum occupancy measurement for the fusion of spectrum maps. However, most optimization problems of spectrum map fusion often cannot obtain the optimal solution and their computational complexity is very high.
In this paper, we propose a new multi-UAV spectrum map fusion method based on differential ridge regression, which can construct high-accuracy spectrum maps in the electromagnetic environment with strong-correlation data. We first construct a spectrum map fusion model by leveraging the spatial distribution characteristic of spectrum data. Then, we design a new map fusion regularization term to constrain the fusion regularization parameters and compress the ridge regression coefficient sizes. We also derive the lower bound of the spectrum map fusion problem and analyze its convergence. Finally, we propose an accelerated maximally split alternating directions method of multipliers (AMS-ADMM) algorithm to reduce the computational complexity of spectrum map construction. The key contributions are as follows:
We construct a spectrum map fusion model based on differential ridge regression. By introducing the -norm, a new regularization term is designed, which can constrain the map fusion parameters and compress regression coefficient sizes, effectively handling the correlation of spectrum data.
We exploit the propagation characteristics of the spectrum signal and formulate a model-driven solution for the spectrum map fusion optimization problem. By developing the dual transformation, we derive the lower bound of the optimal value and ensure the convergence of the map fusion optimization problem.
We design an AMS-ADMM algorithm to decompose the original fusion problem into several subproblems. The subproblems are coordinated to obtain the solution of the original problem, and, thus, the computational complexity is significantly reduced.
Part of this work was presented in [
18]. In this paper, we analyze the convergence of the map fusion optimization problem and propose the new AMS-ADMM, which has lower computational complexity than the method used in [
18]. Moreover, we consider a real electromagnetic propagation environment in this paper and leverage ray tracing (RT) to construct the ideal SEM for performance evaluation purposes. Multiple UAVs are also used for spectrum data sampling. In contrast, in [
18], simulations were only performed in simple open environments.
The remaining part of this paper is arranged as follows.
Section 2 presents the process of spectrum map modelling. We complete the construction of the spectrum map fusion model in
Section 3.
Section 4 describes the design of regularization terms. Simulation results are presented in
Section 5 to demonstrate the superior performance of the proposed fusion method. Finally, the conclusion is provided in
Section 6.
Notations: a, and stand for a scalar, a column vector, and a matrix, respectively; represents a identity matrix, and represents an zero matrix; denotes a vector of ones with a magnitude of K; is the entry on the i-th row and j-th column of ; denotes the i-th row of ; the inverse, transpose, and conjugate transpose of are represented by , , and , respectively; and denote the Frobenius norm and vectorization of , respectively; ⊗, ⊕, and ⋄ denote the Kronecker product, Kronecker sum, and Khatri–Rao product, respectively; and expectation of a random variable is denoted by .
2. Spectrum Map Modeling
We consider a typical urban area with buildings, vegetation, and vehicles, as shown in
Figure 1. Multiple UAVs equipped with spectrum receivers are used to collect spectrum data from several radiation sources (RSs). We divide this area into
grids. In this paper, we use the inverse distance weighting (IDW) to estimate the spectrum strength of an unknown grid and construct the spectrum map of the area [
19]. This method is adaptable to different scenarios, and can distinguish the difference in spectrum strength at different distances by adjusting the weighted index, effectively constructing the spectrum maps for every UAV [
20].
According to the IDW, the weights of the unknown grid are determined by the distance between the unknown grid and the sampled grid. Specifically, the weight decreases as the grid distance increases. Therefore, the spectrum strength value
of the unknown grid can be expressed as
where
denotes the spectrum strength of the known sample grid
, and
denotes the distance between the unknown grid and the known sampling grid. According to (2), weight allocation is mainly dependent on the weighting index
p, which controls the decay rate of weight distance. Generally, the spectrum strength value of the unknown grid estimated by this method gradually approaches the strength value of the nearest known grid as the weighting index increases. Therefore, IDW can distinguish the spectrum strength differences effectively, and the spectrum fusion model construction is also smooth enough for further analysis.
Figure 1 illustrates the process of the inverse distance weighting method for estimating unknown grid weights. In (2),
can be expressed as
where
is the center coordinate of the
i-th grid and
is center coordinate of the grid to be measured. By applying the above method, we can estimate the spectrum strength of the unknown grid and construct the spectrum maps of UAVs.
3. Spectrum Map Fusion Model
In this section, we analyze the propagation characteristics of signals according to the path loss model to design the spectrum map fusion model [
21].
When the signal frequency is in MHz and the distance is in km, assuming the antenna gain of both the transmitting and receiving ends is 1, the path loss model of urban scenarios can be expressed as
where
is the path loss at the reference distance;
is the path loss exponent; and
is the shadow fading. In the urban scenarios, considering the attenuation of RSs with the increase of distance during propagation in space, the received signal strength is [
22]
where
is the transmission power of the RS;
and
are the gains of transmitter and the receiver antennas, respectively;
is the signal wavelength; and
d is the linear distance between the radiation source and UAVs [
23].
From (5), we can see that the signal strength decreases with the attenuation of distance and/or frequency. Based on the path loss model (5), we can see that the distribution of spectrum strength near the RSs exhibits aggregation characteristics [
24]. Therefore, we can further complete the construction of the spectrum map model.
The spectrum strength of adjacent frequency bands often have strong correlations due to external interference factors, which can cause abnormal regression coefficients or numerical distortions in the fusion model, as well as data redundancy, thus masking key useful information [
25]. To demonstrate the effectivity of our method in addressing strong correlations, we employ the Cramer’s V method to measure the correlation between the spectrum data, as given by
where the value of
is between 0 and 1;
is the Chi square test statistic of different scenarios;
, which can be denoted by
, is the number of spectral strength collected by UAVs; and
. According to [
25], the data has strong correlation when
V is greater than 0.5, and the data has weak correlation when
V is less than 0.3.
To demonstrate the use of differential ridge regression to handle strong correlations between spectrum data, we plot
Figure 2.
Figure 2a shows the energy distribution of the raw spectrum data. Then, the raw spectrum data is differential processed in
Figure 2b,c, enhancing local mutation features while suppressing stationary background noises and reducing data redundancy [
16]. Multi-directional differential combination also improves the applicability of map fusion methods in various environments [
26]. The differentiated data often still exhibits feature correlation between adjacent regions, while
regularization based on ridge regression can effectively compresses regression coefficients to reduce the impact of data correlation on the stability of the fusion model. As is shown in
Figure 2d, the potential noise components can be suppressed and useful signal components are preserved by adjusting the regularization parameter based on ridge regression. After reducing data redundancy through differential processing, the regularization of ridge regression can efficiently suppress local residual interference, improving the accuracy of spectrum map construction.
Based on
Figure 2, we design a differential ridge regression regularization term to improve the accuracy of spectrum map fusion. Define
as the
g-th spectrum strength data to be fused, where
and
denote the numbers of rows and columns of the spectrum strength data matrix, respectively. Then,
is defined as the
g-th column vector of the fused spectrum strength data and
as the vectorization of
. Subsequently, the spectrum strength matrix can be given as
Fusing the spectrum maps of different UAVs can effectively suppress abnormal data in the constructed spectrum map [
27]. Spectrum maps are supplemented to address potential anomalies and interference. We employ
-norm to measure the difference, as given by
where
is the
m-th row vector of
,
, and
is an indicative function, which can be expressed as
We construct the loss function as
We proceed to impose constraints on (10), as given by
where
is the tolerance factor. Therefore, we have the optimization problem as
To ensure the rationality of the optimization problem calculation results, we perform developed Lagrange dual transformation, which can be written as
where
is called dual variable. We perform dual transformation on (13), as given by
Lemma 1. The function obtained from the developed dual transformation of convex optimization problems based on our spectrum map fusion determines the lower bound of the optimal value of the original problem.
Proof. Consider a common optimization problem, as given by
where the domain of the independent variable is
. We abbreviate the domain as
. Assume that
, which is a non empty set.
is the optimal solution value. The Lagrange function of the optimization problem can be written as
The domain of (16) is
.
is the Lagrange multiplier corresponding to the
i-th inequality constraint
.
is the Lagrange multiplier corresponding to the
i-th equality constraint
. Vectors
and
are called dual variables. Operate the dual transformation on (16), and we have
A random
selected from the domain satisfies the constraint condition, and therefore we have
In (18), the first term on the left is non positive and the second term is zero. According to (18), we have
Therefore, (18) can be rewritten as
According to (20), holds for any feasible , which also means holds. Thus, the dual function forms the lower bound of the optimal value of the original problem. The proof is complete. □
4. Design of Regularization Term for Differential Ridge Regression
In this section, we use the differential characteristics of spectrum data to design a regularization term based on differential ridge regression and apply the regularization term to the fusion model, providing convergence solutions [
28].
After analyzing the relationship between received signal strength and propagation distance, we calculate the first and second partial derivatives of received signal strength
with respect to propagation distance
d, as
According to (21), the partial derivative of
d with respect to
is always negative, and the spectrum strength is inversely proportional to the third power of the propagation distance. Meanwhile, (22) indicates that the second partial derivative of
d to
is positive, implying that the change rate of spectrum strength
with distance
d continues to increase. Since a partial derivative is always negative, the change rate of spectrum strength with distance gradually approaches 0. Therefore, the rate of attenuation of spectrum strength slows down with the increasing distance. In other words, the data differences in the spectrum map exhibit variability and sparsity around the transmitter antenna [
29]. Thus, we use ridge regression to address the sparsity of the spectrum map and compensate for the incompleteness of the collected spectrum strength data through regularization. In addition, the introduction of regularization in ridge regression helps improve the fitting and generalization ability of spectrum map fusion models.
On the other hand, we obtain the optimal value of the fusion model through computation. The proposed developed Lagrange duality can precisely combine mathematical models and optimization algorithms. We often get stuck in local optima during the process of solving the fusion model, while the developed Lagrange duality can ensure that the local optimum is the global optimum. By combining the differential derivation formula of spectrum strength with the original spectrum map, we can see that the spectrum strength value is much greater than zero, and the signal strength decays slowly with the increasing distance. Therefore, there is sparsity in the difference between adjacent signal strengths. To describe the difference in strength between adjacent spectra, we perform differential processing on the spectrum strength vector
, expressed as
Substituting (23) into (12), we have
where
represents the tolerance factor. For the sake of computational convenience, we can instead solve the optimization problem to obtain the values of the independent variables corresponding to the optimal values, written as
In (25), is the regularization parameter of differential ridge regression for balancing the loss function and constraining the sparsity of the function.
Then, the Lagrange augmented function of the objective function can be written as
For the sake of computational convenience, we simplify the variables in (26) by reducing some of the parameters as follows
and then (26) can be simplified as
We proceed to perform dual transformation on (28), which can be written as
Define
k as the number of iterations and
k as a natural number. We use
and
to constrain the calculation process. (In most cases,
,
[
30].) Repeat the following operation until convergence is reached.
After the iteration is completed, we input the final result of the Algorithm 1 into (29) and use the properties of Lagrange duality to determine the lower bound to verify whether the operation result meet the constraints, which ensures the rationality of the operation result.
Algorithm 1 Spectrum Map Fusing |
Input: Spectrum maps matrix to be fused regularization parameter , iteration counter , tolerance factor |
Output: Spectrum map fusion result |
Initialization: |
Update using (30) |
Update using (31) |
Update u using (32) |
if do |
q = |
restart the procedure |
end if |
Return the final values of .
|
5. An Accelerated Maximally Split ADMM
In this section, we propose the accelerated split ADMM to solve the optimization problem.
5.1. ADMM for Solving the Fusion Problem
We note that in this paper, since we use UAVs to collect spectrum data, the data distribution is uniform, and we can obtain a convexity of the objective function. In the case of non-uniform distribution, we use traditional iterative methods for fusion directly. Then, we consider the general convex optimization problem
where
is the node data matrix,
is the model weight vector,
is the target output vector,
is a convex loss function, and
is a separable convex regularization function. Partition the node data matrix as
and the weight vector as
with
,
, and
, and rewrite the regularization function as
. After introducing
auxiliary variable vectors,
with
, which are compacted as
, the convex optimization problem (32) is then transformed into
Let
k denote the iteration number; a variable with superscript
k or
represents the estimate of that variable in the
kth or
th iteration. The ADMM for the
P-partitioned model fitting problem (34) is described as
where
is a penalty parameter, and
are scaled Lagrangian multiplier vectors, and
in (35). We refer to the ADMM (35) as a P-partition ADMM.
Introduce the average auxiliary variable vector
v, the average scaled multiplier vector
u, and the average model output vector
y as
Problem (35) can be rewritten as
which is subject to the constraint (36).
Minimizing (37) over
with fixed
v has the solution
Therefore, the
V-update in (35) can be computed by solving
Apply (38) for
. The
P-partition ADMM (35) for problem (34) is then simplified as
where
in (40).
5.2. An Accelerated Maximally Split ADMM for Fusion Problem Solving
As shown above, we take
and
. In this case, the block weight vector wp reduces to a weight scalar
and the block data matrix
reduces to a column data vector
. We assume that
The
P-partition ADMM (40) for the general convex model fitting problem (34) then becomes
where
, and
in (41).
It is obvious that the optimization over the weight vector w has been maximally split into univariate subproblems in (41).
If the loss function is also decomposable with respect to the elements of v, the optimization problem (41) can also be split into univariate subproblems.
For the fusion problem, the loss function and regularization function of the model fitting problem (34) are expressed as
With (42), the
-minimization and the v-minimization in (41), respectively, can be rewritten as
After analytically solving (43) for
and
, an accelerated maximally split for the fusion problem, which is denoted by the proposed solution, is obtained as
where
and
.
Then, the
-update reduces to
The update for
v and
u remain the same as (44). In order to make the algorithm easier to solve the fusion problem, we have
In the derivation of (46),
and
are taken as
The decomposability of the cost function has been sufficiently utilized. Using (47) rather than (46) is significant, as it leads to a more efficient solution.
Then, we replace the fixed gain factor
with a tunable parameter
. This simple modification was shown to have caused an obvious increase in the convergence speed of the algorithm. Motivated by this modification, we replace the fixed scalar factor
in both the numerator and denominator of the
-update in (44) by a tunable parameter
, which can be written as
where
in (49).
After eliminating the multiplier vector u from (48), the fusion problem becomes
where
in (50).
5.3. Convergence Analysis and Parameter Selection of the Accelerated Maximally Split ADMM
Based on the convergence analysis, optimal parameters of the algorithm for a particular regularization scheme are derived. We introduce the following equations to assist in analyzing the convergence of the fusion problem, as given by
Thus, (49) can be rewritten as
The fixed-point
of the iterative algorithm (51) satisfies
Eliminating
from (52), and we can get
Calculating the difference between
and
in (50), we obtain
From (54) we obtain with in (50). Furthermore, inserting into (52) gets us .
With the fixed-point
, we rewrite the (44) as
where
The linear dynamical system can be written in the matrix-vector form, as
Based on the above derivation, we are led to the conclusion that the fixed-point
of (50) is
where
We proceed to analyze the relationship between the convergence of fusion problem and the convergence ratio
, as given by
The spectrum radius
of matrix
Q is small, where
S is some positive definite matrix.
Next, we execute the optimal parameters and practical parameter selection. It is seen from the above analysis that the convergence ratio of (49) depends on the algorithm parameters and . Theoretically, the optimal values of and for the fastest convergence can be determined by minimizing the spectrum radius of matrix Q over and . However, direct minimization of through eigenvalues of Q is very time consuming in general.
Fortunately, for the case with regularization factors, we obtain the succinct convergence condition (58). In addition, a concise analytic expression (59) for the spectrum radius of matrix Q in terms of the data matrix G, model parameter , and algorithm parameters and can also be determined. From (58) and (59), the optimal algorithm parameters and for given data matrix and regularization factors can be quickly obtained by minimizing in (45) over and , subject to constraint (58).
We introduce
With some algebra, it is known that
is a function of
, i.e.,
Then, for the fusion problem with
, the optimal parameters
and
of (49) are determined by
the smallest convergence ratio is
The optimal parameter
of (42), i.e., (49) with
, is
and the smallest convergence ratio is
By (62) and (64), the optimal algorithm parameters and are functions of the fusion model parameters and . We can compute the function values in advance on a 2-D dense grid of , and then look up the optimal algorithm parameters very quickly for specific problems in application. For the fusion problem with general regularization factors, the algorithm parameters and computed by (62) and (64) are not optimal. However, they are often good candidate parameters with which (49) converges fast, or they may be used as initial values in optimization of the algorithm parameters and .
5.4. Complexity Analysis
The AMS-ADMM algorithm is used in this article to simplify the complexity of the differential ridge regression algorithm and improve its computational efficiency. The core complexity of spectrum construction comes from the complexity of the AMS-ADMM algorithm used in the spectrum map fusion algorithm. Since the spectrum strength vectors before and after fusion are denoted with and , respectively, the computational complexity of the spectrum map fusion model is . The use of the proposed AMS-ADMM algorithm reduces the complexity to , while the algorithms using direct calculation have to take the spectrum matrices into account and have a complexity of . Obviously, our algorithm effectively reduces computational complexity compared to algorithms using direct calculation.
Next, we compare the computational complexity between the proposed algorithm and other ADMM algorithms. Assuming the same input data, the main computation burden relies on evaluating and performing a sort operation for
. According to (41), the computational complexity of ADMM relies on an input signal strength vector whose complexity is
. On the basis of [
31], the computational complexity of the Tikhonov regularization method is
. According to [
32], the computational complexity of the adaptative LASSO algorithm is
. In comparison, the computational complexity of our AMS-ADMM algorithm is lower than these methods.
6. Simulation Results
In this section, we perform simulations to demonstrate the performance of the proposed spectrum map fusion method. Simulations are conducted in an area of 900 m × 900 m, which is divided into 160 × 160 grids and each grid has a side length of 5 m. We conduct spectrum map fusion in two typical scenarios with different data correlation and frequecies. In Scenario 1, the correlation of spectrum strength data is
, so the spectrum strength data has strong correlation. In Scenario 2, the correlation of spectrum strength data is
, indicating that the data has weak correlation. The signal power, signal center frequency, signal bandwidth, and signal positions of two typical scenarios are listed in
Table 1.
Figure 3a–c show the spectrum map without noises, the spectrum map with SNR = 20 dB, and the fused spectrum map in Scenario 1, respectively. We can see that the method proposed in this paper effectively suppresses the noise interference and significantly improves the accuracy of the spectrum map by fusing the spectrum maps with strong data correlation. Due to the characteristic of differential ridge regression in preventing signal fluctuations, the fused spectrum map appears smooth. Comparing the spectrum maps in
Figure 3b,c, fusing multiple spectrum maps by our method can reduce the construction root mean square error (RMSE) by over 30%. The proposed method introduces a differential regularization term to penalize sudden and discontinuous changes in spectrum strength during the fusion process of spectral maps, and thereby can enhance the smoothness and consistency of the fusion map while avoiding the noise overfitting in the spectrum strength data.
Figure 4a–c show the ideal spectrum map of Scenario 2, the spectrum map with SNR = 20 dB, and the fused spectrum map, respectively. By comparing
Figure 3 with
Figure 4, we can see that the method proposed in this paper can also suppress noise interference and improve the accuracy of the fused maps in an electromagnetic environment with weak correlation. This is because the proposed new regularization terms can constrain the map fusion parameters and compress regression coefficient sizes, effectively handling the correlation of spectrum data. We can also see that, although the frequencies, source locations, and source power in Scenario 2 are different from those in Scenario 1, our method can still achieve satisfactory performance in spectrum map construction. The reason is that we exploit the propagation characteristics of the spectrum signal to constrcut the spectrum map fusion model. This model suppress the local noise interferences in different electromagnetic environments.
We evaluate the performance of the fusion method numerically by calculating RMSE in two scenarios, as shown in
Figure 5 and
Figure 6.
Figure 5a,b show the RMSEs of the constructed spectrum map versus the number of spectrum receivers. Comparing
Figure 5a,b, we can see that the method proposed in this paper provided exceptional performance in spectrum map fusion in two different scenarios. This is because employing the proposed regularization term in differential ridge regression can improve the generalization ability of the fusion model.
Figure 5 also shows that the spectrum map construction accuracy improves as the number of spectrum receivers increases, but the accuracy increases slowly when the number of spectrum receivers exceeds five. The reason is that the noises and measurement errors induced by a single receiver can be mitigated as the number of receivers increases.
We also compare the proposed method with the improved weighted average method (IWAM) [
6], the group sparsity method (GSM) [
33], the least absolute shrinkage and selection operator method (LASSOM), the learning-based fusion method (LBFM) [
11], and the compressed-sensing-based method [
12].
Figure 6a,b show the spectrum map construction RMSEs of five methods versus the SNRs. We can also see that our method outperform other methods in spectrum map construction. This is because the method proposed in this paper involves a differential ridge regression regularization term to suppress external interference, which can deal with complex constraint conditions through convex optimization derivation. The addition of regularization terms based on differential ridge regression improves the accuracy in fusing spectrum data with collinearity of features. Additionally, the proposed fusion method employ the developed Lagrange duality to solve the optimal value of the path loss function based on spectrum construction. By using our method, we can ensure the convergence of optimization problems and suppress the noises and abnormal interference in the process of spectrum map construction, thus improving the spectrum map accuracy.