The Spectrum Analysis Solution (SAS) System: Theoretical Analysis, Hardware Design and Implementation

This paper describes a multichannel super-heterodyne signal analyzer, called the Spectrum Analysis Solution (SAS), which performs multi-purpose spectrum sensing to support spectrally adaptive and cognitive radar applications. The SAS operates from ultrahigh frequency (UHF) to the S-band and features a wideband channel with eight narrowband channels. The wideband channel acts as a monitoring channel that can be used to tune the instantaneous band of the narrowband channels to areas of interest in the spectrum. The data collected from the SAS has been utilized to develop spectrum sensing algorithms for the budding field of spectrum sharing (SS) radar. Bandwidth (BW), average total power, percent occupancy (PO), signal-to-interference-plus-noise ratio (SINR), and power spectral entropy (PSE) have been examined as metrics for the characterization of the spectrum. These metrics are utilized to determine a contiguous optimal sub-band (OSB) for a SS radar transmission in a given spectrum for different modalities. Three OSB algorithms are presented and evaluated: the spectrum sensing multi objective (SS-MO), the spectrum sensing with brute force PSE (SS-BFE), and the spectrum sensing multi-objective with brute force PSE (SS-MO-BFE).


Introduction
In the United States, the Federal Communications Commission (FCC) regulates the radio frequency (RF) portion of the electromagnetic spectrum for non-federal use. The current FCC spectrum management policy allocates explicit blocks of the spectrum to specified applications with harsh interference penalties. This regulatory policy follows an exclusive-use model in which spectrum bands are licensed to applications for exclusive use [1]. Since 1994, the FCC has auctioned off large pieces of the spectrum to private industry in keeping with the high spectral demand. Allocating the spectrum in such a rigid manner has a lasting impact on the progress and capability of RF devices.
Over the past several years, there has been an exponentially increasing number of RF applications as well as an equally increasing demanded BW for these applications. For this reason, the RF spectrum is rapidly becoming an overcrowded, or congested, environment. Countless RF applications, such as mobile phones, have undergone explosive growth over the past two decades. Although the spectrum is becoming more congested and an increasing number of bands continue to be allotted for exclusive environment. Section 2 presents an overview of the statistical measures that are used in characterizing the different sub-band selection approaches described later in Section 3. Hardware design and software implementation considerations of the Spectrum Analysis Solution (SAS) system are presented in Section 4. Section 5 presents data collection and data analysis. Finally, Section 6 presents conclusions and directions for future work in this area.
The novelty of our paper lies in the development, validation, and comparison of optimization algorithms for dynamic spectrum sensing to support the operation of a cognitive radar. These algorithms expand upon the existing spectrum sensing, multi-objective optimization model so that mutual interference between radar and communication systems is further mitigated. The successful application of these algorithms to the SS system, their real-time implementation, and the manner in which considerable flexibility is incorporated within to address different scenarios is also a novel contribution in this paper. Figure 1 provides a general block diagram of a SS radar. This paper focuses on the spectrum receiver and data processing boxes in the SS radar block diagram. A spectrum receiver conditions and digitizes the RF energy in the environment. A fast Fourier transform (FFT) converts the discrete spectrum data from the time domain to the frequency domain. Next, a statistical analysis leads to the determination of an optimal OSB of transmission. An OSB is a portion of the spectrum and is an ideal band for radar transmission in its environment and mission profile for a given modality of operation [21]. Note the existence of feedback loop between the Data Processing block and the Adaptive Transmitter in Figure 1. The OSB is communicated to an adaptive transmitter that generally consists of one or more transmitting elements and an adaptive RF front-end. The adaptive transmitter transmits a waveform within the OSB. The transmitted signal is sent back to the processor for matched filtering which is performed in the Radar Scene Analysis block. The radar scene analysis is a statistical interpretation of a radar echo signal that provides information about the environment [7]. In this paper, we discuss a SS hardware architecture and associated signal processing designed to work in conjunction with and support of a cognitive radar requiring an active understanding of the RF environment. Section 2 presents an overview of the statistical measures that are used in characterizing the different sub-band selection approaches described later in Section 3. Hardware design and software implementation considerations of the Spectrum Analysis Solution (SAS) system are presented in Section 4. Section 5 presents data collection and data analysis. Finally, Section 6 presents conclusions and directions for future work in this area.

Spectrum Sensing Statistical Measures
The novelty of our paper lies in the development, validation, and comparison of optimization algorithms for dynamic spectrum sensing to support the operation of a cognitive radar. These algorithms expand upon the existing spectrum sensing, multi-objective optimization model so that mutual interference between radar and communication systems is further mitigated. The successful application of these algorithms to the SS system, their real-time implementation, and the manner in which considerable flexibility is incorporated within to address different scenarios is also a novel contribution in this paper. Figure 1 provides a general block diagram of a SS radar. This paper focuses on the spectrum receiver and data processing boxes in the SS radar block diagram. A spectrum receiver conditions and digitizes the RF energy in the environment. A fast Fourier transform (FFT) converts the discrete spectrum data from the time domain to the frequency domain. Next, a statistical analysis leads to the determination of an optimal OSB of transmission. An OSB is a portion of the spectrum and is an ideal band for radar transmission in its environment and mission profile for a given modality of operation [21]. Note the existence of feedback loop between the Data Processing block and the Adaptive Transmitter in Figure 1. The OSB is communicated to an adaptive transmitter that generally consists of one or more transmitting elements and an adaptive RF front-end. The adaptive transmitter transmits a waveform within the OSB. The transmitted signal is sent back to the processor for matched filtering which is performed in the Radar Scene Analysis block. The radar scene analysis is a statistical interpretation of a radar echo signal that provides information about the environment [7].  Consider a time domain signal x(t) over a time duration τ whose in-phase and quadrature components are denoted as x I (t) and x Q (t), respectively. Thus, we have If the signal is sampled at intervals of ∆τ, the number of samples N is given by N = τ/∆t. If the sampled values of the signal and its in-phase and quadrature components are denoted, respectively, as x(n), x I (n) and x Q (n), for n = 1, 2, . . . , N, then we have

Spectrum Sensing Statistical Measures
After performing a K-point Fast Fourier Transform (FFT) operation, the power spectral density (PSD) is obtained as X(k) = F{x(n)}, k = 1, 2, . . . , K, where k represents a frequency bin of the signal and K is the total number of frequency bins. The frequency bin size, or the resolution bandwidth (RBW) ∆ω in the PSD, is given by where ω 0 is the start frequency and ω K is the stop frequency.
The system noise power at the output of a receiver system arising from the noise signal x n (t), whose sampled values are denoted as x n (n), is computed using where G is the receiver gain, F n is the receiver noise figure, k B is the Boltzmann constant, T is the temperature, and B is the receiver bandwidth. In a similar fashion as seen in Equation (3), the PSD of noise, X n (k), can be obtained. System noise plays a quintessential role in the interpretation of spectral data, particularly in the calculation of PO and SINR, as will be evident later.

Percent Occupancy (PO)
PO is a statistic frequently used in cognitive radio applications to characterize the spectral capacity [22][23][24]. PO is a point-by-point comparison of the power spectrum to a threshold, γ, which is commonly generated on the basis of a system's noise floor. Note that PO is interchangeable with the term "spectrum occupancy". PO is a two state process wherein the first state is labeled "occupied" and the complementary state is labeled "open" [25]. Consider a PSD X(k), as defined in Equation (3). We define b k as a binary parameter (either 0 or 1), which determines whether the k-th sample of X(k) is above a threshold, γ [26]. This binary parameter can be defined as PO is therefore expressed in percentage as where L b is the total number of data points at which b k = 1, such that There are many competing techniques for the determination of γ. Uncertainty in the computation of PO is related to the threshold that defines the minimum power needed in a bin to achieve occupancy [20]. Figure 2 illustrates the importance of the γ value to a PO calculation. A poorly defined γ value will lead to an incorrect perception of the spectral opportunity. A common practice is to set a threshold on the basis of the noise floor of the system, assumed to be additive white Gaussian noise (AWGN). One consistency among the various methods is that the calculation of γ is typically calibrated based upon an estimate or a measurement of the system noise floor; however, system noise may vary over time so calibration data may not always be accurate or consistent. The validity of PO values hinges on the proper selection of the γ value that is used in Equation (6).
PO is a standard metric used to characterize the spectral capacity of the RF environment as it provides a general understanding of the openness or "clarity" of a channel [27]. For instance, if a channel has a high PO, it is likely that the opportunity within that channel is limited, while a low PO indicates more channel availability. While PO begins to provide an understanding of the spectral activity, further statistical analysis can reduce spectral uncertainty. Gaussian noise (AWGN). One consistency among the various methods is that the calculation of  is typically calibrated based upon an estimate or a measurement of the system noise floor; however, system noise may vary over time so calibration data may not always be accurate or consistent. The validity of PO values hinges on the proper selection of the  value that is used in Equation (6).
PO is a standard metric used to characterize the spectral capacity of the RF environment as it provides a general understanding of the openness or "clarity" of a channel [27]. For instance, if a channel has a high PO, it is likely that the opportunity within that channel is limited, while a low PO indicates more channel availability. While PO begins to provide an understanding of the spectral activity, further statistical analysis can reduce spectral uncertainty.
(a) (b) Figure 2. Effect of Percent Occupancy (PO) threshold setting: (a). If the threshold is set too low, the likelihood of false detection will increase; (b) If the threshold is set too high, the likelihood of missed detection will increase.

Total Signal and Noise Energy
Total signal energy (in joules) is defined as the the signal energy over the full period of time within a data collect,  . It is computed as wherein the impedance is assumed to be 1 Ω, by convention [28]. In a similar fashion, the total noise energy is given by An essential BW is a finite band that contains the majority of the signal power [28]. Therefore, power outside of the essential BW can be considered negligible. Within an essential BW, we have and In terms of dBJ (decibels relative to 1 joule), we can express, using Parseval's theorem, A high total signal energy relative to the total energy of the spectral noise corresponds to one or more signals being present in that channel. While total signal energy and PO can be used in conjunction to portray the spectral capacity and density, an understanding of the distribution of the power and energy within the band is still lacking. If the threshold is set too low, the likelihood of false detection will increase; (b) If the threshold is set too high, the likelihood of missed detection will increase.

Total Signal and Noise Energy
Total signal energy (in joules) is defined as the the signal energy over the full period of time within a data collect, τ. It is computed as wherein the impedance is assumed to be 1 Ω, by convention [28]. In a similar fashion, the total noise energy is given by An essential BW is a finite band that contains the majority of the signal power [28]. Therefore, power outside of the essential BW can be considered negligible. Within an essential BW, we have and In terms of dBJ (decibels relative to 1 joule), we can express, using Parseval's theorem, E x,n (dBJ) = 10 log 10 E x,n . A high total signal energy relative to the total energy of the spectral noise corresponds to one or more signals being present in that channel. While total signal energy and PO can be used in conjunction to portray the spectral capacity and density, an understanding of the distribution of the power and energy within the band is still lacking.

Power Spectral Entropy
The power spectral entropy (PSE) is most simply a measurement of the "uncertainty" of a power spectrum. PSE is maximized if the signal is AWGN and the value of entropy decreases as the distribution becomes less random, thus providing an indication of the characteristics of signals within a band. Thus, entropy is a measure of dispersion. PSE is robust to noise uncertainty and highlights minor deviations from AWGN in the spectrum, as entropy has a large dynamic range in the frequency domain [29].
PSE is calculated using an estimate of the probability density function (pdf) of the signal spectrum, p Ψ (X). The histogram method is used to estimate the pdf for PSE [30]. To attain an empirical estimate the pdf, we will first consider a PSD signal, X(k) denoted in Equation (3). The minimum and maximum values of X(k) are denoted as X min and X max , respectively. This range of values is then divided into a discrete number of bins, Ψ, with a bin size ∆ψ = (X max − X min )/Ψ, where Ψ is a value set based on the discrete number of output samples from the receiver.
Let κ m denote the number of X(k) values that correspond to the m-th power bin, i.e., those that The empirical pdf estimate using the histogram method is An empirical estimate of entropy is therefore PSE is useful in determining portions of the spectrum with high and low activity. Consequently, PSE is a robust detector of white noise and can be used to reduce a radar's spectral footprint. This concept is discussed more in Section 3.2. The metrics PO, total average power, and PSE all characterize the spectrum; however, none of these statistics provides an understanding as to a radar's ability to detect a target in a given RF environment. SINR, discussed next, is directly related to a radar's probability of detection.

Signal-to-Interference-Plus-Noise Ratio (SINR)
The SINR of a matched-filter response is the ratio of the signal energy to averaged interference plus noise power [31]. SINR is defined as where P I is the radio frequency interference (RFI) power.
Results have shown that the SINR is directly correlated with the probability of detection, P D , and inversely corrected with both the probability of false alarm, P F , and the probability of missed detection, P MD = 1 − P D .

Pulse Bandwidth
Radar range resolution is defined by a radar's ability to distinguish targets that are separated in range from the radar. When performing matched filtering, range resolution is dependent on the width of the pulses produced by the cross-correlation function. The matched filter technique allows for a lengthened pulse width in the time domain (thus a large radiated energy), while maintaining a narrow range resolution. In radar, matched filtering occurs when cross correlation is performed between the transmit signal and received spectrum.
For frequency-modulated radars, the range resolution ∆R is inversely proportional to the pulse bandwidth (BW), as follows: where B is the pulse BW and c is the speed of light [32]. Thus, for better resolution, BW should be as large as possible.

Spectrum Sensing Multi-Objective (SS-MO)
The spectrum sensing multi-objective (SS-MO) is a weighted sum multi-objective optimization algorithm (WSMO) [12]. The radar operation criteria driving the SS-MO are twofold: maximize SINR and maximize pulse BW (i.e., minimize range resolution). The fundamental premise of the SS-MO is that radar performance can be maximized based on the RF environment through the selection of an optimal sub-band (OSB) for transmission with both a high SINR and a high BW. Many cognitive radar schemes incorporate feedback from the RF environment to operate in frequency sub-bands of high SINR. The task of detecting sub-bands with both high SINR and a large BW, however, is not as trivial as it may seem, especially when taking into consideration the time constraints of the decision process.
In the case of SS-MO, noise plus interference energy is calculated based on the collected spectrum data in a real-time manner. An FFT is performed on the digitized I/Q spectrum data producing the frequency domain samples shown in Equation (3). The average power for each frequency bin k is defined as To compute brute force noise plus interference power efficiently, binomial summations are performed similarly to the computation of a Pascal triangle [33]. The power of each individual sample, θ k , is calculated in the first level of the triangle. In the next level, the power in each adjacent bin from the first level are added together. In the following levels, energy from level 1 is summed with power from the preceding level, as follows: where the level number is i and the element location for the i-th level is j [12]. Figure 3 is a representation of the summation method employed for a four-level data set.  The first objective function is equivalent to SINR, given by where s E is the signal power. The second objective function is the inverse of the range resolution since a lower value of R  equates to a higher likelihood of target distinction, from Equation (17). Therefore, the second objective function is defined as where j i,  is the sub-band bandwidth. These values are normalized to their maximum values that are based on system considerations to yield dimensionless quantities j i Z , 1 and j i Z , 2 , respectively.
A weighted combination of the two normalized objective functions yields is the weighting parameter. The weighting parameter  is adjusted to emphasize one objective function over the other and is dependent on the radar application. For example, it would be beneficial to set   0.5 for radar applications that require a high range resolution with large bandwidths. Since the goal of the proposed research is to investigate multi-objective optimization for arbitrary radar applications, we select   0.5 in this develop to provide equal priority to each weighting function.
The maximum j i Z , provides the optimal ) , ( j i values given by The first objective function is equivalent to SINR, given by where E s is the signal power. The second objective function is the inverse of the range resolution since a lower value of ∆R equates to a higher likelihood of target distinction, from Equation (17). Therefore, the second objective function is defined as where β i,j is the sub-band bandwidth. These values are normalized to their maximum values that are based on system considerations to yield dimensionless quantitiesẐ1 i,j andẐ2 i,j , respectively. A weighted combination of the two normalized objective functions yields where 0 ≤ α ≤ 1 is the weighting parameter. The weighting parameter α is adjusted to emphasize one objective function over the other and is dependent on the radar application. For example, it would be beneficial to set α ≤ 0.5 for radar applications that require a high range resolution with large bandwidths. Since the goal of the proposed research is to investigate multi-objective optimization for arbitrary radar applications, we select α = 0.5 in this develop to provide equal priority to each weighting function. The maximum Z i,j provides the optimal (i, j) values given by where the constraints are In our analysis, the value used throughout for Z1 min was 0 dB and the value used throughout for Z2 min was 0.15 m which corresponds to a β i,j value of 5 MHz. For a typical spectrum shown in Figure 4a, the intensity image of the linear WSMO function, Z i,j , for the SS-MO is shown in Figure 4b. The green star in Figure 4b indicates the pixel corresponding to the selected OSB for transmission, as determined by Equation (23), which in our case is a sub-band bandwidth of 35 MHz at a start frequency of 1135 MHz.  Figure   4b. The green star in Figure 4b indicates the pixel corresponding to the selected OSB for transmission, as determined by Equation (23), which in our case is a sub-band bandwidth of 35 MHz at a start frequency of 1135 MHz.  The SS-MO technique is designed with the intent of defining OSBs for a cognitive radar transmission. While the SS-MO moves towards optimizing a radar's capabilities in a congested environment, it does not take into account the operational needs of the primary users. In Section 3.2, we outline a technique for detecting continuous sub-bands of the spectrum with limited activity. In Section 3.3, we develop a WSMO technique that includes a third PSE weighting function with the goal of reducing the RFI that is caused by the radar system on other systems while maximizing the radar's performance.

Spectrum Sensing with Brute Force Entropy (SS-BFE)
Co-channel interference can be defined as RFI within the same band as the channel of operation of an RF system [34]. The utility of PSE in an objective function for the determination of an OSB for radar transmission is to reduce co-channel interference caused by the radar on the other systems in the immediate environment. Brute force PSE combined with image processing techniques are used to find continuous sub-bands of white noise in the spectrum in the SS-BFE algorithm. The goal of the SS-BFE technique presented is to limit the co-channel interference caused by a radar, which in turn improves its electromagnetic compatibility (EMC) characteristics. EMC is defined based on the following parameters: (1) interference caused on other systems, and (2) susceptibility to interference from other systems.
In scenarios where the reception of electromagnetic energy is not detrimental to the radar's performance, an algorithm, such as SS-MO, does not necessarily select an OSB with an adequate The SS-MO technique is designed with the intent of defining OSBs for a cognitive radar transmission. While the SS-MO moves towards optimizing a radar's capabilities in a congested environment, it does not take into account the operational needs of the primary users. In Section 3.2, we outline a technique for detecting continuous sub-bands of the spectrum with limited activity. In Section 3.3, we develop a WSMO technique that includes a third PSE weighting function with the goal of reducing the RFI that is caused by the radar system on other systems while maximizing the radar's performance.

Spectrum Sensing with Brute Force Entropy (SS-BFE)
Co-channel interference can be defined as RFI within the same band as the channel of operation of an RF system [34]. The utility of PSE in an objective function for the determination of an OSB for radar transmission is to reduce co-channel interference caused by the radar on the other systems in the immediate environment. Brute force PSE combined with image processing techniques are used to find continuous sub-bands of white noise in the spectrum in the SS-BFE algorithm. The goal of the SS-BFE technique presented is to limit the co-channel interference caused by a radar, which in turn improves its electromagnetic compatibility (EMC) characteristics. EMC is defined based on the following parameters: (1) interference caused on other systems, and (2) susceptibility to interference from other systems.
In scenarios where the reception of electromagnetic energy is not detrimental to the radar's performance, an algorithm, such as SS-MO, does not necessarily select an OSB with an adequate EMC. The SS-MO it does not take into consideration the RFI that is caused by the radar. Normalized PSE can be very robust at finding bands with minimal RFI, or high spectral opportunity.
Using Equation (15), a brute force calculation of PSE is performed for all possible window sizes, or sub-bands, of a spectrum to form a matrix H of size i × j, wherein i and j are defined as in Section 3.1. For the typical spectrum presented in Figure 5a, the resulting matrix of PSE intensities is then normalized to create a matrix or a grey-scale image is shown in Figure 5b. Since the normalized PSE value corresponds directly to the randomness of a sub-band of the spectrum, intuition would suggest selecting the value from the normalized brute force PSE matrix corresponding to the maximum PSE value. This approach, however, is not ideal. Consider a band of real system noise (collected from the SAS system outlined in Section 4), such as the one in Figure 6a. The histogram of the normalized PSE values was observed to be almost Gaussian distributed around a mean of 0.8626 with a very limited dynamic range when compared to that of a spectrum containing the signal(s). Its corresponding matrix of PSE intensities is depicted in Figure 6b. If one were to select an OSB purely based on the maximum PSE, a sub-band within a larger band of noise will be identified. The ideal approach is to select the maximum bandwidth sub-band of white noise in order to optimize radar operation (both SINR and range resolution) without causing additional co-channel interference to other systems. Selecting the full band of system noise rather than the sub-band of system noise would cause a Pareto improvement between the counter-parties of radar operation (defined by range resolution) and EMC (defined by PSE). Pareto efficiency is achieved when no counter-parties (range resolution and EMC) can change to cause an improvement among all of the parties [35]. Accordingly, Pareto improvement is a change that makes one of the counter-parties better off without hindering another counter-party [36]. EMC. The SS-MO it does not take into consideration the RFI that is caused by the radar. Normalized PSE can be very robust at finding bands with minimal RFI, or high spectral opportunity. Using Equation (15), a brute force calculation of PSE is performed for all possible window sizes, or sub-bands, of a spectrum to form a matrix H of size j i  , wherein i and j are defined as in Section 3.1. For the typical spectrum presented in Figure 5a, the resulting matrix of PSE intensities is then normalized to create a matrix or a grey-scale image is shown in Figure 5b. Since the normalized PSE value corresponds directly to the randomness of a sub-band of the spectrum, intuition would suggest selecting the value from the normalized brute force PSE matrix corresponding to the maximum PSE value. This approach, however, is not ideal. Consider a band of real system noise (collected from the SAS system outlined in Section 4), such as the one in Figure 6a. The histogram of the normalized PSE values was observed to be almost Gaussian distributed around a mean of 0.8626 with a very limited dynamic range when compared to that of a spectrum containing the signal(s). Its corresponding matrix of PSE intensities is depicted in Figure 6b. If one were to select an OSB purely based on the maximum PSE, a sub-band within a larger band of noise will be identified. The ideal approach is to select the maximum bandwidth sub-band of white noise in order to optimize radar operation (both SINR and range resolution) without causing additional co-channel interference to other systems. Selecting the full band of system noise rather than the sub-band of system noise would cause a Pareto improvement between the counter-parties of radar operation (defined by range resolution) and EMC (defined by PSE). Pareto efficiency is achieved when no counter-parties (range resolution and EMC) can change to cause an improvement among all of the parties [35]. Accordingly, Pareto improvement is a change that makes one of the counter-parties better off without hindering another counter-party [36].  EMC. The SS-MO it does not take into consideration the RFI that is caused by the radar. Normalized PSE can be very robust at finding bands with minimal RFI, or high spectral opportunity. Using Equation (15), a brute force calculation of PSE is performed for all possible window sizes, or sub-bands, of a spectrum to form a matrix H of size j i  , wherein i and j are defined as in Section 3.1. For the typical spectrum presented in Figure 5a, the resulting matrix of PSE intensities is then normalized to create a matrix or a grey-scale image is shown in Figure 5b. Since the normalized PSE value corresponds directly to the randomness of a sub-band of the spectrum, intuition would suggest selecting the value from the normalized brute force PSE matrix corresponding to the maximum PSE value. This approach, however, is not ideal. Consider a band of real system noise (collected from the SAS system outlined in Section 4), such as the one in Figure 6a. The histogram of the normalized PSE values was observed to be almost Gaussian distributed around a mean of 0.8626 with a very limited dynamic range when compared to that of a spectrum containing the signal(s). Its corresponding matrix of PSE intensities is depicted in Figure 6b. If one were to select an OSB purely based on the maximum PSE, a sub-band within a larger band of noise will be identified. The ideal approach is to select the maximum bandwidth sub-band of white noise in order to optimize radar operation (both SINR and range resolution) without causing additional co-channel interference to other systems. Selecting the full band of system noise rather than the sub-band of system noise would cause a Pareto improvement between the counter-parties of radar operation (defined by range resolution) and EMC (defined by PSE). Pareto efficiency is achieved when no counter-parties (range resolution and EMC) can change to cause an improvement among all of the parties [35]. Accordingly, Pareto improvement is a change that makes one of the counter-parties better off without hindering another counter-party [36].  Consequently, the indices that correspond to the bottom most point on each isosceles triangle must be accurately determined. We present below a robust corner detection method for determining these points in a grey-scale image that was created from the brute force PSE matrix.

Application of Shi-Tomasi Corner Detector
Corner detection techniques are well developed in the field of computer vision and image processing due to their numerous applications, including object tracking and image correspondence. The utility of corner detection in image processing applications spans from the fact that corner points can be localized among images due to the stability of a corners features over varying viewpoints [37]. Localized areas in an image with high immediate changes in intensity in several directions can be defined as a corner.
Several approaches were examined for the determination of maximum BW within closely distributed PSE intensities on a brute force PSE grey-scale image. Two metrics considered when examining the utility of these corner detection techniques were: (1) corner detection ability, and (2) computational efficiency. Of the corner detectors considered, the Shi-Tomasi approach [38] was used. Although computationally intensive, it produced the most accurate results; thus, its superior performance outweighed its computational complexity of the algorithm. The Shi-Tomasi corner detection technique is derived from the Harris-Stephens corner detector [39]. The Harris-Stephens corner detection scheme is an efficient and effective method for detecting pixels of interest in an image, and it is based on the fact that there is a significant change in intensity in all directions surrounding a corner. Further mathematical details are available in [40].
Based upon the Shi-Tomasi approach, the corners detected are shown as colored stars in Figure 7b when applied to the normalized brute force PSE grey-scale image of Figure 5b. For reference purposes, the assumed signal spectrum from Figure 5a is reproduced in Figure 7a. Since the solution space does not allow for a range resolution of less than 0.15 m, corners for window sizes below 5 MHz are not considered. The green star is the optimal corner value determined, which results in a sub-band bandwidth of 6.5 MHz at a start frequency of 1143 MHz. Notice how the normalized brute force PSE image in Figure 5b is composed of several layers of isosceles right (45°-45°-90°) triangles. The bottom most point on each isosceles triangle corresponds to an index in which there is the maximum BW within a grouping of closely distributed PSE values. Consequently, the indices that correspond to the bottom most point on each isosceles triangle must be accurately determined. We present below a robust corner detection method for determining these points in a grey-scale image that was created from the brute force PSE matrix.

Application of Shi-Tomasi Corner Detector
Corner detection techniques are well developed in the field of computer vision and image processing due to their numerous applications, including object tracking and image correspondence. The utility of corner detection in image processing applications spans from the fact that corner points can be localized among images due to the stability of a corners features over varying viewpoints [37]. Localized areas in an image with high immediate changes in intensity in several directions can be defined as a corner.
Several approaches were examined for the determination of maximum BW within closely distributed PSE intensities on a brute force PSE grey-scale image. Two metrics considered when examining the utility of these corner detection techniques were: (1) corner detection ability, and (2) computational efficiency. Of the corner detectors considered, the Shi-Tomasi approach [38] was used. Although computationally intensive, it produced the most accurate results; thus, its superior performance outweighed its computational complexity of the algorithm. The Shi-Tomasi corner detection technique is derived from the Harris-Stephens corner detector [39]. The Harris-Stephens corner detection scheme is an efficient and effective method for detecting pixels of interest in an image, and it is based on the fact that there is a significant change in intensity in all directions surrounding a corner. Further mathematical details are available in [40].
Based upon the Shi-Tomasi approach, the corners detected are shown as colored stars in Figure 7b when applied to the normalized brute force PSE grey-scale image of Figure 5b. For reference purposes, the assumed signal spectrum from Figure 5a is reproduced in Figure 7a. Since the solution space does not allow for a range resolution of less than 0.15 m, corners for window sizes below 5 MHz are not considered. The green star is the optimal corner value determined, which results in a sub-band bandwidth of 6.5 MHz at a start frequency of 1143 MHz.

Spectrum Sensing Multi-Objective with Brute Force PSE (SS-MO-BFE)
As its name suggests, the SS-MO-BFE OSB identification technique is a WSMO function that considers the weighting functions for SINR, range resolution, and normalized PSE. Although the SS-BFE also considers all of these objectives, normalized PSE has a disproportionate amount of influence

Spectrum Sensing Multi-Objective with Brute Force PSE (SS-MO-BFE)
As its name suggests, the SS-MO-BFE OSB identification technique is a WSMO function that considers the weighting functions for SINR, range resolution, and normalized PSE. Although the SS-BFE also considers all of these objectives, normalized PSE has a disproportionate amount of influence on the OSB selection. The driving concept of the SS-MO-BFE algorithm is that this technique provides a compromise between the two extreme solutions provided by the SS-MO and the SS-BFE. Since SS-MO-BFE is a WSMO, each parameter can be weighed individually thus allowing for additional flexibility. While the SS-MO defines an OSB with optimal radar performance and the SS-BFE defines an OSB in which a radar can perform, while causing minimal co-channel interference, the SS-MO-BFE is able to find a middle ground between both objectives.
The SS-MO-BFE takes the SINR and BW weighting functions used in the SS-MO algorithm, given by Equations (20) and (21), respectively, while adding a third normalized PSE objective for the determination of an OSB. The third objective function is The WSMO equation used in the SS-MO-BFE technique is then where 0 ≤ α i ≤ 1, i = 1, 2, 3 are the weighting parameters and The values of α i can be assigned on an application by applications basis. In our analysis, we assign equal weights to all of the objective functions considered, i.e., α 1 = α 2 = α 3 = 1 3 . Like the SS-MO, the OSB determined by the SS-MO-BFE is selected using Equation (23) with the redefined WSMO presented in Equation (27). The limiting factors for SINR and range resolution presented in Equations (24) and (25), respectively, apply to the optimal Z i,j indices in SS-MO-BFE as well. Figure 8b displays an example image of the linear WSMO function, Z i,j , for the SS-MO-BFE for a spectrum given in Figure 8a, which is the same spectrum used in Figure 4a. Due to the additional PSE weighting function considered, the SS-MO-BFE selected a smaller OSB than the SS-MO for this example spectrum. In this case, we obtain a sub-band bandwidth of 17.5 MHz at a start frequency of 1135.5 MHz. on the OSB selection. The driving concept of the SS-MO-BFE algorithm is that this technique provides a compromise between the two extreme solutions provided by the SS-MO and the SS-BFE. Since SS-MO-BFE is a WSMO, each parameter can be weighed individually thus allowing for additional flexibility. While the SS-MO defines an OSB with optimal radar performance and the SS-BFE defines an OSB in which a radar can perform, while causing minimal co-channel interference, the SS-MO-BFE is able to find a middle ground between both objectives. The SS-MO-BFE takes the SINR and BW weighting functions used in the SS-MO algorithm, given by Equations (20) and (21), respectively, while adding a third normalized PSE objective for the determination of an OSB. The third objective function is The WSMO equation used in the SS-MO-BFE technique is then are the weighting parameters and 1 The values of i  can be assigned on an application by applications basis. In our analysis, we assign equal weights to all of the objective functions considered, i.e., . Like the SS-MO, the OSB determined by the SS-MO-BFE is selected using Equation (23) with the redefined WSMO presented in Equation (27). The limiting factors for SINR and range resolution presented in Equations (24) and (25), respectively, apply to the optimal j i Z , indices in SS-MO-BFE as well.

System Overview
The SAS is a high precision signal analyzer that is meant to perform energy detection for SS radar. There are several different techniques to sense the environment in a SS radar; however, none is quite as robust as energy detection. These detection theory methods include matched filtering,

System Overview
The SAS is a high precision signal analyzer that is meant to perform energy detection for SS radar. There are several different techniques to sense the environment in a SS radar; however, none is quite as robust as energy detection. These detection theory methods include matched filtering, constant false alarm rates (CFAR), spectral correlation, cyclostationary detection, radio identification based sensing, and waveform based sensing [9].
As discussed in Section 1, the SAS is a nine-channel system that primarily operates in the ultra-wideband (UWB) range from ultrahigh frequency (UHF) to the S-band. Figure 9 shows a condensed block diagram of the SAS's complete front-end leading to the digitization of the RF environment. The front end block diagram is broken down into four more subsections, which are individually boxed and numbered. The design goals of the SAS were to attain high resolution, high sampling rates, a large spurious free dynamic range (SFDR), high-speed processing capabilities, and a large storage capacity. The SAS consists of one wideband monitor channel and eight narrowband channels. The wideband monitoring channel is used to scan and characterize a broad region of the spectrum, ranging from 100 kHz to 1.8 GHz. The BWs of four of the eight narrowband channels are 50 MHz, while the BWs of the other four narrowband channels are 100 MHz. The BW of these channels is limited by the BW achievable by their downconverters. The 50-MHz BW applies to the channels containing the 8111 downconverters, while the 100-MHz BW applies to the channels containing the 7120 downconverters. constant false alarm rates (CFAR), spectral correlation, cyclostationary detection, radio identification based sensing, and waveform based sensing [9]. As discussed in Section 1, the SAS is a nine-channel system that primarily operates in the ultrawideband (UWB) range from ultrahigh frequency (UHF) to the S-band. Figure 9 shows a condensed block diagram of the SAS's complete front-end leading to the digitization of the RF environment. The front end block diagram is broken down into four more subsections, which are individually boxed and numbered. The design goals of the SAS were to attain high resolution, high sampling rates, a large spurious free dynamic range (SFDR), high-speed processing capabilities, and a large storage capacity. The SAS consists of one wideband monitor channel and eight narrowband channels. The wideband monitoring channel is used to scan and characterize a broad region of the spectrum, ranging from 100 kHz to 1.8 GHz. The BWs of four of the eight narrowband channels are 50 MHz, while the BWs of the other four narrowband channels are 100 MHz. The BW of these channels is limited by the BW achievable by their downconverters. The 50-MHz BW applies to the channels containing the 8111 downconverters, while the 100-MHz BW applies to the channels containing the 7120 downconverters.
The wideband monitoring channel points the eight narrowband channels to areas of interest within the spectrum so that the narrowband channels can provide a higher resolution image of the spectrum. Areas of interest within the spectrum can be defined in many ways. In the case of the SAS, these are defined as those with high energy or activity. The benefit of the SAS is its ability to provide a high-resolution understanding of the spectrum without the trade-off of BW.

Hardware Implementation and Validation
Digital electronics play a key role in a radar's ability to handle complex environments. Additional dynamic range is achieved by moving these digital components as close to the receiver as possible [41]. The core components of the SAS system consist of the Pentek downconverters and analog-to-digital converters (ADCs). A hardware validation was performed in order to better understand the SAS's true capabilities beyond the vendor supplied specifications. A characterization of these core components was the first step to ensure a calibrated setup. Based on these characterizations, a front-end was designed to condition the signal. Extensive hardware testing of each component in the system was performed to ensure its proper performance. The wideband monitoring channel points the eight narrowband channels to areas of interest within the spectrum so that the narrowband channels can provide a higher resolution image of the spectrum. Areas of interest within the spectrum can be defined in many ways. In the case of the SAS, these are defined as those with high energy or activity. The benefit of the SAS is its ability to provide a high-resolution understanding of the spectrum without the trade-off of BW.

Hardware Implementation and Validation
Digital electronics play a key role in a radar's ability to handle complex environments. Additional dynamic range is achieved by moving these digital components as close to the receiver as possible [41]. The core components of the SAS system consist of the Pentek downconverters and analog-to-digital converters (ADCs). A hardware validation was performed in order to better understand the SAS's true capabilities beyond the vendor supplied specifications. A characterization of these core components was the first step to ensure a calibrated setup. Based on these characterizations, a front-end was designed to condition the signal. Extensive hardware testing of each component in the system was performed to ensure its proper performance.

ADC and Downconverter Performance Validation
The ADCs and downconverters (DCs) are referenced by their Pentek model numbers. The 7120s and 8111 opt. 1-4 are downconverters, while the 71661 and the 71741 are narrowband and wideband ADCs, respectively. Table 1 outlines the general specifications of these DCs and ADCs. In order to validate the ADCs and DCs, the frequency responses of the cards are considered. Automated tone sweeps generated by a Keysight N5171B EXG signal generator were input at the receive channel of each ADC individually in order to understand how well the digitized output of the ADCs match a controlled input. The SAS has been designed such that the narrowband channels (corresponding to the 71661 ADCs) observe the energy downconverted to the band of 200 to 250 MHz that has been aliased into baseband to avoid intermodulation (IM) products surrounding zero frequency. Since a large amount of aliasing was evident in each ADC card, a significant amount of energy from a tone outside of each ADCs' frequency band was detected within that band. This resulted in the need for anti-aliasing filters prior to the ADCs.
The ADCs act as the bottle neck for the frequency resolution of the system as the other components are analog rather than digitized. The Pentek 71741 wideband ADC has a sampling rate of 3.6 GSa/s, while the narrowband 71661 ADCs have a sampling rate of 200 MSa/s. To reiterate, the purpose of the narrowband channels is to display a high-resolution image of the spectrum where a wideband channel cannot. To gain a better perspective on the overall performance of the system, an estimate of the narrowband resolution was attained through "two-tone testing". One tone remained static, while the other tone was swept past the static tone with a step size of 1 kHz. The concept behind the test is that the ADC has a minimum resolution of the difference between the tone frequencies the last time the two tones could be distinguished. Note that the number of points collected by the ADC (which is variable for the SAS) affects the frequency resolution and noise floor of the SAS. The testing was performed with the standard 2 16 points for the 71661 narrowband ADCs. The number of points per spectra is variable, however 2 16 is the standard value used for the narrowband channels. The experimental resolution of the 71661 ADC was approximately 3 kHz, which is high resolution by today's standards for the proposed application.
The downconverter operation was validated by looking at the frequency response of the downconverters with variable settings. The RF input of each downconverters was connected to a signal generator, while the IF output was connected to a spectrum analyzer. A single tone was sent into the downconverters while the tuning bands and attenuation were changed. The amplitude and frequency of the tone were swept beyond the tuning band to identify the ability of the internal filtering. The internal filtering for the 8111 downconverters were very tight and performed well over a broadband view; however, a need for further anti-aliasing filtering was identified for the 7120 downconverter channels.

Front End Design
Several iterations of front end design were performed before reaching the current state. Co-site interference is defined as interference on a channel that is created by RF energy in the environment that is outside of that channel's operational BW [34]. The SAS's front-end mitigates co-site interference with minimal degradation of each channel's bands of interest. The National Telecommunications and Information Administration (NTIA) produced studies of the interference that out-of-band (OOB) emissions can cause in Next-Generation Weather Radars (NEXRADs) [42]. With this study in mind, the SAS's front-end was designed to reduce co-site interference by reducing OOB interference. All of the components in the SAS are commercial off-the-shelf (COTS) and are connected using low-loss coaxial cables. The remainder of Section 4.2.2 describes the design of the four hardware subsections labeled in Figure 9 individually in greater depth.

Front End Block 1
A detailed block diagram of Block 1 of the SAS is shown in Figure 10. Part numbers correspond to those manufactured by Mini-Circuits (https://www.minicircuits.com), unless otherwise specified. Block 1 is composed of an antenna, a series of filters, an amplifier, and a power splitter. The primary function of Block 1 is to capture and filter the RF energy across the full scope of the SAS. The antenna at the front end should have a BW that supports the full BW of the SAS. The Schwarzbeck BBHA 9120 E double ridged broadband horn antenna (http://schwarzbeck.de/Datenblatt/k9120e.pdf) was used in our SAS design. The antenna acts as an additional band pass filter (BPF) at the front end. Filters ZX75HP-122-S+, VLFX-1350, and SHP-100+ combine in series to act as a BPF that filters across the band of 100 kHz to 2 GHz. Additional amplification is added with the low noise amplifier (LNA), ZKL-2R7+. Finally, the signal power is split between the three adjoining blocks of the SAS using a power splitter. All of the power splitters used in the SAS are the ZN4PD1-63W-S+. that is outside of that channel's operational BW [34]. The SAS's front-end mitigates co-site interference with minimal degradation of each channel's bands of interest. The National Telecommunications and Information Administration (NTIA) produced studies of the interference that out-of-band (OOB) emissions can cause in Next-Generation Weather Radars (NEXRADs) [42]. With this study in mind, the SAS's front-end was designed to reduce co-site interference by reducing OOB interference. All of the components in the SAS are commercial off-the-shelf (COTS) and are connected using low-loss coaxial cables. The remainder of Section 4.2.2 describes the design of the four hardware subsections labeled in Figure 9 individually in greater depth.

Front End Block 1
A detailed block diagram of Block 1 of the SAS is shown in Figure 10. Part numbers correspond to those manufactured by Mini-Circuits (https://www.minicircuits.com), unless otherwise specified. Block 1 is composed of an antenna, a series of filters, an amplifier, and a power splitter. The primary function of Block 1 is to capture and filter the RF energy across the full scope of the SAS. The antenna at the front end should have a BW that supports the full BW of the SAS. The Schwarzbeck BBHA 9120 E double ridged broadband horn antenna (http://schwarzbeck.de/Datenblatt/k9120e.pdf) was used in our SAS design. The antenna acts as an additional band pass filter (BPF) at the front end. Filters ZX75HP-122-S+, VLFX-1350, and SHP-100+ combine in series to act as a BPF that filters across the band of 100 kHz to 2 GHz. Additional amplification is added with the low noise amplifier (LNA), ZKL-2R7+. Finally, the signal power is split between the three adjoining blocks of the SAS using a power splitter. All of the power splitters used in the SAS are the ZN4PD1-63W-S+. The overall gain of Block 1 excluding the antenna, but including the power splitter is shown in Figure 11. It was also confirmed that the isolation between the power splitter output channels was higher than 20 dB across the desired band.  The overall gain of Block 1 excluding the antenna, but including the power splitter is shown in Figure 11. It was also confirmed that the isolation between the power splitter output channels was higher than 20 dB across the desired band. that is outside of that channel's operational BW [34]. The SAS's front-end mitigates co-site interference with minimal degradation of each channel's bands of interest. The National Telecommunications and Information Administration (NTIA) produced studies of the interference that out-of-band (OOB) emissions can cause in Next-Generation Weather Radars (NEXRADs) [42]. With this study in mind, the SAS's front-end was designed to reduce co-site interference by reducing OOB interference. All of the components in the SAS are commercial off-the-shelf (COTS) and are connected using low-loss coaxial cables. The remainder of Section 4.2.2 describes the design of the four hardware subsections labeled in Figure 9 individually in greater depth.

Front End Block 1
A detailed block diagram of Block 1 of the SAS is shown in Figure 10. Part numbers correspond to those manufactured by Mini-Circuits (https://www.minicircuits.com), unless otherwise specified. Block 1 is composed of an antenna, a series of filters, an amplifier, and a power splitter. The primary function of Block 1 is to capture and filter the RF energy across the full scope of the SAS. The antenna at the front end should have a BW that supports the full BW of the SAS. The Schwarzbeck BBHA 9120 E double ridged broadband horn antenna (http://schwarzbeck.de/Datenblatt/k9120e.pdf) was used in our SAS design. The antenna acts as an additional band pass filter (BPF) at the front end. Filters ZX75HP-122-S+, VLFX-1350, and SHP-100+ combine in series to act as a BPF that filters across the band of 100 kHz to 2 GHz. Additional amplification is added with the low noise amplifier (LNA), ZKL-2R7+. Finally, the signal power is split between the three adjoining blocks of the SAS using a power splitter. All of the power splitters used in the SAS are the ZN4PD1-63W-S+. The overall gain of Block 1 excluding the antenna, but including the power splitter is shown in Figure 11. It was also confirmed that the isolation between the power splitter output channels was higher than 20 dB across the desired band.

Front End Block 2
Block 2 of the SAS represents the 1.8-GHz wideband channel. A comprehensive block diagram of Block 2 is shown in Figure 12. As the input to Block 1 filters the signal across the full BW of the SAS, no additional filtering is required prior to the 71741 wideband ADC. A 3-dB attenuator, VAT-3+, is placed at the output of the splitter to increase the splitter isolation. A ZKL-2R7+ LNA amplifies the signal to overcome some of the power loss in the splitter and attenuator. A 6-dB attenuator, VAT-6+, is placed prior to the 71741 wideband ADC to again increase channel isolation. Figure 13 shows the gain of the series of components that compose Block 2.  Figure 12. As the input to Block 1 filters the signal across the full BW of the SAS, no additional filtering is required prior to the 71741 wideband ADC. A 3-dB attenuator, VAT-3+, is placed at the output of the splitter to increase the splitter isolation. A ZKL-2R7+ LNA amplifies the signal to overcome some of the power loss in the splitter and attenuator. A 6-dB attenuator, VAT-6+, is placed prior to the 71741 wideband ADC to again increase channel isolation. Figure 13 shows the gain of the series of components that compose Block 2.   Figure 14. The downconverter testing, as discussed in Section 4.2.1, led to the conclusion that the internal filter bank of the 8111 opt. 1-4 downconverters was adequate for the performance of these channels. Therefore, no additional anti-aliasing filtering is applied to these channels in Block 3. A 6-dB, VAT-6+, attenuator follows the splitter from Block 1 to increase the splitter isolation. Next, the ZKL-2R7+ LNA amplifies the signal to cancel some of the loss in the splitter and attenuators. The signal is again split between the four narrowband channels with added attenuation to increase channel isolation. The gain of the series of components that compose Block 3 leading to the inputs of the 8111 opt. 1-4 downconverters is displayed in Figure 15.

downconverters. A comprehensive block diagram of Block 3 is shown in
Block 2 of the SAS represents the 1.8-GHz wideband channel. A comprehensive block diagram of Block 2 is shown in Figure 12. As the input to Block 1 filters the signal across the full BW of the SAS, no additional filtering is required prior to the 71741 wideband ADC. A 3-dB attenuator, VAT-3+, is placed at the output of the splitter to increase the splitter isolation. A ZKL-2R7+ LNA amplifies the signal to overcome some of the power loss in the splitter and attenuator. A 6-dB attenuator, VAT-6+, is placed prior to the 71741 wideband ADC to again increase channel isolation. Figure 13 shows the gain of the series of components that compose Block 2.   Figure 14. The downconverter testing, as discussed in Section 4.2.1, led to the conclusion that the internal filter bank of the 8111 opt. 1-4 downconverters was adequate for the performance of these channels. Therefore, no additional anti-aliasing filtering is applied to these channels in Block 3. A 6-dB, VAT-6+, attenuator follows the splitter from Block 1 to increase the splitter isolation. Next, the ZKL-2R7+ LNA amplifies the signal to cancel some of the loss in the splitter and attenuators. The signal is again split between the four narrowband channels with added attenuation to increase channel isolation. The gain of the series of components that compose Block 3 leading to the inputs of the 8111 opt. 1-4 downconverters is displayed in Figure 15.  Figure 14. The downconverter testing, as discussed in Section 4.2.1, led to the conclusion that the internal filter bank of the 8111 opt. 1-4 downconverters was adequate for the performance of these channels. Therefore, no additional anti-aliasing filtering is applied to these channels in Block 3. A 6-dB, VAT-6+, attenuator follows the splitter from Block 1 to increase the splitter isolation. Next, the ZKL-2R7+ LNA amplifies the signal to cancel some of the loss in the splitter and attenuators. The signal is again split between the four narrowband channels with added attenuation to increase channel isolation. The gain of the series of components that compose Block 3 leading to the inputs of the 8111 opt. 1-4 downconverters is displayed in Figure 15.  Block 4 of the SAS includes four of the eight narrowband channels corresponding to the 7120 downconverters. A comprehensive block diagram of Block 4 is shown in Figure 16. In Section 4.2.1, the need for additional anti-aliasing filtering surrounding the 7120 downconverters was established in order to prevent unwanted co-site interference. While the 7120 downconverters have a total BW of 35 to 4400 MHz, developing a filter bank to support this BW is unnecessary as the channels containing the 8111 opt. 1-4 are capable of providing a high-resolution image of the spectrum from 800 to 2100 MHz. Therefore, a narrower filter scheme was implemented for the narrowband channels contained in Block 4 focused on the lower frequency range of the SAS. The first two channels containing the 7120 downconverters have been re-purposed for use in the band of 200-550 MHz and the second two channels containing the 7120 downconverters have been re-purposed for use in the band of 500-800 MHz.

downconverters. A comprehensive block diagram of Block 3 is shown in
Similar to the scheme in Block 3, the input of Block 4 features an attenuator (VAT-6+), an LNA (ZKL-2R7+), a splitter (ZN4PD1-63W-S+), and another attenuator (VAT-6+). The first two channels have two low pass filters (LPFs) (VLFX-400+) prior to the 7120 downconverters. The second two channels have two LPFs in series with a HPF (VLFX-540 and SHP-500+, respectively) prior to the 7120 downconverters. Additional anti-aliasing filtering and isolation in the form of two filters and an attenuator (RBPF-246+ and VAT-3+, respectively) are placed between all four 7120 downconverters and 71661 narrowband ADCs. Figure 17 shows the gain of this series of components in Block 4.  Block 4 of the SAS includes four of the eight narrowband channels corresponding to the 7120 downconverters. A comprehensive block diagram of Block 4 is shown in Figure 16. In Section 4.2.1, the need for additional anti-aliasing filtering surrounding the 7120 downconverters was established in order to prevent unwanted co-site interference. While the 7120 downconverters have a total BW of 35 to 4400 MHz, developing a filter bank to support this BW is unnecessary as the channels containing the 8111 opt. 1-4 are capable of providing a high-resolution image of the spectrum from 800 to 2100 MHz. Therefore, a narrower filter scheme was implemented for the narrowband channels contained in Block 4 focused on the lower frequency range of the SAS. The first two channels containing the 7120 downconverters have been re-purposed for use in the band of 200-550 MHz and the second two channels containing the 7120 downconverters have been re-purposed for use in the band of 500-800 MHz.
Similar to the scheme in Block 3, the input of Block 4 features an attenuator (VAT-6+), an LNA (ZKL-2R7+), a splitter (ZN4PD1-63W-S+), and another attenuator (VAT-6+). The first two channels have two low pass filters (LPFs) (VLFX-400+) prior to the 7120 downconverters. The second two channels have two LPFs in series with a HPF (VLFX-540 and SHP-500+, respectively) prior to the 7120 downconverters. Additional anti-aliasing filtering and isolation in the form of two filters and an attenuator (RBPF-246+ and VAT-3+, respectively) are placed between all four 7120 downconverters and 71661 narrowband ADCs. Figure 17 shows the gain of this series of components in Block 4.  Figure 16. In Section 4.2.1, the need for additional anti-aliasing filtering surrounding the 7120 downconverters was established in order to prevent unwanted co-site interference. While the 7120 downconverters have a total BW of 35 to 4400 MHz, developing a filter bank to support this BW is unnecessary as the channels containing the 8111 opt. 1-4 are capable of providing a high-resolution image of the spectrum from 800 to 2100 MHz. Therefore, a narrower filter scheme was implemented for the narrowband channels contained in Block 4 focused on the lower frequency range of the SAS. The first two channels containing the 7120 downconverters have been re-purposed for use in the band of 200-550 MHz and the second two channels containing the 7120 downconverters have been re-purposed for use in the band of 500-800 MHz.
Similar to the scheme in Block 3, the input of Block 4 features an attenuator (VAT-6+), an LNA (ZKL-2R7+), a splitter (ZN4PD1-63W-S+), and another attenuator (VAT-6+). The first two channels have two low pass filters (LPFs) (VLFX-400+) prior to the 7120 downconverters. The second two channels have two LPFs in series with a HPF (VLFX-540 and SHP-500+, respectively) prior to the 7120 downconverters. Additional anti-aliasing filtering and isolation in the form of two filters and an attenuator (RBPF-246+ and VAT-3+, respectively) are placed between all four 7120 downconverters and 71661 narrowband ADCs. Figure 17 shows the gain of this series of components in Block 4.

Software Implementation
The basic implementation goal of the SAS's software was to stream data as rapidly as possible. The duty cycle of collection time to collection time plus processing time was considered when designing the SAS's software. This duty cycle cp D is denoted as

Software Implementation
The basic implementation goal of the SAS's software was to stream data as rapidly as possible. The duty cycle of collection time to collection time plus processing time was considered when designing the SAS's software. This duty cycle cp D is denoted as

Software Implementation
The basic implementation goal of the SAS's software was to stream data as rapidly as possible. The duty cycle of collection time to collection time plus processing time was considered when designing the SAS's software. This duty cycle D cp is denoted as where τ c is the time spent collecting and τ p is the time spent processing in a real-time system. In order to maximize this duty cycle, the SAS performs minimal active processing. The primary purpose of the current version of the system is to provide data for post-processing. A ReadyFlow C program primarily written by Pentek controls the ADCs and downconverters. A LabVIEW graphical user interface (GUI) calls the modified ReadyFlow C programs provided by Pentek in order to initialize and write certain card parameters. Some of these card parameters include: number of samples, sensitivity (variable attenuation), and tuning frequency. The ADCs produce I/Q data through a Hilbert transform of the time domain signal. A Hilbert transform produces the orthogonal signal to the receive signal. This operation is performed on the field programmable gate arrays (FPGA) that are located on the ADC's printed circuit board (PCB). The I/Q data are therefore streamed directly to the SAS computer via a PCI-express 8X cable. The GUI then opens up a TCP connection with the cards and begins the process of streaming 16 bit I/Q data from the individual channels. The GUI allows for some real-time processing along with actively updated frequency and time domain graphs for each channel. The SAS GUI, shown in Figure 18, has the capability to perform the following real-time functions: 1. Perform a fast Fourier transform (FFT) on the I/Q data 2.
Display time and frequency domain spectra to the front panel for all nine channels 3.
Auto-tune, sweep or manually adjust the instantaneous bands of each channel individually 4.
Manually adjust the attenuation and number of samples of each channel individually 5.
Monitor the relative activity of the spectrum for the wideband channel 6.
Display an active binary histogram of the spectral data for all nine channels  Since the real-time processing capabilities of the SAS are limited, the SAS provides an option to save data to a binary file that allows for post-processing. Parallel processing techniques were implemented to streamline the processing and maximize the GUI's efficiency. A rapid save mode was also implemented in which the SAS GUI forgoes all active processing to maximize cp D . When the SAS is in rapid save mode, I/Q data are streamed directly from any combination of the nine channels (selected by the user) and written to binary files. Along with the exclusion of active Since the real-time processing capabilities of the SAS are limited, the SAS provides an option to save data to a binary file that allows for post-processing. Parallel processing techniques were implemented to streamline the processing and maximize the GUI's efficiency. A rapid save mode was also implemented in which the SAS GUI forgoes all active processing to maximize D cp . When the SAS is in rapid save mode, I/Q data are streamed directly from any combination of the nine channels (selected by the user) and written to binary files. Along with the exclusion of active processing, no datum is displayed to the screen when the SAS is in rapid save mode.

Data Collection, Generation, and Analysis
Data were collected using the SAS in several instances in order to build a database of spectra to perform statistical spectrum analysis. To gain perspective on the spectrum, an ambient data collection was performed. Next, closed loop testing was performed in which an arbitrary waveform generator (AWG) fed spectra directly into the SAS via cable. Closed loop testing was performed using a pseudo-random generation technique, which relied on a combination of quantitative and qualitative observations of the ambient spectrum data.
We also present statistical analysis of the pseudo-random data collected by the SAS utilizing the multi-objective functions for OSB selection defined in Section 3 that are based on the statistics discussed in Section 2. It should be noted that the pseudo-random WF data discussed herein have been decimated to decrease the necessary processing time. A Hamming LPF has also been applied to these spectra to reduce high frequency noise. The established SS-MO algorithm from Ref. [12] is used as a base line for comparison with the performance of the new algorithms developed in this paper.

Ambient Data Collection
Ambient SAS data were collected in a suburban area with a medium to high density of people. Rather than utilizing the SAS's auto-tune or sweep functionality for this data collection, the narrowband, high resolution channels were focused on bands in the spectrum in order to simplify the analysis. A more continuous time picture of the spectrum is achieved with a static instantaneous band as well.
The Schwarzbeck BBHA 9120 E double ridged broadband horn antenna was used and was selected because of its broadband and high directivity performance. This antenna performs adequately in the lower frequency bands without sacrificing performance among the higher frequencies. Figure 19 shows the gain of the antenna relative to an isotropic radiator.

Data Collection, Generation, and Analysis
Data were collected using the SAS in several instances in order to build a database of spectra to perform statistical spectrum analysis. To gain perspective on the spectrum, an ambient data collection was performed. Next, closed loop testing was performed in which an arbitrary waveform generator (AWG) fed spectra directly into the SAS via cable. Closed loop testing was performed using a pseudorandom generation technique, which relied on a combination of quantitative and qualitative observations of the ambient spectrum data.
We also present statistical analysis of the pseudo-random data collected by the SAS utilizing the multi-objective functions for OSB selection defined in Section 3 that are based on the statistics discussed in Section 2. It should be noted that the pseudo-random WF data discussed herein have been decimated to decrease the necessary processing time. A Hamming LPF has also been applied to these spectra to reduce high frequency noise. The established SS-MO algorithm from Ref. [12] is used as a base line for comparison with the performance of the new algorithms developed in this paper.

Ambient Data Collection
Ambient SAS data were collected in a suburban area with a medium to high density of people. Rather than utilizing the SAS's auto-tune or sweep functionality for this data collection, the narrowband, high resolution channels were focused on bands in the spectrum in order to simplify the analysis. A more continuous time picture of the spectrum is achieved with a static instantaneous band as well.
The Schwarzbeck BBHA 9120 E double ridged broadband horn antenna was used and was selected because of its broadband and high directivity performance. This antenna performs adequately in the lower frequency bands without sacrificing performance among the higher frequencies. Figure 19 shows the gain of the antenna relative to an isotropic radiator. The input signal was split directly into the SAS's front-end as well as into a LeCroy WaveMaster 8620A oscilloscope and a Tektronix RSA6114A real-time spectrum analyzer (RSA) for data verification purposes. Figure 20 shows photographs of the ambient data collection setup. The data collected is used as motivation for more controlled algorithm testing. The input signal was split directly into the SAS's front-end as well as into a LeCroy WaveMaster 8620A oscilloscope and a Tektronix RSA6114A real-time spectrum analyzer (RSA) for data verification purposes. Figure 20 shows photographs of the ambient data collection setup. The data collected is used as motivation for more controlled algorithm testing.

Statistical Analysis of the Ambient Data
A statistical analysis of the spectra from the ambient data collection was performed to guide the generation of spectra for closed loop testing. Two statistical metrics were considered: PO and total signal energy (or alternately, total average power s P ) and PO, as derived in Sections 2.1 and 2.2, respectively. In Section 2.1, k b is calculated on the basis of a threshold,  . It should be noted that the threshold  is used to characterize the collected data in terms of total average power versus percent occupancy. This characterization provides an assessment of the spectra processed by the multiobjective optimization algorithms (discussed below). For example, the algorithms would process high-power, narrowband interference different from low-power, wideband interference. The functionality of the multi-objective optimization algorithms themselves do not use thresholding since the algorithms search a solution space for the result.
Ambiguity in the determination of PO stems from the method of selection of  . Several active noise floor estimation techniques can be used in defining  . For the purpose of characterizing these spectra, the luxury of real-time noise floor computation was not afforded. Rather, the SAS was taken off-line and calibration data were collected. A 50-Ω termination was connected to the input of the front end of the SAS and a relatively long-term run sequence was executed. A measurement of the system's noise floor over time was effectively taken. A point-by-point average of the calibration data in the linear frequency domain was then calculated at each tuning frequency in order to provide an estimate of the noise floor mean. The point-by-point average is calculated using where N is the total number of collections at each tuning frequency, YY is the matrix of linear frequency domain data that is defined by the frequency bin, k , and the collection number, n . The PO threshold,  , was then specified as where  is the standard deviation of the point-by-point average. Setting  to three standard deviations above the running average is appropriate because only 0.1% of AWGN will exceed  .

Statistical Analysis of the Ambient Data
A statistical analysis of the spectra from the ambient data collection was performed to guide the generation of spectra for closed loop testing. Two statistical metrics were considered: PO and total signal energy (or alternately, total average power P s ) and PO, as derived in Sections 2.1 and 2.2, respectively.
In Section 2.1, b k is calculated on the basis of a threshold, γ. It should be noted that the threshold γ is used to characterize the collected data in terms of total average power versus percent occupancy. This characterization provides an assessment of the spectra processed by the multi-objective optimization algorithms (discussed below). For example, the algorithms would process high-power, narrowband interference different from low-power, wideband interference. The functionality of the multi-objective optimization algorithms themselves do not use thresholding since the algorithms search a solution space for the result.
Ambiguity in the determination of PO stems from the method of selection of γ. Several active noise floor estimation techniques can be used in defining γ. For the purpose of characterizing these spectra, the luxury of real-time noise floor computation was not afforded. Rather, the SAS was taken off-line and calibration data were collected. A 50-Ω termination was connected to the input of the front end of the SAS and a relatively long-term run sequence was executed. A measurement of the system's noise floor over time was effectively taken. A point-by-point average of the calibration data in the linear frequency domain was then calculated at each tuning frequency in order to provide an estimate of the noise floor mean. The point-by-point average is calculated using where N is the total number of collections at each tuning frequency, YY is the matrix of linear frequency domain data that is defined by the frequency bin, k, and the collection number, n. The PO threshold, γ, was then specified as where σ is the standard deviation of the point-by-point average. Setting γ to three standard deviations above the running average is appropriate because only 0.1% of AWGN will exceed γ. Figure 21 is a scatter plot of the total average power versus PO for the ambient data collected. This scatter plot breaks the points up into select sub-bands showing the individual distributions for specific center frequencies (CF). These sub-band distributions can therefore be cataloged based on FCC mandated applications. For instance, in Figure 21, there is a grouping of points around (P s , PO) = (−67 dBm, 45%) from a 50-MHz BW with a 1960-MHz CF. The corresponding allocated applications for a band of 1930 to 2165 MHz pertain to personal communication systems (PCS), 2-GHz mobile satellite services (MSS) uplink, space, fixed, and mobile. A combination of relatively high total average power and PO would support the assumption that these spectra are likely to contain one or more wideband signals. Due to the suburban location of the data collection, it can be surmised that cellular phones are the primary sources of the energy detected in this spectra, particularly Long-Term Evolution (LTE) mobile communication. A similar process can be used with the other sub-band distributions to speculate on the applications detected in the spectra.  Total average power and PO are not directly proportional; however the scattering is not completely random either. In many scenarios, a higher total average power will lead to a higher PO, although that is not always the case.

Closed Loop Testing
A pseudo-random database of spectra was compiled using the Agilent M8190A 12GSa/s Arbitrary Waveform Generator (AWG). The motivation for using a pseudo-random database of spectra is to attain an understanding as to the performance of the algorithms. A controlled spectra at the input of the SAS limits the complexity of the problem space, allowing for a more conclusive analysis as to the performance of the algorithms discussed. The signals produced by the AWG consisted of a pseudo-random combination of chirps (wide band) and sinusoids (narrow band).
During the closed loop testing, the spectra generated by the AWG were split into the SAS, LeCroy's WaveMaster 8620A oscilloscope, and Tektronix RSA6114A real-time spectrum analyzer (RTSA). Only the data collected by the SAS are analyzed herein as the other systems were used for verification or separate testing purposes. Total average power and PO serve as the two input parameters that provide a basis for the generation of the pseudo-random spectra. These scatter plots presented in Figure 21 serve as the foundation on which the pseudo-random data sets were modeled. An analysis as to the distribution of the total average power and PO of each band (denoted by its specific CF) was performed to select spectra with similar distributions from the pseudo-randomly generated database. The range of acceptable total average power and PO for each ambient spectra is displayed in Figure 22 and Table 2 along with the corresponding waveforms (WF) selected from the pseudo-random database.
These total average power and PO ranges were calculated as respectively. Due to the extensive collection time and static nature of certain ambient spectra, the calculated ranges of total average power and PO had very small standard deviations making it difficult to find pseudo-randomly generated spectra that fell within the allotted ranges. In these circumstances, spectra with total average power and PO contiguous to the specified ranges were selected. Figure 23 shows the total average power versus PO scatter plot for the pseudo-randomly Total average power and PO are not directly proportional; however the scattering is not completely random either. In many scenarios, a higher total average power will lead to a higher PO, although that is not always the case.

Closed Loop Testing
A pseudo-random database of spectra was compiled using the Agilent M8190A 12GSa/s Arbitrary Waveform Generator (AWG). The motivation for using a pseudo-random database of spectra is to attain an understanding as to the performance of the algorithms. A controlled spectra at the input of the SAS limits the complexity of the problem space, allowing for a more conclusive analysis as to the performance of the algorithms discussed. The signals produced by the AWG consisted of a pseudo-random combination of chirps (wide band) and sinusoids (narrow band).
During the closed loop testing, the spectra generated by the AWG were split into the SAS, LeCroy's WaveMaster 8620A oscilloscope, and Tektronix RSA6114A real-time spectrum analyzer (RTSA). Only the data collected by the SAS are analyzed herein as the other systems were used for verification or separate testing purposes. Total average power and PO serve as the two input parameters that provide a basis for the generation of the pseudo-random spectra. These scatter plots presented in Figure 21 serve as the foundation on which the pseudo-random data sets were modeled. An analysis as to the distribution of the total average power and PO of each band (denoted by its specific CF) was performed to select spectra with similar distributions from the pseudo-randomly generated database. The range of acceptable total average power and PO for each ambient spectra is displayed in Figure 22 and Table 2 along with the corresponding waveforms (WF) selected from the pseudo-random database.
These total average power and PO ranges were calculated as [P s,upper , P s,lower ] = µ P s ± 3σ P s , and [PO upper , PO lower ] = µ PO ± 3σ PO , respectively. Due to the extensive collection time and static nature of certain ambient spectra, the calculated ranges of total average power and PO had very small standard deviations making it difficult to find pseudo-randomly generated spectra that fell within the allotted ranges. In these circumstances, spectra with total average power and PO contiguous to the specified ranges were selected. Figure 23 shows the total average power versus PO scatter plot for the pseudo-randomly generated waveforms. There is considerably less jitter in Figure 23 as compared to that in Figure 21 as the pseudo-random WFs are not time-varying.
Sensors 2017, 17, x FOR PEER REVIEW 23 of 31 generated waveforms. There is considerably less jitter in Figure 23 as compared to that in Figure 21 as the pseudo-random WFs are not time-varying. Figure 22. Range of total average power and PO calculated for each center frequencies (CF) of the ambient data collection from Equations (31) and (32).

Comparative Analysis Utilizing the Pseudo-Random Database
The performance of the SS-MO, SS-BFE, and SS-MO-BFE algorithms are compared on the basis of the following: (1) Statistical performance, and (2) Computational efficiency. Since the algorithms' computational efficiency has not been specifically optimized, the results from a computational standpoint are less significant. The data set used for the comparison are the twelve pseudo-randomly  generated waveforms. There is considerably less jitter in Figure 23 as compared to that in Figure 21 as the pseudo-random WFs are not time-varying. Figure 22. Range of total average power and PO calculated for each center frequencies (CF) of the ambient data collection from Equations (31) and (32).

Comparative Analysis Utilizing the Pseudo-Random Database
The performance of the SS-MO, SS-BFE, and SS-MO-BFE algorithms are compared on the basis of the following: (1) Statistical performance, and (2) Computational efficiency. Since the algorithms' computational efficiency has not been specifically optimized, the results from a computational standpoint are less significant. The data set used for the comparison are the twelve pseudo-randomly

Comparative Analysis Utilizing the Pseudo-Random Database
The performance of the SS-MO, SS-BFE, and SS-MO-BFE algorithms are compared on the basis of the following: (1) Statistical performance, and (2) Computational efficiency. Since the algorithms' computational efficiency has not been specifically optimized, the results from a computational standpoint are less significant. The data set used for the comparison are the twelve pseudo-randomly generated WFs outlined in Table 2. As outlined in Section 5.3, these WFs were fed directly into the input of the SAS. For the purpose of this section, fifty spectrum data per WF were analyzed.

Statistical Performance
The performance metrics utilized in this analysis are SINR, BW (as it affects radar range resolution), and percent interference (PI). SINR and BW are defined in Sections 2.4 and 2.5, respectively. PI is defined as the ratio where Em B is the number of emitters within the OSB selected by an algorithm and Em T is the number of emitters in the total view of the wideband spectrum. Because the spectra were generated, all of the signals within the spectra are known. Therefore, an emitter is defined as any individual sinusoid or chirp within the band of a spectrum. The determination as to whether an emitter is within a select OSB is binary. The FCC Spectrum Policy Task Force defines harmful interference as "Interference which endangers the functioning of a radionavigation service or of other safety services or seriously degrades, obstructs, or repeatedly interrupts a radiocommunication service operating in accordance with these [International] Radio Regulations" [2]. The reasonable assumption is made that a radar transmission in an OSB overlapping less than 1% of a wideband signal does not degrade the primary user's ability to perform its intended function. Therefore, any overlap of less than 1% is not considered interference. See Figure 24 for an intuition regarding the bounds of a signal classified as an emitter. The noise floor of the spectrum in Figure 24 is approximately −127 dBm. Any frequency bin with an amplitude above −127 dBm on the red line is declared an emitter. The PI quantifies the amount of co-channel interference that is caused by a radar transmission across the select OSB. An intuition for the spectral footprint, and to an extent the EMC, of a radar can be derived from PI. generated WFs outlined in Table 2. As outlined in Section 5.3, these WFs were fed directly into the input of the SAS. For the purpose of this section, fifty spectrum data per WF were analyzed.

Statistical Performance
The performance metrics utilized in this analysis are SINR, BW (as it affects radar range resolution), and percent interference (PI). SINR and BW are defined in Sections 2.4 and 2.5, respectively. PI is defined as the ratio where B Em is the number of emitters within the OSB selected by an algorithm and T Em is the number of emitters in the total view of the wideband spectrum. Because the spectra were generated, all of the signals within the spectra are known. Therefore, an emitter is defined as any individual sinusoid or chirp within the band of a spectrum. The determination as to whether an emitter is within a select OSB is binary. The FCC Spectrum Policy Task Force defines harmful interference as "Interference which endangers the functioning of a radionavigation service or of other safety services or seriously degrades, obstructs, or repeatedly interrupts a radiocommunication service operating in accordance with these [International] Radio Regulations" [2]. The reasonable assumption is made that a radar transmission in an OSB overlapping less than 1% of a wideband signal does not degrade the primary user's ability to perform its intended function. Therefore, any overlap of less than 1% is not considered interference. See Figure 24 for an intuition regarding the bounds of a signal classified as an emitter. The noise floor of the spectrum in Figure 24 is approximately −127 dBm. Any frequency bin with an amplitude above −127 dBm on the red line is declared an emitter. The PI quantifies the amount of co-channel interference that is caused by a radar transmission across the select OSB. An intuition for the spectral footprint, and to an extent the EMC, of a radar can be derived from PI.
In Equation (35)  An algorithm's performance for each statistic is quantified through a root-mean-square error (RMSE) defined as where In Equation (35), O i is the metric's best value, D i is the metric's value as selected by the algorithm, and w i normalizes the error based on the total range of possible values. The best values (O i ) for PI, BW, and SINR are 0%, 35 MHz, and max(Z1 i,j ), respectively. A RMSE = 0 denotes a metric that has been optimized. In the case of BW, O i = 35 MHz and w i = 30 MHz. For PI, O i = 0.00% and w i = 100%. Figure 25 shows the PI results for all of the algorithms for comparison with the PI for β max , the maximum available BW yielding the best resolution. In Figure 25, the 50 spectrum datum collected by the SAS were averaged for each WF. Table 3 outlines the breakdown of emitters in each spectrum along with the average PI that is caused by the select OSB for each algorithm individually. Only once did all three algorithms (Waveform 3) have the optimal average PI of 0%, simultaneously resulting in an RMSE of 0. Of the three algorithms, the SS-BFE minimized PI most efficiently since its overall RMSE was the least, followed by SS-MO-BFE, and then the SS-MO whose RMSE was the highest. All three algorithms show a significant improvement over the PI of β max , which has a constant PI of 100%.  Figure 25 shows the PI results for all of the algorithms for comparison with the PI for max  , the maximum available BW yielding the best resolution. In Figure 25, the 50 spectrum datum collected by the SAS were averaged for each WF. Table 3 outlines the breakdown of emitters in each spectrum along with the average PI that is caused by the select OSB for each algorithm individually. Only once did all three algorithms (Waveform 3) have the optimal average PI of 0%, simultaneously resulting in an RMSE of 0. Of the three algorithms, the SS-BFE minimized PI most efficiently since its overall RMSE was the least, followed by SS-MO-BFE, and then the SS-MO whose RMSE was the highest. All three algorithms show a significant improvement over the PI of max  , which has a constant PI of 100%.  In the spectra corresponding to Waveform 4, the RMSE of SS-BFE was observed to be slightly greater than that of the SS-MO-BFE. However, the difference is minute, indicating a slight, insignificant variation in performance. It is worth noting that both spectra contain a chirp emitter. In OSBs containing wideband signals such as chirps, the PSE value can be inflated as the energy within the wideband signal can be almost uniformly distributed leading to poor OSB identification. This is not typically the case as the energy in most wideband signals are less uniformly distributed than a sub-band containing purely noise. This effect is amplified in a controlled input scenario as signal  In the spectra corresponding to Waveform 4, the RMSE of SS-BFE was observed to be slightly greater than that of the SS-MO-BFE. However, the difference is minute, indicating a slight, insignificant variation in performance. It is worth noting that both spectra contain a chirp emitter. In OSBs containing wideband signals such as chirps, the PSE value can be inflated as the energy within the wideband signal can be almost uniformly distributed leading to poor OSB identification. This is not typically the case as the energy in most wideband signals are less uniformly distributed than a sub-band containing purely noise. This effect is amplified in a controlled input scenario as signal fading is not a factor. The SINR weighting function in SS-MO-BFE counteracts the high PSE values as wideband signals are typically high powered RFI. Figure 26 compares each algorithm's β i,j results averaged over each spectrum. Because range resolution is inversely related to BW, a high BW is desirable in order to achieve the best resolution. Table 4 shows the average β i,j value selected by each technique. As anticipated, the SS-MO provides the best range resolution among all of the algorithms followed by the SS-MO-BFE, and then followed by SS-BFE over the complete dataset.
Of all three algorithms, the SS-MO provides the most weight for maximizing bandwidth as the weighting factor on the range resolution objective function, Z2 i,j , is α = 0.5. This weighting factor is larger than that of the SS-MO-BFE, which uses a weighting factor of υ = 1 3 = 0.33 for Z2 i,j . Because SS-BFE is not a traditional WSMO function, the weight applied to the range resolution objective cannot be directly compared to the other algorithms; however, the results are telling. The SS-BFE typically selects a much smaller OSB than the SS-MO or the SS-BFE as its main goal is to minimize co-channel interference.
fading is not a factor. The SINR weighting function in SS-MO-BFE counteracts the high PSE values as wideband signals are typically high powered RFI. Figure 26 compares each algorithm's j i ,  results averaged over each spectrum. Because range resolution is inversely related to BW, a high BW is desirable in order to achieve the best resolution. Table 4 shows the average j i ,  value selected by each technique.
As anticipated, the SS-MO provides the best range resolution among all of the algorithms followed by the SS-MO-BFE, and then followed by SS-BFE over the complete dataset.
Of all three algorithms, the SS-MO provides the most weight for maximizing bandwidth as the weighting factor on the range resolution objective function, SS-BFE is not a traditional WSMO function, the weight applied to the range resolution objective cannot be directly compared to the other algorithms; however, the results are telling. The SS-BFE typically selects a much smaller OSB than the SS-MO or the SS-BFE as its main goal is to minimize co-channel interference.   Figure 27 displays the SINR results for all three algorithms for comparison, while Table 5 reports the SINR performance of each algorithm for the twelve spectra.   Figure 27 displays the SINR results for all three algorithms for comparison, while Table 5 reports the SINR performance of each algorithm for the twelve spectra. Sensors 2017, 17, x FOR PEER REVIEW 27 of 31 Figure 27. Average signal-to-interference-plus-noise ratio (SINR) values for each SS technique for each pseudo-random waveform.  Table 6 presents overall performance metrics averaged across all waveforms. The SINR results averaged over all spectra considered reveal that the SINR is highest for the SS-BFE, followed by SS-MO-BFE, SS-MO, and max  , in that order. It should be noted, however, that the SINR values produced by each algorithm are relatively close as each algorithm maximizes SINR in its own manner. The principal goal of SS-BFE is to determine an OSB with minimal interference in which a radar can operate and SINR is inherently proportional to the inverse of interference power. Both SS-MO and SS-MO-BFE incorporate an SINR objective function. The significant SINR disparity can be seen between the max  SINR values and the SINR values of the SS-MO, SS-MO-BFE, and SS-BFE OSBs. All three algorithms select an OSB with a considerable SINR improvement over the maximum BW.

Computational Performance
Although the OSB selection algorithms were not designed to optimize computational efficiency, the current computational expense of the algorithms is examined. It should be understood that this   Table 6 presents overall performance metrics averaged across all waveforms. The SINR results averaged over all spectra considered reveal that the SINR is highest for the SS-BFE, followed by SS-MO-BFE, SS-MO, and β max , in that order. It should be noted, however, that the SINR values produced by each algorithm are relatively close as each algorithm maximizes SINR in its own manner. The principal goal of SS-BFE is to determine an OSB with minimal interference in which a radar can operate and SINR is inherently proportional to the inverse of interference power. Both SS-MO and SS-MO-BFE incorporate an SINR objective function. The significant SINR disparity can be seen between the β max SINR values and the SINR values of the SS-MO, SS-MO-BFE, and SS-BFE OSBs. All three algorithms select an OSB with a considerable SINR improvement over the maximum BW.

Computational Performance
Although the OSB selection algorithms were not designed to optimize computational efficiency, the current computational expense of the algorithms is examined. It should be understood that this computational analysis is not indicative of the maximum attainable efficiency of the algorithm, but rather of the efficiency of each algorithm in its current state of being.
To quantify computational performance, the average processing time for each function is presented. These functions were called consecutively 100 times in a parent function. The input dataset consisted of decimated spectra composed of 2 10 or 1024 samples. The average computation time for each OSB function is outlined in Table 7. The same processor and analysis platform were used when calculating the average computation time. Processing time is unique to processor speed and analysis platform, therefore the average processing time values presented in Table 7 provide an understanding of the computational expense of each OSB function relative to the other two OSB functions. The least efficient prsssocess among all of the algorithms is computing the brute force PSE matrix. This computation may be able to be streamlined using more efficient matrix math; however, this solution has not been explored.
Another approach was recently investigated to refine the spectral content into a subset of representative information, thereby reducing the number of frequency bins (K) input to SS-MO [14]. This fast SS-MO technique simultaneously reduces the computational complexity while preserving the performance of multi-objective optimization. Future research will investigate the utility of this approach with the proposed OSB selection techniques.

Conclusions
This paper discusses the SS radar solution space with a focus on statistical spectrum analysis. A SS radar has the same applications and goals of a typical radar system, however it uses knowledge, both a priori and active observation, to optimize the radar performance or to increase the radar's EMC. A statistical framework was established to serve as a foundation for the three OSB selection algorithms that are developed in the paper, namely, the SS-MO, the SS-BFE, and the SS-MO-BFE. These algorithms are designed to determine or define an OSB for radar transmission based on an input spectrum. The SS-MO's primary goal is to increase radar performance in a congested environment via a WSMO function containing SINR and BW (i.e., range resolution) weighting functions. The SS-BFE's intention is to utilize the PSE along with Pareto improvement to determine an OSB of a spectrum where a radar will operate while minimizing the co-channel interference it may cause. The SS-MO-BFE technique operates in the middle-ground of the SS-MO and SS-BFE in the sense that its intent is to find a sub-band that allows for increased radar performance and EMC. The SS-MO-BFE uses a WSMO function (much like the SS-MO) that accounts for SINR, range resolution, and PSE weighting functions. All three algorithms were evaluated and compared using ambient and generated data captured by a unique hardware implementation. Depending upon the application, any one of the approaches may be appropriate.
While the paper addresses one specific topic, extensive details that are presented on the hardware and algorithm development will permit others to modify the approach for their own applications. It is imperative that attention be paid to spectrum sensing owing to the rapid spectrum congestion in recent years in order to maintain EMC with and avoid RFI from other users.
Several avenues for improvement are under investigation. The OSB identification techniques have been investigated without considering the hurdles that are associated with real-time implementation. The SAS lays out a hardware that is capable of providing active spectral data; however, real-time processing techniques can be more efficiently implemented. Our analysis is limited to temporally static spectra in order to narrow the problem space. The spectrum, however, is a temporally dynamic entity and must be examined as such. Therefore, a practical OSB technique should incorporate some form of spectrum prediction to account for change over time. As an example, the empirical estimate of entropy defined in Equation (15) does not consider the correlation between sequential samples. The actual entropy, which depends not only on the occurrence frequency of each received signal strength (RSS) level, but also the temporal order in which the RSS levels occurred, can be employed as it captures the full frequency-time structure present in a given spectrum band's revolution pattern [43].