1. Introduction
In 2013, we introduced the VIIRS Nightfire (VNF) algorithm [
1] for the detection and characterization of subpixel infrared (IR) emitters at night with a combination of near-infrared (NIR), shortwave infrared (SWIR) and mid-wave infrared (MWIR) radiances, collected by the Visible Infrared Imaging Radiometer Suite (VIIRS) and flown by the NASA/NOAA Joint Polar Satellite System (JPSS). Currently, VNF data are produced worldwide on a nightly basis with VIIRS data collected from the Suomi NPP and NOAA-20 satellites. From radiance values in all night-time infrared channels, we can extract a discrete spectrum of electromagnetic radiation, corresponding to a given pixel in the image (
Figure 1). The pixel itself corresponds to a certain area on the Earth’s surface; therefore, the resulting discrete spectrum is the sum of the spectra of all sources located inside the pixel footprint as seen from space. The VIIRS pixel footprint of the moderate resolution (M) bands ranges from 0.6 to 2.5 square kilometers from the edge of the scan [
2]. The VIIRS pixel footprints are large enough to contain several subpixel IR emitters, plus ambient-temperature background objects, each contributing to the pixel’s total emission spectrum. The presence of subpixel IR emitters results in enhanced radiances in the shorter wavelength channels, with the background dominating longwave infrared. VNF identifies pixels containing subpixel IR emitters and then iteratively fits two or three Planck curves to match the observed radiances. The Planck curves point to the temperature and source size of the emitter, which can be extracted using Wein’s displacement law [
3] and Planck’s law [
4]. IR emitter temperatures and source sizes are input to the Stefan–Boltzmann law [
5] to calculate radiant heat in terms of megawatts (MW).
VNF uses two distinct detectors for subpixel IR emitters. The first detector operates on NIR and SWIR night-time images, which are dominated by the sensors noise floor due to the lack of solar irradiance. The IR emitters stand out as bright pixels immersed in a dark background. For bands M7, M8, M10 and M11, the detection algorithm is the same, and the pixels that confidently exceed the sensor’s noise floor are marked as detections. The detection threshold is set as the image mean plus four standard deviations.
The second VNF detector operates on the two mid-wave infrared (MWIR) channels, namely M12 and M13. These channels trace their roots back to the MODIS instrument, which has six MWIR channels. The M12–M13 brightness temperature difference is used in the VIIRS cloud detection algorithm to distinguish between cloud and snow during daylight hours [
6]. VIIRS band M13 is the key spectral band in the NASA and NOAA active fire detection algorithm, which detects hotspot pixels based on the enhanced brightness temperature in the mid-wave relative to the brightness temperature in longwave infrared (LWIR). VNF takes a different approach to subpixel IR emitter detection in MWIR, leveraging the high correlation that background radiant emission have in the two MWIR spectral bands (M12–M13).
2. Background
To unmix the observed spectrum into its constituent elements, in VNF, we approximate the real scene with a model of several blackbody emitters within a pixel footprint of a known size. Each of the selected black bodies contribute radiance to the full pixel signal. For each emitter in the model scene, there are two parameters: the blackbody temperature and the area of its projection onto the pixel footprint.
The spectral density of electromagnetic radiation emitted by a blackbody at a given temperature
T (K) is defined by the Planck law:
where
Bλ(T) (W/m
2/sr/µm) is the spectral radiance at the wavelength
(µm);
kB is the Boltzmann constant (1.380649 × 10
−23 J⋅K
−1);
h is the Planck constant (6.62607015 × 10
−34 J⋅s); and
c is the speed of light (~300,000 km/s). From a programming point of view, the Boltzmann and Planck constants are very small and difficult to represent digitally. In practice, they are often replaced by:
These terms are referred to as the first radiation constant
(1.191042869 × 10
−16 W⋅sr
−1⋅m
2) and the second radiation constant
(1.438777 m⋅K). Using the radiation constants, the Planck law Equation (1) becomes:
With Equation (2), we can fit a Planck curve and estimate the parameters T and ε that the resulting curve most closely (in the least squares sense) matches the observed radiances in the night-time VIIRS bands. The Planck curves are fitted using the simplex algorithm [
7] for the IR spectral bands where the signal from the subpixel heat source exceeds the noise and the background level. An example of a Planck curve fit to the VIIRS observed radiances is shown in
Figure 2. In pixels with both SWIR and MWIR detection, the original VNF algorithm performs dual Planck curve fitting for an IR emitter and a cool background. EOG currently implements a new version of VNF that will analyze pixels for two IR emitters and a cool background.
Note that in Equation (2), there is a unitless emissivity scaling factor ε, which can range from zero to one. Blackbody emitters have an emissivity close to one. The emitters analyzed in VNF are subpixels and thus appear as “graybodies” with emissivities less than one. VNF calculates IR emitter source areas based on the ratio between the observed emitter Planck curve and the amplitude of an emitter at the temperature filling the entire pixel footprint. Instead of “ε”, we refer to this ratio as the “emission scaling factor” or ESF [
1].
The VNF method is used to detect and analyze heat sources with a temperature significantly higher than the background and a size much smaller than that of the full pixel footprint. Examples include forest fires, gas flares, volcanic eruptions, industrial kilns, etc. [
8]. Therefore, an important stage in VNF is the detection of a subpixel heat source in the analyzed pixel.
To detect a subpixel heat source, we need to find when the radiances of the entire pixel in the IR spectral bands exceed the thermal noise of the sensor and the background from the Earth surface or clouds compared to nearby pixels without a heat source. The full pixel spectrum has mixed signals from both the background and the subpixel heat source. If the temperature difference between the subpixel source and the background is large enough, or the heat source has a sufficiently large area, then the contribution of its spectrum to the total radiance can be detected.
High-temperature sources, such as gas flares (T~1800 K), have peak radiant emissions in the SWIR region near the VIIRS spectral band M10 (see
Figure 1 and
Figure 3). The background radiant emission from the Earth’s surface in the M10 band at night is negligible compared to the internal thermal noise of the sensor (
Figure 3). Therefore, the presence of high-temperature subpixel sources in VNF can be detected using a simple threshold in the M10 band equal to four standard deviations of the thermal noise.
For heat sources of a lower temperature, e.g., forest fires (T~800 K), the peak of the Planck curve shifts towards MWIR bands M12–M13 (see
Figure 1). In these bands, a background radiant emission from the terrain and clouds is already clearly visible (
Figure 3). In contrast to the NIR and SWIR bands, a fixed threshold detector cannot be used in the MWIR bands because the varying background radiance is comparable to the signal from the heat source.
The classic “hotspot” method by Dozier [
9] and others finds pixels with enhanced brightness temperatures in a single MWIR channel relative to the brightness temperature in a longwave infrared (LWIR) reference band. In this paper, we present a new approach to the subpixel heat source detection in VIIRS bands M12–M13, based on the fact that the center wavelengths of these bands are close and the background radiances in these bands are strongly correlated (
Section 3). At night, the M12 and M13 radiances are so highly correlated that a dense diagonal baseline is present (
Figure 4 and pixels containing IR emitters are displaced from the baseline. The baseline is dissipated in daytime due to the inclusion of solar-reflected radiance (
Figure 4). In
Section 4, we estimate the sensitivity of this method and its utility in the detection of subpixel saturation in the VIIRS band M12. In
Section 5, we compare the new approach with the well-known MODIS and VIIRS thermal anomalies algorithm [
10,
11,
12,
13] and its subsequent modifications implemented in the active fire product (AFP).
AFP is used to detect fires at both day and night and is produced from both MODIS and VIIRS data. The AFP detects pixels in MODIS images corresponding to open fire or other thermal anomalies, such as volcanic eruptions, based on enhanced MWIR brightness temperature (BT) at 4 um, relative to the BT in the LWIR. For VIIRS, AFP is produced for both the moderate spatial resolution M bands and the finer resolution imagery band (I-bands) [
14]. Because AFP hotspot detection is performed with a single spectral band, the temperature and source size of the IR emitter cannot be calculated. Without those details, heat output cannot be calculated with the Stefan–Boltzmann law. Instead, AFP calculates “fire radiative power”, or FRP, by assuming the IR emitter’s temperature is 1000 K [
15].
4. Results
The M12–M13 scattergram detection algorithm has been used in VNF records since 2012. The VNF detections are available online (
https://eogdata.mines.edu/products/vnf/, accessed on 15 February 2023) for open access with a two-to-six-hour delay after the satellite observation and are aggregated into a relational spatiotemporal database for global monitoring of gas flares (
https://eogdata.mines.edu/download_global_flare.html, accessed on 15 February 2023) [
12]. In VNF, the MWIR scattergram detector is used in parallel with the other two SWIR threshold detectors in bands M10 and M11, which are more sensitive at night-time than the MWIR detector [
9]. However, the MWIR detector is essential for selecting the type of Planck curve fitting, i.e., a single curve for the IR emitter only (2), or a dual curve for the IR emitter and the background (3). In the first case, the radiances from the MWIR and LWIR bands are not used in the least-squares estimate of the IR emitter size and temperature. Followed by atmospheric correction in the SWIR and MWIR bands, the MWIR scattergram detector is used to unmix secondary subpixel IR emitters, such as smoldering and pyrolysis, in the multispectral signal from forest fires [
18].
After the launch of the JPSS-1 satellite in late 2017, there was a significant change in the VNF algorithm because of the addition of the M11 band to the night-time data stream from both the Suomi NPP and JPSS-1 satellites. Before 2018, it was not possible to fit the Planck curve to lower-temperature IR emitters, such as forest fires and industrial sites, if there was no detection in M12–M13. This is because SWIR bands M7-M10 are all located too far left on the tail of their Planck spectra and do not provide enough data for the positioning of Wien’s displacement peak.
4.1. Detector Sensitivity
The adaptive nature of the MWIR scattergram detector makes it difficult to define its sensitivity in terms of absolute radiance thresholds. However, we can statistically “reverse engineer” the thresholds using quantiles of the cumulative probability function (CDF) of the radiances in the M12 and M13 bands over a long period of time.
To estimate the CDF detection thresholds, we selected all MWIR detections from the VNF database in 2018. Radiance detection limits were taken as the 0.5% point on the CDF coming from the radiance histogram generated for each spectral band (
Figure 7). The detection limits for M12 and M13 were found to be 0.073 and 0.071 W/m
2/sr/µm.
With Planck’s law, we can interpret the detection limits of our algorithm in terms of the temperature and source area of the detected heat source. The central wavelength of the M12 and M13 bands and their radiance detection limit were used as constraints. Then, the minimum detectable source area can be estimated by varying its temperature.
Figure 8 shows a scattergram of the temperature versus the source area for one year of operational VNF detections, together with the resulting detection limit lines.
4.2. Subpixel Saturation in VIIRS Band M12
Detection algorithm should take into account possible incorrect measurements associated with the sensor noise and limited dynamic range. One criterion may be that the observed values should be below saturation limits of the sensor. For VIIRS bands M12 and M13, they are 4.41 and 404.3 W/m2/sr/µm, respectively. The general effect of saturation reduces the pixel radiance relative to the unaffected bands. Saturation can occur anywhere in the swath. However, in the M12 band, the incorrect values can occur even below its saturation level. This is because the pixel radiances in the M12 sensor plane are averaged over several neighboring photodetectors to compensate for geometrical distortion (bowties) at the scan edges. The number of photodetectors contributing to a single M-band pixel can vary from one detector at the edges of the scan to three detectors in the middle of the scan at nadir. If the signal is saturated in only one of the averaged detectors, then the resulting radiance is less than the saturation limit, but it still cannot be used for the VNF Planck curve fitting. Typically, only pixels from the outer aggregation zone reach saturation radiances. Thus, there are two styles of saturation, namely “full pixel saturation” and “subpixel saturation”. Subpixel saturation does not occur in the outer aggregation zone. Full pixel saturation is unambiguous because the recorded radiance matches the saturation radiances.
The VIIRS constrains the expansion of the M-band pixel footprints from nadir to the edge of scan by systematically varying the number of pixels aggregated on board [
12]. In the region of ±31.72 degrees out from nadir, three pixels are aggregated. The instrument then switches to aggregate two pixels out to ±44.86 degrees. In the final segment of the scan (out to ±56.28 degrees), no aggregation is used, and the instrument records a signal from single pixels. While successfully controlling the footprint size, this aggregation scheme alters the signal-to-noise ratios and saturation in the aggregation zones.
Based on the long-term database of VNF detections, we devised an empirical rule to identify the presence of subpixel saturation:
In
Figure 9, such a case corresponds to falling into the region of the upper wedge outlined by the dashed line.
5. Discussion
The sensitivity of the scattergram detection algorithm and VNF radiative heat estimates of the detected subpixel sources can be compared with the two other operational fire detection products, MODIS and VIIRS AFP.
5.1. Data Sources
To compare the nocturnal sensitivity of AFP and our detector, we selected two regions in Siberia. One region of interest (ROI) with frequent forest fires was in Khabarovsk Krai (NW corner coordinates: 56N 114E; SE corner 44S 140E). The overview map for that region with VNF detections used in this study is shown in
Figure 10. The second ROI with gas flares from oil fields in Khanty-Mansiysk Autonomous Okrug (NW corner coordinates: 65N 70E; SE corner: 60S 80E). The gas flare map for that region is shown in
Figure 11. All comparisons were made with the data collected in 2015.
To increase the reliability of the comparison between VNF and MODIS AFP, we selected orbits in 2015 with close satellite overpass times over the selected regions. To reduce the error from geometrical distortion at the edges of the scan, we used only the satellite passes with a satellite zenith angle of less than 30 degrees (nadir views). VNF and VIIRS AFP detections that come from the same satellite and overpass time alignment are not needed, but we used the same orbits as before to have all three detection methods cross-comparable.
Finally, we selected 114 MODIS and Suomi NPP orbits with close overpass times in Khanty-Mansiysk (time difference from 18 s to 38 min) and 45 orbits with close overpass times in Khabarovsk (time difference from 24 s to 13 min).
5.2. Method of Comparison
For the three detection methods, namely VNF, MODIS AFP and VIIRS AFP, we compare both the probability of detection (sensitivity) and the estimated radiative power in the two classes of IR emitters, i.e., gas flares and forest fires.
To compare the probability of the of detection for gas flares, we took eight flares and for each satellite pass, we count whether this flare was detected or not. We make this comparison separately for cloudy and cloud-free detections. To determine the presence of clouds, we use cloud flag values from the VNF algorithm. To compare the radiative power estimates, we use the fire radiative power (FRP) parameter in the AFP products and the radiative heat (RH) parameter from VNF. To compare the power of gas flares, we take only the pairs of VNF and AFP detections with one-to-one correspondence in location and time (we call such detections “mutual”, see
Figure 12). We take all mutual detections for all intersections of the orbits and build a linear regression between RH and FRP.
The detection probability of forest fires is compared with the area covered by VNF and AFP detections. Because the sensor pixels have different shapes and resolutions, we cover the entire ROI with a regular grid with a 0.25-degree step in latitude and longitude. We assume that if at least one detection falls into a certain grid cell, then this cell and the corresponding area are covered by the detections. For each intersection of the orbits, we separately determine the number of cells covered with VNF and AFP detections and analyze the linear regression.
To compare the estimates of radiative power from forest fires, we take only the “overlapping” subsets of VNF and AFP detections at each orbital crossing. We call the detection subsets
A and
B “overlapping” if for any detection from subset
A, there is a detection in subset
B within the distance ε and if the opposite also holds true, i.e., for any detection from subset
B, there is a detection in the subset
A within the distance ε (see
Figure 13). This approach to the selection of “overlapping” detection differs from the one we used to compare gas flares. The reason for this is that forest fires often have an extended source area, covered by multiple pixels from the same image. Because the sensors have different spatial resolutions and pixel footprints, it is incorrect to use “one-to-one” correspondence between detection pixels. Instead, we sum up the radiative power over the entire pixel sets detected by VNF and AFP and analyze the linear regression between the integrated radiative power.
5.3. Detector Comparison Results
When comparing radiative heat estimates for gas flares by VNF and MODIS AFP, only 32 “mutual” detections were found in Khanty-Mansi for MODIS and VIIRS orbital crossings. Using the VNF flare catalog [
19], we identified these flares. There are many more “mutual” detections between VNF and VIIRS AFP. The red lines on both plots in
Figure 14 represent regression through the origin. It shows that for gas flares, VNF gives radiative heat values that are, on average, four times higher than the fire radiative power from MODIS and VIIRS AFP.
A comparison of the MWIR detection probability of gas flares by VNF vs MODIS and VIIRS AFP is shown in
Figure 15. The detection probability by VNF for gas flares is higher than by both MODIS and VIIRS AFP.
For the MWIR detections of gas flares, we estimated the accuracy and F-score. The accuracy shows the ratio of correct answers to the total number of all questions and is calculated by Equation (3):
The F-score is the harmonic mean between the precision, showing the number of correct positive answers out of the total number of correct answers, and the recall, showing the number of correct positive answers and the total number of questions, suggesting a positive answer. The F-score is calculated by Equation (4):
In Equations (4) and (5), we assume that the gas flares are constantly active because we have no ground validation. As such, any detection is a correct positive response, any lack of detection is an incorrect negative response, and there are no correct negative and incorrect positive responses in this case. Thus:
- -
TP (true positive) is the number of detections for all overpasses (only detections for eight flares are counted, meaning one detection for each flare);
- -
FP (false positive) is always zero because we assume that the flares are constantly active;
- -
TN (true negative) is always zero for the same reason;
- -
FN (false negative) is the number of overpasses without flare detections.
Our estimates of the accuracy and F-scores for different algorithms are shown in
Table 1.
In
Figure 16, we compare VNF vs MODIS and VIIRS AFP in terms of the detection probability of forest fires. The probability of detection by VNF at night is eight times higher than that of MODIS AFP, and it is slightly less than the VIIRS AFP method.
Figure 17 shows the comparison of VNF and AFP radiative heat estimates for forest fires. The red line in both plots shows regression through zero. In both cases, the correlation level when comparing VNF with both MODIS AFP and VIIRS AFP is high (R
2 > 0.95), and the regression coefficient is close to one.
6. Conclusions
The mid-wave infrared (3–5 um) has been referred to as a crossover zone [
20], in which the radiance observed from space contains both a reflected sunlight component and thermal emissions from objects within pixels, such as clouds, water bodies and land surfaces. This is shown in
Figure 18, where it can be seen that the VIIRS MWIR bands fall on the trailing edge of the solar spectrum and the leading edge of the Earth’s radiant emissions. The situation becomes even more complicated when it comes to the remote sensing of IR emitters, where both flaming and non-flaming components have significant radiant emissions in MWIR. Note that the IR emitter Planck curves are offset by the temperature differences, with flaring and flaming shifted to shorter wavelengths compared to non-flaming components, such as pyrolysis.
The detection of subpixel IR emitters and the spectral unmixing of the flaming, non-flaming and background radiances in MWIR can be vastly simplified by working with night-time data. With the solar component eliminated, background pixels form a sharp diagonal baseline, which can be located and encased using AI methods. Pixels containing subpixel IR emitters, such as biomass burning and natural gas flaring, fall outside of the background diagonal. The unmixing of the radiances from IR emitters and the background is accomplished using Planck curve fitting, performed with the observed radiances. With sunlight eliminated, the full radiance recorded in NIR and SWIR bands can be attributed to IR emitters and can be fed directly into Planck curve fitting for a primary emitter [
18].
VNF uses Planck curve fitting to unmix the radiance components from the background and IR emitters in MWIR. The original VNF algorithm solved for the temperature, ESF, source area and radiant heat of a single subpixel IR emitter. The more recently developed VNF version four uses a flaming subtractive method to analyze primary and secondary emitters [
18]. The primary emitter has higher temperature than the secondary emitter, which is warmer than the background. Radiances from NIR and SWIR define the primary emitter and residual radiances from M12–M16 are used in dual-curve Planck curve fitting to define the secondary emitter and background.
The VNF algorithms only work with night-time data, which is a shortcoming in terms of defining the diurnal dynamics of fires. However, the VNF output products provide spectrally based estimates of temperature, source area and radiant heat—variables that are missing from MODIS and VIIRS active fire products (AFPs). It should be noted that the AFPs calculate fire radiative power (FRP), which has the same units (megawatts) as VNF’s radiant heat (RH). However, FRP is calculated assuming a temperature of 1000 K. VNF’s RH is calculated with the IR emitter’s temperature and source area as input to the Stefan–Boltzmann law. The FRP fixed temperature assumption results in an over- and underestimation of heat output for IR emitters that are hotter or colder than 1000 K.
EOG processes VNF in near real time and maintains an archive available to researchers. We encourage wide utilization of the VNF data for analyses of fire, flares and industrial emitters.