Next Article in Journal
Nonlinear Cylindrical Markers Using Metamaterials
Next Article in Special Issue
Cross-Sensor Nighttime Lights Image Calibration for DMSP/OLS and SNPP/VIIRS with Residual U-Net
Previous Article in Journal
Precise Orbit Determination and Maneuver Assessment for TH-2 Satellites Using Spaceborne GPS and BDS2 Observations
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Extending the DMSP Nighttime Lights Time Series beyond 2013

1
Earth Observation Group, Payne Institute for Public Policy, Colorado School of Mines, Golden, CO 80401, USA
2
Cooperative Institute for Research in Environmental Sciences, University of Colorado, Boulder, CO 80309, USA
3
NOAA National Centers for Environmental Information, Boulder, CO 80305, USA
4
Russian Space Research Institute, 117997 Moscow, Russia
5
Moscow Institute of Physics and Technology, 117303 Moscow, Russia
6
NRC “Kurchatov Institute”, 123182 Moscow, Russia
*
Author to whom correspondence should be addressed.
Remote Sens. 2021, 13(24), 5004; https://doi.org/10.3390/rs13245004
Submission received: 29 October 2021 / Revised: 3 December 2021 / Accepted: 6 December 2021 / Published: 9 December 2021
(This article belongs to the Special Issue Artificial Intelligence in Nighttime Remote Sensing)

Abstract

:
Data collected by the Defense Meteorological Satellite Program’s Operational Linescan System (DMSP-OLS) sensors have been archived and processed by the Earth Observation Group (EOG) at the National Oceanic and Atmospheric Administration (NOAA) to make global maps of nighttime images since 1994. Over the years, the EOG has developed automatic algorithms to make Stable Lights composites from the OLS visible band data by removing the transient lights from fires and fishing boats. The ephemeral lights are removed based on their high brightness and short duration. However, the six original satellites collecting DMSP data gradually shifted from day/night orbit to dawn/dusk orbit, which is to an earlier overpass time. At the beginning of 2014, the F18 satellite was no longer collecting usable nighttime data, and the focus had shifted to processing global nighttime images from Visible Infrared Imaging Radiometer Suite (VIIRS) Day/Night Band (DNB) data. Nevertheless, it was soon discovered that the F15 and F16 satellites had started collecting pre-dawn nighttime data from 2012 onwards. Therefore, the established algorithms of the previous years were extended to process OLS data from 2013 onwards. Moreover, the existence of nighttime data from three overpass times for the year 2013–DMSP satellites F18 and F15 from early evening and pre-dawn, respectively, and the VIIRS from after midnight, made it possible to intercalibrate the images of three different overpass times and study the diurnal pattern of nighttime lights.

1. Introduction

The nighttime lights of the world have emerged as the most reliable and globally consistent dataset for various scientific studies and applications. Some examples of the use of nighttime light images in scientific studies include mapping urban areas [1,2], human ecological footprint [3], measuring socio-economic indices [4,5,6,7,8], population [9], human health and biological impacts [10], effects of a pandemic such as COVID-19 [11,12], studying impacts of war and natural disasters [13,14], boat detection and illegal fishing activities [15,16], and detection of fires, flares, and other infrared (IR) emitters [17].
The original global low light imaging nighttime data series, spanning from 1992–2013, were collected by the U.S. Air Force Defense Meteorological Satellite Program (DMSP), Operational Linescan System (OLS). Since the OLS collected global nightly data, it was possible to filter out sunlit, moonlit, and cloudy data, visually ‘linescreen’ to exclude lights due to aurora and abrupt gain changes and make consistent products extending from 65 south to 75 north [18]. This series ended in 2013 due to orbital degradation of the DMSP F18 satellite, which shifted to a dawn-dusk overpass and collected insufficient nighttime data to create a global nighttime lights product for 2014.
Since then, the focus shifted to low light imaging data collected by the NASA-NOAA Visible Infrared Imaging Radiometer Suite (VIIRS) Day/Night Band (DNB) [19]. Compared to VIIRS DNB, DMSP OLS data have several shortcomings, including coarse spatial resolution, six-bit quantization, limited dynamic range resulting in saturation on urban cores, and lack of in-flight calibration. The improvements in data quality from DMSP OLS to VIIRS DNB include a 45 times smaller pixel footprint, l4 bit quantization, wider dynamic range, no saturation on bright sources, and in-flight calibration [20].
The original global nighttime lights time series from DMSP was produced using OLS data from six individual satellites (Figure 1). With the passage of time, each satellite gradually shifted from a day/night orbit to a dawn/dusk orbit, which is to an earlier overpass time. The OLS sensors collected sufficient nighttime data worldwide as long as the overpass occurred later than 19:30, and global annual nighttime lights products could be generated. Recently, after adding additional years to the DMSP equatorial crossing time chart, the National Oceanic and Atmospheric Administration (NOAA) discovered that both the F15 and F16 satellites had continued to shift and had started collecting pre-dawn nighttime data from 2012 to the present. The interesting thing that has happened because of the shift in the orbit of the DMSP satellites is that recent data are closer in time to the overpass time of VIIRS, which is 1:30 am. Based on this information, the Earth Observation Group (EOG) at Payne Institute for Public Policy, Colorado School of Mines, decided to utilize their several years’ expertise to extend the processing of DMSP nighttime light series using pre-dawn data. The algorithms that were developed to generate the annual global DMSP nighttime light products [18] have been maintained, with a few changes. The first change is that instead of a professional analyst going through each orbit and selecting the lines to exclude lights due to aurora and solar glare, a Neural Network was trained based on lines selected for 3650 half orbits of 2018 [21,22]. The cloud-masking procedure has also been updated since the last publication [18] and will be discussed in the ‘methods’ section. Besides these changes, the software used for processing the historical series of DMSP were used in reprocessing the years 2013–2019.
Although the DMSP nighttime series extends from 1992 to 2013, and the VIIRS from 2012 onwards, because of the major differences between the DMSP and VIIRS satellite sensors [20], cross-calibration and long-term scientific studies using nighttime lights have been difficult. To overcome this problem, Nechaev et al. [23] developed a method of producing an analog of the DMSP annual nightlight image from the corresponding VIIRS product using the U-net Convolutional Neural Network (CNN) and deep residual learning strategy [24]. Therefore, by downgrading the VIIRS nighttime lights for the years 2012 and beyond and cross-calibrating them with the DMSP F15 and F16 satellites of the corresponding years, it is possible to study the diurnal variations of the city lights. In this paper, intercalibrated DMSP F182013, F152013, and Downgraded VIIRS Nighttime Light (DVNL), with overpass times of approximately 7:30 p.m., 4:30 a.m., and 1:30 a.m., respectively, were examined to understand the diurnal pattern of nighttime lights.
In the first half of the ‘methods’ section, we will discuss the steps for creating the annual Stable Lights products for the DMSP series beyond 2013. For this paper, we will cite examples from F152018. As stated before, the steps for creating the annual Stable Lights have remained more or less consistent with the previous series [18]. In the second half, we will touch upon the process of intercalibrating the F15 and F18 DMSP images to the downgraded VIIRS nighttime image and examine the diurnal pattern of nighttime light for 2013 corresponding to different satellite overpass times.

2. Materials and Methods

The polar orbiting Defense Meteorological Satellite Program’s Operational Linescan System (DMSP-OLS) sensors have been flown by the US Air Force, Department of Defense (DoD) since the mid-1970s. The DMSP data have been archived at NOAA’s National Centers for Environmental Information (NCEI) since 1992. Nighttime Lights processing was established by the Earth Observation Group at NOAA/NCEI in 1994, and transitioned to the Payne Institute for Public Policy, Colorado School of Mines in 2020.
The OLS data are available on a global scale at a spatial resolution of 2.7 km and are made up of two spectral bands, a visible band (0.4–1.1 µm) and a thermal band (10.5–12.6 µm) (Figure 2).
The OLS was designed to detect moonlit clouds and a photomultiplier tube (PMT) is used to intensify the visible band signal. However, because of this intensification, lights from cities, fires, fishing boats, gas flares, and so on are also detected. Some of these lights’ sources are transient, for example, fires and fishing boats, while the city lights are more permanent. The annual ‘Stable’ Lights composites are made by isolating the transient sources from the more permanent sources by examining the distributions of the visible bands, which go into the composite products. Although the OLS is unique in its ability to collect low-light imaging data, it has some flaws, such as coarse spatial resolution, a 6-bit quantization, and a limited dynamic range resulting in saturation of city centers. In the following sections, we discuss the steps in creating the DMSP-OLS Stable Lights composite for the year 2018 from 3651 orbits of the F152018 satellite.

2.1. Steps in Creating the OLS Stable Lights Composite

2.1.1. OLS Flag Images

There are several steps of pre-processing involved to ensure the inclusion of only high-quality cloud-free nighttime data in the Stable Lights product. This is done by creating companion flag images for the OLS orbits. The flag images are used to place the OLS pixels into classes. The flag images are 16-bit, and they are processed bit-wise. Thus, each OLS pixel can simultaneously be in more than one class by turning specific bits on. The flag categories used in the Stable Lights processing are DAYTIME, NIGHTTIME MARGINAL, ZERO LUNAR ILLUMINANCE, CLOUDS PRESENT, and NO DATA.
Solar elevation angles help to determine the DAYTIME and NIGHTTIME MARGINAL flags. The DAYTIME flag bit is set for solar elevation angles greater than −6, and the NIGHTTIME MARGINAL flag is set for solar elevation angles between −15 and −6 (Figure 3). The NIGHTTIME MARGINAL flag bit covers the transition zone from nighttime to daytime, and the data in this terminator zone is of reduced quality in comparison to the darker nighttime data.
The ZERO LUNAR ILLUMINANCE flag is set using lunar illuminance values computed by means of an algorithm acquired from the US Naval Observatory [25]. The algorithm estimates the lunar illuminance present at the Earth’s surface as a function of the lunar phase, azimuth, and elevation, which in turn are computed from the latitude and longitude of each OLS pixel and the time at the nadir pixel of each scan line. When the returned lunar illuminance is less than 0.0005 lux, the ZERO LUNAR ILLUMINANCE flag is set. Sometimes, there may be scanlines within an OLS nighttime suborbit with no real data but are present as placeholders. The NO DATA flag is set for these regions.

2.1.2. Orbital Screening for Aurora, Solar Glare, and Abrupt Gain Changes

This step in orbital processing includes one of the most significant changes from the way it was done before. The suborbits with ZERO LUNAR ILLUMINANCE flag bit goes into the processing of the Stable Lights product. However, these suborbits may have aurora, solar glare, and abrupt gain changes. The abrupt gain changes, seen in the OLS orbits through F15, were caused by the thresholds, which were altered incrementally to keep up with the changing maximum gain of the OLS. The maximum gain of the OLS was shifted to prevent saturation when the orbit shifted from night to day. Although the gain thresholds were adjusted weekly, they were not recorded as part of the data stream. Previously, an analyst had to go through each suborbit and visually screen for abrupt gain changes (through F15 satellite) and the presence of aurora and solar glare, selecting a start and end scanline of data to include in the Stable Lights product. It took several hours for an analyst to go through all the suborbits of a month and accomplish this task. However, in processing the extension series, Neural Network (NN) was used to segment the orbit and find the limits and remove parts of the DMSP orbit lit with aurora and solar glare.
The segmentation type is a bounding box. The near-pole parts of the orbit inside the bounding box detected by NN are believed to contain aurora and glare, and thus they are not used in further nighttime lights compositing. To build the NN, Detectron2 Artificial Intelligence (AI) library by Facebook Research, which provides state-of-the-art detection and segmentation algorithms for image analysis, was used [21]. In particular, Detectron COCO Instance Segmentation Baselines with Mask based on the Regions with CNN features (R-CNN) algorithm was employed [22] with the following settings for the network weights, learning rate, and maximum number of iterations (Equation (1)):
MODEL.WEIGHTS = model_zoo.get_checkpoint_url (“COCO-Instance Segmentation/mask_rcnn_R_50_FPN_3x.yaml”)
SOLVER.BASE_LR = 0.00025
SOLVER.MAX_ITER = 10,000
The NN was trained with 3650 nighttime half-orbits observed in F15 2018, where 3568 of these images were used for training and 82 for validation. The size of the images, which varied slightly in height, were 1465 (East-West) × ~6750 (North-South) pixels. Each of the images was at first hand-labeled by a professional analyst to mark the two scanlines limiting the outmost northern and southern boundaries of aurora and solar glare. After this initial task by the analyst, 4 h of training at the Google Colab platform made it possible for the network to recognize aurora and segment the orbits with 99% accuracy. Figure 4 shows the lines selected by the NN algorithm.

2.1.3. Cloud Masks

Screening the OLS data for clouds and excluding cloudy data from the Stable Lights processing is critical for generating a quality product. Clouds alter the appearance of the nighttime visible band data. Heavy cloud cover will completely obscure the signal, while thinner clouds can alter the signal by making the lights appear dimmer and more spread out. There is no readily available cloud-mask product for the OLS visible band, so an algorithm was developed to create a cloud-mask by comparing the OLS thermal band to modeled surface temperatures. Thermal band data significantly colder than the modeled surface temperatures are labeled as clouds. The cloud-mask algorithm used for this Stable Lights extension series builds upon previous work detailed in Baugh et al. [18].
The modeled surface temperature grids used are part of the National Center for Environmental Prediction (NCEP) Global Forecast System (GFS) model runs [26]. Operationally, the NCEP-GFS model generates global surface temperature grids every 6 h, with forecasts at 3 h intervals spanning multiple days into the future. The global grids are currently generated at spatial resolutions of 1, 0.5, and 0.25 degree. The 0.5 degree spatial resolution model runs were used for this Stable Lights extension series.
The cloud-mask algorithm first identifies all NCEP-GFS surface temperature files with model run (or 3-h forecast) times that are adjacent in time to the OLS orbit, or within the time of the OLS orbit. As the nighttime side of an OLS orbit is generally ~50 min in length, there are always two adjacent surface temperature grids and there can sometimes be an additional surface temperature grid whose time falls within the OLS orbital segment. For the example orbit, F15201801162050, the start time is 16 January 2018 20:50:49 and the end time is 47 min later at 21:38:00. The surrounding NCEP-GFS model runs are at 16 January 2018 18:00 and 17 January 2018 00:00. In addition, there is a third file, the 3 h forecast for the 16 January 2018 18:00 model run corresponding to 16 January 2018 21:00, that falls in the middle of the time range of our example orbit. These grids are shown in Figure 5.
After identifying the appropriate surface temperature files, the global 0.5 degree grids are spatially mapped into the OLS swath. This is done using the center latitudes and longitudes of each OLS pixel and resampling the 0.5 degree surface temperature grids into the OLS swath using the bilinear resampling technique. This yields surface temperatures that spatially match the OLS thermal band. The resulting three surface temperature images for the example orbit F15201801162050 are shown on the left-hand side of Figure 6.
Once the global surface temperature grids have been remapped onto the OLS swath, the final step is to do a temporal interpolation to more closely approximate the surface temperature at the time of the OLS orbit. This is done, for each OLS scanline, by taking the time-adjacent surface temperature grids and using linear interpolation to obtain a new surface temperature estimate at the time of the scanline. The resulting surface temperature image, time-interpolated to match the OLS scanline times, is shown on the right-hand side of Figure 6.
The final step in the cloud-masking process is to create a difference image of the time-interpolated surface temperature grid subtracted from the OLS thermal band. A cloud threshold value of −10 was empirically determined. Difference values less than the cloud threshold are considered clouds and are added to the companion flag by setting the CLOUDS PRESENT bit to 1. Graphical representations of the process and the resulting cloud mask for our example orbit F15201801162050 are shown in Figure 7.

2.1.4. Reprojection

The OLS visible and thermal bands, and their companion flag bands, are reprojected into 30 arc-second grids. Before reprojection is done, the suborbits are restricted to latitude 65S and 75N. A further restraint that is enacted is the exclusion of the outer edges of the OLS swath, shown in blue in Figure 4b, and these are areas with scan angles greater than 40.91 degrees. The edges are discarded because at the edge of swath, the OLS visible band shows an escalation of background noise, and the geolocation accuracy is reduced.
The reprojection software was designed to geolocate and reproject OLS data. The geolocation algorithm allocates latitudes and longitudes to each OLS pixel based on the scan angle, nadir latitude and longitude, satellite altitude, height and azimuth, and a digital elevation model of the Earth’s surface. Then, the reprojection software, using the nearest neighbor sampling technique, resamples the input OLS data and companion flag bands into output 30 arc-second grids. Examples of the output grids are shown in Figure 8.

2.1.5. Making the Composite

To create the best quality visible band data composite, data are included only if the flag bits are set as:
DAYTIME: OFF
NIGHTTIME MARGINAL: OFF
ZERO LUNAR ILLUMINANCE: ON
CLOUDS PRESENT: OFF
NO DATA: OFF
The Stable Lights compositing process takes in all input visible and the accompanying flag grids and creates a suite of output files. The output files created include an average visible band image, an image of the number of cloud-free observations used, and histograms of input visible band data for each grid cell. The histograms help in the outlier removal process discussed in the next section (Figure 9).

2.1.6. Outlier Removal

The average visible band composite does not differentiate between the transient lights from fires, fishing boats, and the more permanent sources of lights. Thus, to create a Stable Lights product that does not have the transient light sources, the composite histograms are examined for bright outliers.
The outlier removal algorithm is an iterative process performed on the composite histograms indicating the distribution of the input visible band data for each grid cell. The algorithm works by iteratively computing the standard deviation of observations. The largest visible band observation is removed, and the standard deviation is computed for the remaining observations. Then, the new standard deviation is compared to that of the previous iteration. This iterative process continues till the standard deviations converge, which is defined as a difference of less than 0.2. If more than 50% of the observations are removed, no convergence is stated. Generally, the histograms for grid cells with fires have a few high DN observations, but mostly low visible band DNs spread throughout the DN range of 0–63. On the other hand, grid cells with small towns have the bulk of their observations in the lower visible band DNs, but the spread of the values is higher than a no-light grid cell (Figure 10).
The output of this step is a new outlier-removed average visible band composite, which is created by using the observations remaining after the standard deviation convergence, or by taking into account all the observations when there is no convergence (Figure 11).

2.1.7. Background Removal

The last step in creating the Stable Lights product is to isolate areas in the outlier-removed composite, which have lights from those background areas where lights are absent. In the outlier-removed average composite, the background values change significantly from region to region. Thus, local background threshold values need to be computed. To gather samples of the background values, an analyst placed markers over areas in the outlier-removed composite, which visually appeared light-free. The outlier-removed composite was then processed in kernel-sized steps of 25 × 25 pixels. For each kernel, each of the 256, 400 × 400-pixel tiles covering this kernel were inspected. Areas in the kernel with values more than the maximum light-free values from the tile were tallied as “greater than background”. Areas that were tallied as “greater than background” at least 40% of the time were used to create the Stable Lights mask. The Stable Lights mask was then applied to the average visible band composite to create the final Stable Light composite product (Figure 12).

2.1.8. Geographic Alignment

The DMSP-OLS nighttime light composites from satellite F18 appear to be shifted southwest of the ground location. For the previous DMSP satellite years, the LandScan population grid [27] was used for ground-truthing as it correlates well with the DMSP global composites and has a global extent. A cross-correlation technique was developed to create a best-fit translation between the Stable Lights product and the LandScan population grid, and then the linear translation was applied to the Stable Lights product.
For the geographic alignment of the extension series, instead of the LandScan population grid, the resampled VIIRS DNB composite of 2016 was used. The geolocation algorithm for the VIIRS Day/Night Band (DNB) has far more precise control of its surface footprint [28], and thus it was used to align the DMSP extension series to the resampled VIIRS DNB grid of 2016 using the same cross-correlation and best-fit translation technique. The resampling of the VIIRS DNB grid from 15 arc-seconds to 30 arc-seconds was necessary so that both the DMSP and VIIRS grid were in the same resolution of 30 arc-seconds (Figure 13).

2.2. Intercalibrating the 2013 Nighttime Images to Study Diurnal Patterns

For 2013, the EOG generated three global nighttime lights datasets with varying overpass times. The first one is the F182013 DMSP nighttime image from early evening with the satellite overpass time at around 7:30 p.m. The second one is the resampled VIIRS 2013 (VNL V2 2013 resampled from 15 arc seconds to 30 arc seconds with physical units in nW cm−2 sr−1) downgraded to DMSP digital numbers (DVNL) based on Neural Network analysis trained on VNL V2 2016 and DMSP F152016. The third variety of global nighttime lights of 2013 is the F152013 with an overpass time at pre-dawn, approximately at 4:30 a.m.
The existence of these three global nighttime images of 2013 at different overpass times provided us with the opportunity to examine the diurnal patterns of electric lighting. However, to remove the sensor effects from the diurnal analysis it was necessary to use one product as a reference and match the other two to the reference image. As stated earlier, the DMSP visible band does not have any in-flight calibration. On the contrary, the VIIRS Day/Night Band (DNB) has in-flight calibration, which is updated every month. Thus, to explore the diurnal patterns in electric lighting, the outlier-removed DMSP F152013 and F182013 were matched to the downgraded VNL V2 from 2013 (DVNL), which was used as a reference grid. The outlier-removed versions of DMSP F152013 and F182013 were used so that no background noise values would interfere with the intercalibration process.
In order to develop an intercalibration, it was necessary to collect brightness data from a set of features that have no diurnal pattern. Through a thorough examination of several features, the flares in the Persian Gulf were determined to be the best candidates. The flares in the Persian Gulf are offshore and isolated from electric lighting sources. The flares form as large circular off-shore features with halos of lights created by the atmospherically scattered light. The outer edges of the halos correspond to the sensor’s detection limits and are quite similar for all three data sets. The DMSP products have patches in the center, which are saturated. The transect across one of the Persian gulf flares shows that the DN levels match closely even without intercalibration. This also reinforces that these flares are good candidates for developing the intercalibration (Figure 14).
The intercalibrations were developed through second-order polynomial fits with DNVL 2013 on the X axis and outlier-removed DMSP F152013 on the Y axis, and then in the other equation taking DVNL on the X axis and outlier-removed DMSP F182013 on the Y axis. The intercepts were taken as zero based on the assumption that adjusted F182013 and F152013 would be zero when DVNL is zero (Figure 15, Equation (2)). The derived coefficients were applied to the DMSP F152013 and F182013 images, respectively, to obtain the intercalibrated images:
DNadjusted = C1 × DN + C2 × DN2

3. Results

3.1. The Stable Lights Composite of F152018

The steps described in the ‘Materials and Methods’ section were implemented on the 3651 orbits of the F152018 satellite to create the global Stable Lights product for the year 2018 (Figure 16). The Stable Lights product shows the visible band intensities in Digital Numbers (DNs) for all lit areas. Areas with transient lighting were removed and non-lit areas (background) were set to zero. These same methods were used to process the Stable Lights images for the whole extension series of 2013–2019. These can be downloaded from https://eogdata.mines.edu/wwwdata/dmsp/extension_series/ (accessed on 3 December 2021).

3.2. Diurnal Patterns in Nighttime Lights

An RGB image was made with the intercalibrated images of 2013, where R = the intercalibrated image of F182013, G = the DVNL image of 2013, and B = the intercalibrated image of F152013. To study the diurnal patterns of lights, a section of northern India was clipped out and 12 points were placed covering the different hues, which were observed in the RGB image (Figure 17). The profiles drawn for these 12 different point locations on the RGB composite provide interesting insights for the diurnal patterns of lighting for this region of northern India with different intensities of lighting during early evening (7:30 p.m.), after midnight (1:30 a.m.), and pre-dawn (4:30 a.m.) (Table 1 and Figure 18).

4. Discussion and Conclusions

This study was based on the methods that were developed by Baugh et al. [18] to create the Stable Lights images from 1992–2013. These data are available for download from https://eogdata.mines.edu/products/dmsp/#v4_dmsp_download (accessed on 3 December 2021). In creating the extension series of DMSP, that is 2013–2019, one major modification was done, that is, instead of a professional analyst going through each orbit and selecting the upper and lower scan lines to exclude aurora and solar glare, Neural Network was trained to select those lines. This reduced the processing time considerably. The second change is that the cloud masking procedure was updated.
The CNN procedure developed by Nechaev et al. [23] to produce analogs of DMSP nighttime images from the corresponding VIIRS images of the same year allow researchers to conduct various socio-economic studies through the entire time period of 1992–2019. This is indeed invaluable to the scientific community. As the development of the CNN procedure is the content of another paper that is in review, here we focused on the development of the intercalibration process, and the use of the intercalibrated images to study diurnal patterns of the lights.
The orbital shift of the DMSP F15 and F16 satellites has made it possible to collect data for the pre-dawn time since 2012. The existence of global nighttime images for three time periods for 2013: 7:30 p.m. (DMSP F182013), 1:30 a.m. (DVNL 2013), and 4:30 a.m. (DMSP F152013), has made it possible to study the diurnal pattern of nighttime lights. For intercalibration, the flares in the Persian Gulf were selected because of the consistency in their DN values in the DMSP F152013, DVNL 2013, and DMSP F152013 images. Second-order polynomial fits were established, and coefficients were derived. The derived coefficients were used to calibrate the F152013 and F182013 images to match the DVNL 2013 image. The 12 profiles obtained from the points on the different hues of the RGB image of northern India, made from the three different overpass times of the DMSP and VIIRS satellites, is a pioneering approach for studying the diurnal patterns of nighttime lights.
We plan to extend the intercalibration between DMSP and VIIRS for 2014 through 2019, and to extend the study of diurnal patterns of lighting to other parts of the world. The EOG will continue to process the monthly and annual grids of DMSP nighttime images as long as usable data are collected and made available. The long time series of Stable Lights products and their intercalibrated versions will be immensely useful for researchers in the study of nighttime lights through the years, and also will aid in the various socio-economic studies that are conducted using nighttime lights. The diurnal patterns of lighting will enable an understanding of the lighting behavior of people residing in different parts of the world.

Author Contributions

Conceptualization, C.D.E., K.E.B., M.Z., T.G. and F.-C.H.; methodology, C.D.E., K.E.B., M.Z., A.P., T.G. and F.-C.H.; software, K.E.B., M.Z., A.P. and T.G.; validation, K.E.B., M.Z., T.G., A.P., F.-C.H. and C.D.E.; formal analysis, K.E.B., T.G., M.Z., C.D.E. and A.P.; investigation, T.G., M.Z., C.D.E., A.P. and K.E.B.; data curation, T.G., K.E.B. and F.-C.H.; writing—T.G., K.E.B., M.Z., A.P. and C.D.E.; writing—review and editing, K.E.B., C.D.E., M.Z. and F.-C.H.; visualization, K.E.B., T.G., C.D.E., M.Z. and A.P.; funding acquisition, C.D.E. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by AGENCE FRANCAISE DE DEVELOPPEMENT (AFD), a public body whose registered office is at 5 Rue Roland Barthes, 75012 Paris, France registered on the Paris Trade and Companies Register under number B 775 665 599. Siret Number: 77566559900129; Chorus Number: PAR-IRS-003; Purchase order number: 21004880.

Acknowledgments

The authors wish to thank the Air Force Weather Agency for providing the DMSP-OLS digital data stream to NOAA/NCEI, which forms the basis of this work.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

References

  1. Luqman, M.; Rayner, P.J.; Gurney, K.R. Combining Measurements of Built-up Area, Nighttime Light, and Travel Time Distance for Detecting Changes in Urban Boundaries: Introducing the BUNTUS Algorithm. Remote Sens. 2019, 11, 2969. [Google Scholar] [CrossRef] [Green Version]
  2. Hu, X.; Qian, Y.; Pickett, S.T.A.; Zhou, W. Urban Mapping Needs Up-to-date Approaches to Provide Diverse Perspectives of Current Urbanization: A Novel Attempt to Map Urban Areas with Nighttime Light Data. Landsc. Urban Plan. 2020, 195, 103709. [Google Scholar] [CrossRef]
  3. Ghosh, T.; Anderson, S.J.; Elvidge, C.D.; Sutton, P.C. Using Nighttime Satellite Imagery as a Proxy Measure of Human Well-Being. Sustain. Sci. Pract. Policy 2013, 5, 4988–5019. [Google Scholar] [CrossRef] [Green Version]
  4. Proville, J.; Zavala-Araiza, D.; Wagner, G. Night-Time Lights: A Global, Long Term Look at Links to Socio-Economic Trends. PLoS ONE 2017, 12, e0174610. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Wu, R.; Yang, D.; Dong, J.; Zhang, L.; Xia, F. Regional Inequality in China Based on NPP-VIIRS Night-Time Light Imagery. Remote Sens. 2018, 10, 240. [Google Scholar] [CrossRef] [Green Version]
  6. Ivan, K.; Holobâcă, I.-H.; Benedek, J.; Török, I. Potential of Night-Time Lights to Measure Regional Inequality. Remote Sens. 2019, 12, 33. [Google Scholar] [CrossRef] [Green Version]
  7. Singhal, A.; Sahu, S.; Chattopadhyay, S.; Mukherjee, A.; Bhanja, S.N. Using Night Time Lights to Find Regional Inequality in India and Its Relationship with Economic Development. PLoS ONE 2020, 15, e0241907. [Google Scholar] [CrossRef] [PubMed]
  8. Gibson, J.; Olivia, S.; Boe-Gibson, G.; Li, C. Which Night Lights Data Should We Use in Economics, and Where? J. Dev. Econ. 2021, 149, 102602. [Google Scholar] [CrossRef]
  9. Hall, O.; Bustos, M.F.A.; Olén, N.B.; Niedomysl, T. Population Centroids of the World Administrative Units from Nighttime Lights 1992–2013. Sci. Data 2019, 6, 235. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  10. Mazor, T.; Levin, N.; Possingham, H.P.; Levy, Y.; Rocchini, D.; Richardson, A.J.; Kark, S. Can Satellite-Based Night Lights Be Used for Conservation? The Case of Nesting Sea Turtles in the Mediterranean. Biol. Conserv. 2013, 159, 63–72. [Google Scholar] [CrossRef] [Green Version]
  11. Elvidge, C.D.; Ghosh, T.; Hsu, F.-C.; Zhizhin, M.; Bazilian, M. The Dimming of Lights in China during the COVID-19 Pandemic. Remote Sens. 2020, 12, 2851. [Google Scholar] [CrossRef]
  12. Ghosh, T.; Elvidge, C.D.; Hsu, F.-C.; Zhizhin, M.; Bazilian, M. The Dimming of Lights in India during the COVID-19 Pandemic. Remote Sens. 2020, 12, 3289. [Google Scholar] [CrossRef]
  13. Li, X.; Liu, S.; Jendryke, M.; Li, D.; Wu, C. Night-Time Light Dynamics during the Iraqi Civil War. Remote Sens. 2018, 10, 858. [Google Scholar] [CrossRef] [Green Version]
  14. Qiang, Y.; Huang, Q.; Xu, J. Observing Community Resilience from Space: Using Nighttime Lights to Model Economic Disturbance and Recovery Pattern in Natural Disaster. Sustain. Cities Soc. 2020, 57, 102115. [Google Scholar] [CrossRef]
  15. Geronimo, R.C.; Franklin, E.C.; Brainard, R.E.; Elvidge, C.D.; Santos, M.D.; Venegas, R.; Mora, C. Mapping Fishing Activities and Suitable Fishing Grounds Using Nighttime Satellite Images and Maximum Entropy Modelling. Remote Sens. 2018, 10, 1604. [Google Scholar] [CrossRef] [Green Version]
  16. Bos, B. Fishing under the Radar: Illuminating the Compliance Gap of Fishing Bans. 27 September 2021. Available online: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3871993 (accessed on 7 December 2021).
  17. Elvidge, C.; Zhizhin, M.; Baugh, K.; Hsu, F.-C.; Ghosh, T. Methods for Global Survey of Natural Gas Flaring from Visible Infrared Imaging Radiometer Suite Data. Energies 2015, 9, 14. [Google Scholar] [CrossRef]
  18. Baugh, K.; Elvidge, C.D.; Ghosh, T.; Ziskin, D. Development of a 2009 Stable Lights Product Using DMSP-OLS Data. In Proceedings of the Asia-Pacific Advanced Network 30, Hanoi, Vietnam, 9–13 August 2010. [Google Scholar]
  19. Elvidge, C.D.; Baugh, K.; Zhizhin, M.; Hsu, F.C.; Ghosh, T. VIIRS Night-Time Lights. Int. J. Remote Sens. 2017, 38, 5860–5879. [Google Scholar] [CrossRef]
  20. Elvidge, C.D.; Baugh, K.E.; Zhizhin, M.N.; Hsu, F.-C. Why VIIRS Data Are Superior to DMSP for Mapping Nighttime Lights. Proc. Asia Pac. Adv. Netw. 2013, 35, 62–69. [Google Scholar]
  21. Wu, Y.; Kirillov, A.; Massa, F.; Lo, W.-Y.; Girshick, R. Detectron2 Is FAIR’s Next-Generation Platform for Object Detection, Segmentation and Other Visual Recognition Tasks; Github: San Francisco, CA, USA, 2019; Available online: https://github.com/facebookresearch/detectron2 (accessed on 3 December 2021).
  22. Girshick, R.; Donahue, J.; Darrell, T.; Malik, J. Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA, 23–28 June 2014; pp. 580–587. [Google Scholar]
  23. Nechaev, D.; Zhizhin, M.; Hsu, F.C.; Poyda, A.; Ghosh, T.; Elvidge, C.D. Cross-Sensor Nighttime Lights Image Calibration for DMSP/OLS and SNPP/VIIRS with Residual U-Net. Remote Sens. 2021. accepted. [Google Scholar]
  24. Ronneberger, O.; Fischer, P.; Brox, T. U-Net: Convolutional Networks for Biomedical Image Segmentation. In Proceedings of the Medical Image Computing and Computer-Assisted Intervention—MICCAI 2015, Munich, Germany, 5–9 October 2015; Springer International Publishing: Berlin/Heidelberg, Germany, 2015; pp. 234–241. [Google Scholar]
  25. DeYoung, J.A.; Janiczek, P.M. Computer Programs for Sun and Moon Illuminance with Contingent Tables and Diagrams; Naval Observatory: Washington, DC, USA, 1987. [Google Scholar]
  26. National Center for Environmental Prediction (NCEP) Global Forecast System (GFS). Available online: https://www.nco.ncep.noaa.gov/pmb/products/gfs/ (accessed on 29 October 2021).
  27. Bright, E.A.; Rose, A.N.; Urban, M.L.; McKee, J. LandScan 2017 High-Resolution Global Population Data Set; Oak Ridge National Lab. (ORNL): Oak Ridge, TN, USA, 2018. [Google Scholar]
  28. Baker, N. Joint Polar Satellite System (JPSS) VIIRS Geolocation Algorithm Theoretical Basis Document (ATBD); Noaa Nesdis Center for Satellite Applications and Research: Greenbelt, MD, USA, 2017. Available online: https://www.star.nesdis.noaa.gov/jpss/documents/ATBD/D0001-M01-S01-004_JPSS_ATBD_VIIRS-Geolocation_A.pdf (accessed on 29 October 2021).
Figure 1. Local overpass times for the DMSP satellite series.
Figure 1. Local overpass times for the DMSP satellite series.
Remotesensing 13 05004 g001
Figure 2. Nighttime portion of orbit F15201801162050 over Asia (a) OLS visible band (0.4–1.1 µm); (b) OLS thermal band (10.5–12.6 µm).
Figure 2. Nighttime portion of orbit F15201801162050 over Asia (a) OLS visible band (0.4–1.1 µm); (b) OLS thermal band (10.5–12.6 µm).
Remotesensing 13 05004 g002
Figure 3. Nighttime portion of orbit F15201801162050 over Asia (a) OLS visible band (0.4–1.1 µm); (b) Companion flag band, with DAYTTIME shown in red and NIGHTTIME MARGINAL shown in green.
Figure 3. Nighttime portion of orbit F15201801162050 over Asia (a) OLS visible band (0.4–1.1 µm); (b) Companion flag band, with DAYTTIME shown in red and NIGHTTIME MARGINAL shown in green.
Remotesensing 13 05004 g003
Figure 4. OLS Visible Band Nighttime portion of orbit F15201801162050 over Asia. (a) Yellow lines show start and end line shown by NN; (b) Companion flag band, with DAYTTIME shown in red; and NIGHTTIME MARGINAL shown in green; yellow areas were discarded by the lines selected by the NN algorithm; blue areas show edge-of-scan data.
Figure 4. OLS Visible Band Nighttime portion of orbit F15201801162050 over Asia. (a) Yellow lines show start and end line shown by NN; (b) Companion flag band, with DAYTTIME shown in red; and NIGHTTIME MARGINAL shown in green; yellow areas were discarded by the lines selected by the NN algorithm; blue areas show edge-of-scan data.
Remotesensing 13 05004 g004
Figure 5. NCEP GFS 0.5 degree surface temperature grids used for creating the cloud-mask for orbit F15201801162050. All times are UTC. (a) 16 January 2018 18:00 model grid; (b) 16 January 2018 21:00 (3 h forecast grid of the 18:00 model run); (c) 17 January 2018 00:00 model grid.
Figure 5. NCEP GFS 0.5 degree surface temperature grids used for creating the cloud-mask for orbit F15201801162050. All times are UTC. (a) 16 January 2018 18:00 model grid; (b) 16 January 2018 21:00 (3 h forecast grid of the 18:00 model run); (c) 17 January 2018 00:00 model grid.
Remotesensing 13 05004 g005
Figure 6. The left 3 panels show the NCEP GFS 0.5 degree surface temperature grids from Figure 5 spatially mapped into the OLS orbit F15201801162050. The panel on the right shows the result of the linear interpolation between the surface temperature grids to match the scanline times for the OLS orbit F15201801162050. The OLS scanline times are shown on the vertical time axis.
Figure 6. The left 3 panels show the NCEP GFS 0.5 degree surface temperature grids from Figure 5 spatially mapped into the OLS orbit F15201801162050. The panel on the right shows the result of the linear interpolation between the surface temperature grids to match the scanline times for the OLS orbit F15201801162050. The OLS scanline times are shown on the vertical time axis.
Remotesensing 13 05004 g006
Figure 7. (a) OLS thermal band for orbit F15201801162050; (b) Surface temperature grid (spatially and temporally interpolated to match OLS orbit); (c) Temperature difference image. (d) OLS thermal band with the resultant cloud mask overlaid as blue.
Figure 7. (a) OLS thermal band for orbit F15201801162050; (b) Surface temperature grid (spatially and temporally interpolated to match OLS orbit); (c) Temperature difference image. (d) OLS thermal band with the resultant cloud mask overlaid as blue.
Remotesensing 13 05004 g007
Figure 8. Data reprojected to 30 arc-second grids, mid-swath only. (a) OLS visible band; (b) OLS thermal band. (c) Companion flag bands, CLOUDS shown in blue and NIGHTTIME MARGINAL shown in green.
Figure 8. Data reprojected to 30 arc-second grids, mid-swath only. (a) OLS visible band; (b) OLS thermal band. (c) Companion flag bands, CLOUDS shown in blue and NIGHTTIME MARGINAL shown in green.
Remotesensing 13 05004 g008
Figure 9. OLS Composite Products for F152018, showing (a) the number of cloud-free observations; (b) Average visible band observations; (c) Example of a visible band histogram of a city in Australia.
Figure 9. OLS Composite Products for F152018, showing (a) the number of cloud-free observations; (b) Average visible band observations; (c) Example of a visible band histogram of a city in Australia.
Remotesensing 13 05004 g009
Figure 10. Visible band histogram examples of (a) a grid cell containing fires; (b) a grid cell containing a small town. The outlier removal process removed the highest observations shown with vertical yellow lines in the two histogram examples.
Figure 10. Visible band histogram examples of (a) a grid cell containing fires; (b) a grid cell containing a small town. The outlier removal process removed the highest observations shown with vertical yellow lines in the two histogram examples.
Remotesensing 13 05004 g010
Figure 11. OLS composite products for F152018, showing Australia. (a) Average visible band; (b) Outlier-removed average visible band. Note that the fires have been removed in the outlier-removed composite product. OLS composite products for F152018, showing coastal waters of China and South Korea. (c) Average visible band; (d) Outlier-removed average visible band. Note that the fishing boat activity has been largely removed in the outlier-removed composite product.
Figure 11. OLS composite products for F152018, showing Australia. (a) Average visible band; (b) Outlier-removed average visible band. Note that the fires have been removed in the outlier-removed composite product. OLS composite products for F152018, showing coastal waters of China and South Korea. (c) Average visible band; (d) Outlier-removed average visible band. Note that the fishing boat activity has been largely removed in the outlier-removed composite product.
Remotesensing 13 05004 g011
Figure 12. OLS Composite products for F152018, cropped to show the area around Hanoi, Vietnam. (a) Outlier-removed average visible band showing analyst-chosen light-free regions in red, green, and yellow; (b) Stable Lights mask; (c) Stable Lights, which is the average visible band with the Stable Lights mask applied. Note that in this part of the world, there are lights from fishing boats present more than 50% of the time, and thus they become a part of the Stable Lights product.
Figure 12. OLS Composite products for F152018, cropped to show the area around Hanoi, Vietnam. (a) Outlier-removed average visible band showing analyst-chosen light-free regions in red, green, and yellow; (b) Stable Lights mask; (c) Stable Lights, which is the average visible band with the Stable Lights mask applied. Note that in this part of the world, there are lights from fishing boats present more than 50% of the time, and thus they become a part of the Stable Lights product.
Remotesensing 13 05004 g012
Figure 13. F152018 Stable Lights shown with the resampled VIIRS DNB grid of 2016 over the Florida Keys, USA. The OLS Stable Lights image is shown in red, and the resampled VIIRS DNB grid is shown in cyan. Areas of overlap between the two images are shown in white. (a) Image showing most of Florida; (b) Detail over the Florida Keys, before geographic alignment; (c) Detail over Florida Keys, after geographic alignment. The shift for this satellite-year was x = 4, y = 1.
Figure 13. F152018 Stable Lights shown with the resampled VIIRS DNB grid of 2016 over the Florida Keys, USA. The OLS Stable Lights image is shown in red, and the resampled VIIRS DNB grid is shown in cyan. Areas of overlap between the two images are shown in white. (a) Image showing most of Florida; (b) Detail over the Florida Keys, before geographic alignment; (c) Detail over Florida Keys, after geographic alignment. The shift for this satellite-year was x = 4, y = 1.
Remotesensing 13 05004 g013
Figure 14. (a) RGB image of the Persian Gulf flares, R = outlier-removed F182013, G = DVNL, B = outlier-removed F152013. Showing the transect drawn across one of the flares; (b) Profile of the DN values of the transect shown in Figure (a).
Figure 14. (a) RGB image of the Persian Gulf flares, R = outlier-removed F182013, G = DVNL, B = outlier-removed F152013. Showing the transect drawn across one of the flares; (b) Profile of the DN values of the transect shown in Figure (a).
Remotesensing 13 05004 g014
Figure 15. Intercalibration (a) DVNL 2013 against DMSP outlier-removed F152013; (b) DVNL 2013 against DMSP outlier-removed F182013.
Figure 15. Intercalibration (a) DVNL 2013 against DMSP outlier-removed F152013; (b) DVNL 2013 against DMSP outlier-removed F182013.
Remotesensing 13 05004 g015
Figure 16. F152018 Stable Lights product.
Figure 16. F152018 Stable Lights product.
Remotesensing 13 05004 g016
Figure 17. RGB Image of northern India. Points for diurnal profiles. The numbers correspond to Table 1.
Figure 17. RGB Image of northern India. Points for diurnal profiles. The numbers correspond to Table 1.
Remotesensing 13 05004 g017
Figure 18. Diurnal profiles of the 12 points.
Figure 18. Diurnal profiles of the 12 points.
Remotesensing 13 05004 g018
Table 1. Points selected for the profiles and their colors and DN values.
Table 1. Points selected for the profiles and their colors and DN values.
NumberColor7:30 PM1:30 AM4:30 AM
1Magenta9.402.6
2Red9.100.0
3Green0.030.0
4Cyan0.053.8
5Dark blue0.002.6
6Pinkish gray15.975.9
7Yellowish gray19.174.8
8Yellow13.050.0
9Cyan0.054.4
10Yellowish gray8.652.9
11Cyan0.012.7
12Cyan0.022.8
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Ghosh, T.; Baugh, K.E.; Elvidge, C.D.; Zhizhin, M.; Poyda, A.; Hsu, F.-C. Extending the DMSP Nighttime Lights Time Series beyond 2013. Remote Sens. 2021, 13, 5004. https://doi.org/10.3390/rs13245004

AMA Style

Ghosh T, Baugh KE, Elvidge CD, Zhizhin M, Poyda A, Hsu F-C. Extending the DMSP Nighttime Lights Time Series beyond 2013. Remote Sensing. 2021; 13(24):5004. https://doi.org/10.3390/rs13245004

Chicago/Turabian Style

Ghosh, Tilottama, Kimberly E. Baugh, Christopher D. Elvidge, Mikhail Zhizhin, Alexey Poyda, and Feng-Chi Hsu. 2021. "Extending the DMSP Nighttime Lights Time Series beyond 2013" Remote Sensing 13, no. 24: 5004. https://doi.org/10.3390/rs13245004

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop