Next Article in Journal
Using Stable Hydrogen and Oxygen Isotopes to Distinguish the Sources of Plant Leaf Surface Moisture in an Urban Environment
Next Article in Special Issue
Investigation of Sediment-Rich Glacial Meltwater Plumes Using a High-Resolution Multispectral Sensor Mounted on an Unmanned Aerial Vehicle
Previous Article in Journal
Subsurface Drip Lateral Line Depths to Protect against Root Intrusion
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

From Land to Sea, a Review of Hypertemporal Remote Sensing Advances to Support Ocean Surface Science

1
Department of Geography, and Environmental Research Institute, University College Cork, T12K8AF Cork, Ireland
2
Department of Geography, University College Cork, T12K8AF Cork, Ireland
3
School of Biological, Earth & Environmental Sciences, and MaREI Centre Environmental Research Institute, University College Cork, T12K8AF Cork, Ireland
4
Oceanographic Services, OSIS, Marine Institute, Rinville, H91 R673 Oranmore, Ireland
5
Department of Natural Resources, Faculty of Geo-Information Science and Earth Observation, University of Twente, 7514 AE Enschede, The Netherlands
*
Author to whom correspondence should be addressed.
Water 2019, 11(11), 2286; https://doi.org/10.3390/w11112286
Submission received: 19 September 2019 / Revised: 22 October 2019 / Accepted: 28 October 2019 / Published: 31 October 2019
(This article belongs to the Special Issue Applications of Remote Sensing to Marine Fisheries and Oceanography)

Abstract

:
Increases in the temporal frequency of satellite-derived imagery mean a greater diversity of ocean surface features can be studied, modelled, and understood. The ongoing temporal data “explosion” is a valuable resource, having prompted the development of adapted and new methodologies to extract information from hypertemporal datasets. Current suitable methodologies for use in hypertemporal ocean surface studies include using pixel-centred measurement analyses (PMA), classification analyses (CLS), and principal components analyses (PCA). These require limited prior knowledge of the system being measured. Time-series analyses (TSA) are also promising, though they require more expert knowledge which may be unavailable. Full use of this resource by ocean and fisheries researchers is restrained by limitations in knowledge on the regional to sub-regional spatiotemporal characteristics of the ocean surface. To lay the foundations for more expert, knowledge-driven research, temporal signatures and temporal baselines need to be identified and quantified in large datasets. There is an opportunity for data-driven hypertemporal methodologies. This review examines nearly 25 years of advances in exploratory hypertemporal research, and how methodologies developed for terrestrial research should be adapted when tasked towards ocean applications. It highlights research gaps which impede methodology transfer, and suggests achievable research areas to be addressed as short-term priorities.

1. Introduction

Single-date and multi-date remote sensing imagery are widely used in support of oceanographic and fisheries research and monitoring. With increases in the temporal frequency of imagery, a greater diversity of ocean surface features which shape fisheries can be studied, modelled, and understood in terms of their development over time. The advent of the hypertemporal image resource allows researchers to analyse vastly more information-rich datasets (Figure 1). These contain very detailed information on spatially extensive and temporally variable areas, enabling studies to capture the full lifecycle of fast-moving ocean surface features such as eddies, current deviations, and the impacts of wind-driven mixing in surface waters. In 1995, Piwowar and LeDrew [1] noted that the remote sensing community was on the brink of a “temporal data explosion”, as the archive length for some global remote sensing data rapidly approached the 30-year mark deemed necessary to establish climate norms. Over twenty years later, the era of Big Data has arrived [2]. We are currently in the midst of the envisaged explosion. Global datasets at near-daily resolutions are now established (Table 1) and the range of measured parameters is diversifying, which could be invaluable for monitoring the structure and functioning of Earth systems. These are at spatial and temporal resolutions which would have been inconceivable 25 years ago, with climatologically relevant temporal extents. While a large body of work exists on the terrestrial application of these temporally long and dense time series of remotely sensed datasets, ocean applications have received less attention.
Hypertemporal data are essentially multitemporal data, collected with a very fine temporal resolution (Figure 2). Piwowar and LeDrew [1] were amongst the first published authors to use the term hypertemporal (also referred to as “hyper-temporal”, or “high temporal resolution”) with respect to satellite remote sensing data (hereafter referred to as Earth Observation, or EO, data). They also highlighted the need for new hypertemporal image analysis approaches to process temporal signals in these datasets in a spatially coherent manner. Such approaches could include novel techniques and algorithms, but also draw upon the pool of existing methods, adapted for use on large, temporally orientated datasets (see Figure 2). Despite their efforts and the increasingly frequent reference to hypertemporal data in the scientific literature, the term is still somewhat ill-defined. Jakubaukas et al. [7] noted a dataset which may require hypertemporal analysis can contain upwards of several dozen to several hundred successive digital images, echoing Piwowar and LeDrew’s [1] sentiments. Drawing on an analogy of hyperspectral data, it is essential to consider the characteristics of what makes such data hyperspectral as opposed to multispectral. Hyperspectral digital images are spectrally overdetermined with more data points than are realistically needed [8] for an analysis. Whilst they feature a high degree of data redundancy, and potential information duplication, this characteristic provides ample spectral information to identify and distinguish between spectrally similar, but unique materials. Echoing the interpretation of hyperspectral, Kleynhans [9] provides useful guidance on the term hypertemporal, interpreting it to mean “highly sampled”, taken at regular, constant intervals, usually a few (8–30) days apart. They specifically highlight the importance of “frequent, equal spaced observations”.
It is the temporal density (number and frequency) of repeated measurements, as well as the character of measurements in relation to each other, which qualify data as hypertemporal. While sensors can measure hundreds of bands, it is the narrowness and contiguous nature of the band measurements that make them hyperspectral [8]. For hypertemporal images to be useful, the data need to be consistent from time-slice image to image [10], just as internal image consistency is often assumed in the analysis of multispectral images [11]. Regarding hypertemporal data, each estimate of a parameter is essentially a point measurement in time, acquired over a maximum of a second, with the contiguous nature established by the revisit period of the satellite platform. This review only considers satellite-derived hypertemporal data conforming to the stipulations outlined by Piwowar et al. [12]. Specifically, the input data analysed in a study must:
  • Be univariate in nature (with multiple images of the same parameter only);
  • Contain a set of time slices, all of which must be precisely co-registered (with image-to-image pixels perfectly aligned spatially); and
  • Exhibit radiometric consistency between images (i.e., they are measured using the same sensors or inter-validated sensor systems, and exhibit a degree of normalisation between time slices).
Since 1995, a diverse range of applications have been developed which involved extracting meaningful information from hypertemporal data. These include landcover mapping [10,13], landuse mapping [14], change detection [15,16,17,18], ecosystem structure and species modelling [19,20,21,22,23], phenology mapping [24,25,26], gradient analysis [27,28,29], and data quality assessment [30]. To date, a limited range of ocean-focused hypertemporal studies have been conducted (Figure 3), hampered by validation challenges and limited knowledge on the partitioning of temporal patterns over the ocean’s surface. Hypertemporal altimeter data have been used to study eddy propagation routes and velocities [31]. Work on sea ice has exploited hypertemporal microwave-derived sea ice concentration data acquired over Arctic seas [32]. A range of different approaches have been trialled, overcoming both technical and theoretical challenges whilst doing so [12,31,32,33]. It is recognised that the research community are not fully exploiting the information content of satellite observations [34]. New theoretical frameworks are required to better exploit high-resolution information from satellite data. This review explores the limited oceanic work which has been done, and highlights the potential to build upon the more extensive terrestrial experience available. It suggests priority areas of research to catalyse the use of hypertemporal datasets of satellite-derived parameters in future oceanic work.

2. Challenges and Opportunities for Hypertemporal Remote Sensing

The Earth’s ocean, covering approximately 71% of the planet’s surface [35], is a challenging and expensive area from which to secure in situ measurements at a high spatial and/or temporal resolution. Detailed information on the spatiotemporal characteristics of the ocean surface, therefore, are rare in comparison to those found on the terrestrial realm. One can simply compare the range of data sites and species which are available in terrestrial phenological databases such as the USA National Phenology Network database [36], the Pan-European Phenology database [37], or the Chinese Phenological Observation Network [38], with the lack of an oceanic equivalent, to understand the scale of the observation issue. In the absence of ground-based networks of in situ data, validation of satellite image products remains a significant challenge that marine spatiotemporal studies have yet to adequately address.
Nevertheless, the need for a better understanding of the spatial and temporal variability of ocean surface characteristics prevails. Certain locations at the ocean surface do exhibit prominent changes in biological productivity on a seasonal basis (e.g., [33,39,40]). Others can exhibit large inter-annual variations (e.g., [40,41]), with seasonalities often noted as being multi-modal (e.g., [41,42]). These fluctuations can vary spatially and temporally between years and over seasons. For example, dust transport and deposition can drive high spatiotemporal variability in ocean productivity and surface processes [43,44]. The situation is further complicated by the mobility of the ocean’s surface, where mesoscale features such as eddies can move over 4 km per day [31]. With respect to hypertemporal datasets, this high mobility can be recorded across a number of pixels’ seasonal signals, and can be expressed within and between different parameters. This presents opportunities to examine, and use, the characteristic internal variability of hypertemporal datasets. For example, variables that characterise the heterogeneity of a dataset can facilitate applications in support of ocean surface partitioning [45], defining habitat boundaries as done for terrestrial vegetation by Ali et al. [46]. They could also complement existing studies which compare species distributions to satellite-derived front locations (e.g., [47,48]).
The long-term satellite image archives now approaching, and in some cases exceeding, 30 years, also provide opportunities. Environmental normals and trends in ocean surface processes, related to hemispheric teleconnections and climatic changes, can be identified and quantified (e.g., [49,50]). Given their univariate and continuous nature, hypertemporal datasets are particularly well suited to providing a statistically robust record. They also represent an opportunity to explore the impacts of fine-scale temporal and spatial fluctuations in surface waters and their oceanographic and biogeographical implications, at various spatial and temporal scales, and timeframes. Maximising the potential of ocean hypertemporal remote sensing requires either (i) an extensive and comprehensive collection of in-situ data and knowledge, or (ii) the adoption of data-driven approaches to generate a library of such signals. When combined with existing in-situ datasets, temporal signal libraries would provide an important resource to support future work. The techniques discussed within this paper are not an exhaustive list, but do represent some suggested approaches to addressing these and other application opportunities using hypertemporal satellite imagery.

3. Avenues to Extract Information from Hypertemporal Earth Observation Datasets

There has been over 20 years of progress in developing and adapting methodologies for hypertemporal data applications. Hypertemporal researchers often use composite methodologies (see Table 2 and Figure 3). Well-established methods are combined with novel components to extract meaningful information (new data) from oversampled, noise-rich datasets of the Earth’s surface conditions. This makes conducting a methodological review to assist in the development of ocean science applications quite challenging. However, Piwowar and LeDrew [1] suggest three primary avenues of methodology development (Table 2), namely, principal components analysis (PCA), classification (CLS), and time-series analysis (TSA). They note these primary methodologies would be useful for exploring the temporal nature of a hypertemporal dataset [1]. A fourth approach also needs to be added to this primary set, this being the pixel-centred measurement and summary analysis of measurement values (PMA). Whilst very few studies deploy these methodologies in isolation, these four primary approaches should be strongly considered for ocean studies using hypertemporal datasets in the short (5 year) to medium term (10-year). At this stage, the methodologies trialled are exploratory in nature. Each approach noted here has its caveats and drawbacks, as well as its successes. These advances, predominantly in the terrestrial arena, do provide analysts and researchers with a range of options to apply to ocean studies. They are presented here to highlight progress, promote discussion, and encourage others to seek novel methodologies in alternative thematics (such as the meteorological arena). General cautions are highlighted, with the onus being on the reader to determine the more study-specific critiques when considering a methodology to adapt for their particular ocean study.

3.1. Pixel-Centred Measurement and Summary Analysis (PMA)

The simplest approach uses either the raw measurements contained in each pixel or everyday statistical measures (mean and standard deviation) to highlight key features of the time series. This can involve the use of thresholds, or exploit summarising the variability into relatively simple and meaningful values (see Figure 4). For example, Okkonen et al. [31] extracted measurements of sea surface height anomalies and geostrophic velocity from hypertemporal altimeter data. Using these anomaly measures, timing, and latitude location, they were able to identify eddy propagation characteristics, charting the routes along which the various propagation velocities occurred. In some cases, it is appropriate to summarise key periods or intervals of the time series. For example, Piwowar [49] determined a 22-year environmental normal of vegetation vigour from NDVI (normalised difference vegetation index—a satellite-derived measure of terrestrial photosynthetic activity) data. This approach can be extended by doing a trend analysis on statistical summaries of different periods. This was demonstrated by Wessels et al. [59] in detecting land surface degradation over the course of a 13-season period captured in an NDVI dataset.
As output products, the statistical summaries are useful (e.g., [31]), and can be analysed further (as shown by Piwowar [49]). Furthermore, studies in species modelling have demonstrated they can also be combined with data from other sources (e.g., [21,60,61]). However, relative to the potential of higher-order processing, raw hypertemporal measurement values or foundational statistical summaries are of limited use. Studies have demonstrated the utility of exploring more computationally intensive approaches. For example, Kleynhans et al. [62] demonstrated how an autocorrelation-function-based method outperformed an NDVI differencing method [63] when used for change detection. Research has demonstrated the weaknesses of using raw values in examining gradual landcover change, showing that more sensitive analytical procedures were required to cope with weather impacts on the data and trends within the data [59]. Meanwhile, others have shown how statistical summaries of raw values can often incorporate pixel values afflicted by long-term cloud contamination [30]. This is a particular concern when using measurements derived from the optical sensors, and is a driver for the adoption of higher order, noise reducing methodologies. For example, Pittiglio et al. [21] had to use an adapted Savitzky–Golay filter (a form of time series analysis) to model their NDVI time series, producing inputs for a model on elephant seasonal presence. This was an effort to reduce noise from missing values and cloud contamination of their optical-based imagery. Whilst this did introduce a potential subjective influence into the data through the Savitzky–Golay modelling, it did enable them to overcome the cloud contamination issue. This highlights the potential to move beyond raw data, and the use of simple statistical summaries. However, in spite of the limitation associated with using foundational statistical summaries, it is critical to note that they do form the basis of higher-level processing approaches. These seek to extract and use the patterns inherent in the hypertemporal datasets, reduce the data volume, and highlight logical features of the spatiotemporal signals within.

3.2. Principal Components Analysis (PCA)-Founded Approaches

Principal components analysis [53,64,65] has proven to be a useful tool to analyse the interrelationships between the highly sampled data within hypertemporal datasets. Typically used as a data compression tool, this data-driven approach undertakes a linear transformation on a set of image bands to create a new band set. This is composed of uncorrelated images, ordered in terms of the amount of dataset variance explained [64], and representing the majority of the information presented in the original time series [53,66]. It can effectively concentrate information from many correlated image datasets into a few uncorrelated principal components [65], highlighting the strongest spatial and temporal signals [53]. The first component captures the characteristic value of that variable within a pixel time series, whilst the second and all remaining standardised components represent change elements of successively decreasing magnitude [64]. Higher-order components thus define more spatially and temporally localised anomalies although they are representative of less “information” from the source data and more noise [53]. The technique has featured in a range of hypertemporal studies focusing on sea ice [1,53], snow cover [66], vegetation studies [67,68], and investigating hypertemporal dataset consistency when derived from multiple sensor sources [69].
In isolation, the components are not very useful, but must be compared and contrasted with other data derivatives to provide meaningful interpretations [54]. For example, Derksen et al. [66] clearly outline how the PCA component eigenvalue (λ) and eigenvector (α) can be used to calculate component loadings for each time slice. A positive loading indicates similarity between the component and the time-slice image, whilst a negative loading indicates dissimilarity. This composite PCA-loadings-plot analysis method highlights not only where important patterns are occurring, but also identifies when they are most prominent, whereby a detailed search for causative factors is done. Eastman and Fulk [64] first used a precursor of the method (which they termed “correlation analysis”) on a multitemporal dataset of African vegetation. In less computationally complex approaches, further analysis involves extensive literature surveying for explanatory factors (e.g., [64,70]). However, inputting derived components into further analyses can more rigorously draw out patterns and provide explanations. For example, many studies have examined a spatial pattern’s temporal persistence over years through examining the time-series plot of loadings [66,69,71]. Piwowar and Derksen [53] retrieved the most significant spatial and temporal patterns, then examined the links between the extracted patterns and atmospheric conditions. LeDrew [32] took the outputs from a PCA into a wavelet analysis and subsequent correlations analysis, examining process linkages such as the role of the Arctic Oscillation in forcing of sea ice concentration. Another study by Piwowar [50] took advantage of PCA’s capability to minimise inter-band correlation strengths, using the first ten components to inform the development of a refined pixel purity index (adapted from [72]) to aid in temporally un-mixing time series of sea ice data. Meanwhile, Udelhoven et al. [68] demonstrated how PCA could not only produce reduced data for further analysis, but could also receive refined data in the form of time-series profiles smoothed using a Savitzky–Golay filter. They then input selected output components into subsequent decision fusion classifications.
Of all the potential hypertemporal analysis procedures, PCA is particularly well suited to the task of identifying significant anomaly patterns in EO imagery over long time periods [53]. However, the derived principal components are aggregated patterns, and although statistically meaningful, there is no guarantee that the patterns are physically meaningful unless there is extensive visual validation [26]. Loadings analysis can delve deeper and locate a time slice to which the component is statistically similar. This enables the user to refine their search for causative factors to a specific timeframe. However, any such search is therefore founded on the limiting assumption that the spatial patterns in each component are the product of a single factor, isolated from positive or negative feedback interactions between factors. Furthermore, in PCA, a spatiotemporal feature which has a low-magnitude signal, yet is highly prevalent spatially, will dominate the initial components extracted. Signals with a high magnitude, though low spatial prevalence, may feature in later, higher-order components (Figure 5). These may be the signals arising from small but highly important regional features (such as coastal upwellings) or temporary mesoscale features (such as eddies). With PCA, such features may be missed by methodologies which assume higher-order components are of little importance. When the features of interest are mobile over time, such as with mesoscale eddies, this is further complicated. As an eddy’s influence moves through the dataset, it has an impact on different pixels at different times, reducing the overall influence on the pixel time series.
Figure 5 shows one such suspected eddy whose lifecycle is clearly identifiable in terms of the surface feature’s genesis and conclusion from June to August. When displayed with contoured component images following a PCA of the year-long hypertemporal dataset containing the June to August imagery, the challenges of using PCA to study these features are exposed. In terms of sea surface current data, it is a readily identifiable structure on 2 July, appearing as a ring of surface waters moving at relatively higher speeds. However, this appearance is minimal within the hypertemporal dataset. Despite eddy structures being visible throughout the time-series of imagery, their influence is restricted both spatially and temporally, when and where they occur. This has the effect of relegating their appearance in PCA images to those of higher orders. Furthermore, expressed as sea surface current speeds, the structure’s surface expression is composed of both high and low speed areas. When they are accounted for, these variations in speed will be isolated in different components. These are theoretically uncorrelated, demonstrating PCA’s inability to coherently capture ocean surface features resulting from a synergy of factors. These spatiotemporal limitations are complicated further by the nature of a PCA (and other hypertemporal methodologies such as CLS and PMA) with regard to removing the order, provided by the unidirectional nature of time, from a hypertemporal dataset. In removing any sequencing in a time-series’ temporal progression, PCA’s ability to exploit this is effectively curtailed [73]. This renders PCA as being an incomplete method in terms of fully exploiting the spatiotemporal potential of a hypertemporal image dataset, requiring its use as part of a composite process. Components cannot be used in isolation, but are combined with complementary analyses (such as a loadings plot analysis) of the data to derive more complete information extraction. Meanwhile, its utility is severely limited for studying mesoscale features such as eddies without significant adaptation and consideration of the input dataset specifications. Features of interest should first be identified using other means, before narrowing the spatial and temporal scope of the dataset to ensure the influence of the feature is magnified for the PCA to enhance.

3.3. Classification (CLS)-Founded Approaches

Classification involves assigning discrete units (pixels) to single thematic units [74]. Pixels are classified or grouped on the basis of their multivariable statistical properties, or by segmentation based on both statistics or discernible spatial relationships [65]. Analogous to hyperspectral classification, hypertemporal classification uses the pixel’s temporal signature. There is a general hierarchy of classification methods, the broadest division being supervised or unsupervised. Supervised classification generally depends on previous knowledge of a study area, acquired by external sources or field work [65,74]. Groups are defined using pixel summary statistics or identified characteristics of training areas representing different objects on the Earth’s surface, selected subjectively by users on the basis of their own a-priori knowledge or experience [65]. Unsupervised classification (clustering) approaches identify natural groupings or clusters entirely on the basis of the whole dataset distribution’s statistics. This produces an image of statistical clusters for later characterisation a posteriori, by examining their contained area and applying the users knowledge and experience [65,75].
For terrestrial-focused studies, it is possible to collect information on the region’s temporal characteristics. Sufficient in-situ data, or expert knowledge can be acquired or collected to drive supervised approaches. In comparison, in-situ data or expertise providing a comparable level of knowledge of the ocean surface’s temporal characteristics are few and far between. Furthermore, collection of such datasets can only be achieved at a comparatively high cost, and high risk. This limits the spatial and temporal coverage of data needed to maximise hypertemporal data exploitation. Hypertemporal datasets are also very data rich [57]. Due to the number of bands in the feature space, visual pattern recognition of training groupings is hardly feasible, further limiting our ability to undertake supervised classification studies. If conducting a supervised classification on a hypertemporal ocean dataset, a researcher must effectively identify enough sample temporal training profiles to adequately capture the diversity of the region of interest. This needs to be done with limited, if any, in situ knowledge of the surface situation and history, in an environment in which it is often prohibitively expensive to collect the required data. Faced with such expensive and often insurmountable challenges in obtaining the data or expert knowledge needed to conduct expert-driven classification approaches, researchers must currently focus, initially, on more unsupervised (clustering) approaches. These data-driven approaches demand no a-priori knowledge of the study area [74,75], and are more appropriate at this stage and time for ocean studies. Focusing on describing ocean regions with their temporal characteristics, and clarifying what they represent, would enable subsequent research to exploit more targeted supervised approaches. Research using unsupervised methodologies, or adapted methodologies, has included the use of ISODATA clustering [13,20,28,30], k-means clustering [49,55,76], minimum error [77], maximum likelihood [78], Ward’s method [55], and expectation maximisation [55]. k-means and ISODATA clustering are by far the more commonly used approaches.
Both k-means and ISODATA are iterative procedures, first assigning arbitrary initial cluster vectors, then classifying each pixel to the closest vector, calculating new cluster means, and then iteratively repeating the cycle until the change between iterations is deemed to be small. With k-means, the number of clusters remains static throughout, whilst ISODATA allows for a cluster to be split into two, and two clusters to be merged on a threshold basis [79,80]. Examples of hypertemporal k-means studies are somewhat limited in number. Piwowar [49] used a hypertemporal k-means classification of NDVI data to define and characterise terrestrial phenoregions. Others input time-series state vectors extracted from a hypertemporal dataset into 2-class k-means clustering [76], demonstrating the potential for an entirely unsupervised change detection approach using hypertemporal data. k-means clustering has also been used as a benchmark against more advanced supervised terrestrial change detection algorithms [55].
A more adaptive method of clustering is the ISODATA (iterative self-organising data analysis) technique. First proposed for hypertemporal research by de Bie et al. [13], subsequent years have seen refinements and tests of the algorithm’s use and modes of deployment on a number of different landcover [10,13,56,81] and species modelling applications [20,23]. A primary concern regarding unsupervised classification is the lack of knowledge beforehand of how many clusters best represent and capture the variability in the hypertemporal dataset [57]. The more clusters the dataset is divided into, the better the fit to the data. However, beyond an optimal cluster number, each additional cluster does not explain a meaningful amount of the variability. This is potentially addressed by taking an ensemble approach to ISODATA classification, using separability (divergence) statistics analysis and identification of coincident peaks to guide identification of this number [28,30]. Throughout its development, this divergence-guided ISODATA clustering approach has not always adhered to the coincident peak rule (e.g., [10,56]), remaining subjective at a key juncture—the analysis of the divergence statistics. There are often experience-driven assessments of a significant peak in average divergence denoted cluster number selection. For ocean deployment, the approach would need to be completely objective, indicating that a high number of cluster outputs may be required (e.g., potentially up to 200 clusters as run by Girma et al. [20]), whilst peaks must be identified using an entirely automated approach. Such an advance would effectively enable ocean researchers to circumvent the in-situ data gap and build the needed a-priori knowledge for more supervised efforts to be undertaken. Automation of this algorithm for ocean use could open some interesting avenues for ocean studies. For example, de Bie et al. [57] integrated the divergence-guided ISODATA clustering algorithm into their novel land heterogeneity mapping (LaHMa) algorithm for quantifying landscape heterogeneity—the variation of a landscape property across space and time [22,82]. This was later used as a basis for investigating landcover gradients underpinning the Cretan landscape [46]. They used the accompanying optimal cluster map to determine a stratified sampling strategy for collecting complementary in-situ data. For ocean sciences the benefits would be twofold. Firstly, stratifying sampling regimes offers cost efficiencies by providing data-driven guidance for sampling transects. Secondly, with sufficient characterisation of surface waters at various scales, it could become feasible to deploy more supervised approaches for which example deployments are evidenced in the terrestrial realm. Possible methodologies could include the use of artificial neural networks [83,84,85] and decision tree classifiers [26] on hypertemporal datasets, or more likely, hypertemporal dataset derivatives. Furthermore, categorisation of the ocean’s surface into regions exhibiting different temporal profiles could provide opportunities for these profiles to be examined and explored. Terrestrially, this has been demonstrated for deriving regionalised crop calendar information [10], and to determine heterogeneous and relatively homogenous regions before investigating their sub-regional surface characteristics [46]. Being able to determine regions of relatively homogeneous temporal behaviour could also aid in characterising regional time-series, enabling an expanded range of methodologies which rely on expert knowledge for their use.
However, unsupervised CLS algorithms tend to use statistical summaries of the temporal profiles which remove the unidirectional nature of time to underpin the clustering process. Whilst this benefits studies which focus on locating extreme conditions, similar to PCA, the approaches inform on what is occurring in the dataset, but not when it occurs (Figure 6). The ordering of temporal data provided by the unidirectional nature of time remains underexploited. With PCA, an analysis of temporal loadings can provide some insights into when certain component features are most expressed. However, the underlying assumption that each component is the product of a single factor weakens the strength of using this. Furthermore, the analyst must be extremely cautious when using multi-annual time-series of data, staying highly aware of the potential impact of surface changes on their data. Terrestrially, such changes may be the product of landcover or even landuse changes. However, with regard to the ocean surface, long-term gradual changes due to climate change, or even short-term subsurface perturbations such as undersea volcanic activities, can change the signals recorded in ocean parameter measurements between years. This can affect the clarity of the classifications obtained and the accuracy of their interpretation. To address the when, one possible avenue involves using sliding windows [55] to analyse sequential subsections or subsection extracts of the temporal profile. These subsets can then form inputs for classification and applications such as change detection [55], building the connection between what and when. With hypertemporal datasets, this would magnify the computing power required significantly and, thereby, the cost of undertaking such analyses. Alternatively, research can focus on the use of time series analysis to examine the patterns which occur within a hypertemporal dataset and determine when they are expressed.

3.4. Time Series Analysis (TSA)-Founded Approaches

Time series analysis, the procedure of fitting a model to a given time-series [86], forces a critical evaluation of the temporal data to be examined based on a sound understanding of the phenomena being modelled, an appreciation of the mathematical attributes, and limitations of the models being considered [87]. TSA has three principal objectives [88]: (i) description of the various statistical inputs to the time series, (ii) explanation of the mechanisms which generate the series, and (iii) prediction, which can only be made after (i) and (ii) have been satisfied. It is in the synthesis of the three objectives of TSA that the real power of the process is realised [88]. TSA modelling is a manual process, with the researcher heuristically evaluating the model using graphical displays of summary statistics at each step in the modelling process. The residual series (modelled values—observed) is then analysed by the researcher to determine any remaining autocorrelation/trends not adequately described by the model [86,89]. In this way, the researcher is enabled to learn about the temporal characteristics of their data in a hands-on manner. Studies have demonstrated a range of TSA applications to hypertemporal datasets, including trend analyses [27,90], characterising productivity pulses and drivers [33], mapping phenological variation [24,25,39,91], characterising features of the Earth’s surface [29,92], studying species movement behaviour and migration [93,94], and identifying temporal characterisations for species distribution models [20,95].
With a TSA, the researcher attempts to explain and characterise the occurrence of observed temporal phenomena [96]. When properly constructed, TSA can be useful to identify other temporal sequences of the same process (e.g., [86,89]). Modelling the pixel time-series correctly is an essential part of TSA to which a number of different modelling approaches have been applied, including autoregressive moving average (ARMA) models [88,97,98], Gaussian models [25], adaptive Savitzky–Golay filter [23,28,30,94], Fourier transformation-based approaches [7,90,92,99], and extended Kalman filter approaches [54,100].
Approaches such as ARMA modelling or Savitzky–Golay filtering involve fitting functions to a time-series of data points, and replacing the original values with values predicted by the functions. This increases the signal-to-noise ratio of the temporal data [101,102]. They have been shown to be highly useful when studying landcover seasonality and phenology [25,98], extracting information on sea ice seasonality [88,89] and producing smooth, gap-free data for further processing [28]. Whilst the strengths of these approaches are well documented, their applicability to ocean studies are limited firstly by their weakness in requiring a-priori knowledge to guide model training. For example, the results of an ARMA model deployment on hypertemporal sea ice data directly challenged the assumptions of many previous studies, and in doing so, provided a deeper understanding of the cryospheric processes in the Arctic [86]. However, the study noted that modelling would not be possible without a sound understanding of the processes underpinning the system being modelled. Model refinement depends strongly on the initial time-series being sampled to inform refinement, and the ARMA development process is highly manual. This manual and subjective nature of TSA also features in the Gaussian [25] and Savitzky–Golay [28] approaches. The extraction of metrics (such as the start of season date) is also highly subjective, requiring the selection of arbitrary thresholds [25]. Whilst applicable to ocean studies, they face the same challenges of requiring a pre-existing understanding of system processes, and with caution being taken when sampling initial time-series for defining the function.
Secondly, TSA produces modelled data from which metrics or input images for further analyses are derived. Hypertemporal datasets are univariate. It is rare to find researchers processing raw band data (for exceptions see [16,17]). The datasets processed are usually parameter estimates such as sea ice concentration estimates, or estimates of photosynthetic activity. These are derived from the raw measurements of electromagnetic radiation, which have been processed to correct for potential atmospheric interference on the basis of models. Whilst this does allow researchers to study surface phenomena, the more original data (with more limited model influence) is purer, with less introduced model uncertainties. A critical evaluation of the reduced-noise signal is advisable within the context of model uncertainty propagation and determining the validity of the TSA-modelled outputs.
Some TSA methods do enable the temporal nature of the time-series to be studied in a more data-driven manner. Fast Fourier transformation (FFT) is noted as an effective and computationally efficient algorithm to compute discrete Fourier transforms [103], and has been used when evaluating NDVI time-series data [104]. Fourier analysis has been used on hypertemporal NDVI data [7], highlighting that it can be extremely useful for identifying and isolating modes of data variability. Fourier analyses produce a phase and amplitude dataset for each identified harmonic in the signal, determining the dominant harmonics to carry forward. For example, the dominant harmonics have successfully been put into harmonic analysis of time-series (HANTS) analysis [20,105]. However, it has been noted that Fourier analysis works better on longer time-series [99] as it makes the assumption that the input signals are infinitely long [106]. This is somewhat unrealistic given that processed time-series are of finite length. Furthermore, applying fast Fourier transforms to studies involving terrestrial change detection assumes that the underlying process is stationary [107]. This has implications for any ocean study looking for change, or where the temporal processes featured in the area of interest are in doubt (experiencing a change over the time period in question), or where the processes may be more interannually elastic than is currently understood. An extended Kalman filter (EKF) approach has been proposed to detecting nonstationary events in time-series [108]. Indeed, Kleynhans et al. [108] reported on the comparison of the EKF-based feature extraction method with the FFT-based feature extraction method, finding optimised change detections using the EKF-based approach. Whereas Fourier could be deployed to explore patterns deemed to be stationary over time, EKF, by contrast, was developed specifically for the purpose of change detection in time.
A further potential avenue involves the use of hidden Markov models (HMM), to examine parameter dynamics. A HMM-based approach has been used to analyse vegetation dynamics at large scales [109], using a hypertemporal dataset of land-surface photosynthetic activity (measured using NDVI). Viovy and Saint [109] described not only the process of applying a HMM to hypertemporal data, but also the complexities involved. The HMM model must be trained, directed by a-priori external knowledge of the surface being examined. In this case, HMM definition required knowledge of (i) where savannah landcover existed, (ii) expert knowledge of what characteristic features of the temporal profile represent (such as seasonal characteristics of savannah vegetation), and (iii) information extracted using a classification approach to extract usable time series for interpreting and training the HMM. For ocean surface studies to exploit HMM-based avenues, knowledge of a study region’s temporal diversity is needed to provide the state probability inputs that HMMs require. This need for training remains evident in more recent HMM applications which use hypertemporal datasets, such as a study by [110] looking at the potential for HMMs to be used on hypertemporal MODIS datasets for continuous change detection.
Temporal mixture analysis (TMA), whilst not strictly a TSA method, shares many similarities with the Fourier analysis approach. An adaptation of spectral mixture analysis, this approach has been used to study the temporal characteristics of sea ice concentration [111]. The focus of TMA is (i) the extraction of temporal end-members—pure examples of temporal signals that contribute to some degree to all pixels in a hypertemporal dataset, and (ii) the determination of the magnitude to which those end-members contribute to each pixel’s temporal signal. End-members refer to extreme, not average, conditions [12], and can be used to define a baseline of temporal variability, or an environmental normal [50]. However, the selection of end-members can be somewhat subjective and can miss important contributory end-members. Efforts throughout the work by Piwowar et al. [12,50,111] document the challenges faced in obtaining end-members in a more unsupervised manner, before applying a data-driven pixel purity index approach to mask unsuitable end-member pixels [72].
Concerning TSA modelling, there are two principal limitations to consider for ocean studies. The first concerns model specifications and accounting for multi-modal seasonality in the ocean surface data. In agricultural systems, satellite-derived time-series often feature multi-modal seasonality (e.g., [10,99], Figure 7). The same is true of natural ocean surface waters. Ji et al. [33] highlighted the presence of bi-annual pulses in primary production in some Arctic waters. This would be expressed in any time-series of satellite-derived photosynthetic activity measurements, and could also feature in any time series analysis of potential contributory factors (such as sea surface temperature or sea state). Similarly, the bi-modality of the Columbia River plume [42] would influence any seasonality in physical measurements of coastal waters acquired in the nearby vicinity, and could drastically affect the accuracy of the model fit. The second limitation concerns the subjectivity of TSA. There have been welcome advances in TSA methods with regard reducing subjectivity in the TSA process (e.g., progress by Piwowar et al. [12,50,111] in determining the purest possible temporal signals). However, in terms of minimising user-interaction and subjectivity, TSA is not yet at the same level of development as PCA or classification.
Where the harmonics extracted by TSA align with an annual cycle, phenological studies of the timing of recurring biological events, the abiotic and biotic drivers of their timing, and the interrelation amongst phases of the same or different species are possible [113]. Justice et al. [114] have illustrated the potential for remote sensing datasets to support investigating vegetation phenology. Subsequent hypertemporal studies demonstrate applications to crop research [10,56], investigations into more natural systems on both land [24] and in the ocean [39], and research into the timing of abiotic events [26]. Satellite-derived phenology metrics characterising the seasonal profile of the hypertemporal time-series, or wider harmonic descriptors (known as “state vectors”), can be used for direct visualisation and analysis [25,93]. They can also be delivered as inputs for further processing [20,26,90,99,115]. The “smoothed time series” itself can also be input into subsequent analyses [28], or characterised further with sequential measures [116,117]. Whilst these higher processing efforts are novel and welcome, the products are modelled data. Researchers must remain conscious that modelling assumptions and subjectivity applied in TSA steps will carry onwards into the post-processing. This is of particular relevance given the potential for the sheer data volume to obscure more subtle influences. Furthermore, for ocean studies interpreting or using derived metrics or harmonics, the user must remain conscious of the validation issues facing temporal ocean studies and the modelling of specification constraints.
In summary, hypertemporal TSA are potentially applicable to any environmental image datasets which meet hypertemporal criteria [88] and can produce highly relevant conclusions to shape understanding of Earth surface processes [86]. When sufficient knowledge of an ocean system is known, the application of TSA can be highly beneficial, as is the case with the range of TSA and TMA studies conducted on Arctic waters. However, TSA does have some limitations which must be considered before use in ocean studies, and which may propagate through further processing chains. The selection of suitable models to fit the time-series data as well as appropriate time-series subsamples to shape these models feature as the strongest caution regarding TSA application to hypertemporal ocean studies. This is due to a scarcity of in-situ information on the nature of the ocean surface. The range of Arctic studies does highlight the utility of not restricting analyses to a single approach. It demonstrates the potential for conducting multifaceted studies into even a single time-series to discern patterns in the data, and ultimately obtain clarity on the region’s spatiotemporal characteristics which are recorded within. An examination of Figure 3 epitomises this, with later TSA studies being composed of multiple methodologies, demonstrating the range of research work achievable by better expert knowledge. In doing so, it hints at the oceanographic knowledge potential which would be unlocked if hypertemporal studies first focused on addressing the knowledge gap on the temporal diversity of the ocean surface.

4. Adopting a Strategic Approach for Future Advances

The ability of hypertemporal methodologies to assume a temporal logic makes them quite transferable (with relatively minimal adaptation) to novel time-series datasets (Figure 2). Methodologies developed for land applications may be suitable for use in hypertemporal ocean studies after considering the limitations of each method, and adapting them accordingly. Though advances in both terrestrial and ocean arenas remain very much exploratory, efforts have generated a pool of methods which can be built upon by ocean researchers. Some, such as PCA and CLS, are more readily usable with minimal adaptation. Others, such as TSA, highlight the potential for research once the foundations of expert knowledge are established for the study regions. The approach (methodology blend) taken will depend on the information required. However, for the short- to medium-term, this review highlights three primary considerations to guide studies being undertaken and to ensure best practice in hypertemporal ocean studies. Namely, studies should focus on:
  • Prioritising data-driven approaches;
  • Quantifying temporal signature diversity and ocean surface heterogeneity; and
  • Exploiting the unidirectional nature of time.
These should be integrated into a strategic approach to hypertemporal methodology development and use on ocean surface datasets.

4.1. Prioritising Data-Driven Approaches

There is limited information on the mapped temporal diversity of the ocean surface and regional differences. Supervised approaches require not only an expert awareness of the ocean region being captured by the sensor with each acquisition but also an understanding of region-specific spatiotemporal variability. Given the challenges faced collecting in-situ oceanographic data, the application of data-driven approaches should be prioritised in the short (1–5 year) term. This should enable the oceanographic and hypertemporal EO communities to determine what spatiotemporal patterns are evident in the data, or at least indicate the diversity of patterns being expressed in the region. Clarification of this is advisable before proceeding to more expert-knowledge-driven (a priori), supervised and user-interactive approaches.

4.2. Quantifying Temporal Signal Diversity and Ocean Surface Heterogeneity

With the limited existing in-situ data available, hypertemporal studies need to be strategic in their planning and execution. A primary barrier to exploiting EO datasets is the dearth of knowledge regarding temporal signal diversity and location. Whilst TSA would appear to be the natural solution to collate these, it can miss unforeseen, yet important, temporal signals expressed over a limited area. It would be more appropriate to first characterise the ocean surface heterogeneity—the variation of ocean surface properties across space and time [22,82]—using variations of CLS and PCA approaches. Qualifying and potentially quantifying the diversity of signals being expressed in the ocean surface measurements will help determine where temporally pure or representative signals may be obtained. Subsequent characterisation of classes, and principal components could enable researchers to more fully appreciate the range of temporal signals present in their temporal dataset, and refine their TSA approach to integrate this more enhanced, data-driven awareness.

4.3. Exploiting the Unidirectional Nature of Time

Concerning hypertemporal methodologies in general, the sequential ordering in datasets provided by time represents an underexploited opportunity. Whilst temporal sliding window-based approaches are demonstrating successes with regard to change detection, the temporal sequence is a feature of hypertemporal datasets which defies direct exploitation by CLS- and PCA-based methodologies. Composite methodologies (for example, PCA coupled with loadings analysis) are suggested to feature strongly in advances in this arena, bridging the determination of what is occurring and when it is occurring by using the ordering provided by time to improve object and pattern recognition. The when is particularly important with ocean research as dispatching resources to sample in-situ measurements of a phenomenon can be extremely expensive with little return if poorly timed.

5. Conclusions

A diverse range of approaches now exists to extract useful information from hypertemporal datasets. It is encouraging to note that almost 25 years since Piwowar and LeDrew’s [1] call for hypertemporal methodologies, a wide range of approaches has been developed. This gives ocean researchers an extensive pool of knowledge to build upon in studying ocean surface waters. For ocean studies, data-driven approaches should be prioritised until sufficient knowledge of the spatiotemporal patterns of the ocean surface is available to exploit more supervised approaches. This suggests a strategic need to focus on quantifying ocean surface heterogeneity and the diversity of temporal signals being expressed as part of any analysis in the short term. Finally, there is an identifiable gap in hypertemporal research with regards to exploiting the unidirectional nature of time upon which research efforts could be focused.

Author Contributions

This research article was compiled with the following contributions from the authors: R.G.S.; Original manuscript preparation, editing and manuscript coordination, F.C.; Supervision, review and editing, M.J.; Supervision, review and editing, E.O.; Supervision, review and editing, C.C.; Supervision, review and editing, K.d.B.; Review and editing.

Funding

This research has been funded by the European Union, through the Horizon 2020 research and innovation programme, under grant agreement no. 687289 (Co-ReSyF). For more information on the Co-ReSyF project, see www.co-resyf.eu.

Acknowledgments

The authors would like to thank the anonymous reviewers. Their efforts in reviewing this considerably long piece of work, and providing the concise and detailed feedback are very much appreciated.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Piwowar, J.M.; LeDrew, E.F. Hypertemporal analysis of remotely sensed sea-ice data for climate change studies. Prog. Phys. Geogr. 1995, 19, 216–242. [Google Scholar] [CrossRef] [Green Version]
  2. Goodchild, M.F.; Guo, H.; Annoni, A.; Bian, L.; de Bie, K.; Campbell, F.; Craglia, M.; Ehlers, M.; van Genderen, J.; Jackson, D.; et al. Next-generation Digital Earth. Proc. Natl. Acad. Sci. USA 2012, 109, 11088–11094. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Martin, M.; Dash, P.; Ignatov, A.; Banzon, V.; Beggs, H.; Brasnett, B.; Cayula, J.; Cummings, J.; Donlon, C.; Gentemann, C.; et al. Group for High Resolution Sea Surface temperature (GHRSST) analysis fields inter-comparisons. Part 1: A GHRSST multi-product ensemble (GMPE). Deep Res. Part II 2012, 77–80, 21–30. [Google Scholar] [CrossRef]
  4. US National Aeronautics and Space Administration MODIS-Aqua Chlorophyll—A Product Description. Available online: https://oceancolor.gsfc.nasa.gov/atbd/chlor_a/ (accessed on 13 September 2019).
  5. Cavalieri, D.J.; Parkinson, C.L.; Gloersen, P.; Zwally, H.J. Sea Ice Concentrations from Nimbus-7 SMMR and DMSP SSM/I-SSMIS Passive Microwave Data, Version 1. Available online: https://nsidc.org/data/NSIDC-0051/versions/1 (accessed on 11 September 2019).
  6. Vogelzang, J.; Stoffelen, A. Scatterometer wind vector products for application in meteorology and oceanography. J. Sea Res. 2017, 74, 16–25. [Google Scholar] [CrossRef]
  7. Jakubaukas, M.E.; Peterson, D.L.; Legates, D. Fourier decomposition of an AVHRR NDVI time-series for seasonal inter-annual landcover change detection. In Analysis of Multi-Temporal Remote Sensing Images; Bruzzone, L., Smits, P., Eds.; World Scientific: Singapore, 2001; p. 456. [Google Scholar]
  8. Shippert, P. Why Use Hyperspectral Imagery? Photogramm. Eng. Remote Sens. 2004, 70, 377–379. [Google Scholar]
  9. Kleynhans, W. Detecting Land-Cover Change Using MODIS Time-Series Data. Ph.D. Thesis, University of Pretoria, Pretoria, South Africa, 2011. [Google Scholar]
  10. Nguyen, T.T.H.; de Bie, C.A.J.M.; Ali, A.; Smaling, E.M.A.; Chu, T.H. Mapping the irrigated rice cropping patterns of the Mekong delta, Vietnam, through hyper-temporal spot NDVI image analysis. Int. J. Remote Sens. 2012, 33, 415–434. [Google Scholar] [CrossRef]
  11. McCloy, K.R. Resource Management Information Systems: Remote Sensing, GIS and Modelling; Taylor & Francis: Boca Raton, FL, USA, 2006. [Google Scholar]
  12. Piwowar, J.M.; Peddle, D.R.; Ledrew, E.F. Temporal mixture analysis of Arctic sea ice imagery: A new approach for monitoring environmental change. Remote Sens. Environ. 1998, 63, 195–207. [Google Scholar] [CrossRef]
  13. de Bie, C.A.J.M.; Khan, R.; Toxopeus, A.G.; Venus, V.; Skidmore, A.K. Hypertemporal image analysis for crop mapping and change detection. In Proceedings of the International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Beijing, China, 3–11 July 2008; International Society of Photogrammetry and Remote Sensing: Beijing, China, 2008; Volume XXXVII-B7, pp. 803–814. [Google Scholar]
  14. de Bie, C.A.J.M.; Khan, M.R.; Smakhtin, V.U.; Venus, V.; Weir, M.J.C.; Smaling, E.M.A. Analysis of multi-temporal SPOT NDVI images for small-scale land-use mapping. Int. J. Remote Sens. 2011, 32, 6673–6693. [Google Scholar] [CrossRef]
  15. Grobler, T.L.; Ackermann, E.R.; Van Zyl, A.J.; Olivier, J.C.; Kleynhans, W.; Salmon, B.P. An inductive approach to simulating multispectral MODIS surface reflectance time series. IEEE Geosci. Remote Sens. Lett. 2013, 10, 446–450. [Google Scholar] [CrossRef]
  16. Kleynhans, W.; Salmon, B.P.; Wessels, K.J.; Olivier, J.C. Rapid detection of new and expanding human settlements in the Limpopo province of South Africa using a spatio-temporal change detection method. Int. J. Appl. Earth Obs. Geoinf. 2015, 40, 74–80. [Google Scholar] [CrossRef] [Green Version]
  17. Kleynhans, W.; Salmon, B.P.; Olivier, J.C. Detecting settlement expansion in South Africa using a hyper-temporal SAR change detection approach. Int. J. Appl. Earth Obs. Geoinf. 2015, 42, 142–149. [Google Scholar] [CrossRef]
  18. Salmon, B.P.; Wessels, K.J.; van den Bergh, F.; Steenkamp, K.; Kleynhans, W.; Swanepoel, D.; Roy, D.; Kovalskyy, V. Evaluation of a rule-based classifier for Landsat-based automated land cover mapping in South Africa. In Proceedings of the IGARSS 2013—2013 IEEE International Geoscience and Remote Sensing Symposium, Melbourne, Australia, 21–26 July 2013; pp. 4301–4304. [Google Scholar]
  19. Main, R.; Mathieu, R.; Kleynhans, W.; Wessels, K.; Naidoo, L.; Asner, G.P. Hyper-temporal C-band SAR for baseline woody structural assessments in deciduous savannas. Remote Sens. 2016, 8, 661. [Google Scholar] [CrossRef]
  20. Girma, A.; de Bie, C.A.J.M.; Skidmore, A.K.; Venus, V.; Bongers, F. Hyper-temporal SPOT-NDVI dataset parameterization captures species distributions. Int. J. Geogr. Inf. Sci. 2015, 30, 89–107. [Google Scholar] [CrossRef]
  21. Pittiglio, C.; Skidmore, A.K.; van Gils, H.A.M.J.; Prins, H.H.T. Identifying transit corridors for elephant using a long time-series. Int. J. Appl. Earth Obs. Geoinf. 2012, 14, 61–72. [Google Scholar] [CrossRef]
  22. Pittiglio, C.; Skidmore, A.K.; Van Gils, H.A.; Prins, H.H. Elephant response to spatial heterogeneity in a savanna landscape of northern Tanzania. Ecography 2013, 36, 819–831. [Google Scholar] [CrossRef]
  23. Jiang, Y.; de Bie, C.A.J.M.; Wang, T.; Skidmore, A.K.; Liu, X.; Song, S.; Shao, X. Hyper-temporal remote sensing helps in relating epiphyllous liverworts and evergreen forests. J. Veg. Sci. 2013, 24, 214–226. [Google Scholar] [CrossRef]
  24. Beck, P.S.A.; Jönsson, P.; Høgda, K.A.; Karlsen, S.R.; Eklundh, L.; Skidmore, A.K. A ground-validated NDVI dataset for monitoring vegetation dynamics and mapping phenology in Fennoscandia and the Kola peninsula A ground-validated NDVI dataset for monitoring vegetation dynamics and mapping phenology in Fennoscandia and the Kola peninsula. Int. J. Remote Sens. 2007, 2819, 4311–4330. [Google Scholar] [CrossRef]
  25. O’Connor, B.; Dwyer, E.; Cawkwell, F.; Eklundh, L. Spatio-temporal patterns in vegetation start of season across the island of Ireland using the MERIS Global Vegetation Index. ISPRS J. Photogramm. Remote Sens. 2012, 68, 79–94. [Google Scholar] [CrossRef]
  26. Tan, W.; LeDrew, E. Monitoring Arctic sea ice phenology change using hypertemporal remotely sensed data: 1989–2010. Theor. Appl. Climatol. 2016, 125, 353–363. [Google Scholar] [CrossRef]
  27. Beck, P.S.A.; Wang, T.J.; Skidmore, A.K.; Liu, X.H. Displaying remotely sensed vegetation dynamics along natural gradients for ecological studies. Int. J. Remote Sens. 2008, 29, 4277–4283. [Google Scholar] [CrossRef]
  28. Ali, A.; de Bie, C.A.J.M.; Skidmore, A.K.; Scarrott, R.G.; Hamad, A.; Venus, V.; Lymberakis, P. Mapping land cover gradients through analysis of hyper-temporal NDVI imagery. Int. J. Appl. Earth Obs. Geoinf. 2013, 23, 301–312. [Google Scholar] [CrossRef]
  29. Wessels, K.; Steenkamp, K.; Von Maltitz, G.; Archibald, S. Remotely sensed vegetation phenology for describing and predicting the biomes of South Africa. Appl. Veg. Sci. 2011, 14, 49–66. [Google Scholar] [CrossRef]
  30. Ali, A.; de Bie, C.A.J.M.; Skidmore, A.K. Detecting long-duration cloud contamination in hyper-temporal NDVI imagery. Int. J. Appl. Earth Obs. Geoinf. 2013, 24, 22–31. [Google Scholar] [CrossRef]
  31. Okkonen, S.R.; Weingartner, T.J.; Danielson, S.L.; Musgrave, D.L.; Schmidt, G.M. Satellite and hydrographic observations of eddy-induced shelf-slope exchange in the northwestern Gulf of Alaska. J. Geophys. Res. Oceans 2003, 108. [Google Scholar] [CrossRef]
  32. LeDrew, E. The temporal signal of sea ice variability in the Polar Basin from wavelet analysis of passive microwave sea ice concentrations. In Proceedings of the International Workshop on the Analysis of Multi-Temporal Remote Sensing Images, Biloxi, MS, USA, 16–18 May 2005; IEEE: Piscataway, NJ, USA, 2005; pp. 182–183. [Google Scholar]
  33. Ji, R.; Jin, M.; Varpe, Ø. Sea ice phenology and timing of primary production pulses in the Arctic Ocean. Glob. Chang. Biol. 2013, 19, 734–741. [Google Scholar] [CrossRef] [PubMed]
  34. Le Traon, D.; Antoine, D.; Bentamy, A.; Bonekamp, H.; Breivik, L.; Chapron, B.; Corlett, G.; Diharboure, G.; DiGiacomo, P.; Donlon, C.; et al. Use of satellite observations for operational oceanography: Recent achievements and future prospects. J. Oper. Oceanogr. 2015, 8, s12–s27. [Google Scholar] [CrossRef]
  35. Lalli, C.; Parsons, T. Biological Oceanography: An Introduction, 2nd ed.; Elsevier Ltd.: Amsterdam, The Netherlands, 1997; ISBN 9780750633840. [Google Scholar]
  36. USA National Phenology Network Database. Available online: https://www.usanpn.org/data (accessed on 31 July 2019).
  37. Pan-European Phenology Database. Available online: http://www.pep725.eu/statistics.php (accessed on 31 July 2019).
  38. Dai, J.; Wang, H.; Ge, Q. The spatial pattern of leaf phenology and its response to climate change in China. Int. J. Biometeorol. 2014, 58, 521–528. [Google Scholar] [CrossRef]
  39. Racault, M.; Le, C.; Buitenhuis, E.; Sathyendranath, S.; Platt, T. Phytoplankton phenology in the global ocean. Ecol. Indic. 2012, 14, 152–163. [Google Scholar] [CrossRef]
  40. Eliasen, S.K.; Hátún, H.; Larsen, K.M.H.; Jacobsen, S. Faroe shelf bloom phenology—The importance of ocean-to-shelf silicate fl uxes. Cont. Shelf Res. 2017, 143, 43–53. [Google Scholar] [CrossRef]
  41. Rixen, T.; Haake, B.; Ittekkot, V.; Guptha, M.V.S.; Nair, R.R.; Schlüssel, P. Coupling between SW monsoon-related surface and deep ocean processes as discerned from continuous particle flux measurements and correlated satellite data. J. Geophys. Res. 1996, 101, 28569–28582. [Google Scholar] [CrossRef]
  42. Thomas, A.C.; Weatherbee, R.A. Satellite-measured temporal variability of the Columbia River plume. Remote Sens. Environ. 2006, 100, 167–178. [Google Scholar] [CrossRef]
  43. Prospero, J.M.; Barrett, K.; Church, T.; Dentener, F.; Duce, R.A.; Galloway, J.N.; Ii, H.L.; Moody, J.; Quinn, P. Atmospheric deposition of nutrients to the North Atlantic Basin. Biogeochemistry 1996, 35, 27–73. [Google Scholar] [CrossRef]
  44. Michaels, A.F.; Olson, D.; Sarmiento, J.L. Inputs, losses and transformations of nitrogen and phosphorus in the pelagic North Atlantic Ocean. Biogeochemistry 1996, 35, 181–226. [Google Scholar] [CrossRef]
  45. Krug, L.A.; Platt, T.; Sathyendranath, S.; Barbosa, A.B. Ocean surface partitioning strategies using ocean colour remote Sensing: A review. Prog. Oceanogr. 2017, 155, 41–53. [Google Scholar] [CrossRef]
  46. Ali, A.; de Bie, C.A.J.M.; Skidmore, A.K.; Scarrott, R.G.; Lymberakis, P. Mapping the heterogeneity of natural and semi-natural landscapes. Int. J. Appl. Earth Obs. Geoinf. 2014, 26, 176–183. [Google Scholar] [CrossRef]
  47. Santos, A.M.P. Fisheries oceanography using satellite and airborne remote sensing methods: A review. Fish. Res. 2000, 49, 1–20. [Google Scholar] [CrossRef]
  48. Nieto, K.; Xu, Y.; Teo, S.L.H.; McClatchie, S.; Holmes, J. How important are coastal fronts to albacore tuna (Thunnus alalunga) habitat in the Northeast Pacific Ocean? Prog. Oceanogr. 2017, 150, 62–71. [Google Scholar] [CrossRef]
  49. Piwowar, J.M. An Environmental Normal of Vegetation Vigour for the Northern Great Plains. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2011, 4, 292–302. [Google Scholar] [CrossRef]
  50. Piwowar, J.M. The derivation of an Arctic sea ice normal through temporal mixture analysis of satellite imagery. Int. J. Appl. Earth Obs. Geoinf. 2008, 10, 92–108. [Google Scholar] [CrossRef]
  51. Derksen, C.; Wulder, M.; LeDrew, E.; Goodison, B. Associations between spatially autocorrelated patterns of SSM/I-derived prairie snow cover and atmospheric circulation. Hydrol. Process. 1998, 12, 2307–2316. [Google Scholar] [CrossRef]
  52. Derksen, C.; LeDrew, E.; Goodison, B. Ssm/i derived snow water equivalent data: The potential for investigating linkages between snow cover and atmospheric circulation. Atmos. Ocean 1998, 36, 95–117. [Google Scholar] [CrossRef]
  53. Piwowar, J.M.; Derksen, C.P. Spatial-temporal variability of Northern Hemisphere sea ice concentrations and concurrent atmospheric teleconnections. J. Environ. Inform. 2008, 11, 103–122. [Google Scholar] [CrossRef]
  54. Kleynhans, W.; Olivier, J.C.; Salmon, B.P.; Wessels, K.J.; van den Bergh, F. A spatio-temporal approach to detecting land cover change using an extended kalman filter on modis time series data. In Proceedings of the IGARSS 2010—2010 IEEE International Geoscience and Remote Sensing Symposium, Honolulu, HI, USA, 25–30 July 2010; pp. 1972–1975. [Google Scholar]
  55. Salmon, B.P.; Olivier, J.C.; Wessels, K.J.; Kleynhans, W.; van den Bergh, F.; Steenkamp, K.C. Unsupervised Land Cover Change Detection: Meaningful Sequential Time Series Analysis. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2011, 4, 327–335. [Google Scholar] [CrossRef]
  56. Ali, A.; de Bie, C.A.J.M.; Scarrott, R.G.; Ha, N.T.T.; Skidmore, A.K. Comparative Performance Analysis of a Hyper-Temporal Ndvi Analysis Approach and a Landscape-Ecological Mapping Approach. ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci. 2012, I-7, 105–110. [Google Scholar] [CrossRef]
  57. de Bie, C.A.J.M.; Nguyen, T.T.H.; Ali, A.; Scarrott, R.; Skidmore, A.K. LaHMa: A landscape heterogeneity mapping method using hyper-temporal datasets. Int. J. Geogr. Inf. Sci. 2012, 26, 2177–2192. [Google Scholar] [CrossRef]
  58. Grobler, T.L. Sequential and Non-Sequential Hypertemporal Classification and Change Detection of MODIS Time-Series. Ph.D. Thesis, University of Pretoria, Pretoria, South Africa, 2012. [Google Scholar]
  59. Wessels, K.J.; van den Bergh, F.; Scholes, R.J. Limits to detectability of land degradation by trend analysis of vegetation index data. Remote Sens. Environ. 2012, 125, 10–22. [Google Scholar] [CrossRef]
  60. Oindo, B.O.; de By, R.A.; Skidmore, A.K. Interannual variability of NDVI and bird species diversity in Kenya. JAG 2000, 2, 172–180. [Google Scholar] [CrossRef]
  61. Oindo, B.O.; Skidmore, A.K. Interannual variability of NDVI and species richness in Kenya. Int. J. Remote Sens. 2002, 23, 285–298. [Google Scholar] [CrossRef] [Green Version]
  62. Kleynhans, W.; Salmon, B.P.; Olivier, J.C.; Van Den Bergh, F.; Wessels, K.J.; Grobler, T.L.; Steenkamp, K.C. Land cover change detection using autocorrelation analysis on MODIS time-series data: Detection of new human settlements in the gauteng province of South Africa. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2012, 5, 777–783. [Google Scholar] [CrossRef]
  63. Lunetta, R.S.; Knight, J.F.; Ediriwickrema, J.; Lyon, J.G.; Worthy, L.D. Land-cover change detection using multi-temporal MODIS NDVI data. Remote Sens. Environ. 2006, 105, 142–154. [Google Scholar] [CrossRef]
  64. Eastman, J.R.; Fulk, M. Evaluation Time Series Long Sequence Gomponents Principal Standardized Using. Photogramm. Eng. Remote Sens. 1993, 59, 991–996. [Google Scholar]
  65. Liu, J.-G.; Mason, P.J. Image Processing and GIS for Remote Sensing: Techniques and Applications; John Wiley & Sons: Chichester, UK, 2016. [Google Scholar]
  66. Derksen, C.; LeDrew, E.; Goodison, B. Temporal and spatial variability of North American prairie snow cover (1988–1995) inferred from passive microwave- derived snow water equivalent imagery. Water Resour. Res. 2000, 36, 255–266. [Google Scholar] [CrossRef]
  67. Lasaponara, R. Estimating Interannual Variations in Vegetated Areas of Sardinia Island Using SPOT/VEGETATION NDVI Temporal Series. IEEE Geosci. Remote Sens. Lett. 2006, 3, 481–483. [Google Scholar] [CrossRef]
  68. Udelhoven, T.; van der Linden, S.; Waske, B.; Stellmes, M.; Hoffmann, L. Hypertemporal Classification of Large Areas Using Decision Fusion. IEEE Geosci. Remote Sens. Lett. 2009, 6, 592–596. [Google Scholar] [CrossRef]
  69. Derksen, C.; Walker, A.; LeDrew, E.; Goodison, B. Combining SMMR and SSM/I Data for Time Series Analysis of Central North American Snow Water Equivalent. J. Hydrometeorol. 2003, 4, 304–316. [Google Scholar] [CrossRef]
  70. Piwowar, J.M.; Ledrew, E.F. Principal components analysis of arctic ice conditions between 1978 and 1987 as observed from the SMMR data record. Can. J. Remote Sens. 1996, 22, 390–403. [Google Scholar] [CrossRef]
  71. Piwowar, J.M.; Derksen, C.P.; Ledrew, E.F. Principal Components Analysis of the Variability of Northern Hemisphere Sea Ice Concentrations: 1979–1999. In Proceedings of the 23rd Canadian Symposium on Remote Sensing/10e Congrès de L’Association Québécoise de Télédetection, Sainte-Foy, QC, Canada, 21–24 August 2001; Canadian Remote Sensing Society: Ottawa, ON, Canada, 2001; pp. 619–628. [Google Scholar]
  72. Boardman, J.W.; Kruse, F.A.; Green, R.O. Mapping target signatures via partial unmixing of AVIRIS data, North Grapevine Mountains Nevada. In Proceedings of the 10th Thematic Conference on Geologic Remote Sensing, San Antonio, TX, USA, 9–12 May 1994; Environmental Research Institute of Michigan: Ann Arbor, MI, USA, 1995; Volume 1, pp. 407–418. [Google Scholar]
  73. Scarrott, R.G. Extracting Gradient Boundaries Using Hyper-Temporal Image Analysis: Progress towards a Tool for Gradient Analysts. Ph.D. Thesis, University of Southampton, Southampton, UK, Lund University, Lund, Sweden, University of Warsaw, Warsaw, Poland, International Institute for Geo-Information Science and Earth Observation (ITC), Enschede, The Netherlands, 2009. [Google Scholar]
  74. Chuvieco, E.; Heute, A. Fundamentals of Satellite Remote Sensing; CRC Press: Boca Raton, FL, USA, 2010; ISBN 9780415310840. [Google Scholar]
  75. de Bie, C.A.J.M. Spatial-temporal mapping of agro-ecosystems and the need to build thematic legends. In Proceedings of the XXth ISPRS Congress, Geo-Imagery Bridging Continents, Istanbul, Turkey, 12–23 July 2004; Commission VII Papers. International Society of Photogrammetry and Remote Sensing: Istanbul, Turkey, 2004; pp. 1–7. [Google Scholar]
  76. Salmon, B.P.; Kleynhans, W.; Van Den Bergh, F.; Olivier, J.C.; Marais, W.J.; Grobler, T.L.; Wessels, K.J. A search algorithm to meta-optimize the parameters for an Extended Kalman filter to improve classification on hyper-temporal images. In Proceedings of the 2012 IEEE International Geoscience and Remote Sensing Symposium, Munich, Germany, 22–27 July 2012; pp. 4974–4977. [Google Scholar]
  77. Ackermann, E.R.; Grobler, T.L.; van Zyl, A.J.; Steenkamp, K.C.; Olivier, J.C. Minimum Error Land Cover Separability Analysis and Classification. In Proceedings of the IGARSS 2011—2011 IEEE International Geoscience and Remote Sensing Symposium, Vancouver, BC, Canada, 24–29 July 2011; Volume 2, pp. 2999–3002. [Google Scholar]
  78. Grobler, T.L.; Ackermann, E.R.; van Zyl, A.J.; Kleynhans, W.; Salmon, B.P.; Olivier, J.C. Sequential classification of MODIS time-series. In Proceedings of the IGARSS 2012—2012 IEEE International Geoscience and Remote Sensing Symposium, Munich, Germany, 22–27 July 2012; pp. 6236–6239. [Google Scholar]
  79. Schowengert, R.A. Remote Sensing: Models and Methods for Image Processing, 2nd ed.; Academic Press: San Diego, CA, USA, 1997. [Google Scholar]
  80. Jensen, J.R. Introductory Digital Image Processing: A Remote Sensing Perspective, 3rd ed.; Pearson Prentice Hall: Upper Saddle River, NJ, USA, 2005. [Google Scholar]
  81. Khan, M.R.; de Bie, C.A.J.M.; van Keulen, H.; Smaling, E.M.A.; Real, R. Disaggregating and mapping crop statistics using hypertemporal remote sensing. Int. J. Appl. Earth Obs. Geoinf. 2010, 12, 36–46. [Google Scholar] [CrossRef]
  82. Li, H.; Reynolds, J.F. On Definition and Quantification of Heterogeneity. Oikos 1995, 73, 280–284. [Google Scholar] [CrossRef]
  83. Olivier, J.C.; Wessels, K.J.; Araya, S. Detection of Land Cover Change Using an Artificial Neural Network Within a Temporal Sliding Window on Modis Time Series Data. In Proceedings of the IGARSS 2008—2008 IEEE International Geoscience and Remote Sensing Symposium, Boston, MA, USA, 7–11 July 2008; pp. 8–9. [Google Scholar]
  84. Salmon, B.P.; Olivier, J.C.; Kleynhans, W.; Wessels, K.J.; van den Bergh, F.; Steenkamp, K.C. The use of a Multilayer Perceptron for detecting new human settlements from a time series of MODIS images. Int. J. Appl. Earth Obs. Geoinf. 2011, 13, 873–883. [Google Scholar] [CrossRef] [Green Version]
  85. Salmon, B.P.; Kleynhans, W.; van den Bergh, F.; Olivier, J.C.; Marais, W.J.; Grobler, T.L.; Wessels, K.J. Meta-Optimization of the Extended Kalman Filter’s Parameters Through the Use of the Bias Variance Equilibrium Point Criterion. IEEE Trans. Geosci. Remote Sens. 2014, 52, 5072–5087. [Google Scholar] [CrossRef]
  86. Piwowar, J.M.; LeDrew, E.F. On the Autoregressive Nature of Arctic Sea Ice Concentrations. Can. J. Remote Sens. 2001, 27, 517–525. [Google Scholar] [CrossRef]
  87. Hipel, K.; McLeod, A. Time Series Modelling of Water Resources and Environmental Systems; Elsevier: Amsterdam, The Netherlands, 1994. [Google Scholar]
  88. Piwowar, J.M.; Ledrew, E.F. ARMA time series modelling of remote sensing imagery: A new approach for climate change studies. Int. J. Remote Sens. 2002, 23, 5225–5248. [Google Scholar] [CrossRef]
  89. Piwowar, J.M.; Wessel, G.R.I.; LeDrew, E.F. Image Time Series Analysis of Arctic Sea Ice. In Proceedings of the Geoscience and Remote Sensing Symposium, IGARSS ’96, Remote Sensing for a Sustainable Future, Lincoln, NE, USA, 31 May 1996; IEEE: Piscataway, NJ, USA, 1996; pp. 645–647. [Google Scholar]
  90. Fensholt, R.; Langanke, T.; Rasmussen, K.; Reenberg, A.; Prince, S.D.; Tucker, C.; Scholes, R.J.; Le, Q.B.; Bondeau, A.; Eastman, R.; et al. Greenness in semi-arid areas across the globe 1981–2007—An Earth Observing Satellite based analysis of trends and drivers. Remote Sens. Environ. 2012, 121, 144–158. [Google Scholar] [CrossRef]
  91. Anderson, M.R.; Drobot, S.D. Arctic ocean snow melt onset dates derived from passive microwave: A new data set. In Report GD-30: Monitoring an Evolving Cryosphere—Summary of the NSIDC Special Session at the American Geophysical Union Fall Meeting 2001; Mullins, T., Naranjo, L., Yohe, L., Eds.; National Snow and Ice Data Centre: Boulder, CO, USA, 2002; pp. 13–17. ISBN 981-02-4955-1. [Google Scholar]
  92. Menenti, M.; Azzali, S.; Verhoef, W.; Vanswol, R. Mapping agroecological zones and time-lag in vegetation growth by means of fourier-analysis of time-series of ndvi images. Adv. Space Res. 1993, 13, 233–237. [Google Scholar] [CrossRef]
  93. Shariatinajafabadi, M.; Wang, T.; Skidmore, A.K.; Toxopeus, A.G.; Kölzsch, A.; Nolet, B.A.; Exo, K.M.; Griffin, L.; Stahl, J.; Cabot, D. Migratory herbivorous waterfowl track satellite-derived green wave index. PLoS ONE 2014, 9, e108331. [Google Scholar] [CrossRef]
  94. Zeng, Z.G.; Beck, P.S.; Wang, T.J.; Skidmore, A.K.; Song, Y.L.; Gong, H.S.; Prins, H.H. Effects of plant phenology and solar radiation on seasonal movement of golden takin in the Qinling Mountains, China Effects of plant phenology and solar radiation on seasonal movement of golden takin in the Qinling Mountains, China. J. Mammal. 2010, 91, 92–100. [Google Scholar] [CrossRef]
  95. Jiang, Y.; Wang, T.; De Bie, C.A.J.M.; Skidmore, A.K.; Liu, X.; Song, S.; Zhang, L.; Wang, J.; Shao, X. Satellite-derived vegetation indices contribute significantly to the prediction of epiphyllous liverworts. Ecol. Indic. 2014, 38, 72–80. [Google Scholar] [CrossRef]
  96. Rabiner, L.R.; Juang, B.H. An introduction to hidden markov models. IEEE ASSP Mag. 1986, 3, 4–16. [Google Scholar] [CrossRef]
  97. Hoff, J.C. A Practical Guide to Box-Jenkins Forecasting; Lifetime Learning Publications: Belmont, CA, USA, 1983. [Google Scholar]
  98. Reed, B.C.; Brown, J.F.; Van der Zee, D.; Loveland, T.R.; Merchant, J.W.; Ohlen, D.O.; Bradley, C.; Jesslyn, F.; Thomas, R.; James, W.; et al. Measuring Phenological Variability from Satellite Imagery. J. Veg. Sci. 1994, 5, 703–714. [Google Scholar] [CrossRef]
  99. Canisius, F.; Turral, H.; Molden, D. Fourier analysis of historical NOAA time series data to estimate bimodal agriculture. Int. J. Remote Sens. 2007, 28, 5503–5522. [Google Scholar] [CrossRef]
  100. Salmon, B.P.; Olivier, J.C.; Kleynhans, W.; Wessels, K.J. A modified temporal approach to meta-optimizing an Extended Kalman Filters parameters. In Proceedings of the IGARSS 2014—2014 IEEE International Geoscience and Remote Sensing Symposium, Quebec City, QC, Canada, 13–18 July 2014; pp. 4224–4227. [Google Scholar]
  101. Jönsson, P.; Eklundh, L. Seasonality Extraction by Function Fitting to Time-Series of Satellite Sensor Data. IEEE Trans. Geosci. Remote Sens. 2002, 40, 1824–1832. [Google Scholar] [CrossRef]
  102. Jönsson, P.; Eklundh, L. TIMESAT—A program for analyzing time-series of satellite sensor data. Comput. Geosci. 2004, 30, 833–845. [Google Scholar] [CrossRef]
  103. Mitra, S. Digital Signal Processing; Stephen, W., Ed.; McGraw-Hill: New York, NY, USA, 2002. [Google Scholar]
  104. Lhermitte, S.; Verbesselt, J.; Jonckheere, I.; Nackaerts, K.; van Aardt, J.A.; Verstraeten, W.W.; Coppin, P. Hierarchical image segmentation based on similarity of NDVI time series. Remote Sens. Environ. 2008, 112, 506–521. [Google Scholar] [CrossRef]
  105. Verhoef, W.; Menenti, M.; Azzali, S. A colour composite of NOAA-AVHRR-NDVI based on time series analysis (1981–1992). Int. J. Remote Sens. 1996, 17, 231–235. [Google Scholar] [CrossRef]
  106. Holloway, D. Accurate temporal resolution of harmonic content in both amplitude and phase. Anziam J. 2014, 55, C235–C249. [Google Scholar] [CrossRef]
  107. Kleynhans, W.; Olivier, K.C.; Wessels, K.J.; van den Bergh, F.; Salmon, B.P.; Steenkamp, K.C. Improving land cover class separation using an extended kalman filter on MODIS NDVI time-series data. IEEE Geosci. Remote Sens. Lett. 2010, 7, 381–385. [Google Scholar] [CrossRef]
  108. Kleynhans, W.; Olivier, J.C.; Salmon, B.P.; Wessels, K.J.; van den Bergh, F. Improving NDVI time series class separation using an Extended Kalman Filter. In Proceedings of the IGARSS 2009—2009 IEEE International Geoscience and Remote Sensing Symposium, Cape Town, South Africa, 12–17 July 2009; pp. 256–259. [Google Scholar]
  109. Viovy, N.; Saint, G. Hidden Markov Models applied to vegetation dynamics analysis using satellite remote sensing. IEEE Trans. Geosci. Remote Sens. 1994, 32, 906–917. [Google Scholar] [CrossRef]
  110. Yuan, Y.; Meng, Y.; Lin, L.; Sahli, H.; Yue, A.; Chen, J. Continuous Change Detection and Classification Using Hidden Markov Model: A Case Study for Monitoring Urban Encroachment onto Farmland in Beijing. Remote Sens. 2015, 7, 15318–15339. [Google Scholar] [CrossRef] [Green Version]
  111. Piwowar, J.M.; Peddle, D.R.; LeDrew, E.F. Temporal Mixture Analysis of SMMR Sea Ice Concentrations. In Proceedings of the Geoscience and Remote Sensing Symposium, IGARSS ’96, Remote Sensing for a Sustainable Future, Lincoln, NE, USA, 31 May 1996; IEEE: Piscataway, NJ, USA, 1996; pp. 938–940. [Google Scholar]
  112. O’Connor, B.; Scarrott, R.; Dwyer, N. Use of Remote Sensing in Phenological Research in Ireland. In Climate Change Impacts on Phenology: Implications for Terrestrial Ecoystems. Climate Change Research Programme (CCRP) 2007–2013 Report Series No. 22; Donnelly, A., O’Neill, B., Eds.; (IE) Environmental Protection Agency: Johnstown Castle, Ireland, 2013; pp. 35–39. ISBN 978-1-84095-463-0. [Google Scholar]
  113. Lieth, H. Purposes of a Phenology Book. In Phenology and Seasonality Modeling; Lieth, H., Ed.; Springer: New York, NY, USA, 1974; pp. 3–19. [Google Scholar]
  114. Justice, C.O.; Townshend, J.R.G.; Holben, A.N.; Tucker, C.J. Analysis of the phenology of global vegetation using meteorological satellite data. Int. J. Remote Sens. 1985, 6, 1271–1318. [Google Scholar] [CrossRef]
  115. Anees, A.; Oliver, J. Detecting Beetle Infestations in Pine Forest Using MODIS NDVI Time-series Data. In Proceedings of the IGARSS 2013—2013 IEEE International Geoscience and Remote Sensing Symposium, Melbourne, Australia, 21–26 July 2013; pp. 3329–3332. [Google Scholar]
  116. Kleynhans, W.; Salmon, B.P.; Olivier, J.C.; van den Bergh, F.; Wessels, K.J.; Grobler, T. Detecting land cover change using a sliding window temporal autocorrelation approach. In Proceedings of the IGARSS 2012—2012 IEEE International Geoscience and Remote Sensing Symposium, Munich, Germany, 22–27 July 2012; pp. 6765–6768. [Google Scholar]
  117. Salmon, B.P.; Kleynhans, W.; Schwegmann, C.P.; Olivier, J.C. Proper comparison among methods using a confusion matrix. In Proceedings of the IGARSS 2015—2015 IEEE International Geoscience and Remote Sensing Symposium, Milan, Italy, 13–18 July 2015; pp. 3057–3060. [Google Scholar]
Figure 1. Hypertemporal data versus those of reduced spatial extent (in-situ data only) and temporal resolution. Shown are available in situ sea temperature data for 2011 versus Earth Observation (EO)-derived estimates of sea surface temperature (SST) for three sampling points near Ireland. Single-image, multi-temporal, and hypertemporal cases are arranged as three columns consisting of an image visual, and the data available for each sample point. Sampling point 1 can avail of both EO-derived (from the level-4 GHRSST product) and in-situ data (obtained from temperature sensors on board the M3 weather buoy). Sample points 2 and 3 can avail of EO-derived data only.
Figure 1. Hypertemporal data versus those of reduced spatial extent (in-situ data only) and temporal resolution. Shown are available in situ sea temperature data for 2011 versus Earth Observation (EO)-derived estimates of sea surface temperature (SST) for three sampling points near Ireland. Single-image, multi-temporal, and hypertemporal cases are arranged as three columns consisting of an image visual, and the data available for each sample point. Sampling point 1 can avail of both EO-derived (from the level-4 GHRSST product) and in-situ data (obtained from temperature sensors on board the M3 weather buoy). Sample points 2 and 3 can avail of EO-derived data only.
Water 11 02286 g001
Figure 2. Moving from a spectral to a temporal logic to exploit hypertemporal imagery using existing methodologies. (a) Multispectral image data from a single Sentinel-2A MSI acquisition over Southern Ireland on 10 February 2019, with the multispectral signature at point X displayed below. (b) Hypertemporal data from 1 year (2011) of level-4 GHRSST sea surface temperature data, processed for the North Atlantic Region, with the hypertemporal signature at point Z displayed below. Both three-dimensional datacubes (latitude, longitude, and either band or time) can contain pixel-based signatures, with the temporal signatures containing the inherent sequencing provided by time. Methodologies founded upon a spectral logic can therefore be adapted along a temporal logic.
Figure 2. Moving from a spectral to a temporal logic to exploit hypertemporal imagery using existing methodologies. (a) Multispectral image data from a single Sentinel-2A MSI acquisition over Southern Ireland on 10 February 2019, with the multispectral signature at point X displayed below. (b) Hypertemporal data from 1 year (2011) of level-4 GHRSST sea surface temperature data, processed for the North Atlantic Region, with the hypertemporal signature at point Z displayed below. Both three-dimensional datacubes (latitude, longitude, and either band or time) can contain pixel-based signatures, with the temporal signatures containing the inherent sequencing provided by time. Methodologies founded upon a spectral logic can therefore be adapted along a temporal logic.
Water 11 02286 g002
Figure 3. Methodological nature and grey-literature impact of hypertemporal papers reviewed in this article. Peer-reviewed articles and book chapters which implemented a methodology on a hypertemporal dataset (as defined here), have been classified on the basis of the outlined four primary approaches, and whether they were focused on a marine or terrestrial application. The bubble area infers the grey-literature impact, which was determined by recording the number of Google scholar citations associated with each publication on the 2 September 2019. Studies which deployed composite methodologies are indicated by linking lines between the component methodologies. Bracketed numbers link to the reference list of this review, to aid the reader identify the specific publication of interest to them.
Figure 3. Methodological nature and grey-literature impact of hypertemporal papers reviewed in this article. Peer-reviewed articles and book chapters which implemented a methodology on a hypertemporal dataset (as defined here), have been classified on the basis of the outlined four primary approaches, and whether they were focused on a marine or terrestrial application. The bubble area infers the grey-literature impact, which was determined by recording the number of Google scholar citations associated with each publication on the 2 September 2019. Studies which deployed composite methodologies are indicated by linking lines between the component methodologies. Bracketed numbers link to the reference list of this review, to aid the reader identify the specific publication of interest to them.
Water 11 02286 g003
Figure 4. Example hypertemporal datacube of GHRSST level-4 sea surface temperature data for the North Atlantic, showing potential distinct signature features and the potential for simple statistical summaries. (a) Sample image from the 1 January 2011, showing the dataset extent, and coupled with a 3D representation of the temporal datacube. The locations of sites 1 to 5 from which temporal signatures were extracted are indicated. (b) The temporal signatures from example sites 1–5, coupled with box plot statistical summaries of their values.
Figure 4. Example hypertemporal datacube of GHRSST level-4 sea surface temperature data for the North Atlantic, showing potential distinct signature features and the potential for simple statistical summaries. (a) Sample image from the 1 January 2011, showing the dataset extent, and coupled with a 3D representation of the temporal datacube. The locations of sites 1 to 5 from which temporal signatures were extracted are indicated. (b) The temporal signatures from example sites 1–5, coupled with box plot statistical summaries of their values.
Water 11 02286 g004
Figure 5. Challenges faced by principal components analysis in highlighting mobile mesoscale ocean features in the Grand Banks region of the North Atlantic. (a) The evolution of a suspected eddy structure in a subsample of a year-long 7-day interval hypertemporal dataset of level-4 absolute geostrophic speed. (b) The imaged and contoured components 2–6 of a principal components analysis of the year-long hypertemporal dataset. Together with component 1, they represent over 86% of the variability contained within the dataset. (c) Contoured components 2–4 overlying the sea surface speed imagery, demonstrating the lack of delineation of the feature highlighted in panel (a). The speed data have been resolved from a level-4 dataset of geostrophic velocity data produced by the ESA-GlobCurrent initiative and made available through the Copernicus Marine Core Service.
Figure 5. Challenges faced by principal components analysis in highlighting mobile mesoscale ocean features in the Grand Banks region of the North Atlantic. (a) The evolution of a suspected eddy structure in a subsample of a year-long 7-day interval hypertemporal dataset of level-4 absolute geostrophic speed. (b) The imaged and contoured components 2–6 of a principal components analysis of the year-long hypertemporal dataset. Together with component 1, they represent over 86% of the variability contained within the dataset. (c) Contoured components 2–4 overlying the sea surface speed imagery, demonstrating the lack of delineation of the feature highlighted in panel (a). The speed data have been resolved from a level-4 dataset of geostrophic velocity data produced by the ESA-GlobCurrent initiative and made available through the Copernicus Marine Core Service.
Water 11 02286 g005
Figure 6. Using the unidirectional nature of time to differentiate statistically equal sites. Panel (a) shows a sample of surface water flows off the coast of Newfoundland over 2011, extracted from a year-long 7-day interval hypertemporal dataset of level-4 absolute geostrophic velocity data (from the ESA-GlobCurrent initiative and made available through the Copernicus Marine Core Service). Two sample sites (1077 and 1196) are indicated, from which a 53-measurement time series has been extracted covering 2011 at 7-day intervals. Panel (b) shows the statistical summary of both sites, which are equal statistically (t-test, t = −0.083, p > 0.2). Panel (c) shows how the temporal sequence of peaks and troughs can enable the two sites to be differentiated, in spite of their statistical similarity when the ordering provided by time is removed. The three main peaks for site 1196 are highlighted by light blue panels, whilst the two main peaks for site 1077 are highlighted by yellow panels.
Figure 6. Using the unidirectional nature of time to differentiate statistically equal sites. Panel (a) shows a sample of surface water flows off the coast of Newfoundland over 2011, extracted from a year-long 7-day interval hypertemporal dataset of level-4 absolute geostrophic velocity data (from the ESA-GlobCurrent initiative and made available through the Copernicus Marine Core Service). Two sample sites (1077 and 1196) are indicated, from which a 53-measurement time series has been extracted covering 2011 at 7-day intervals. Panel (b) shows the statistical summary of both sites, which are equal statistically (t-test, t = −0.083, p > 0.2). Panel (c) shows how the temporal sequence of peaks and troughs can enable the two sites to be differentiated, in spite of their statistical similarity when the ordering provided by time is removed. The three main peaks for site 1196 are highlighted by light blue panels, whilst the two main peaks for site 1077 are highlighted by yellow panels.
Water 11 02286 g006
Figure 7. Impact of inappropriate model selection on obtaining optimal seasonality profiles for an area of Ireland’s photosynthetic activity. Both a single season (blue) and double season (red) Gaussian curve have been fit to a single-year time-series of MODIS enhanced vegetation index data for 2006, with replicates for the years before and after. The presence of a mid-season decrease in photosynthetic activity (potentially linked to intensive field management activities) is obscured by the application of a single-season curve. The conclusions of the modelling shown here are reported in [112].
Figure 7. Impact of inappropriate model selection on obtaining optimal seasonality profiles for an area of Ireland’s photosynthetic activity. Both a single season (blue) and double season (red) Gaussian curve have been fit to a single-year time-series of MODIS enhanced vegetation index data for 2006, with replicates for the years before and after. The presence of a mid-season decrease in photosynthetic activity (potentially linked to intensive field management activities) is obscured by the application of a single-season curve. The conclusions of the modelling shown here are reported in [112].
Water 11 02286 g007
Table 1. A sample of existing hypertemporal datasets for ocean applications.
Table 1. A sample of existing hypertemporal datasets for ocean applications.
ProductParameterTemporal ExtentTemporal ResolutionSpatial ResolutionDescribed In
GHRSST Global Ocean Sea Surface Temperature Multi Product Ensemble (GMPE)Sea surface temperature2009–presentDaily~0.25°Martin et al. [3]
MODIS Aqua Chlorophyll-a Concentration Level 3Sea surface photosynthetic activity2002–presentDaily~4 km2NASA [4]
Sea Ice Concentrations from Nimbus-7 SMMR and DMSP SSM/I-SSMIS Passive Microwave Data, Version 1Sea ice1978–2018daily~25 km2Cavalieri et al. (updated yearly) [5]
Global Wind Level-3 ASCAT 12.5 km Coastal Wind ProductSurface winds2012–presentdaily~12.5 km2Vogelzang & Stoffelen [6]
Table 2. A sample of hypertemporal studies showing the range of hierarchically arranged applications, and range of data processing methodologies. The hierarchy is aligned with that proposed by Piwowar & LeDrew [1]. Primary techniques are more likely to be most useful for general explorations of the data’s temporal nature. These primary techniques host the four methodology categories discussed in this paper (PMA, PCA, CLS, and TSA). Secondary functions are more helpful in explaining the dataset’s nature, whilst tertiary functions are applied pre- or post-processing, and often facilitate interpreting the primary analysis outputs.
Table 2. A sample of hypertemporal studies showing the range of hierarchically arranged applications, and range of data processing methodologies. The hierarchy is aligned with that proposed by Piwowar & LeDrew [1]. Primary techniques are more likely to be most useful for general explorations of the data’s temporal nature. These primary techniques host the four methodology categories discussed in this paper (PMA, PCA, CLS, and TSA). Secondary functions are more helpful in explaining the dataset’s nature, whilst tertiary functions are applied pre- or post-processing, and often facilitate interpreting the primary analysis outputs.
Study (Authors, [Reference])Publication YearApplicationMethodologies Used
PrimarySecondaryTertiary
Pixel-Centred Measurement & Analysis (PMA)Classification (CLS)Principal Components Analysis (PCA)Time-Series Analysis (TSA)Fourier Series AnalysisTemporal Metrics & Phenology MetricsTemporal Mixture AnalysisWavelet Analysis (A.)Post-Classification A.Autocorrelation A.Correlation A.Loadings A.
Derksen et al. [51]1998Links between snow cover & atmospheric circulation
Derksen et al. [52]1998Links between snow cover & atmospheric circulation
Okkonen et al. [31]2003Mesoscale eddies
LeDrew [32]2005Sea ice variability
Piwowar & Derksen [53]2008Sea ice concentration & atmospheric teleconnections
Piwowar [50]2008Sea ice concentration and characterising normals
Kleynhans et al. [54]2010Landcover classification & change detection
Piwowar [49]2011Characterising normal for vegetation vigour and anomalies
Salmon et al. [55]2011Settlement expansion, landcover change detection
Ali et al. [56]2012Landscape ecology mapping
de Bie et al. [57]2012Landscape heterogeneity mapping, methodology development
Grobler et al. [58]2012Landcover classification & change detection
O’Connor et al. [25]2012Land surface phenology
Pittiglio et al. [21]2012Inputs for species distribution modelling
Ali et al. [28]2013Landcover, gradient mapping
Girma et al. [20]2015Species distributions
Kleynhans et al. [16]2015Landcover change detection

Share and Cite

MDPI and ACS Style

Scarrott, R.G.; Cawkwell, F.; Jessopp, M.; O’Rourke, E.; Cusack, C.; de Bie, K. From Land to Sea, a Review of Hypertemporal Remote Sensing Advances to Support Ocean Surface Science. Water 2019, 11, 2286. https://doi.org/10.3390/w11112286

AMA Style

Scarrott RG, Cawkwell F, Jessopp M, O’Rourke E, Cusack C, de Bie K. From Land to Sea, a Review of Hypertemporal Remote Sensing Advances to Support Ocean Surface Science. Water. 2019; 11(11):2286. https://doi.org/10.3390/w11112286

Chicago/Turabian Style

Scarrott, Rory Gordon, Fiona Cawkwell, Mark Jessopp, Eleanor O’Rourke, Caroline Cusack, and Kees de Bie. 2019. "From Land to Sea, a Review of Hypertemporal Remote Sensing Advances to Support Ocean Surface Science" Water 11, no. 11: 2286. https://doi.org/10.3390/w11112286

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop