Next Article in Journal
Close Observation of the Evolution Process during Initial Stage of Triggered Lightning Based on Continuous Interferometer
Previous Article in Journal
A New Way for Cartesian Coordinate Transformation and Its Precision Evaluation
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Semianalytical Algorithm for Estimating Water Transparency in Different Optical Water Types from MERIS Data

by
Anastazia Daniel Msusa
1,
Dalin Jiang
2 and
Bunkei Matsushita
3,*
1
Graduate School of Life and Environmental Sciences, University of Tsukuba, Tennoudai 1-1-1, Tsukuba 305-8572, Japan
2
Earth and Planetary Observation Sciences (EPOS), Biological and Environmental Sciences, Faculty of Natural Sciences, University of Stirling, Stirling FK9 4LA, UK
3
Faculty of Life and Environmental Sciences, University of Tsukuba, Tennoudai 1-1-1, Tsukuba 305-8572, Japan
*
Author to whom correspondence should be addressed.
Remote Sens. 2022, 14(4), 868; https://doi.org/10.3390/rs14040868
Submission received: 20 January 2022 / Revised: 4 February 2022 / Accepted: 8 February 2022 / Published: 11 February 2022

Abstract

:
Water transparency (or Secchi disk depth:   Z S D ) is a key parameter of water quality; thus, it is very important to routinely monitor. In this study, we made four efforts to improve a state-of-the-art Z S D estimation algorithm that was developed in 2019 on the basis of a new underwater visibility theory proposed in 2015. The four efforts were: (1) classifying all water into clear (Type I), moderately turbid (Type II), highly turbid (Type III), or extremely turbid (Type IV) water types; (2) selecting different reference wavelengths and corresponding semianalytical models for each water type; (3) employing an estimation model to represent reasonable shapes for particulate backscattering coefficients based on the water type classification; and (4) constraining likely wavelength range at which the minimum diffuse attenuation coefficient (Kd(λ)) will occur for each water type. The performance of the proposed Z S D estimation algorithm was compared to that of the original state-of-the-art algorithm using a simulated dataset (N = 91,287, Z S D values 0.01 to 44.68 m) and an in situ measured dataset (N = 305,   Z S D values 0.3 to 16.4 m). The results showed a significant improvement with a reduced mean absolute percentage error (MAPE) from 116% to 65% for simulated data and from 32% to 27% for in situ data. Outliers in the previous algorithm were well addressed in the new algorithm. We further evaluated the developed   Z S D estimation algorithm using medium resolution imaging spectrometer (MERIS) images acquired from Lake Kasumigaura, Japan. The results obtained from 19 matchups revealed that the estimated   Z S D matched well with the in situ measured   Z S D , with a MAPE of 15%. The developed Z S D estimation algorithm can probably be applied to different optical water types due to its semianalytical features.

1. Introduction

Water transparency relates to the depth to which light will penetrate water and to photosynthesis changes in a specific waterbody over time; thus, it is key to thoroughly evaluating water quality [1,2,3,4,5,6,7,8,9]. Changes in water transparency can also be an indicator of a human threat to an ecosystem [10,11,12,13,14]. Water transparency is often represented using Secchi disk depth ( Z S D ), which can be measured using a traditional Secchi disk or estimated using the remote sensing technique. Recently, the remote sensing technique has been widely used because it is capable of providing a synoptic view of Z S D distribution in waters and estimation algorithms have been fine tuned [15,16,17].
Generally, two types of Z S D estimation algorithms are used with the remote sensing technique: empirical and semianalytical algorithms. Empirical algorithms use a simple regression analysis between remote sensing data and in situ measured Z S D values, while semianalytical algorithms are based on an underwater visibility theory [4,18,19,20,21]. Compared to empirical algorithms, they are more suitable for estimating Z S D values from remote sensing data because they can be applied to various waters without the requirements of in situ data for algorithm recalibration [21,22].
Two underwater visibility theories are currently in use: the classic theory proposed in 1952 [23] and the new theory proposed in 2015 [4]. Previous studies have found that Z S D estimation algorithms based on the new theory perform better than those based on the classic theory [4,20,21,22,24]. Algorithms based on the new theory rely on the diffuse attenuation coefficient (Kd(λ)) at a wavelength corresponding to the maximum light transparency [4]. In these algorithms, the accurate estimation of total absorption and backscattering coefficients (a ( λ ) and bb(λ), respectively) using an appropriate quasianalytical algorithm (QAA) is a key step for estimating Z S D values more accurately. Therefore, the selection of the most appropriate QAA for each water type is necessary [4,15,19,21,25,26,27,28].
Recently, Jiang et al. [21] developed a semianalytical algorithm (hereafter referred to as the Jiang19 algorithm) to estimate Z S D values with the aim of improving a Z S D estimation algorithm developed previously by Lee et al. [4]. Both algorithms are based on the new underwater visibility theory. However, only two water types (i.e., clear and turbid waters) were considered in the Jiang19 algorithm, and thus only two reference wavelengths (560 nm for clear waters and 754 nm for turbid water) were used to estimate a ( λ ) and bb(λ). Although previous studies have confirmed the success of using 560 nm for clear waters [29] and 754 nm for highly turbid waters [30] as reference wavelengths in total absorption coefficient estimations, the assumption of a pure water absorption coefficient dominating the total absorption coefficient at these two wavelengths will probably be invalid in moderately turbid and extremely turbid waters. This is because the absorption coefficients of phytoplankton and nonalgal particles at 560 and 754 nm will also be high in moderately and extremely turbid waters [31]. Therefore, the applicability of the Jiang19 algorithm to different optical water types is still a challenge. It is thus necessary to revisit the Jiang19 algorithm and improve its water type classification, reference wavelength selection, and water-type-corresponding QAA application to estimate more accurate Z S D values in waters with different optical properties.
Consequently, the objectives of our study were to: (1) develop a new algorithm for estimating Z S D more accurately in waters with different optical properties by classifying more water types and by selecting a more appropriate reference wavelength and corresponding QAA for each water type; and (2) evaluate the performance of the developed Z S D estimation algorithm using synthetic, in situ, and medium resolution imaging spectrometer (MERIS) data.

2. Materials and Methods

2.1. Data Acquisition

2.1.1. In Situ Data Collection

We collected 305 in situ measured hyperspectral remote sensing reflectance ( R r s (λ)) and Z S D data pairs from 20 lakes and Tokyo Bay in Japan (Figure 1, hereafter referred to as the in situ dataset). The Z S D values were measured with a 30 cm diameter white Secchi disk. The Z S D data ranged from 0.3 to 16.4 m and covered clear to highly turbid waters. The in situ measured R r s (λ) values were obtained through the above-water approach. This approach measures the radiance of the skylight (Ls), the total upwelling radiance from the water (Lt), and the radiance from a standard gray board (Lg) using a FieldSpec® HandHeld spectroradiometer (ASD, Boulder, CO, USA) with a sensor zenith angle of 40° and an azimuth angle of 135° from the sun [32]. All measurements were carried out between 9:30 to 14:00 local time (three measurements were taken between 14:00 and 16:00). Then, the R r s was calculated as follows:
R r s = ( L t ρ L s ) / ( π R g L g ) Δ
where ρ is the water surface reflectance factor (0.028 when the wind speed is less than 5 m/s) [32], Rg is the reflectance of the gray board, and Δ is the residual reflected skylight calculated using a method proposed by Jiang et al. [33]. All R r s (λ) spectra were then converted to MERIS bands based on the MERIS spectral response functions. This dataset was used to evaluate the performance of the developed Z S D estimation algorithm.
To further evaluate the estimated Z S D values from MERIS images, we also acquired in situ measured Z S D values at 10 stations in Lake Kasumigaura (Figure 1b) between January 2003 and March 2012 from the Lake Kasumigaura database, which were collected by the National Institute for Environmental Studies (NIES), Japan [34].

2.1.2. Synthetic Data Collection and Generation

In this study, we collected one synthetic dataset from Jiang et al. [31], which is called Synthetic Dataset I (N = 91,287) in Table 1. Synthetic Dataset I contains pairs of R r s (λ) spectra as well as total absorption coefficient (a ( λ ) ) and total backscattering coefficient (bb(λ)) values. The R r s (λ) spectra were generated from the simulated a ( λ ) and bb(λ) values by using a bio-optical model proposed by Gordon et al. [35] and Lee et al. [29] with assumptions of a nadir viewing angle and optically deep waters. For Synthetic Dataset I, the chlorophyll-a concentration (Cchl), tripton concentration (Ctr), and CDOM absorption coefficient at 440 nm (aCDOM(440)) were varied with different intervals between 0.01–1000 mg/m3, 0.01–1000 g/m3, and 0.01–5 m−1, respectively. More details on Synthetic Dataset I generation can be found in Jiang et al. [31].
We then generated two other synthetic datasets to help with the development and evaluation of the algorithms. Synthetic Dataset II contains the diffuse attenuation coefficient (Kd(λ)) values, which were generated from the simulated a ( λ ) and bb(λ) values in Synthetic Dataset I by using the following semianalytical equation proposed by Lee et al. [36,37]:
K d ( λ ) = ( 1 + 0.005 θ ) a ( λ ) + 4.259 ( 1 0.265 η w ( λ ) ( 1 0.52 e 10.8 a ( λ ) ) b b ( λ )
where θ is the solar zenith angle and η w   is the ratio of b b w (backscattering coefficient of pure water [38]) to b b .
Synthetic Dataset III consists of simulated Z S D values. These Z S D values were generated from the simulated Kd(λ) values (Synthetic Dataset II) and the corresponding R r s (λ) values (Synthetic Dataset I) using the following semianalytical equation developed by Jiang et al. [21]:
Z S D = 1 ( 1 + K T / K d ) · min K d ( λ ) ln ( | 0.14 R r s P C | C t r ) ,     K T / K d = 1.04 ( 1 + 5.4 μ ) 0.5 1 / ( 1 s i n ( θ ) 2 R I 2 ) 0.5
where min K d ( λ ) is the minimum K d ( λ ) value among the visible wavelengths, R r s P C   is the corresponding R r s at the wavelength with the minimum K d ( λ ) , C t r is the contrast threshold for sighting a white disk (i.e., 0.013 sr−1), RI is the refractive index value of water (1.34, [39]), K T is the diffuse attenuation coefficient of upwelling radiance at the wavelength with the minimum K d ( λ ) , θ is the solar zenith angle, and μ is defined as bb/(a+bb). A summary of all synthetic datasets is listed in Table 1.

2.1.3. Satellite Data Collection and Processing

In our study, the MERIS Level-1B data between 2002 and 2012 for Lake Kasumigaura were collected from the European Space Agency (ESA, https://merisfrs-merci-ds.eo.esa.int, accessed on 4 February 2018). We selected MERIS data due to their good spatial (300 × 300 m) and spectral (15 bands in visible and near-infrared domains) characteristics. Atmospheric correction was performed using the Case-2 Regional Processor in BEAM 5.0, and clouds and cloud shadows were identified using the IdePix module in SNAP. We then masked out the pixels with clouds, cloud buffers, cloud shadows, and failed atmospheric correction. Finally, we compiled 19 matchups from Lake Kasumigaura by matching the acquisition times of in situ measured Z S D values and satellite images (acquired on the same day). These matchups were used to further evaluate the performance of the developed Z S D estimation algorithm. In addition, the averages of the Z S D values derived from 3-by-3 pixels were used as satellite-estimated values.

2.2. Development of a Z S D Estimation Algorithm

2.2.1. The Original Jiang19 Algorithm

The original Jiang19 algorithm contains three main steps. First, a QAA hybrid is developed to retrieve a ( λ ) and b b ( λ ) from R r s (λ) spectra. In the QAA hybrid, a maximum chlorophyll index (MCI) proposed by Gower et al. [40] is used to switch QAA_V5 [29] and QAA_T (i.e., QAA_Turbid in [30]). In detail, if MCI <= 0.0016 sr−1, 560 nm is used as the reference wavelength and thus QAA_V5 is selected to estimate a ( λ ) and b b ( λ ) for clear waters; otherwise, 754 nm is used as the reference wavelength and thus QAA_T is selected to estimate a ( λ ) and b b ( λ ) for turbid waters.
Then, K d ( λ ) is estimated from a ( λ )   and b b ( λ ) using Equation (2) as the second step, and Z S D is estimated from the minimum K d ( λ ) in the visible domain (e.g., 443 nm, 490 nm, 510 nm, 560 nm, 620 nm, 665 nm) and the corresponding R r s (λ) using Equation (3) (the third step).

2.2.2. Development of a New Z S D Estimation Algorithm

Since previous studies have confirmed that semianalytical Equations (2) and (3) are robust in waters with different optical properties if accurate a ( λ ) and b b ( λ ) are provided (e.g., [4,21,22,36,41]), our efforts were focused on how to obtain more accurate a ( λ ) and b b ( λ ) values from R r s (λ) spectra. A flowchart of the developed Z S D estimation algorithm is shown in Figure 2. Comparing to the Jiang19 algorithm, four improvements were carried out in this study, which are detailed sequentially in the following paragraphs.
First, we adopted a recently proposed water type classification algorithm that can classify all waters into four types, clear (Type I), moderately turbid (Type II), highly turbid (Type III), and extremely turbid (Type IV), by comparing the values of R r s at 490, 560, 620, and 754 nm [31]. This approach allowed us to more reasonably assume that the pure water absorption coefficient dominated the total absorption coefficients at the reference wavelengths (i.e., 560 nm for Types I & II, 754 nm for Type III, and 865 nm for Type IV) [29,31,42]. The water type classification algorithm is described as follows:
If   R r s ( 490 )   >   R r s ( 560 ) ,   then   Type   I   waters , Else ,   if   R r s ( 490 )   >   R r s ( 620 ) ,   then   Type   II   waters , Else ,   if   R r s ( 754 )   >   R r s ( 490 )   and   R r s ( 754 )   >   0.01   sr 1 ,   then   Type   IV   waters , Else ,   Type   III   waters .
Second, we selected a different reference wavelength and corresponding QAA for each water type to retrieve a ( λ 0 ) and b b ( λ 0 ) values at the reference wavelength ( λ 0 ). For Type I waters, we selected 560 nm as the reference wavelength and then used an empirical equation in QAA_V5 to estimate a(560) due to its good performance in clear water [29,43,44,45]. The Equations are:
a ( 560 ) = a w ( 560 ) + 10 1.146 1.366 x 0.469 x 2
x = l o g 10 ( r r s ( 443 ) + r r s ( 490 ) r r s ( 560 ) + 5 r r s ( 665 ) r r s ( 490 ) r r s ( 665 ) )  
where r r s is the remote sensing reflectance just below the water surface, aw(560) is the absorption coefficient of pure water at 560 nm, and a ( 560 ) is the total absorption coefficient at 560 nm.
For Type II waters, we selected the same wavelength (i.e., 560 nm) as the reference wavelength but used a different empirical equation from QAA_TM (developed by Curtarelli et al. [42]) to estimate a(560). We adopted QAA_TM because of its good performance in moderately turbid waters compared to QAA_V6 developed by Lee et al. [42,46]. The equation is:
a ( 560 ) = a w ( 560 ) + 0.43 ( R r s ( 560 ) R r s ( 665 ) + R r s ( 709 ) ) 1.44
where R r s ( 560 ) , R r s ( 665 ) , and R r s ( 709 ) are the remote sensing reflectance just above the water surface at 560, 665, and 709 nm, respectively. However, since Equation (7) used a longer wavelength (709 nm) than those used in Equation (6), and considering the effects of a low signal-to-noise ratio in a practical application, we followed Lee et al.’s [46] suggestion to use QAA_V5 for the waters with R r s (665) < 0.0015 sr−1 (i.e., we still used Equations (5) and (6)).
For Type III waters, 754 nm was selected as the reference wavelength, and the equations from QAA_T were adopted to estimate a(754) (i.e., a ( 754 ) a w ( 754 ) [30]). Similar to the consideration for Type II waters, we used a threshold of R r s (754) < 0.0015 sr−1 and used QAA_TM for those waters with lower R r s (754). This approach allowed us to avoid the effects of a low signal-to-noise ratio in a practical application.
For Type IV waters, 865 nm was selected as the reference wavelength and the assumption of a(865) ≈ a w (865) was adopted, as suggested by Jiang et al. [31]. After estimation of a( λ 0 ) at the reference wavelength ( λ 0 ), the particulate backscattering coefficient ( b b p ( λ 0 ) )   could be calculated by the following equation [21,29]:
b b p ( λ 0 ) = μ ( λ 0 ) a ( λ 0 ) 1 μ ( λ 0 ) b b w ( λ 0 )
Here, bbw(λ0) is the backscattering coefficient of pure water at the reference wavelength.
In the third effort, we employed two empirical models (for Types I and II, respectively) and one semianalytical model (for both Types III and IV waters), which can represent reasonable shapes for particulate backscattering coefficients (bbp(λ)), thereby allowing us to retrieve more accurate a ( λ ) and bb(λ) values at a given wavelength for each water type. For Type I waters, the spectral slope Y was calculated using an empirical Equation in Lee et al. [29]:
Y = 2.0 ( 1 1.2 e x p ( 0.9 r r s ( 443 ) r r s ( 560 ) ) )
For Type II waters, the spectral slope Y was calculated using a different empirical Equation in Curtarelli et al. [42]:
Y = 0.5248 e x p ( r r s ( 665 ) r r s ( 709 ) )
For Types III and IV waters, the spectral slope Y was calculated using a semianalytical Equation in Yang et al. [30]:
Y = 372.99 [ l o g 10 ( μ ( 754 ) μ ( 779 ) ) ] 2 + 37.286 l o g 10 ( μ ( 754 ) μ ( 779 ) ) + 0.84
Then a ( λ ) and bb(λ) at the given wavelength (λ) were calculated using the following Equations [29]:
b b ( λ ) = b b w ( λ ) + b b p ( λ 0 ) ( λ 0 λ ) Y
a ( λ ) = ( 1 μ ( λ ) ) b b ( λ ) μ ( λ )
To summarize the second and third efforts, we selected QAA_V5 for Type I waters, QAA_TM for Type II waters, QAA_T with a reference wavelength of 754 nm (hereafter renamed QAA_T754) for Type III waters, and QAA_T with a reference wavelength of 865 nm (renamed QAA_T865) for Type IV waters.
In the fourth effort, we carried out a statistical analysis using Synthetic Dataset II to investigate the possibility of a minimum Kd(λ) for each water type. Figure 3 shows the number of synthetic water samples with the minimum Kd(λ) occurring at each visible wavelength for each water type. From the figure, we can observe that the minimum Kd(λ) almost always occurred at 490 and 560 nm for Type I waters, 560 nm for Type II waters, 560, 620, and 665 nm for Type III waters, and at 665 nm for Type IV waters. Accordingly, we considered the relating wavelengths to find the minimum Kd(λ) for each water type. This effort avoided the selection of inappropriate wavelengths due to estimation errors in the previous steps (e.g., due to uncertainty in the estimations of Y values using Equations (9)–(11).

2.3. Accuracy Assessment

We used the root mean square error (RMSE) in a l o g 10 unit, the mean absolute percentage error (MAPE), bias, and the Nash-Sutcliffe efficiency (NSE) to evaluate the performance of the developed algorithm. The Equations are as follows:
RMSE = i = 1 N [ l o g 10 ( X e s t i m a t e d , i ) l o g 10 ( X m e a s u r e d , i ) ] 2 N
MAPE = 1 N i = 1 N | X e s t i m a t e d , i X m e a s u r e d , i X m e a s u r e d , i | · 100 %
Bias = 10 Y 1 , Y = i = 1 N [ l o g 10 ( X e s t i m a t e d , i ) l o g 10 ( X m e a s u r e d , i ) ] N
NSE   = 1 i = 1 N ( X e s t i m a t e d , i X m e a s u r e d , i ) 2 i = 1 N ( X m e a s u r e d , i X m e a s u r e d ¯ ) 2
where X e s t i m a t e d is the estimated Z S D value, X m e a s u r e d is the corresponding in situ measured or known Z S D value, X m e a s u r e d ¯ is the mean of in situ measured or known Z S D values, and N is the number of data pairs. The regression results between the estimated and the known or in situ measured Z S D values (i.e., R², slope, and intercept) were also used to help evaluate algorithm performance.

3. Results

3.1. Validation Using Synthetic Datasets I and III

Figure 4 compares known Z S D values (i.e., Synthetic Dataset III) and estimated Z S D values from Synthetic Dataset I using the Jiang19 algorithm and the algorithm developed in our study, respectively. From the figure, we observed many overestimations around the boundary between Type I and Type II waters as well as around the boundary between Type II and Type III waters when the Jiang19 algorithm was used (Figure 4a). These outliers resulted in very low values of R2 (=0.008) and NSE (=−200.12), and high values of RMSE (0.30 in l o g 10   Z S D units), MAPE (116%), and bias (83%). In contrast, the outliers are well addressed in the new algorithm, with improved values of R2 (0.97), NSE (0.90), RMSE (0.23 in l o g 10   Z S D units), and MAPE (65%) (Figure 4b). Even when the outliers in Jiang et al.’s results were removed (N = 84,166), our proposed algorithm still performed better than the Jiang19 algorithm, with reduced values of RMSE (0.29 to 0.23 in l o g 10   Z S D units) and MAPE (90% to 68%) as well as increased values of R2 (0.95 to 0.97) and NSE (0.85 to 0.90). However, a systematic overestimation was found in the new algorithm (bias of 60%). The results shown in Figure 4a,b are also represented according to the QAA used (Figure 4c,d) and to the selected wavelength with the minimum Kd(λ) (Figure 4e,f). These figures were used to discuss how the proposed estimation algorithm worked (see Section 4).

3.2. Validation Using In Situ Dataset

Figure 5 compares the in situ measured and estimated Z S D values. The estimated Z S D values were obtained from in situ measured R r s (λ) spectra using the Jiang19 algorithm or the algorithm developed in this study. The results show that the new Z S D estimation algorithm outperformed the Jiang19 algorithm with a reduced RMSE (from 0.18 to 0.17 in l o g 10 unit) and MAPE (from 32% to 27%) as well as increased NSE (from 0.90 to 0.92) and R2 values (from 0.90 to 0.93). In particular, we observed that three points with large errors due to the use of the Jiang19 algorithm (blue circles with red boxes in Figure 5a) were improved substantially by using the new algorithm (Figure 5b). However, compared to the use of the Jiang19 algorithm, the bias due to the use of the new algorithm increased slightly, from a 13% underestimation to an 18% underestimation. In addition, unlike the results shown in Figure 4, systematic overestimation was not found in the application of in situ measured R r s (λ) spectra to estimate Z S D , regardless of the use of the Jiang 19 algorithm or the new algorithm. Type IV waters were not found from our in situ dataset. As in Figure 4, the results shown in Figure 5a,b are also represented according to the QAA used (Figure 5c,d) and to the selected wavelength with the minimum Kd(λ) (Figure 5e,f). These figures were also used to discuss how the proposed Z S D estimation algorithm worked (see Section 4).

3.3. Validation Using MERIS Data

We further compared the estimated Z S D values from MERIS images using the newly developed algorithm to the in situ measured Z S D values (Figure 6). The in situ measured Z S D values were obtained from the Kasumigaura database, and all matchups were classified to Type III waters based on their MERIS-derived R r s (λ) spectra. From the figure, the MERIS-derived Z S D values were consistent with the in situ measured Z S D values, with a MAPE value of 15%, an RMSE value of 0.08 (in l o g 10   unit), and a bias value of −9%. The R2 value of 0.57 and the slope of 0.82 also indicate the good performance of the new Z S D estimation algorithm. Since the Jiang19 algorithm also selected the same reference band (band 12 of MERIS) and the corresponding QAA (QAA_T754) for all matchups, identical results were obtained when we used the Jiang19 algorithm (data not shown). Systematic overestimation was not found in the application of MERIS data.

4. Discussion

We developed a new algorithm to estimate Z S D from MERIS data. Since this algorithm is based on several existing semianalytical algorithms [21,29,30,31,42], it can be applied to different optical water types, from clear to extremely turbid. The validation results from the synthetic dataset (with a wide range of inherent optical properties, Z S D values ranging from 0.01 to 44.68 m) and the in situ dataset (from 21 Japanese waters, Z S D values ranging from 0.3 to 16.4 m) provide strong evidence to confirm the applicability of the developed Z S D estimation algorithm.
However, a systematic overestimation of Z S D values was observed from the validation results of the use of the synthetic dataset (Figure 4b). This is because the assumption for a ( λ ) at the reference wavelengths resulted in an underestimation of a ( λ ) values and thus an underestimation of bb(λ) values at the same wavelength. These underestimations propagated to the final estimated Z S D values. However, no overestimation of Z S D values was observed when the developed algorithm was applied to the in situ and satellite data (Figure 5b and Figure 6). This is probably because the measurement errors contained in the in situ and satellite data hid (or offset) the systematic overestimation due to the mechanism of the developed algorithm. Therefore, further correction to mitigate the systematic overestimation was not carried out in this study.
Optical water type classification is very important because it helps to both clarify relationships between different properties inside a certain class and quantify the variation between classes [25,47]. Recently, interest has grown in the application of the optical water type classification in the remote sensing of ocean color (e.g., [21,31,48,49,50,51]). In this study, we found that water type classification is a guide to select the most appropriate reference wavelength and corresponding QAA for the more accurate estimation of a ( λ ) and bb(λ) in waters with different optical properties. Therefore, we adopted the latest classification algorithm to classify all waters into four types. In contrast, the Jiang19 algorithm classified waters into only two types (clear and turbid) and used two corresponding QAAs (QAA_V5 and QAA_T754), thus generating large errors around boundaries of different water types (Figure 4a). For example, in Figure 4c, the Jiang19 algorithm classified some data samples as the clear water type and used QAA_V5 to estimate a ( λ ) and bb(λ); thus, large errors occurred in the Z S D estimations (yellow points in Figure 4c). In contrast, we classified these data samples as Water Type II (moderately turbid waters), which enabled us to use QAA_TM for a ( λ ) and bb(λ) estimations and in turn improved the Z S D estimations (blue points in Figure 4d). Similar results can also be observed from Figure 5c. For example, the Jiang19 algorithm classified the yellow point with red box 3 as clear water and two green points with red boxes 1 and 2 as turbid water, and thus used QAA_V5 and QAA_T754 to estimate a ( λ ) and bb(λ), resulting finally in large errors in the Z S D estimations. These three Z S D estimations were improved by classifying them as Type II waters and thus using QAA_TM to replace QAA_V5 and QAA_T754 (Figure 5d).
In addition, Jiang et al. [31] suggested the use of QAA_V6 to estimate a ( λ ) and bb(λ) at the reference wavelength of 665 nm for Type II waters. However, several previous studies have reported that QAA_V6 often failed in turbid waters [6,21,30,42]. Therefore, we used QAA_TM instead of QAA_V6 in this study. Our results also show that QAA_TM performed better than QAA_V6 for Type II waters (data not shown).
We improved the accuracy of a ( λ ) and bb(λ) estimation by classifying waters into four types (effort 1), and then adopted different QAA to estimate a ( λ ) and bb(λ) for each water type (efforts 2 and 3). These three efforts addressed most of the outliers caused by using the Jiang19 algorithm. However, some outliers remained after the above three efforts. This is because 620 or 665 nm was sometimes identified as the wavelength with the minimum Kd even for some Type I and II waters due to uncertainty in the Y estimation model [30]. The identification of 620 or 665 nm is obviously inappropriate as the wavelength with the minimum Kd in Type I and II waters should be at 490 or 560 nm based on the statistical results in Figure 3. Therefore, in this study, we also limited the wavelengths used to estimate the minimum   K d ( λ ) in each water type. This effort can make the wavelengths for estimating minimum   K d ( λ ) close to the reference wavelength in each water type and thus can reduce errors due to uncertainty in the Y estimation model as seen in Figure 4e,f (not clearly observed in Figure 5e,f).

5. Conclusions

In this study, we developed a semianalytical algorithm for estimating Z S D values from remote sensing data. The developed Z S D estimation algorithm considers different optical properties in four water types, thus allowing the selection of the most optimal reference wavelength and QAA for more accurate estimation of total absorption and backscattering coefficients and, in turn, improved Z S D estimations compared to the previous study. In addition, constraining the wavelength range of minimum   K d ( λ ) in each water type contributed to the improvement of Z S D   estimation accuracy. The validation results using synthetic and in situ data show that the developed algorithm is applicable to different optical water types.

Author Contributions

Conceptualization, B.M., A.D.M. and D.J.; methodology, A.D.M. and B.M.; software, A.D.M. and D.J.; validation, A.D.M., B.M. and D.J.; formal analysis, A.D.M., B.M. and D.J.; investigation, B.M. and D.J.; resources, B.M.; data curation, A.D.M. and B.M.; writing—original draft preparation, A.D.M.; writing—review and editing, B.M. and D.J.; visualization, A.D.M., B.M. and D.J.; supervision, B.M.; project administration, B.M.; funding acquisition, B.M. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by the Grants-in-Aid for Scientific Research of the Ministry of Education, Culture, Sport, Science and Technology (MEXT) from Japan (No. 17H01850 and No. 17H04475A).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

The first author would like to show her gratitude to MEXT, Japan for the provision of the scholarship. We would also like to thank the European Space Agency (ESA) for providing MERIS data and the National Institute for Environmental Studies (NIES), Japan for providing Z S D monitoring data. We appreciate two anonymous reviewers for their valuable comments and suggestions for improving the quality of the manuscript.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Swift, T.J.; Perez-Losada, J.; Schladow, S.G.; Reuter, J.E.; Jassby, A.D.; Goldman, C.R. Water clarity modeling in Lake Tahoe: Linking suspended matter characteristics to Secchi depth. Aquat. Sci. 2006, 68, 1–15. [Google Scholar] [CrossRef]
  2. Doron, M.; Babin, M.; Mangin, A.; Hembise, O. Estimation of light penetration, and horizontal and vertical visibility in oceanic and coastal waters from surface reflectance. J. Geophys. Res. Earth Surf. 2007, 112, C06003. [Google Scholar] [CrossRef] [Green Version]
  3. Fleming-Lehtinen, V.; Laamanen, M. Long-term changes in Secchi depth and the role of phytoplankton in explaining light attenuation in the Baltic Sea. Estuar. Coast. Shelf Sci. 2012, 102–103, 1–10. [Google Scholar] [CrossRef]
  4. Lee, Z.; Shang, S.; Hu, C.; Du, K.; Weidemann, A.; Hou, W.; Lin, J.; Lin, G. Secchi disk depth: A new theory and mechanistic model for underwater visibility. Remote Sens. Environ. 2015, 169, 139–149. [Google Scholar] [CrossRef] [Green Version]
  5. Fukushima, T.; Matsushita, B.; Oyama, Y.; Yoshimura, K.; Yang, W.; Terrel, M.; Kawamura, S.; Takegahara, A. Semi-analytical prediction of Secchi depth using remote-sensing reflectance for lakes with a wide range of turbidity. Hydrobiologia 2015, 780, 5–20. [Google Scholar] [CrossRef]
  6. Rodrigues, T.; Alcântara, E.; Watanabe, F.; Imai, N. Retrieval of Secchi disk depth from a reservoir using a semi-analytical scheme. Remote Sens. Environ. 2017, 198, 213–228. [Google Scholar] [CrossRef] [Green Version]
  7. Liu, Y.; Xiao, C.; Li, J.; Zhang, F.; Wang, S. Secchi Disk Depth Estimation from China’s New Generation of GF-5 Hyperspectral Observations Using a Semi-Analytical Scheme. Remote Sens. 2020, 12, 1849. [Google Scholar] [CrossRef]
  8. Olmanson, L.G.; Bauer, M.E.; Brezonik, P.L. A 20-year Landsat water clarity census of Minnesota’s 10,000 lakes. Remote Sens. Environ. 2008, 112, 4086–4097. [Google Scholar] [CrossRef]
  9. Wondie, A.; Mengistu, S.; Vijverberg, J.; Dejen, E. Seasonal variation in primary production of a large high altitude tropical lake (Lake Tana, Ethiopia): Effects of nutrient availability and water transparency. Aquat. Ecol. 2007, 41, 195–207. [Google Scholar] [CrossRef]
  10. Canfield, D.E.; Langeland, K.A.; Linda, S.B.; Haller, W.T. Relations between water transparency and maximum depth of macrophyte colonization in lakes. J. Aquat. Plant Manag. 1985, 23, 25–28. [Google Scholar]
  11. Lee, Z.; Carder, K.L.; Mobley, C.D.; Steward, R.G.; Patch, J.S. Hyperspectral remote sensing for shallow waters: 2 Deriving bottom depths and water properties by optimization. Appl. Opt. 1999, 38, 3831–3843. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  12. Holland, R.E. Changes in Planktonic Diatoms and Water Transparency in Hatchery Bay, Bass Island Area, Western Lake Erie Since the Establishment of the Zebra Mussel. J. Great Lakes Res. 1993, 19, 617–624. [Google Scholar] [CrossRef]
  13. Devlin, M.; Barry, J.; Mills, D.; Gowen, R.; Foden, J.; Sivyer, D.; Tett, P. Relationships between suspended particulate material, light attenuation and Secchi depth in UK marine waters. Estuar. Coast. Shelf Sci. 2008, 79, 429–439. [Google Scholar] [CrossRef]
  14. McCullough, I.M.; Loftin, C.S.; Sader, S.A. High-frequency remote monitoring of large lakes with MODIS 500 m imagery. Remote Sens. Environ. 2012, 124, 234–241. [Google Scholar] [CrossRef]
  15. Bai, S.; Gao, J.; Sun, D.; Tian, M. Monitoring Water Transparency in Shallow and Eutrophic Lake Waters Based on GOCI Observations. Remote Sens. 2020, 12, 163. [Google Scholar] [CrossRef] [Green Version]
  16. Sòria-Perpinyà, X.; Pereira-Sandoval, M.; Ruiz-Verdú, A.; Soria, J.M.; Delegido, J.; Vicente, E.; Moreno, J.; Urrego, E.P. Monitoring water transparency of a hypertrophic lake (the Albufera of València) using multitemporal Sentinel-2 satellite images. Limnetica 2020, 39, 373–386. [Google Scholar] [CrossRef]
  17. Chang, N.; Luo, L.; Wang, X.C.; Song, J.; Han, J.; Ao, D. A novel index for assessing the water quality of urban landscape lakes based on water transparency. Sci. Total Environ. 2020, 735, 139351. [Google Scholar] [CrossRef]
  18. Doron, M.; Babin, M.; Hembise, O.; Mangin, A.; Garnesson, P. Ocean transparency from space: Validation of algorithms estimating Secchi depth using MERIS, MODIS and SeaWiFS data. Remote Sens. Environ. 2011, 115, 2986–3001. [Google Scholar] [CrossRef]
  19. Mao, Y.; Wang, S.; Qiu, Z.; Sun, D.; Bilal, M. Variations of transparency derived from GOCI in the Bohai Sea and the Yellow Sea. Opt. Express 2018, 26, 12191–12209. [Google Scholar] [CrossRef]
  20. Wang, S.; Lee, Z.; Shang, S.; Li, J.; Zhang, B.; Lin, G. Deriving inherent optical properties from classical water color measurements: Forel-Ule index and Secchi disk depth. Opt. Express 2019, 27, 7642–7655. [Google Scholar] [CrossRef]
  21. Jiang, D.; Matsushita, B.; Setiawan, F.; Vundo, A. An improved algorithm for estimating the Secchi disk depth from remote sensing data based on the new underwater visibility theory. ISPRS J. Photogramm. Remote Sens. 2019, 152, 13–23. [Google Scholar] [CrossRef]
  22. Vundo, A.; Matsushita, B.; Jiang, D.; Gondwe, M.; Hamzah, R.; Setiawan, F.; Fukushima, T. An Overall Evaluation of Water Transparency in Lake Malawi from MERIS Data. Remote Sens. 2019, 11, 279. [Google Scholar] [CrossRef] [Green Version]
  23. Duntley, S.Q. The Visibility of Submerged Objects; Visibility Laboratory, Massachusetts Institute of Technology; Scripps Institution of Oceanography: San Diego, CA, USA, 1952; Volume 74. [Google Scholar]
  24. Bowers, D.G.; Roberts, E.M.; Hoguane, A.M.; Fall, K.A.; Massey, G.M.; Friedrichs, C.T. Secchi Disk Measurements in Turbid Water. J. Geophys. Res. Oceans 2020, 125, 1–9. [Google Scholar] [CrossRef] [Green Version]
  25. Uudeberg, K.; Ansko, I.; Põru, G.; Ansper, A.; Reinart, A. Using Optical Water Types to Monitor Changes in Optically Complex Inland and Coastal Waters. Remote Sens. 2019, 11, 2297. [Google Scholar] [CrossRef] [Green Version]
  26. Liu, X.; Lee, Z.; Zhang, Y.; Lin, J.; Shi, K.; Zhou, Y.; Qin, B.; Sun, Z. Remote Sensing of Secchi Depth in Highly Turbid Lake Waters and Its Application with MERIS Data. Remote Sens. 2019, 11, 2226. [Google Scholar] [CrossRef] [Green Version]
  27. Liu, D.; Duan, H.; Loiselle, S.; Hu, C.; Zhang, G.; Li, J.; Yang, H.; Thompson, J.R.; Cao, Z.; Shen, M.; et al. Observations of water transparency in China’s lakes from space. Int. J. Appl. Earth Obs. Geoinf. 2020, 92, 102187. [Google Scholar] [CrossRef]
  28. Zeng, S.; Lei, S.; Li, Y.; Lyu, H.; Xu, J.; Dong, X.; Wang, R.; Yang, Z.; Li, J. Retrieval of Secchi Disk Depth in Turbid Lakes from GOCI Based on a New Semi-Analytical Algorithm. Remote Sens. 2020, 12, 1516. [Google Scholar] [CrossRef]
  29. Lee, Z.; Carder, K.L.; Arnone, R.A. Deriving inherent optical properties from water color: A multiband quasi-analytical algorithm for optically deep waters. Appl. Opt. 2002, 41, 5755–5772. [Google Scholar] [CrossRef]
  30. Yang, W.; Matsushita, B.; Chen, J.; Yoshimura, K.; Fukushima, T. Retrieval of Inherent Optical Properties for Turbid Inland Waters from Remote-Sensing Reflectance. IEEE Trans. Geosci. Remote Sens. 2013, 51, 3761–3773. [Google Scholar] [CrossRef]
  31. Jiang, D.; Matsushita, B.; Pahlevan, N.; Gurlin, D.; Lehmann, M.K.; Fichot, C.G.; Schalles, J.; Loisel, H.; Binding, C.; Zhang, Y.; et al. Remotely estimating total suspended solids concentration in clear to extremely turbid waters using a novel semi-analytical method. Remote Sens. Environ. 2021, 258, 112386. [Google Scholar] [CrossRef]
  32. Mobley, C.D. Estimation of the remote-sensing reflectance from above-surface measurements. Appl. Opt. 1999, 38, 7442–7455. [Google Scholar] [CrossRef] [PubMed]
  33. Jiang, D.; Matsushita, B.; Yang, W. A simple and effective method for removing residual reflected skylight in above-water remote sensing reflectance measurements. ISPRS J. Photogramm. Remote Sens. 2020, 165, 16–27. [Google Scholar] [CrossRef]
  34. NIES. Lake Kasumigaura Database, National Institute for Environmental Studies, Japan. 2020. Available online: http://db.cger.nies.go.jp/gem/moni-e/inter/GEMS/database/kasumi/index.html. (accessed on 24 August 2020).
  35. Gordon, H.R.; Brown, O.B.; Evans, R.H.; Brown, J.W.; Smith, R.C.; Baker, K.S.; Clark, D.K. A Semianalytic Radiance Model of Ocean Color. J. Geophys. Res. 1988, 93, 10909–10924. [Google Scholar] [CrossRef]
  36. Lee, Z.-P.; Du, K.; Arnone, R. A model for the diffuse attenuation coefficient of downwelling irradiance. J. Geophys. Res. Earth Surf. 2005, 110, 1–10. [Google Scholar] [CrossRef]
  37. Lee, Z.; Hu, C.; Shang, S.; Du, K.; Lewis, M.; Arnone, R.; Brewin, R. Penetration of UV-visible solar radiation in the global oceans: Insights from ocean color remote sensing. J. Geophys. Res. Oceans 2013, 118, 4241–4255. [Google Scholar] [CrossRef] [Green Version]
  38. Zhang, X.; Hu, L. Scattering by pure seawater at high salinity. Opt. Express 2009, 17, 12685–12691. [Google Scholar] [CrossRef]
  39. Lee, Z.; Carder, K.L.; Mobley, C.D.; Steward, R.G.; Patch, J.S. Hyperspectral remote sensing for shallow waters. I. A semianalytical model. Appl. Opt. 1998, 37, 6329–6338. [Google Scholar] [CrossRef]
  40. Gower, J.; King, S.; Borstad, G.; Brown, L. Detection of intense plankton blooms using the 709 nm band of the MERIS imaging spectrometer. Int. J. Remote Sens. 2005, 26, 2005–2012. [Google Scholar] [CrossRef]
  41. Yang, W.; Matsushita, B.; Chen, J.; Yoshimura, K.; Fukushima, T. Application of a Semianalytical Algorithm to Remotely Estimate Diffuse Attenuation Coefficient in Turbid Inland Waters. IEEE Geosci. Remote Sens. Lett. 2014, 11, 1046–1050. [Google Scholar] [CrossRef]
  42. Curtarelli, V.P.; Barbosa, C.C.F.; Maciel, D.A.; Júnior, R.F.; Carlos, F.M.; Novo, E.D.M.; Curtarelli, M.; Silva, E. Diffuse Attenuation of Clear Water Tropical Reservoir: A Remote Sensing Semi-Analytical Approach. Remote Sens. 2020, 12, 2828. [Google Scholar] [CrossRef]
  43. Joshi, I.D.; D’Sa, E.J. An estuarine-tuned quasi-analytical algorithm (QAA-V): Assessment and application to satellite estimates of SPM in Galveston Bay following Hurricane Harvey. Biogeosciences 2018, 15, 4065–4086. [Google Scholar] [CrossRef] [Green Version]
  44. Andrade, C.; Alcântara, E.; Bernardo, N.; Kampel, M. An assessment of semi-analytical models based on the absorption coefficient in retrieving the chlorophyll-a concentration from a reservoir. Adv. Space Res. 2019, 63, 2175–2188. [Google Scholar] [CrossRef]
  45. Deng, L.; Zhou, W.; Cao, W.; Wang, G.; Zheng, W.; Xu, Z.; Li, C.; Yang, Y.; Xu, W.; Zeng, K.; et al. Evaluating semi-analytical algorithms for estimating inherent optical properties in the South China Sea. Opt. Express 2020, 28, 13155–13176. [Google Scholar] [CrossRef] [PubMed]
  46. Lee, Z.; Carder, K.L.; Arnone, R. Update of the Quasi-Analytical Algorithm (QAA_v6); International Ocean Colour Coordnating Group—IOCCG: Monterey, CA, USA, 2014. [Google Scholar]
  47. Reinart, A.; Herlevi, A.; Arst, H.; Sipelgas, L. Preliminary optical classification of lakes and coastal waters in Estonia and south Finland. J. Sea Res. 2003, 49, 357–366. [Google Scholar] [CrossRef]
  48. Moore, T.S.; Dowell, M.D.; Bradt, S.; Verdu, A.R. An optical water type framework for selecting and blending retrievals from bio-optical algorithms in lakes and coastal waters. Remote Sens. Environ. 2014, 143, 97–111. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  49. Matsushita, B.; Yang, W.; Yu, G.; Oyama, Y.; Yoshimura, K.; Fukushima, T. A hybrid algorithm for estimating the chlorophyll-a concentration across different trophic states in Asian inland waters. ISPRS J. Photogramm. Remote Sens. 2015, 102, 28–37. [Google Scholar] [CrossRef] [Green Version]
  50. Spyrakos, E.; O’Donnell, R.; Hunter, P.D.; Miller, C.; Scott, M.; Simis, S.G.H.; Neil, C.; Barbosa, C.C.F.; Binding, C.E.; Bradt, S.; et al. Optical types of inland and coastal waters. Limnol. Oceanogr. 2018, 63, 846–870. [Google Scholar] [CrossRef] [Green Version]
  51. Balasubramanian, S.V.; Pahlevan, N.; Smith, B.; Binding, C.; Schalles, J.; Loisel, H.; Gurlin, D.; Greb, S.; Alikas, K.; Randla, M.; et al. Robust algorithm for estimating total suspended solids (TSS) in inland and nearshore coastal waters. Remote Sens. Environ. 2020, 246, 111768. [Google Scholar] [CrossRef]
Figure 1. Study areas: (a) Locations of 20 Japanese lakes and Tokyo Bay and (b) sampling sites of the Lake Kasumigaura database.
Figure 1. Study areas: (a) Locations of 20 Japanese lakes and Tokyo Bay and (b) sampling sites of the Lake Kasumigaura database.
Remotesensing 14 00868 g001
Figure 2. Flowchart of the Z S D estimation algorithm proposed in this study.
Figure 2. Flowchart of the Z S D estimation algorithm proposed in this study.
Remotesensing 14 00868 g002
Figure 3. Statistical analysis using Synthetic Dataset II to identify the possibility of a minimum K d ( λ ) for each water type.
Figure 3. Statistical analysis using Synthetic Dataset II to identify the possibility of a minimum K d ( λ ) for each water type.
Remotesensing 14 00868 g003
Figure 4. Comparison of known and estimated Z S D values. The estimated Z S D values were obtained from the simulated R r s ( λ ) in Synthetic Dataset I using the Jiang19 algorithm (a,c,e) and the new algorithm proposed in this study (b,d,f). The colors in the figures represent water types (a,b), the QAA used (c,d), and the wavelengths with the minimum K d ( λ ) (e,f).
Figure 4. Comparison of known and estimated Z S D values. The estimated Z S D values were obtained from the simulated R r s ( λ ) in Synthetic Dataset I using the Jiang19 algorithm (a,c,e) and the new algorithm proposed in this study (b,d,f). The colors in the figures represent water types (a,b), the QAA used (c,d), and the wavelengths with the minimum K d ( λ ) (e,f).
Remotesensing 14 00868 g004aRemotesensing 14 00868 g004b
Figure 5. Comparison of in situ measured and estimated Z S D values. The estimated Z S D values were obtained from in situ measured R r s ( λ ) spectra using the Jiang19 algorithm (a,c,e) and the new algorithm proposed in this study (b,d,f). The colors in the figures represent water types (a,b), the QAA used (c,d), and the wavelengths with the minimum K d ( λ ) (e,f).
Figure 5. Comparison of in situ measured and estimated Z S D values. The estimated Z S D values were obtained from in situ measured R r s ( λ ) spectra using the Jiang19 algorithm (a,c,e) and the new algorithm proposed in this study (b,d,f). The colors in the figures represent water types (a,b), the QAA used (c,d), and the wavelengths with the minimum K d ( λ ) (e,f).
Remotesensing 14 00868 g005
Figure 6. Comparisons of the in situ measured Z S D values and the estimated Z S D values from MERIS data using the new Z S D estimation algorithm.
Figure 6. Comparisons of the in situ measured Z S D values and the estimated Z S D values from MERIS data using the new Z S D estimation algorithm.
Remotesensing 14 00868 g006
Table 1. Summary of Synthetic Datasets I, II, and III.
Table 1. Summary of Synthetic Datasets I, II, and III.
Synthetic
Dataset
I
(Jiang et al. [31])
II
(This Study)
III
(This Study)
Total Number of DataUsage
Parameter a ( λ ) ,   b b ( λ ) ,   R r s ( λ ) K d ( λ ) Z S D (0.01–44.68 m)91,287Algorithm Validation
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Msusa, A.D.; Jiang, D.; Matsushita, B. A Semianalytical Algorithm for Estimating Water Transparency in Different Optical Water Types from MERIS Data. Remote Sens. 2022, 14, 868. https://doi.org/10.3390/rs14040868

AMA Style

Msusa AD, Jiang D, Matsushita B. A Semianalytical Algorithm for Estimating Water Transparency in Different Optical Water Types from MERIS Data. Remote Sensing. 2022; 14(4):868. https://doi.org/10.3390/rs14040868

Chicago/Turabian Style

Msusa, Anastazia Daniel, Dalin Jiang, and Bunkei Matsushita. 2022. "A Semianalytical Algorithm for Estimating Water Transparency in Different Optical Water Types from MERIS Data" Remote Sensing 14, no. 4: 868. https://doi.org/10.3390/rs14040868

APA Style

Msusa, A. D., Jiang, D., & Matsushita, B. (2022). A Semianalytical Algorithm for Estimating Water Transparency in Different Optical Water Types from MERIS Data. Remote Sensing, 14(4), 868. https://doi.org/10.3390/rs14040868

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop