Performance Evaluation of Four Ocean Reflectance Model

Abstract

Phytoplankton are the main factors influencing light under the sea surface in Case Ι water. The ocean reflectance model (ORM), which takes into account the chlorophyll a concentration data, can calculate the remote sensing reflectance of Case Ι water. In this study, we examined the differences and performance of four ORMs, including Morel and Maritorena (2001, MM01), Morel and Gentili (2007, MG07), Mobley (2014, MO14), and Hydrolight Abcase1 Lookup Tables. The differences between the four ORMs in terms of their absorption and backscattering coefficients were evaluated. Preformation of the four ORMs was compared using the NASA bio-Optical Marine Algorithm Dataset and in situ data from the South China Sea. The results showed that preformation of MM01 was the best.

1. Introduction

Remote sensing of ocean color radiometry has been demonstrated in recent decades to be an unparalleled technique for providing a synoptic view of ocean biology at daily to yearly time scales [1]. Remote sensing reflectance ($R_{\mathrm{rs}}\left(\lambda \right)$) is a well-defined radiometric quantity with a common and precise definition shared among space agencies [2]. Indeed, uncertainties in calibration and differences in atmospheric correction schemes may introduce some distortions [2]. Calibration and validation of various products in open-sea and coastal waters are important tasks in ocean color satellite missions.

To calibrate the accuracy of a satellite, at least 40 matchups are required [3]. There are three ways to obtain matchups [4]. First, in situ data, which are of high quality, are measured from ships, and performed to obtain the NASA bio-Optical Marine Algorithm Dataset (NOMAD). Second, in situ data are measured using optical buoys, which include the marine optical buoy, ‘Bouée pour l’acquisition de Séries Optiques à Long Terme’ and the ocean color component of the Aerosol Robotic Network. Third, data from the ocean reflectance model (ORM) are used. The ORM is not influenced by weather and is easily matched. The input to the ORM is the chlorophyll a (Chla) concentration, which is suitable for Case Ι water.

In over nearly two decades, many studies on the relationship between the apparent optical properties and inherent optical property (IOPs) have been performed [5,6,7,8]. These models were based on Case Ι water, and they revealed the relationship between the spectral volume absorption coefficient ($a\left(\lambda \right)$), spectral volume scattering coefficient ($b_b\left(\lambda \right)$), and Chla concentration. The remote sensing reflectance ($R_{\mathrm{rs}}\left(\lambda \right)$) above the water surface was obtained using radiation transmission data. Morel (1988) developed a simple model (M88) that includes the relationship between IOP and Chla [9]. Based on M88, Morel and Maritorena (2001) developed the first complete model (MM01), and compared MM01 and M88 [10]. Based on MM01, Morel and Gentili (2007) added more in situ data and developed a new model (MG07) [11]. Werdell (2007) improved MG07 and calibrated the Sea-viewing Wide Field-of-view Sensor (SeaWiFS). The difference between the calibration factors for the model and marine optical buoy was less than 9%, and the Coastal Zone Color Scanner was calibrated using historical data from the model. Mobley (2014) developed a new model (MO14) in the Ocean Optics Web Book, which improved the model in the ultraviolet band and $b_b\left(\lambda \right)$ [12]. Mobley and Sundman (2008) developed the commercial software HydroLight to construct RT-based look-up tables (LUTs) [13]. Their LUT-derived IOPs compared well with both in situ and model-simulated hyperspectral data.

The objective of this study was to validate the applicability of four ORMs (MM01, MG07, LUTs, and MO14) in the SCS and global ocean based on in situ measurements and NOMAD data and analyze the uncertainties of the four ORMs to useful suggestions for higher-order applications.

2. Theoretical Background

The basic data product from in situ and satellite radiometry is the remote sensing reflectance ($R_{\mathrm{rs}}$), which is generally described in units of sr⁻¹; Gordon and Clark [14] introduced the concept of $R_{\mathrm{rs}}$ to express the remote sensing reflectance that would occur with no atmosphere, the sun at the zenith, and at the mean sun-earth distance:

$$R_{\mathrm{rs}}\mathsf{\lambda }=\frac{{\mathrm{L}}_w\left(\mathsf{\lambda }\right)}{E_s\left(\lambda \right)}$$

(1)

where $E_s\left(\lambda \right)$ is the solar irradiance in units of W m⁻² nm⁻¹ and ${\mathrm{L}}_w\left(\mathsf{\lambda }\right)$ is the water-leaving radiance in units of W m⁻² nm⁻¹ sr⁻¹. $R_{\mathrm{rs}}$ accounts for the effects of the water surface:

$$R_{\mathrm{rs}}\left(\lambda \right)=\frac{\Re }{Q\left(\lambda \right)}\times R\left(\lambda ,0^{-}\right)$$

(2)

where $R\left(0^{-},\lambda \right)$ is the irradiance reflectance immediately below the water surface, $Q\left(\lambda \right)$ accounts for the effects of the anisotropic radiance distribution and $\Re$ commonly refers to a term accounting for all effects of reflection and refraction at the sea surface.

The irradiance reflectance $R\left(\lambda ,0^{-}\right)$ is related to the ratio of the above coefficients ($\frac{b_b\left(\lambda \right)}{a\left(\lambda \right)+b_b\left(\lambda \right)}$). The irradiance reflectance can be expressed as:

$$R\left(0^{-},\lambda \right)=f^{\prime }\left(\lambda \right)\times \frac{b_b\left(\lambda \right)}{a\left(\lambda \right)+b_b\left(\lambda \right)}$$

(3)

where $a\left(\lambda \right)$ is the spectral volume absorption coefficient and $b_b\left(\lambda \right)$ is the spectral volume scattering coefficient.

To define $u\left(\lambda \right)=\frac{b_b\left(\lambda \right)}{a\left(\lambda \right)+b_b\left(\lambda \right)}$, the relationship between $R_{rs}\left(\lambda \right)$ and $a\left(\lambda \right)$ and $b_b\left(\lambda \right)$ is given as:

$$R_{rs}\left(\lambda \right)=\frac{\Re }{Q\left(\lambda \right)}\times f^{\prime }\left(\lambda \right)\times u\left(\lambda \right)$$

(4)

To define $r_{rs}\mathsf{\lambda }=\frac{L_u\left(\lambda ,0^{-}\right)}{E_d\left(\lambda ,0^{-}\right)}=\frac{R\left(\lambda \right)}{Q\left(\lambda \right)}$, $R_{\mathrm{rs}}\left(\lambda \right)=\Re \times r_{rs}\mathsf{\lambda }$ and $r_{rs}\mathsf{\lambda }=\frac{f^{\prime }\left(\lambda \right)}{Q\left(\lambda \right)}\times u\left(\lambda \right)$.

2.1. Relationship between $R_{rs}\left(\lambda \right)$ and $u\left(\lambda \right)$

Many studies have focused on the relationship between $R_{\mathrm{rs}}\left(\lambda \right)$ and $u\left(\lambda \right)$ [5,6,11,15]. Morel and Gentili (2007) performed calculations using lookup tables (MG07) [11]. Gordon (1988) developed an empirical algorithm based on in situ data (G88) [5]. ZhongPing Lee (2004) also developed an empirical algorithm (L04) [6], and Lee (2009) developed the quasi-analytical algorithm (QAA), which includes the relationship between $R_{\mathrm{rs}}\left(\lambda \right)$ and $u\left(\lambda \right)$ (QAA) [15]. The relationship between $R_{\mathrm{rs}}\left(\lambda \right)$ and $u\left(\lambda \right)$ has two parts. The first is the relationship between $r_{rs}\lambda$ and $u\left(\lambda \right)$. The other is the relationship between $R_{\mathrm{rs}}\left(\lambda \right)$ and $r_{rs}\lambda$.

2.1.1. Relationship between $r_{rs}\lambda$ and $u\left(\lambda \right)$

GM07: $f^{\prime }\left(\lambda \right)$ and $Q\left(\lambda \right)$ are in the lookup tables, based on the sun zenith, Chla, observation angle, and relative azimuth [11].

G88: The relationship between $r_{rs}\lambda$ and $u\left(\lambda \right)$ is given as [5]:

$$r_{rs}\mathsf{\lambda }={\displaystyle \sum }_{i=1}^2{g}_i\times u{\left(\lambda \right)}^i$$

(5)

where $g_1$=0.0949 and $g_2$=0.0794.

QAA: The relationship between $r_{rs}\lambda$ and $u\left(\lambda \right)$ is given as [15]:

$$r_{rs}\lambda =g_0\times u\left(\lambda \right)+g_1\times u{\left(\lambda \right)}^2$$

(6)

where $g_0$= 0.089 and $g_1$= 0.125.

L04: $u\left(\lambda \right)$ divided into $\frac{b_{bw}\left(\lambda \right)}{a\left(\lambda \right)+b_b\left(\lambda \right)}$ and $\frac{b_{bp}\left(\lambda \right)}{a\left(\lambda \right)+b_b\left(\lambda \right)}$, then the relationship between $r_{rs}\mathsf{\lambda }$ and $u\left(\lambda \right)$ was given as [6]:

$$r_{rs}\lambda =0.113\times \frac{b_{bw}\left(\lambda \right)}{a\left(\lambda \right)+b_b\left(\lambda \right)}+g_p\times \frac{b_{bp}\left(\lambda \right)}{a\left(\lambda \right)+b_b\left(\lambda \right)}$$

(7)

where $g_p=0.2\times (1-0.63\times \exp \left(-2.448\times \frac{b_{bp}\left(\lambda \right)}{a\left(\lambda \right)+b_{bp}\left(\lambda \right)}\right)$.

2.1.2. Relationship between ${\mathrm{R}}_{rs}\left(\lambda \right)$ and $r_{rs}\lambda$

IOCCG: The relationship between $R_{\mathrm{rs}}\left(\lambda \right)$ and $r_{rs}\lambda$ is a constant, $\Re \approx 0.5294$ (IOCCG, 2006).

L04: The relationship between $R_{\mathrm{rs}}\left(\lambda \right)$ and $r_{rs}\lambda$ is nonlinear [6].

$$R_{\mathrm{rs}}\left(\lambda \right)=\frac{0.52\times r_{rs}\lambda }{1-1.7\times r_{rs}\lambda }$$

(8)

2.2. $b_b\left(\lambda \right)$. and $a\left(\lambda \right)$ Model

As Chla is the only influencing factor in Case $\mathsf{{\rm I}}$ water, many researchers have developed the $b_b\left(\lambda \right)$ and $a\left(\lambda \right)$ model with the Chla concentration.

$a\left(\lambda \right)$ can be divided into the particle absorption coefficient ($a_p\left(\lambda \right)$), colored dissolved organic matter (CDOM) absorption coefficient ($a_g\left(\lambda \right)$), and pure water absorption coefficient ($a_w\left(\lambda \right)$) in Case $\mathsf{{\rm I}}$ water.

$$a\left(\lambda \right)=a_p\left(\lambda \right)+a_g\left(\lambda \right)+a_w\left(\lambda \right)$$

(9)

$b_b\left(\lambda \right)$ can be divided into the particle backscattering coefficients ($b_{bp}\left(\lambda \right)$) and pure water backscattering coefficients ($b_{bw}\left(\lambda \right)$) in Case $\mathsf{{\rm I}}$ water.

$$b_b\left(\lambda \right)=b_{bp}\left(\lambda \right)+b_{bw}\left(\lambda \right)$$

(10)

where $b_{bw}\left(\lambda \right)=\frac{1}{2}\times b_w\left(\lambda \right)$.

The pure water scattering coefficients and absorption coefficients were obtained from Smith and Baker (1978) [16] and Pope and Fly (1997) [17].

2.2.1. MM01 Model

The relationship between the particle backscattering coefficients ($b_{bp}\left(\lambda \right)$) and Chla concentration in the MM01 model is given as [10]:

$$b_{bp}\left(\lambda \right)=\left\{0.002+0.01\times \left[0.50-0.25\times lo{g}_{10}Chla\right]\right\}{\left(\frac{\lambda }{550}\right)}^v\times b_p\left(550\right)$$

(11)

where $Chla$ is the Chla concentration, $b_p\left(550\right)=0.416\times Chl{a}^{0.766}$, $v=\left\{\begin{array}{c}0.5\times \left[lo{g}_{10}Chl-0.3\right] 0.02\le Chla<2\\ 0 Chla\ge 2\end{array}\right.$.

The absorption coefficient ($a\left(\lambda \right)$) can be calculated using the diffuse attenuation coefficient ($K_d\left(\lambda \right)$), which is given as:

$$a\left(\lambda \right)=K_d\left(\lambda \right){\mu }_d\left(\lambda \right){\left[1+2.25R\left(\lambda \right)\right]}^{-1}\left[1-R\left(\lambda \right)\right]$$

(12)

where $R\left(\lambda \right)=f\left(\lambda \right)\times \frac{b_b\left(\lambda \right)}{a\left(\lambda \right)}$, and ${\mu }_d\left(\lambda \right)$ is the cosine of the downward irradiance. $K_d\left(\lambda \right)$ is given as:

$$K_d\left(\lambda \right)=a_w\left(\lambda \right)+b_{bw}\left(\lambda \right)+\mathsf{\chi }\left(\lambda \right)\times {\mathrm{Chla}}^{e\left(\lambda \right)}$$

(13)

where $\mathrm{Chla}$ is the Chla concentration. $\mathsf{\chi }\left(\lambda \right)$ and $e\left(\lambda \right)$ are obtained from look up tables. As $a\left(\lambda \right)$ is included in the relationship of $R\left(\lambda \right)$, the initial value of $a\left(\lambda \right)$ ($a\left(\lambda \right)=0.75\times K_d\left(\lambda \right))$ can be input and the final $a\left(\lambda \right)$ can be obtained after a few iterations.

2.2.2. MG07 Model

Based on the MM01 model, Morel and Gentili (2007) added in situ data and improved the method for estimating the absorption coefficient [11]. $\mathsf{\chi }\left(\lambda \right)$, $e\left(\lambda \right)$ and ${\mu }_d\left(\lambda \right)$ were similar to MM01, and the absorption coefficient is given as:

$$a\left(\lambda \right)=0.962\times K_d\left(\lambda \right)\times {\mu }_d\left(\lambda \right)\times \left[1-\frac{b_b\left(\lambda \right)}{a\left(\lambda \right)+b_b\left(\lambda \right)}\right]$$

(14)

We improved the method for determining the absorption coefficient based on MG07, which is the same as MG07:

$$a\left(\lambda \right)+b_b\left(\lambda \right)=0.962\times K_d\left(\lambda \right)\times {\mu }_d\left(\lambda \right).$$

(15)

2.2.3. MO14 Model

Mobley (2014) developed a new IOP model [12].

$a_p\left(\lambda \right)$ was given as:

$$a_p\left(\lambda \right)=A\left(\lambda \right)Chl{a}^{E\left(\lambda \right)}$$

(16)

$a_g\left(\lambda \right)$ was given as:

$$a_g\left(\lambda \right)=a_g\left(440\right)\exp \left[-{\mathrm{S}}_g\left(\lambda -440\right)\right]$$

(17)

where ${\mathrm{S}}_g=0.014n{m}^{-1}$, and $a_g\left(440\right)=0.2\times a_p\left(440\right)$.

In relation to $b_b\left(\lambda \right)$, Mobley suggested that the performance of the particle attenuation coefficient ($c_p\left(\lambda \right)$) was better than that of the particle backscattering coefficients ($b_p\left(\lambda \right)$) and $b_p\left(\lambda \right)=c_p\left(\lambda \right)-a_p\left(\lambda \right)$. Then, the $c_p\left(\lambda \right)$ is given as:

$$c_p\left(\lambda \right)=0.407\times {\mathrm{Chla}}^{0.795}\times {\left(\frac{\lambda }{660}\right)}^v$$

(18)

where $Chla$ is the Chla concentration and $\lambda$ is the wavelength. $v$ is the same as in Equation (11).

$$b_{bp}\left(\lambda \right)=b_p\left(\lambda \right)\times B_p\left(\lambda \right)$$

(19)

where $B_p=0.0019+0.010346\left(0.50-0.25\times lo{g}_{10}Chla\right)$.

2.2.4. Hydrolight LUTs

Mobley et al. (2005) constructed RT-based LUTs using the commercial software HydroLight [18]. The approach was developed for inverting hyperspectra $R_{\mathrm{rs}}\left(\lambda \right)$ to derive IOPs without the need for in situ ancillary data. This study used the Abcase1 Module in HydroLight with a wind speed of 0 m/s and sun zenith equal to 0°. The results included Raman scattering and fluorescence, and $B_p$ was calculated as shown in Equation (19).

3. Data and Method

3.1. NOMAD Data Set

Version 2.a of the NOMAD was downloaded from the SeaBASS website (https://seabass.gsfc.nasa.gov/wiki/NOMAD (accessed on 12 July 2021). The NOMAD includes over 3400 stations reporting spectral water-leaving radiances, surface irradiances, and diffuse down-welling attenuation coefficients, encompassing Chla concentrations of 0.012 to 72.12 mg m⁻³. The NOMAD was compiled by the NASA Ocean Biology Processing Group at the Goddard Space Flight Center, Maryland, USA using generous data contributions from the ocean color research community.

The NOMAD is quality-controlled following three steps to obtain accurate data in Case $\mathsf{{\rm I}}$ water. First, the Chla concentration was measured by high-performance liquid chromatography. Second, $R_{\mathrm{rs}}\left(\lambda \right)$ was measured using the in-water method. Finally, $R_{\mathrm{rs}}\left(\lambda \right)$ was classified according to Wei et al. [19], and types 1–4 remained. After quality control, 521 stations remained, as shown in Figure 1.

The optical properties of case-1 water were dominated by phytoplankton, although there were also CDOM and suspended sediment. All of these were all accompanied by the death of phytoplankton. Therefore, the approximate shape of the spectrum was the same, and the spectrum decreased as the band increased. Classes 1–4 belong to this category. In natural water, there is no Case-1 water with a high chlorophyll concentration, as the nutrients required for the algae growth are imported from land sources, accompanied by CDOM and suspended sediments.

3.2. SCS Data Set

In situ data were collected from the coastal and offshore waters of the SCS (Figure 2). Most stations are situated around the Pearl River and Hainan Island. The $R_{\mathrm{rs}}\left(\lambda \right)$ is an in-water optical measurement obtained using HyperPro II (Satlantic), following the NASA ocean-optical protocols [20,21]. The Chla concentration was measured by high-performance liquid chromatography and it ranged from 0.0458 to 0.1869 mg m⁻³. The number of stations in the SCS is 58.

3.3. Statistical Method

Several statistical parameters were used to evaluate the model match-up results. The definitions of the parameters are as follows.

Bias: $Bias=\frac{1}{n}{{\displaystyle \sum }}_{i=1}^{i=n}\left(X_i-Y_i\right)$

Absolute percentage difference (APD): $APD=\frac{1}{n}{{\displaystyle \sum }}_{i=1}^{i=n}\left(\left|\frac{X_i-Y_i}{Y_i}\right|\right)\times 100\%$

Relative percentage difference (RPD): $RPD=\frac{1}{n}{{\displaystyle \sum }}_{i=1}^{i=n}\left(\frac{X_i-Y_i}{Y_i}\right)\times 100\%$

where $X_i$ is the ith model-retrieved value, $Y_i$ is the ith in situ value, and $n$ is the number of match-up data points.

4. Results and Discussion

4.1. Difference between the Four ORM Models

4.1.1. Difference between $a\left(\lambda \right)$ and $b_b\left(\lambda \right)$ of the Four ORM Models

The $a_{ph}^{*}\left(443\right)\left(\frac{a_p\left(443\right)}{Chla}\right)$ and $a_{ph}^{*}\left(488\right)\left(\frac{a_p\left(488\right)}{Chla}\right)$ from the MM01, MG07 and MO14 models are shown in Figure 3. The value of $a_{ph}^{*}\left(443\right)$ of MG07 was larger than that of the other ORM models for all chlorophyll concentrations. The value of $a_{ph}^{*}\left(488\right)$ of MG07 was larger than that of the other ORM models, except when the chlorophyll concentration was less than 0.3 mg m⁻³. The value of $a_{ph}^{*}\left(488\right)$ of MO14 was larger than that of the other ORM models, when the chlorophyll concentration was less than 0.3 mg m⁻³.

The differences in $a\left(\lambda \right)$ and $b_b\left(\lambda \right)$ of the G88, QAA, MG07, and L04 models are shown in Figure 4. We found that the value of $a\left(\lambda \right)$ of MG07 was larger than that of the other ORM models, particularly at 400–600 nm when the concentration of chlorophyll was high. The behavior of $b_b\left(\lambda \right)$ was the same for MM01 and MG07. The value of $b_b\left(\lambda \right)$ in the LUTs was less than that of the other ORM models when the concentration of chlorophyll was high.

4.1.2. Difference between the $r_{rs}\left(\lambda \right)$ Values of the Four ORM Models

The differences in $r_{rs}\lambda$ of the G88, QAA, MG07, and L04 models are shown in Figure 5. We found that the difference in $r_{rs}\lambda$ was small when the concentration of chlorophyll was large. As the Chla concentration decreased, the difference became increasingly large. The difference in $r_{rs}\lambda$ between QAA and GM07 reached 15% at 488 nm and 20% at 510–580 nm when the concentration of chlorophyll was 0.03 mg m⁻³.

4.1.3. Relationship between $R_{\mathrm{rs}}\left(\lambda \right)$ and $r_{rs}\left(\lambda \right)$

The differences in $R_{\mathrm{rs}}\left(\lambda \right)$ between formula (8) and $\Re$ ≈ 0.5291 are shown in Figure 6. The differences in $R_{\mathrm{rs}}\left(\lambda \right)$ between the four models are shown in Figure 7. The $R_{\mathrm{rs}}\left(\lambda \right)$ values of the four models were similar, particularly at 670 nm. The $R_{\mathrm{rs}}\left(\lambda \right)$ of MM01 was larger than that of the other models at 412 and 443 nm when the concentration of chlorophyll was less than 0.1 mg m⁻³. The $R_{\mathrm{rs}}\left(\lambda \right)$ of MO14 was larger than that of the other models when the concentration of chlorophyll was greater than 0.1 mg m⁻³.

4.1.4. Difference between $R_{\mathrm{rs}}\left(\lambda \right)$ of the Four ORM Models

4.2. Global and SCS Performances of the Four Models

The chlorophyll concentration according to NOMAD or SCS data after quality control was used as the input to the four models, and the in situ spectrum data and model output spectrum data were compared to analyze which model performed the best. The first test involved NOMAD and the second involved the SCS dataset. The scope of the in situ spectrum data was larger than that of the model output, as the data measured by the field instrument are influenced by many factors, such as the self-shadow of the instrument, error of the underwater extrapolation method, introduction error of water layering, bidirectional reflectivity, and packing effect of phytoplankton. The outputs of the models are equivalent to the outputs of theoretical analyses, and the model is not comprehensive compared to reality, particularly when simulating backscattering and CDOM absorption, and thus, variation ranges of the models are not as large as those of the data measured by field instruments.

4.2.1. Global Performance of the Four ORM Models

The differences in $R_{\mathrm{rs}}\left(\lambda \right)$ between the four models are shown in Figure 8. The $R_{\mathrm{rs}}\left(\lambda \right)$ values of the four models were similar, especially at 670 nm. The $R_{\mathrm{rs}}\left(\lambda \right)$ of MM01 was larger than that of the other models at 412 and 443 nm when the concentration of chlorophyll was less than 0.1 mg m⁻³. The $R_{\mathrm{rs}}\left(\lambda \right)$ of MO14 was larger than that of the other models when the concentration of chlorophyll was more than 0.1 mg m⁻³.

Comparisons between the $R_{\mathrm{rs}}\left(\lambda \right)$ of the four models with NOMAD data are shown in Figure 8, and the statistical parameters are listed in

Table 1. Statistical parameter of MM01, MG07, MO14 and LUTs models using the NOMAD dataset.

Model		${\mathit{R}}_{\mathbf{rs}}\left(411\right)$	${\mathit{R}}_{\mathbf{rs}}\left(443\right)$	${\mathit{R}}_{\mathbf{rs}}\left(489\right)$	${\mathit{R}}_{\mathbf{rs}}\left(510\right)$	${\mathit{R}}_{\mathbf{rs}}\left(555\right)$	${\mathit{R}}_{\mathbf{rs}}\left(670\right)$
MO14	BIAS (sr−1)	0.00172	−0.00049	−0.00070	−0.00063	−0.00001	0.00002
	RPD (%)	32.05	1.76	−6.03	−11.70	5.05	31.07
	APD (%)	37.20	21.58	20.92	23.81	21.49	42.57
	R2	0.7006	0.7144	0.4914	0.0731	0.2717	0.3964
MM01	BIAS (sr−1)	0.00020	−0.00056	−0.00053	−0.00065	−0.00001	0.00003
	RPD (%)	9.70	−1.59	−4.10	−12.74	4.71	42.17
	APD (%)	26.15	20.80	18.06	22.34	19.64	50.46
	R2	0.7144	0.721	0.4925	0.0226	0.2686	0.3971
MG07	BIAS (sr−1)	−0.00134	−0.00159	−0.00135	−0.00094	−0.00019	0.00003
	RPD (%)	−9.73	−16.65	−19.74	−21.23	−6.11	43.24
	APD (%)	25.50	25.69	25.74	27.30	19.02	50.83
	R2	0.7144	0.722	0.4911	0.0641	0.2735	0.397
LUTs	BIAS (sr−1)	0.00088	−0.00096	−0.00140	−0.00121	−0.00033	0.00005
	RPD (%)	20.82	−6.34	−20.42	−29.03	−14.82	56.54
	APD (%)	30.43	22.16	26.50	33.42	22.57	61.57
	R2	0.7023	0.7131	0.4856	0.0456	0.2443	0.3995

. The global performance of the four ORMs was good. The APD in $R_{\mathrm{rs}}\left(\lambda \right)$ of the four models was less than 30%, especially in the 670-nm band and a few other bands. The $R_{\mathrm{rs}}\left(\lambda \right)$ values of all the models were less than those of the in situ data at 443, 489, 510, and 555 nm. According to the APD, the best bands of MM01, MO14, MG07, and LUTs were 489, 489, 555 and 443 nm, respectively, which were better than 25% and 20%(MM01). For 411 nm, MG07 and MM01 were better than LUTs, and MO14 was the worst. For 443 nm, MO14 and MM01 were better than LUTs, and MG07 was the worst. For 489 and 510 nm, MO14 and MM01 were better than MG07, and LUTs was the worst. For 555 nm, MG07 and MM01 were better than MO14, and LUTs was the worst. For 670 nm, MO14 was the best, and LUTs was the worst. In the global range, MM01 was the best ORM model.

4.2.2. SCS Performance of the Four ORM Models

The scatter plot of the comparison between the $R_{\mathrm{rs}}\left(\lambda \right)$ of the four models with SCS data is shown in Figure 9, and the statistical parameters are shown in

Table 2. Statistical parameters between MM01, MG07, MO14 and LUTs models using the South China Sea dataset.

Model		${\mathit{R}}_{\mathbf{rs}}\left(412\right)$	${\mathit{R}}_{\mathbf{rs}}\left(443\right)$	${\mathit{R}}_{\mathbf{rs}}\left(488\right)$	${\mathit{R}}_{\mathbf{rs}}\left(510\right)$	${\mathit{R}}_{\mathbf{rs}}\left(555\right)$	${\mathit{R}}_{\mathbf{rs}}\left(670\right)$
MO14	BIAS (sr−1)	0.00186	−0.00014	−0.00054	−0.00050	−0.00021	−0.00049
	RPD (%)	19.23	−1.37	−9.14	−14.38	−11.85	−80.17
	APD (%)	19.23	7.29	9.32	14.38	12.34	80.17
	R2	0.327	0.335	0.1642	0.0033	0.0049	0.0416
MM01	BIAS (sr−1)	0.00021	−0.00004	−0.00017	−0.00042	−0.00018	−0.00048
	RPD (%)	2.29	−0.24	−2.71	−11.97	−9.93	−78.56
	APD (%)	9.04	8.06	6.00	11.97	10.62	78.56
	R2	0.3024	0.3224	0.1679	0.0029	0.005	0.0416
MG07	BIAS (sr−1)	−0.00161	−0.00125	−0.00104	−0.00066	−0.00029	−0.00048
	RPD (%)	−16.21	−15.74	−18.08	−19.03	−17.01	−78.25
	APD (%)	17.29	16.16	18.08	19.03	17.01	78.25
	R2	0.3007	0.3169	0.1577	0.001	0.005	0.0416
LUTs	BIAS (sr−1)	0.00090	−0.00056	−0.00110	−0.00094	−0.00041	−0.00046
	RPD (%)	9.50	−6.81	−19.25	−27.05	−24.06	−75.74
	APD (%)	10.35	9.09	19.25	27.05	24.06	75.74
	R2	0.3234	0.335	0.1797	0.0679	0.0053	0.0423

. The performances of the four ORMs were good in the SCS. The APD of $R_{\mathrm{rs}}\left(\lambda \right)$ of the four models was less than 30%, particularly at 670 nm. The $R_{\mathrm{rs}}\left(\lambda \right)$ values of all the models were less than those of the in situ data at 443, 489, 510, and 555 nm. According to APD, the best bands for MM01, MO14, MG07, and LUTs were at 443, 488, 443, and 443 nm, respectively, which were better than 17% and 6% (MM01). According to the APD, MM01 was better than 10% for 412, 443 and 488 nm. For 555 and 510 nm, MM01 was the best. For 670 nm, MM01, MG07, and LUTs were similar, and MO14 was the worst. Therefore, MM01 was the best ORM model in the SCS.

4.2.3. Performance of the Four Models at Different Chlorophyll Concentrations

Chlorophyll concentration is the input to the ORM, and it typically related to the types of sea areas, such as oligotrophic oceans, open oceans, and coastal areas. The monthly average MODIS data (from 2002 to 2015) were used to calculate the average value of chlorophyll in the oligotrophic ocean, as shown in Figure 4.1 of Volume 14 of the IOCCG report. The mean chlorophyll was generally less than 0.07 mg m⁻³ in the oligotrophic ocean. The chlorophyll concentration was typically less than 0.3 mg m⁻³, and greater than 0.07 mg m⁻³ in the open ocean, such as in the SCS. The chlorophyll concentration was typically greater than 0.3 mg m⁻³ in coastal areas. The regions of global ocean based on the chlorophyll concentration are shown in Figure 10. Below, we discuss the performances of the four models for different chlorophyll concentrations (the figures and tables are shown in the Appendix A, Figure A1, Figure A2 and Figure A3,

Table A1. Statistical parameters of MM01, MG07, MO14, and LUTs models in oligotrophic ocean.

Model		${\mathit{R}}_{\mathbf{rs}}\left(411\right)$	${\mathit{R}}_{\mathbf{rs}}\left(443\right)$	${\mathit{R}}_{\mathbf{rs}}\left(489\right)$	${\mathit{R}}_{\mathbf{rs}}\left(510\right)$	${\mathit{R}}_{\mathbf{rs}}\left(555\right)$	${\mathit{R}}_{\mathit{rs}}\left(670\right)$
MO14	BIAS (sr−1)	0.00101	−0.00189	−0.00152	−0.00105	−0.00025	−0.00001
	RPD (%)	13.82	−14.10	−20.54	−25.84	−14.57	−1.93
	APD (%)	22.70	18.83	21.68	26.27	16.78	17.30
MM01	BIAS (sr−1)	0.00006	−0.00119	−0.00090	−0.00088	−0.00020	0.00001
	RPD (%)	5.65	−7.81	−11.63	−21.53	−10.96	7.62
	APD (%)	20.23	15.69	14.39	22.40	14.28	20.17
MG07	BIAS (sr−1)	−0.00248	−0.00265	−0.00172	−0.00105	−0.00027	0.00001
	RPD (%)	−13.87	−21.55	−23.59	−25.89	−15.67	8.45
	APD (%)	22.19	24.06	24.31	26.22	17.27	19.30
LUTs	BIAS (sr−1)	−0.00007	−0.00224	−0.00202	−0.00140	−0.00038	0.00001
	RPD (%)	5.39	−17.43	−27.93	−34.95	−22.86	18.35
	APD (%)	20.37	21.02	28.46	34.95	23.46	24.44

,

Table A2. Statistical parameters of MM01, MG07, MO14, and LUTs models in open ocean.

Model		${\mathit{R}}_{\mathbf{rs}}\left(412\right)$	${\mathit{R}}_{\mathbf{rs}}\left(443\right)$	${\mathit{R}}_{\mathbf{rs}}\left(488\right)$	${\mathit{R}}_{\mathbf{rs}}\left(510\right)$	${\mathit{R}}_{\mathbf{rs}}\left(555\right)$	${\mathit{R}}_{\mathbf{rs}}\left(670\right)$
MO14	BIAS (sr−1)	0.00205	−0.00020	−0.00064	−0.00064	−0.00006	0.00003
	RPD (%)	45.90	7.16	−5.78	−13.19	0.46	45.15
	APD (%)	49.24	24.54	20.55	21.00	15.45	49.38
MM01	BIAS (sr−1)	0.00032	−0.00038	−0.00046	−0.00063	−0.00005	0.00004
	RPD (%)	19.54	3.62	−2.68	−13.09	1.04	57.03
	APD (%)	33.28	23.43	18.74	20.35	15.18	59.29
MG07	BIAS (sr−1)	−0.00115	−0.00140	−0.00132	−0.00092	−0.00021	0.00004
	RPD (%)	−1.70	−12.56	−19.10	−21.55	−8.88	58.48
	APD (%)	30.97	27.10	25.84	25.39	16.24	60.62
LUTs	BIAS (sr−1)	0.00121	−0.00067	−0.00130	−0.00117	−0.00034	0.00006
	RPD (%)	33.40	−0.65	−18.68	−28.52	−16.44	75.29
	APD (%)	40.37	24.23	25.83	30.81	20.41	76.24

and

Table A3. Statistical parameters of MM01, MG07, MO14 and LUTs models in coastal area.

Model		${\mathit{R}}_{\mathbf{rs}}\left(412\right)$	${\mathit{R}}_{\mathbf{rs}}\left(443\right)$	${\mathit{R}}_{\mathbf{rs}}\left(488\right)$	${\mathit{R}}_{\mathbf{rs}}\left(510\right)$	${\mathit{R}}_{\mathbf{rs}}\left(555\right)$
MO14	BIAS (sr−1)	0.00170	0.00073	0.00056	0.00021	0.00020
	RPD (%)	229.39	80.96	49.75	33.38	26.50
	APD (%)	234.39	90.69	60.21	48.17	39.12
MM01	BIAS (sr−1)	0.00046	0.00016	0.00013	−0.00016	0.00004
	RPD (%)	151.66	54.94	33.40	18.71	18.73
	APD (%)	168.93	73.73	50.16	41.50	34.73
MG07	BIAS (sr−1)	−0.00023	−0.00037	−0.00050	−0.00056	−0.00031
	RPD (%)	110.50	32.44	11.14	2.98	0.49
	APD (%)	140.44	63.58	43.35	39.46	29.59
LUTs	BIAS (sr−1)	0.00117	0.00010	−0.00055	−0.00088	−0.00059
	RPD (%)	196.22	52.11	8.65	−9.59	−13.47
	APD (%)	204.90	72.30	42.91	40.96	31.48

).

The four models performed best in oligotrophic oceans, followed by open oceans, and coastal areas performed the worst. In oligotrophic oceans, the APDs of the four models reached 25%, excluding individual bands. In the open ocean, the APDs of the four models reached 30%, excluding individual bands. In coastal areas, the APDs of the four models were close to 50% or higher. In oligotrophic saline bodies and open oceans, the performance results of the four models were acceptable. The statistical results showed that the MM01 model was the best in open and oligotrophic oceans.

4.3. Comparison of the Chlorophyll Algorithm and ORM Models

The chlorophyll concentrations from the NOMAD or SCS data after quality control were used as the input for the four models, and the model output spectrum data and in situ spectrum data were used as the input for the chlorophyll algorithm. OC4 corresponds to running the SeaWiFS algorithm, and OC3 is based on the algorithm developed by NOMAD for SeaWiFS. First, we compared the differences between the calculation results of the different chlorophyll algorithms of the four models and measured chlorophyll on site; then compared the difference between the best model output and NOMAD field spectrum output results.

The performances of the MM01, MG07, MO14, and LUT models with the chlorophyll algorithm are shown in Figure 11 (left), and the statistical parameters of the MM01, MG07, MO14, and LUT models are shown in

Table 3. Statistical parameter of chlorophyll algorithm (OC3 and OC4) between MM01, MG07, MO14, and LUT models and in situ spectrum.

Model		$\mathbf{MM}01$	$\mathbf{MG}07$	$\mathbf{MO}14$	$\mathbf{LUTs}$	In Situ
OC4	BIAS (mg m−3)	−0.03677	−0.03643	−0.08382	−0.15460	0.05355
	RPD (%)	−2.66	7.65	−8.35	−25.40	13.01
	APD (%)	8.13	17.06	14.35	25.61	40.13
OC3	BIAS (mg m−3)	−0.04464	−0.04020	−0.08447	−0.15132	0.01522
	RPD (%)	−2.02	8.94	−7.60	−25.04	10.32
	APD (%)	7.31	17.37	12.28	25.09	37.45

. By comparing the output chlorophyll results of the four models with the onsite measured chlorophyll algorithm, we found that MM01 gave the best results, regardless of whether the OC3 or OC4 chlorophyll algorithm was used. All data measured on site indicated higher chlorophyll concentrations than those indicated by results of the model. This difference was particularly notable in areas with high chlorophyll concentrations. The difference between the chlorophyll concentration output by MM01 and that measured on site was the smallest. The RPD reached below 3%, and the APD was below 10%, which was much better than that of other models for which the RPDs were approximately 7% or more and the APDs were more than 10%. Gordon et al. also verified the semi-analytic radiance model and used the model to develop a chlorophyll algorithm [22]. Lee et al. verified the forward reflectance models based on the stratification of water bodies and demonstrated the validity of the model [23]. As shown by Lee et al. [23], algorithm development and verification using surface Chla is useful, as these data are very easy to collect and generally available for all field measurements. Therefore, we only used surface Chla as the input for the ORM model.

The chlorophyll output results of the measured spectrum of NOMAD showed more obvious fluctuations, as shown in the scatter plot of comparisons with MM01 (Figure 10, right). The chlorophyll inverted by MM01 was mostly a straight line, and the inversion result of the NOMAD was very scattered. The statistical results of NOMAD were similar. The difference between the RPD and similar results of the model were minimal, although there was a significant difference in the APD.

5. Conclusions

Based on the NOMAD and SCS datasets, we tested and verified the four ORM models. Our conclusions were as follows:

• For the relationship between $R_{\mathrm{rs}}\left(\lambda \right)$ and $u\left(\lambda \right)$, the four ORM models were similar at high Chla concentrations. The differences between the four ORMs increased when the Chla concentration decreased.
• In the model of the absorption coefficient, the differences between the four ORM models were large, and MG07 was overestimated compared to the others. In the backscattering coefficients model, the differences between the four ORM models were small, and LUTs underestimated the others, where the Chla concentration was high.
• Analysis of four ORM models and in situ match-ups of remote-sensing reflectance data showed that the model-derived $R_{\mathrm{rs}}\left(\lambda \right)$ values were less than those of the in situ data. The highest uncertainty was observed at 670 nm, and the APDs of the four ORM models were less than 30% globally and 20% in the SCS. The APD of MM01 was similar or better than 20% globally and in the SCS. The global and SCS performances of MM01 were better than those of the other models.
• The inversion effects of the models at different chlorophyll concentrations showed that the four models performed best when the chlorophyll concentration was less than 0.07 mg m⁻³, and chlorophyll concentration was between 0.07 and 0.3 mg m⁻³, and performance was poor when the chlorophyll concentration was greater than 0.3 mg m⁻³.
• The applicability of the four ORM models to the chlorophyll algorithm was compared, and the chlorophyll algorithm was analyzed using on-site spectrum measurements. The MM01 model performed best among all models; the RPD was below 3%, and the APD was below 10%. The performance of the on-site data for the algorithm was worse than that of all models, and the data dispersion was higher.