Next Article in Journal
A Near-infrared Turn-on Fluorescent Sensor for Sensitive and Specific Detection of Albumin from Urine Samples
Previous Article in Journal
Speed Calibration and Traceability for Train-Borne 24 GHz Continuous-Wave Doppler Radar Sensor
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Sensors
Volume 20
Issue 4
10.3390/s20041231
sensors-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Estimation of the Yield and Plant Height of Winter Wheat Using UAV-Based Hyperspectral Images

by
Huilin Tao
1,2,
Haikuan Feng
1,3,4,*,
Liangji Xu
2,
Mengke Miao
1,3,
Guijun Yang
1,3,4,
Xiaodong Yang
1,3,4 and
Lingling Fan
1,3
1
Key Laboratory of Quantitative Remote Sensing in Agriculture, Ministry of Agriculture and Rural Affairs, China, Beijing Research Center for Information Technology in Agriculture, Beijing 100097, China
2
School of Geodesy and Geomatics, Anhui University of Science and Technology, Huainan 232001, China
3
National Engineering Research Center for Information Technology in Agriculture, Beijing 100097, China
4
Beijing Engineering Research Center for Agriculture Internet of Things, Beijing 100097, China
*
Author to whom correspondence should be addressed.
Sensors 2020, 20(4), 1231; https://doi.org/10.3390/s20041231
Submission received: 13 February 2020 / Revised: 21 February 2020 / Accepted: 22 February 2020 / Published: 24 February 2020
(This article belongs to the Section Remote Sensors)
Browse Figures
Versions Notes

Abstract

:
Crop yield is related to national food security and economic performance, and it is therefore important to estimate this parameter quickly and accurately. In this work, we estimate the yield of winter wheat using the spectral indices (SIs), ground-measured plant height (H), and the plant height extracted from UAV-based hyperspectral images (HCSM) using three regression techniques, namely partial least squares regression (PLSR), an artificial neural network (ANN), and Random Forest (RF). The SIs, H, and HCSM were used as input values, and then the PLSR, ANN, and RF were trained using regression techniques. The three different regression techniques were used for modeling and verification to test the stability of the yield estimation. The results showed that: (1) HCSM is strongly correlated with H (R2 = 0.97); (2) of the regression techniques, the best yield prediction was obtained using PLSR, followed closely by ANN, while RF had the worst prediction performance; and (3) the best prediction results were obtained using PLSR and training using a combination of the SIs and HCSM as inputs (R2 = 0.77, RMSE = 648.90 kg/ha, NRMSE = 10.63%). Therefore, it can be concluded that PLSR allows the accurate estimation of crop yield from hyperspectral remote sensing data, and the combination of the SIs and HCSM allows the most accurate yield estimation. The results of this study indicate that the crop plant height extracted from UAV-based hyperspectral measurements can improve yield estimation, and that the comparative analysis of PLSR, ANN, and RF regression techniques can provide a reference for agricultural management.

1. Introduction

Winter wheat is one of the most widely cultivated food crops in the world. Due to its high economic and nutritional value, the study of winter wheat is particularly important. The timely and accurate prediction of crop yield is an urgent issue in precision agriculture, and is of great significance for the formulation of national food policies, price regulation, the development of rural economies, and foreign food trade. Such prediction also assists agricultural managers in decision-making [1,2]. Standardized winter-wheat breeding requires the growth monitoring and yield forecasting of many plants. However, traditional methods of measuring yield can cause damage to crops, are time- and energy-intensive, have a low temporal and spatial resolution, and cannot be applied to large areas [3,4].
All objects absorb and reflect electromagnetic waves of different wavelengths. Different objects exhibit different spectral characteristics, and therefore objects can be identified based on their reflectance spectra. Remote sensing technology is developing rapidly, and can be used to obtain accurate crop canopy reflectance spectra in a dynamic and fast way. In turn, these spectra can be used to infer physiological and biochemical characteristics of crop canopies. There are various ways to obtain remote sensing technology, such as ground platforms, unmanned aerial vehicles (UAVs), and satellite platforms. Ground platforms cannot obtain orthophotos, and the data acquisition process requires large amounts of manpower and material resources, and moreover can cause damage to crops. However, both satellite remote sensing technology and UAV remote sensing technology can be used to monitor crops in a non-destructive way. Satellite remote sensing technology can be used to obtain information over a large scale [5,6], however it suffers from problems such as mixed pixels, long observation period, and low spatial and temporal resolution [7,8,9]. Unlike satellite remote sensing technology, UAV remote sensing technology can be used to monitor crops at a regional scale. It has the characteristics of low cost, convenient operation, high efficiency, high spatial and temporal resolution, and flexible measurement. Consequently, UAV remote sensing technology has begun to be applied for the acquisition of agricultural environmental information and crop monitoring [10,11,12,13]. The UAV sensors used for this purpose are mostly multispectral and digital cameras [14,15]. Multispectral and digital cameras are cheaper and lighter than hyperspectral cameras. However, hyperspectral sensors can obtain more specific information about the physiological parameters of crops [16,17,18,19,20,21,22,23]. Crop information obtained from hyperspectral sensors has been used to establish yield prediction models [23]. Therefore, as an efficient and accurate means to estimate crop yield, UAV-based hyperspectral measurements have received increasing attention from agricultural researchers.
Remote sensing technology can be used to estimate crop yield in various ways. However, crop yield is mainly estimated using either physical or statistical models. Both kinds of model have advantages and disadvantages [24]. Physical models are usually divided into a process model and a parameter model. Physical models are highly mechanical and can simulate the growth of crops, however the simulation requires a large number of input parameters, such as canopy physiological and biochemical parameters, soil data, weather data, and crop variety information. For example, in a previous study, soil data, the content of different components in crop leaves, and a vegetation index were used evaluate rapeseed yield using a physical model [25]. However, the data which are required as input to physical models are often difficult to obtain, which limits the application of physical models. In contrast, statistical models are mainly based on the relationship between remote sensing information and crop yield [26]. The estimation of crop yield using statistical models is mainly divided into two categories: The first includes direct estimation based on a vegetation index, such as the analysis of crop spectral characteristics to construct an inversion model [27]; the construction of a linear estimation model using a vegetation index [28]; and the second includes regression techniques, such as those based on a vegetation index; a partial least squares regression (PLSR) method which is used to construct different vegetation indices and yield inversion models [29]; estimation based on different vegetation indices combined with the partial least squares (PLS) method [3]; and the combination of an artificial neural network (ANN) and a vegetation index [30]. Several types of regression methods have been used to estimate crop yield; for example, a previous study used a combination of PLS and (1) multiple linear regression (MLR) and (2) an ANN to predict the yield of citrus fruit trees, and found that the PLS-MLR model was more accurate and stable than the PLS-ANN model [31]. Regression techniques have achieved relatively good results in the prediction of crop yield. However, the potential of hyperspectral data to predict crop yield is relatively under-explored.
In previous research, most scholars only used vegetation indices or regression techniques to improve the accuracy of crop yield inversion. For instance, Zhao et al. [29] estimated soybean yield, obtaining an R2 of 0.659, while Ye et al. [31] used PLS to invert the yield of citrus fruit trees, obtaining an R2 of 0.75 for the best inversion model. These studies mainly focused on using vegetation indices as a modeling factor, however did not introduce new independent variables in the yield estimation models. The present study investigates the effects of new independent variables on the model-based estimation of crop yield. Specifically, for the first time, this study uses crop plant heights extracted from UAV-based hyperspectral images as independent input variables in a yield prediction model and uses multiple regression techniques to determine the optimal estimation model.
The main purpose of this study was to evaluate the accuracies of winter-wheat yield estimations based on the ground-measured plant height (H), the plant height extracted from UAV-based hyperspectral images (HCSM), and the spectral indices (SIs), using PLSR, ANN, and RF regression techniques.
The remainder of this paper is organized as follows: Section 2 introduces the research area, the experimental design, the acquisition and processing of ground data and UAV-based hyperspectral remote sensing data, and the extraction of winter-wheat plant height, and additionally discusses the determination of the spectral indices, analysis methods, and statistical analysis; Section 3 introduces the results, including the yield-prediction ability of the extracted winter-wheat plant height, the measured plant height, and the spectral indices (SIs) both alone and in combination, as well as the yield-prediction abilities of the PLSR, ANN, and RF regression techniques; Section 4 presents a discussion; and Section 5 lists conclusions.

2. Materials and Methods

2.1. Research Area and Test Design

The research area is located in the National Precision Agriculture Research Demonstration Base in Xiaotangshan Town, Changping District, Beijing, China, at 40°00′–40°21′ N, 116°34′–117°00′ E. The area lies on open terrain at the junction of the Wenyu River alluvial plain and Yanshan mountain. The research area has a warm temperate continental monsoon climate, with an average annual temperature of about 16 °C and an average annual rainfall of about 54 mm. Most precipitation occurs in summer. The geographical location of the research area and the UAV sampling sites are shown in Figure 1. There were a total of 48 test plots in the sampling area, and each test plot measured 8 m in length and 6 m in width. The planted winter-wheat varieties were Zhongmai 175 (ZM175) and Jing 9843 (J9843). The winter wheat was treated with nitrogen fertilization of 0 kg N/hm2 (N1), 195 kg N/hm2 (N2), 390 kg N/hm2 (N3), and 780 kg N/hm2 (N4), and was subjected to three moisture levels: rainfall only, normal water (100 mm), and twice normal water (200 mm); the water irrigation times were 20 October 2014, 09 April 2015, 30 April 2015, and 22 May 2015.

2.2. Ground Data Acquisition and Processing

Ground-based crop yield data and plant height data were obtained in the experimental plots at the winter-wheat jointing stage (21 April 2015), flagging stage (26 April 2015), and flowering stage (13 May 2015).

2.2.1. Yield Acquisition

The crop yield was measured over the entire research area one day after the start of the winter-wheat mature period. Winter-wheat grain was collected from five sampling areas in each plot, each of which had an area of 1 m2; that is, grain was collected from a total area of 5 m2 in each plot. After sampling, GPS was used to determine the positions of the sampling areas to assist in the subsequent acquisition of UAV remote sensing data. The collected grain samples were transported to a laboratory where they were threshed, weighed, and assessed for quality. Then, 50 g of sample was placed in an envelope, which was then dried in an oven at 80 °C until a constant mass was obtained. Then, the sample was weighed again with a balance (accuracy of 0.001 g) and the water content of the sample was calculated based on the difference between the original weight and the dry matter mass. Finally, the winter-wheat yield was calculated based on the quality of the grain, the moisture content of the grain, and the sampling area, resulting in a total of 48 sets of yield data.

2.2.2. Measurement of Plant Height

A total of 20 winter-wheat plants were selected from the center of each plot. The height of each plant was then measured from the ground to the top using a ruler (accuracy of 0.5 mm), and the average height of the 20 plants was taken as the plant height for that plot.

2.3. Acquisition and Processing of UAV-Based Hyperspectral Remote Sensing Data

An eight-rotor UAV remote sensing platform (DJI S1000 UAV, SZ DJI Technology Co., Ltd., Sham Chun, China; Figure 2) was used to acquire hyperspectral images of the experimental plots. The UAV has a single arm length of 386 mm, a net body weight of 4.2 kg, a carrier take-off mass of 6 kg, a flight height of 50 m, and two 18,000 mAh (25 V) batteries, which can last for 30 minutes flying at a speed of 8 m/s.
The UAV was equipped with a UHD 185 Firefly hyperspectral sensor (UHD 185 firefly, Cubert GmbH, Ulm, Baden-Württemberg, Germany). The sensor has a size of 195 × 67 × 60 mm3 and a weight of 0.47 kg, and has 125 spectral channels and a band range of 450–950 nm. The interval of each waveband is 4 nm. Five hyperspectral images were acquired per second, and the UHD185 was positioned vertically downward during the measurement process. In order to prevent effects due to shadow and wind, images were acquired on days with low wind speed and without significant cloud cover. Images were acquired at 12:00. The images were acquired on three flights on 21 April 2015, 26 April 2015, and 13 May 2015, corresponding to the winter-wheat jointing stage, flagging stage, and flowering stage, respectively. The spatial resolution of the hyperspectral images is 21 cm. After the hyperspectral image data were collected, and data were pre-processed. The pre-processing included two main parts: (i) Stitching and geometric correction of hyperspectral images following the method of Turner et al. [32]. This step was performed using the Cubert Cube-Pilot software (Cube-Pilot, version 1.4, Cubert GmbH, Ulm, Baden-Württemberg, Germany). Each hyperspectral image was fused to obtain a corresponding full-color image. After fusion, the Agisoft PhotoScan software (version 1.1.6; Agisoft LLC, St. Petersburg, Russia; hereinafter referred to as “PhotoScan”) was used to complete the stitching of the hyperspectral images. The spatial resolution of the stitched images is about 5 cm. Simultaneously, a digital surface model (DSM) was generated for the three growth stages of winter wheat (jointing, flagging, and flowering); (ii) The reflectance of the canopy spectrum was extracted. According to the spliced hyperspectral images, the area of each plot was observed, the ArcGIS software (version 10.2; Esri, Redlands, CA, USA) was used to draw the area vector of each plot, and the average spectrum of the vector region was used to calculate the average spectrum of the statistical vector region as the winter-wheat canopy spectrum in the different plots.

2.4. Extraction of Winter-Wheat Plant Height

In order to determine the winter-wheat plant height, a digital elevation model (DEM) of the experimental plots—which represents the elevation of the soil under the crops in the plot—was subtracted from the generated digital surface model (DSM)—which contains DEM and crop elevation information—in order to obtain a crop surface model (CSM), which was then used to extract the winter-wheat plant height.

2.5. Spatial Map of Yield

A yield distribution map was constructed using the ENVI software (ITT Visual Information Solutions, Boulder, CO, USA). First, the UAV hyperspectral image was imported into ENVI, then the yield prediction model equation was input in Basic Tools, and finally the yield distribution map was generated.

2.6. Selection of Spectral Indices

In recent years, many researchers have shown that spectral indices are closely related to physiological and biochemical parameters of crops. Due to the application of hyperspectral observations in agricultural monitoring, many spectral indices are used to monitor crop growth. Therefore, based on the existing literature, we selected 20 spectral indices to estimate winter-wheat yield (Table 1).

2.7. Regression Techniques

Partial least squares regression is a data analysis method which focuses on the characteristics of principal component analysis, typical correlation analysis, and linear regression analysis methods in the modeling process. However, since PLSR can effectively use spectral information, it has been widely used in the remote sensing of vegetation and has achieved good research results [51,52].
The basic principle of an ANN is to imitate the operation of the neurons in the human brain in order to simulate the way the brain processes information. The learning and training of neural networks requires a set of input data. An important ability of a neural network is that it can learn from the computing environment through the constant adjustment of its neuron weights and thresholds, and the network training is considered to be complete when the output error of the network reaches the expected value [53].
Random forest is a statistical data analysis method first proposed by Breiman and Cutler. Through bootstrapping sampling, the sample is returned to the sampling method for multiple sampling to form a training set [54]. The data to be predicted are classified by constructing a decision tree, and the category with the most occurrences is selected as the predicted category [55].

2.8. Statistical Analysis

Yield estimation models using PLSR, ANN, and RF were constructed using the MATLAB software (version, 2014a; MathWorks, Inc., Natick, MA, USA) on Microsoft Windows.
In order to build a yield prediction model, two-thirds of the data (n = 32, ground-measured plant height or yield) were selected as the modeling dataset, and the remaining one-third of the samples (n = 16, ground-measured plant height or yield) were used as the verification dataset at each winter-wheat growth stage. Three evaluation indicators were used to determine the accuracy of the yield prediction model, namely the coefficient of determination (R2), root-mean-square error (RMSE), and normalized root-mean-square error (NRMSE) [3]. The calculation equations for these parameters are given as follows:
R 2 = 1 − ∑ i = 1 n ( x i − y i ) 2 ∑ i = 1 n ( x i − x ¯ ) 2
R M S E = ∑ i = 1 n ( y i − x i ) 2 n
N R M S E = R M S E X ¯
where x i is the measured plant height or plant yield for winter wheat, x ¯ is the average measured plant height or yield, y i is the plant height or yield predicted by the model, and n is the number of data points.

3. Results and Analysis

3.1. Extraction of Winter-Wheat Plant Height

The ArcGIS software was used to extract the average plant height in each plot in the jointing stage, flagging stage, and flowering stage, respectively.
The above was achieved using the following main steps:
(1)
Point coordinate information was obtained using the ArcGIS software, and then the elevations of the soil points were extracted using the ArcTooLbox tool in the ArcGIS software;
(2)
The DEM was generated based on the elevations of the soil points using the kriging tools in the ArcGIS software;
(3)
The grid calculator tool in the ArcGIS software was used to extract the CSM of winter wheat by subtracting the DEM of the soil points from the DSM;
(4)
Obtain the height of winter wheat plants in each plot by using the ROI tool in the ArcGIS software.
A total of 144 sets of average plant height data were obtained. Then, the extracted winter-wheat HCSM was compared with the measured plant height. The results are shown in Figure 3.
From Figure 3, it can be seen that there is a strong correlation between the measured values of plant height and the values of HCSM (R2 = 0.97; y = 1.0061x − 16.991), although the HCSM extracted during the three growth stages is less than the measured plant height. This suggests that the proposed model has a strong ability to predict winter-wheat plant height.

3.2. Relationship between Yield and Optimal Spectral Indices, H, and Hcsm

In order to study the relationships between yield and the optimal spectral indices (i.e., the PBI), H, and HCSM at the jointing, flagging, and flowering stages of winter wheat, a linear regression method was performed. The results are shown in Table 2 and Figure 4.
As can be seen from Table 2 and Figure 4, the yield-prediction performance of the PBI, H, and HCSM are different in each growth stage. At the jointing stage, the PBI performed poorly, with an R2 of 0.21, while H and HCSM both performed extremely poorly, with R2 values of 0.01 and 0.05, respectively. During the flagging stage, the PBI, H, and HCSM all performed better than during the jointing stage, with R2 values of 0.44, 0.09, and 0.22, respectively. Similarly, in the flowering stage, the R2 values for PBI, H, and HCSM were all higher than in the flagging stage, with values of 0.63, 0.13, and 0.23, respectively. Meanwhile, the RMSE and NRMSE values for each of the three parameters all decrease over subsequent growth stages. All of the above results indicate that the yield-prediction performances of the PBI, H, and HCSM all improve significantly between the jointing stage and the flagging stage. However, the performances of HCSM, and particularly of H, are significantly poorer than those of the PBI.
The optimal vegetation indices—namely, the PBI—was combined with H and HCSM for regression analysis. The results, given in Table 3 and Figure 5, show that for all three growth stages the yield predictions obtained using a combination of the PBI and H and a combination of the PBI and HCSM are superior to the predictions obtained using the PBI, H, and HCSM individually (see Table 2). For the yield predictions obtained using a combination of the PBI and H, and a combination of the PBI and HCSM, the R2 values increase, and the RMSE and NRMSE decrease. For the yield predictions obtained using a combination of the PBI and H, the R2 values are 0.23, 0.45, and 0.66 in the jointing, flagging, and flowering stages, respectively; the RMSE values are 1243.39, 1052.30, and 819.66 kg/ha, respectively; and the NRMSE values are 21.33%, 18.05%, and 14.06%, respectively. Meanwhile, for the yield predictions obtained using a combination of the PBI and HCSM, the R2 values are 0.23, 0.48, and 0.69 in the jointing, flagging, and flowering stages, respectively; the RMSE values are 1237.70, 1023.87, and 781.51 kg/ha, respectively; and the NRMSE values are 21.23%, 17.57%, and 13.41%, respectively.

3.3. Using H, Hcsm, and Spectral Indices in Combination with Either Partial Least Squares Regression, Random Forest, or an Artificial Neural Network to Estimate Winter-Wheat Yield

PLSR, ANN, and RF methods based all spectral indices (SIs) were used to estimate the winter-wheat yield in the jointing stage, flagging stage, and flowering stage. Table 4 shows the yield-estimation results obtained using PLSR regression for (1) the SIs, (2) a combination of the SIs and H, and (3) a combination of the SIs and HCSM, and Table 5 and Table 6 show the same as Table 4 except for ANN and RF, instead of PLSR, respectively. For the estimations obtained using the SIs, a combination of the SIs and H, and a combination of the SIs and HCSM, the best results were all obtained for the flowering stage for the PLSR, ANN, and RF methods; using PLSR and the SIs, a modeling R2, RMSE, and NRMSE of 0.75, 676.86 kg/ha, and 11.09% were obtained, respectively; using ANN and the SIs, a modeling R2, RMSE, and NRMSE of 0.71, 746.56 kg/ha, and 12.23% were obtained, respectively; and using RF and the SIs, a modeling R2, RMSE, and NRMSE of 0.31, 1148.67 kg/ha, and 18.81% were obtained, respectively. Using PLSR and a combination of the SIs and H, a modeling R2, RMSE, and NRMSE of 0.76, 659.93 kg/ha, and 10.81% were obtained, respectively; using ANN and a combination of the SIs and H, a modeling R2, RMSE, and NRMSE of 0.72, 728.99 kg/ha, and 11.94% were obtained, respectively; and using RF and a combination of the SIs and H, a modeling R2, RMSE, and NRMSE of 0.36, 1090.09 kg/ha, and 17.85% were obtained, respectively. Meanwhile, using PLSR and a combination of the SIs and HCSM, a modeling R2, RMSE, and NRMSE of 0.77, 648.90 kg/ha, and 10.63% were obtained, respectively; using ANN and a combination of the SIs and HCSM, a modeling R2, RMSE, and NRMSE of 0.74, 695.45 kg/ha, and 11.39% were obtained, respectively; and using RF and a combination of the SIs and HCSM, a modeling R2, RMSE, and NRMSE of 0.44, 1009.82 kg/ha, and 16.54% were obtained, respectively. That is, for the flowering stage, the yield-estimation results obtained using a combination of the SIs and H and a combination of SIs and HCSM are superior to those obtained using only the SIs when using the PLSR, ANN, and RF models, respectively. The same is also true for the jointing and flagging stages. Furthermore, inferior yield prediction is obtained using the RF model compared to the PLSR or ANN models for all growth stages and all combinations of SIs, H, and HCSM.
Additionally, the verification dataset was used to verify the yield-prediction ability of the SIs, a combination of SIs and H, and a combination of SIs and HCSM, using the PLSR, ANN, and RF methods, respectively. The results of the verification for PLSR, ANN, and RF are shown in Figure 6, Figure 7 and Figure 8, respectively.

3.4. Map of Predicted Yield

As can be seen from the results in Table 4, Table 5 and Table 6 and Figure 6, Figure 7 and Figure 8, the best yield prediction is obtained using the PLSR and a combination of the SIs and HCSM. Therefore, using this approach, the spatial distribution of winter wheat yield was estimated across the 48 experimental plots for each of the three winter-wheat growth stages, as shown in Figure 9a–c. As can be seen in the figure, the spatial distribution of predicted yield is similar for all growth stages and the range in predicted yield is 3500–9000 kg/ha. Additionally, the predicted yield distribution map shows that the yield of experimental field 2 is higher than that of experimental fields 1 and 3 for all three growth stages.

4. Discussion

4.1. Estimation of Winter-Wheat Plant Height

Extracting the plant height of crops from remote sensing data is of great significance for the management of agricultural production [56,57,58] and can help improve the efficiency of agricultural management. In this paper, a total of 144 manual measurements of plant height obtained during the three main growth stages of winter wheat (i.e., 48 samples per growth stage) were used to analyze the relationship between HCSM and H. The R2 was 0.97 (Figure 3), indicating that the extracted plant height can be reasonably used to estimate the actual plant height. This finding is consistent with the research results of Bendig et al. [57]. However, the value of HCSM was generally smaller than that of H. In this study, UAV-based remote sensing hyperspectral reflectance data were obtained for the winter-wheat canopy in the experimental plots. Since the measured plant height is the height of the highest point of the leaves under growth conditions, HCSM is generally lower than H.

4.2. Yield Estimation Using Spectral Indices, H, and Hcsm

Plant height can reflect the growth status of crops [59], and can also be used to estimate the LAI and biomass of crops [56,57], both of which are closely related to crop yield. The results of this study show that the yield of winter wheat can be estimated using a combination of a single optimal spectral index (in this case, the PBI) and HCSM, but that yield estimation is poor when using only H or HCSM (see Table 2 and Figure 4). The accuracy of the yield estimation obtained using only HCSM (i.e., the estimation which does not consider PBI) does not improve by a large amount between the flagging stage and the flowering stage, which may be related to the fact that the canopy image obtained in the flowering stage contains more mixed pixels. The yield estimations obtained using a combination of the all spectral indices (SIs) and H, and a combination of the SIs and HCSM, respectively, were both superior to the estimation obtained using only the PBI for all three growth stages (Table 3 and Table 4, Figure 5 and Figure 6). Yue et al. [60] found that using multiple spectral indices to estimate crop parameters is superior to using a single spectral index. This finding is consistent with the present research results. Moreover, the yield estimations obtained using a combination of the SIs and HCSM were superior to those obtained using a combination of the SIs and H for all growth stages. This can be attributed to the fact that HCSM was obtained using hyperspectral measurements of the winter-wheat canopy, while H was obtained based only on ground data, which does not contain information about the crop canopy. Therefore, compared with H, HCSM is more objective. The results also show that the yield prediction improves from the jointing stage to the flowering stage. This can be attributed to the fact that, as the crop height increases, the winter wheat canopy coverage increases, and the range of plant LAI, biomass, pigment content, and water content changes; therefore, since the SIs are related to these physiological parameters, the correlation between the SIs and yield increases over subsequent growth stages (Figure 4). Thus, the optimization of model independent variables is crucial for estimating plant yield based on remote sensing data.

4.3. Yield Estimation Using Partial Least Squares Regression, Random Forest, or an Artificial Neural Network

Relatively accurate yield prediction was obtained using both PLSR and ANN, respectively (Table 4 and Table 5, Figure 7 and Figure 8), with PLSR obtaining marginally better results. In contrast, the prediction obtained using RF is relatively poor (Table 6). The superior prediction performance of PLSR and ANN was achieved for both the modeling results and the verification results (Table 4 and Table 5, Figure 7 and Figure 8). Atzberger et al. [61], Fu et al. [62], and Mirzaie et al. [63] found that PLSR can improve the accuracy of crop growth monitoring, which is consistent with the results of this study. Zhao et al. [29] and Ye et al. [31] estimated crop yield via modeling, obtaining maximum R2 values of 0.659 and 0.75, respectively. In comparison, the best R2 value obtained in this paper was 0.77. This shows that the yield estimation model constructed in this paper improves the estimation accuracy. The RF method is suitable for application to large datasets, which can explain its poor performance for crop-yield estimation in this study. The predicted yields for the three growth stages obtained using PLSR are relatively consistent with the ground-measured yield (see Table 4 and Figure 6). Ferencz et al. [64] and Franch et al. [65] monitored yield distribution using Landsat Thematic Mapper (TM) data and moderate Resolution Imaging Spectroradiometer (MODIS) data, respectively, both obtaining good results. Additionally, Kurtser et al. [66] found that RGB camera data can be used to accurately estimate yield. In future research, we plan to use different remote sensing data for yield estimation and to explore the estimation effect of various sensors.

5. Conclusions

In the present study, UAV-based hyperspectral remote sensing images were used to estimate the yield of winter wheat. Spectral indices, ground-measured plant height (H), and plant height extracted from the hyperspectral remote sensing data (HCSM) were used to estimate the yield of winter wheat in three main growth stages using linear regression, PLSR, ANN, and RF methods. The following conclusions can be drawn:
(1)
HCSM is strongly correlated with H (R2 = 0.97). This indicates that crop heights can be accurately estimated using remote sensing data, and that such data could therefore resolve the traditional lack of crop height monitoring. Therefore, the results of the present study validate the application of UAV-based hyperspectral remote sensing technology to agricultural management.
(2)
The correlations between the ground-measured winter-wheat yield and the spectral indices (SIs), H, and HCSM gradually increased over successive crop growth stages. Additionally, the yield estimation obtained using a combination of the SIs and H, or a combination of the SIs and HCSM, were superior to those obtained using the optimal spectral indices (PBI), H, or HCSM alone.
(3)
The PLSR and ANN methods can be used to estimate the yield of winter wheat with a relatively high accuracy, with the PLSR method allowing a slightly higher accuracy. However, the RF method is far less effective for estimating yield than PLSR or ANN.
Overall, the results of this study show that UAV-based hyperspectral images can be used to provide accurate estimates of winter-wheat yield, and could therefore be of great significance for guiding precision agricultural production.

Author Contributions

Conceptualization, H.T., H.F. and L.X.; data curation, M.M., G.Y. and X.Y.; formal analysis, H.T.; investigation, H.T., H.F., L.X., M.M. and L.F.; methodology, H.T.; resources, L.F.; writing—original draft, H.T. and H.F.; writing—review and editing, L.X. and X.Y. All authors have read and agreed to the published version of the manuscript.

Funding

The study was funded by the National Key Research and Development Program (2016YFD070030303), the Nation Science Foundation of China (41601346, 41871333, 41501481, 61661136003, 41771370, 41471285, 41471351).

Acknowledgments

We appreciate the help from Hong Chang and Weiguo Li during field data collection. Thanks to all employees of Xiao Tangshan National Precision Agriculture Research Center.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Mueller, N.D.; Gerber, J.S.; Johnston, M.; Ray, D.K.; Ramankutty, N. Closing yield gaps through nutrient and water management. Nature 2012, 490, 254–257. [Google Scholar] [CrossRef] [PubMed]
  2. Wang, L.; Tian, Y.; Yao, X.; Zhu, Y.; Cao, W. Predicting grain yield and protein content in wheat by fusing multi-sensor and multi-temporal remote-sensing images. Field Crops Res. 2014, 164, 178–188. [Google Scholar] [CrossRef]
  3. Yue, J.; Feng, H.; Yang, G.; Li, Z. A comparison of regression techniques for estimation of above-ground winter wheat biomass using near-surface spectroscopy. Remote Sens. 2018, 10, 66. [Google Scholar] [CrossRef] [Green Version]
  4. Atzberger, C.; Darvishzadeh, R.; Immitzer, M.; Schlerf, M.; Skidmore, A.; le Maire, G. Comparative analysis of different retrieval methods for mapping grassland leaf area index using airborne imaging spectroscopy. Int. J. Appl. Earth Obs. Geoinf. 2015, 43, 19–31. [Google Scholar] [CrossRef] [Green Version]
  5. Galvão, L.S.; Formaggio, A.R.; Tisot, D.A. Discrimination of sugarcane varieties in Southeastern Brazil with EO-1 Hyperion data. Remote Sens. Environ. 2005, 94, 523–534. [Google Scholar] [CrossRef]
  6. Du, M.; Noguchi, N. Multi-temporal monitoring of wheat growth through correlation analysis of satellite images, unmanned aerial vehicle images with ground variable. IFAC-Pap. Line 2016, 49, 5–9. [Google Scholar] [CrossRef]
  7. Wheeler, T.; Von, B.J. Climate change impacts on global food security. Science 2013, 341, 508–513. [Google Scholar] [CrossRef]
  8. Yu, N.; Li, L.; Schmitz, N.; Tian, L.F.; Greenberg, J.A.; Diers, B.W. Development of methods to improve soybean yield estimation and predict plant maturity with an unmanned aerial vehicle based platform. Remote Sens. Environ. 2016, 187, 91–101. [Google Scholar] [CrossRef]
  9. Berni, J.; Zarco-Tejada, P.J.; Suarez, L.; Fereres, E. Thermal and narrowband multispectral remote sensing for vegetation monitoring from an unmanned aerial vehicle. IEEE Trans. Geosci. Remote Sens. 2009, 47, 722–738. [Google Scholar] [CrossRef] [Green Version]
  10. Zaman-Allah, M.; Vergara, O.; Araus, J.L.; Tarekegne, A.; Magorokosho, C.; Zarco-Tejada, P.J.; Hornero, A.; Alba, A.H.; Das, B.; Craufurd, P.; et al. Unmanned aerial platform-based multi-spectral imaging for field phenotyping of maize. Plant Methods 2015, 11, 35. [Google Scholar] [CrossRef] [Green Version]
  11. Everaerts, J. The use of unmanned aerial vehicles (UAVS) for remote sensing and mapping. Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. 2008, 37, 1187–1192. [Google Scholar]
  12. Geipel, J.; Link, J.; Claupein, W. Combined spectral and spatial modeling of corn yield based on aerial images and crop surface models acquired with an unmanned aircraft system. Remote Sens. 2014, 6, 10335–10355. [Google Scholar] [CrossRef] [Green Version]
  13. Zhang, C.; Kovacs, J.M. The application of small unmanned aerial systems for precision agriculture: A review. Precis. Agric. 2012, 13, 693–712. [Google Scholar] [CrossRef]
  14. Bendig, J.; Yu, K.; Aasen, H.; Bolten, A.; Bennertz, S.; Broscheit, J.; Gnyp, M.L.; Bareth, G. Combining UAV-based plant height from crop surface models, visible, and near infrared vegetation indices for biomass monitoring in barley. Int. J. Appl. Earth Obs. Geoinf. 2015, 39, 79–87. [Google Scholar] [CrossRef]
  15. Bareth, G.; Aasen, H.; Bendig, J.; Gnyp, M.L.; Bolten, A.; Jung, A.; Michels, R.; Soukkamaäki, J. Low-weight and UAV-based hyperspectral full-frame cameras for monitoring crops: Spectral comparison with portable spectroradiometer measurements. Photogramm.-Fernerkund.-Geoinf. 2015, 1, 69–79. [Google Scholar] [CrossRef]
  16. Osborne, S.L.; Schepers, J.S.; Francis, D.D.; Schlemmer, M.R. Crop ecology management & quality-use of spectral radiance to estimate in-season biomass and grain yield in nitrogen- and water-stressed corn. Crop Sci. 2002, 42, 165–171. [Google Scholar] [PubMed]
  17. Yan, Z.; Xia, Y.; Yongchao, T.; Dongqin, Z.; Yingxue, L.; Weixing, C. Quantitative relationship between leaf nitrogen accumulation and canopy reflectance spectra in rice and wheat. Chin. J. Plan Ecolo. 2006, 30, 983–990. [Google Scholar] [CrossRef]
  18. Guofu, Z.; Jiangxing, W. Forecasting greenhouse tomato leaves chlorophyll contents based on spectral analysis. J. Agric. Mech. Res. 2008, 11, 33–37. [Google Scholar]
  19. Xiao, F.; Guoqing, Z.; Shu, Q.; Feng, H.; Zhongjie, M. Estimation models of summer maize LAI based on canopy reflectance spectra. J. Maize Sci. 2008, 16, 86–89. [Google Scholar]
  20. Serrano, L.; Filella, I.; Penuelas, J. Remote sensing of biomass and yield of winter wheat under different nitrogen supplies. Crop Sci. 2000, 40, 723–731. [Google Scholar] [CrossRef] [Green Version]
  21. Haiyan, J.; Pengxin, W.; Tailia, Y. Estimations of Chlorophyll and water contents in live leaf of winter wheat with reflectance spectroscopy. Spectrosc. Spectr. Anal. 2007, 27, 514–516. [Google Scholar]
  22. Thenkabail, P.S.; Smith, R.B.; De, P.E. Hyperspectral vegetation indices and their relationships with agricultural crop characteristics. Remote Sens. Environ. 2000, 71, 158–182. [Google Scholar] [CrossRef]
  23. Ma, B.L.; Dwyer, L.M.; Costa, C.; Cober, E.R.; Morrison, M.J. Early prediction of soybean yield from canopy reflectance measurements. Agron. J. 2001, 93, 1227–1234. [Google Scholar] [CrossRef] [Green Version]
  24. Chen, Z.; Li, S.; Ren, J.; Gong, P.; Zhang, M.; Wang, L.; Xiao, S.; Jiang, D. Monitoring and management of agriculture with remote sensing. In Advances in Land Remote Sensing: System, Modeling, Inversion and Application; Liang, S., Ed.; Springer: Dordrecht, The Netherlands, 2008. [Google Scholar]
  25. Gong, Y.; Duan, B.; Fang, S.; Zhu, R.; Wu, X.; Ma, Y.; Peng, Y. Remote estimation of rapeseed yield with unmanned aerial vehicle (UAV) imaging and spectral mixture analysis. Plant Methods 2018, 14, 70. [Google Scholar] [CrossRef] [PubMed]
  26. Rodriguez, J.; Duchemin, B.; Hadria, R.; Watts, C.; Garatuza, J.; Chehbouni, A.; Khabba, S.; Boulet, G.; Palacios, E.; Lahrouni, A. Wheat yield estimation using remote sensing and the STICS model in the semiarid Yaqui valley, Mexico. Agronomie 2004, 24, 295–304. [Google Scholar] [CrossRef] [Green Version]
  27. Huanjun, L.; Ran, K.; Ustin, S.; Xinle, Z.; Qiang, F.; Lei, S.; Tianyi, S. Study on the prediction of cotton yield within field scale with time series hyperspectral imagery. Spectrosc. Spectr. Anal. 2016, 36, 2585–2589. [Google Scholar]
  28. Kefauver, S.C.; Vicente, R.; Vergara-Díaz, O.; Fernandez-Gallego, J.A.; Kerfal, S.; Lopez, A.; Melichar, J.P.E.; Serret Molins, M.D.; Araus, J.L. Comparative UAV and field phenotyping to assess yield and nitrogen use efficiency in hybrid and conventional barley. Front. Plant Sci. 2017, 8, 1733. [Google Scholar] [CrossRef]
  29. Xiaoqing, Z.; Guijun, Y.; Jiangang, L.; Xiaoyan, Z.; Bo, X.; Yanjie, W.; Chunjiang, Z.; Junyi, G. Estimation of soybean breeding yield based on optimization of spatial scale of UAV hyperspectral image. Nongye Gongcheng Xuebao/Trans. Chin. Soc. Agric. Eng. 2017, 33, 110–116. [Google Scholar]
  30. Uno, Y.; Prasher, S.O.; Lacroix, R.; Goel, P.K.; Karimi, Y.; Viau, A.; Patel, R.M. Artificial neural networks to predict corn yield from compact airborne spectrographic imager data. Comput. Electron. Agric. 2005, 47, 149–161. [Google Scholar] [CrossRef]
  31. Xujun, Y.; Saikai, K.; Yong, H. Development of citrus yield prediction model based on airborne hyperspectral imaging. Spectrosc. Spectr. Anal. 2010, 30, 1295–1300. [Google Scholar]
  32. Turner, D.; Lucieer, A.; Wallace, L. Direct georeferencing of ultrahigh-resolution UAV imagery. IEEE Trans. Geosci. Remote Sens. 2014, 52, 2738–2745. [Google Scholar] [CrossRef]
  33. Wu, C.; Niu, Z.; Tang, Q.; Huang, W. Estimating chlorophyll content from hyperspectral vegetation indices: Modeling and validation. Agric. For. Meteorol. 2008, 148, 1230–1241. [Google Scholar] [CrossRef]
  34. PeÞuelas, J.; Isla, R.; Filella, I.; Araus, J.L. Visible and near-infrared reflectance assessment of salinity effects on barley. Crop Sci. 1997, 37, 198–202. [Google Scholar] [CrossRef]
  35. Rondeaux, G.; Steven, M.; Baret, F. Optimization of soil-adjusted vegetation indices. Remote Sens. Environ. 1996, 55, 95–107. [Google Scholar] [CrossRef]
  36. Blackburn, G.A. Quantifying chlorophylls and carotenoids at leaf and canopy scales: An evaluation of some hyperspectral approaches. Remote Sens. Environ. 1998, 66, 273–285. [Google Scholar] [CrossRef]
  37. Peñuelas, J.; Gamon, J.A.; Fredeen, A.L.; Merino, J.; Field, C.B. Reflectance indices associated with physiological changes in nitrogen- and water-limited sunflower leaves. Remote Sens. Environ. 1994, 48, 135–146. [Google Scholar] [CrossRef]
  38. Rama Rao, N.; Garg, P.K.; Ghosh, S.K.; Dadhwal, V.K. Estimation of leaf total chlorophyll and nitrogen concentrations using hyperspectral satellite imagery. J. Agric. Sci. 2008, 146, 65–75. [Google Scholar] [CrossRef]
  39. Broge, N.H.; Leblanc, E. Comparing prediction power and stability of broadband and hyperspectral vegetation indices for estimation of green leaf area index and canopy chlorophyll density. Remote Sens. Environ. 2001, 76, 156–172. [Google Scholar] [CrossRef]
  40. Roujean, J.L.; Breon, F.M. Estimating PAR absorbed by vegetation from bidirectional reflectance measurements. Remote Sens. Environ. 1995, 51, 375–384. [Google Scholar] [CrossRef]
  41. Vincini, M.; Frazzi, E.; D’Alessio, P. Angular Dependence of Maize and Sugar Beet VIs from Directional CHRIS/Proba Data. Available online: https://www.researchgate.net/profile/Ermes_Frazzi/publication/228413259_Angular_dependence_of_maize_and_sugar_beet_VIs_from_directional_CHRISProba_data/links/0046352d50c18b3fe6000000.pdf (accessed on 3 January 2018).
  42. Baret, F.; Guyot, G.; Major, D.J. TSAVI: A vegetation index which minimizes soil brightness effects on LAI and APAR estimation. Symp. Remote Sens. Geosci. Remote Sens. Symp. 1989, 3, 1355–1358. [Google Scholar]
  43. Haboudane, D.; Miller, J.R.; Tremblay, N.; Zarco-Tejada, P.J.; Dextraze, L. Integrated narrow-band vegetation indices for prediction of crop chlorophyll content for application to precision agriculture. Remote Sens. Environ. 2002, 81, 416–426. [Google Scholar] [CrossRef]
  44. Jiang, Z.; Huete, A.R.; Didan, K.; Miura, T. Development of a two-band enhanced vegetation index without a blue band. Remote Sens. Environ. 2008, 112, 3833–3845. [Google Scholar] [CrossRef]
  45. Chappelle, E.W.; Kim, M.S.; McMurtrey, J.E. Ratio analysis of reflflectance spectra (RARS): An algorithm for the remote estimation of the concentrations of chlorophyll A, chlorophyll B, and carotenoids in soybean leaves. Remote Sens. Environ. 1992, 39, 239–247. [Google Scholar] [CrossRef]
  46. Stamatiadis, S.; Taskos, D.; Tsadilas, C.; Christofifides, C.; Tsadila, E.; Schepers, J.S. Relation of ground-sensor canopy reflflectance to biomass production and grape color in two merlot vineyards. Am. J. Enol. Vitic. 2006, 57, 415–422. [Google Scholar]
  47. Datt, B. A new reflectance index for remote sensing of chlorophyll content in higher plants: Tests using Eucalyptus leaves. J. Plant Physiol. 1999, 154, 30–36. [Google Scholar] [CrossRef]
  48. Merzlyak, M.N.; Gitelson, A.A.; Chivkunova, O.B.; Rakitin, V.Y.U. Non-destructive optical detection of pigment changes during leaf senescence and fruit ripening. Physiol. Plant. 1999, 106, 135–141. [Google Scholar] [CrossRef] [Green Version]
  49. Merton, R.; Huntington, J. Early Simulation Results of the Aries-1 Satellite Sensor for Multi-Temporal Vegetation Research Derived from Aviris. In Proceedings of the Eighth Annual JPL Airborne Earth Science Workshop, Pasadena, CA, USA, 9–11 February 1999; pp. 1–10. [Google Scholar]
  50. Zarco-Tejada, P.J.; Berjón, A.; López-Lozano, R.; Miller, J.R.; Martín, P.; Cachorro, V.; González, M.R.; De Frutos, A. Assessing vineyard condition with hyperspectral indices: Leaf and canopy reflflectance simulation in a row-structured discontinuous canopy. Remote Sens. Environ. 2005, 99, 271–287. [Google Scholar] [CrossRef]
  51. Gurgen, A.; Topaloglu, E.; Ustaomer, D.; Yıldız, S.; Ay, N. Prediction of the colorimetric parameters and mass loss of heat-treated bamboo: Comparison of multiple linear regression and artificial neural network method. Color Res. Appl. 2019, 44, 824–833. [Google Scholar] [CrossRef]
  52. Pelawa, W.L.C.R.; Olive, D.J. Bootstrapping multiple linear regression after variable selection. Stat. Pap. Available online: http://lagrange.math.siu.edu/Olive/ppboottest.pdf (accessed on 11 April 2019).
  53. Gevrey, M.; Dimopoulos, I.; Lek, S. Review and comparison of methods to study the contribution of variables in artificial neural network models. Ecol. Model. 2003, 160, 249–264. [Google Scholar] [CrossRef]
  54. Fan, L.; Zhao, J.; Xu, X.; Liang, D.; Yang, G.; Feng, H.; Yang, H.; Wang, Y.; Chen, G.; Wei, P. Hyperspectral-based estimation of leaf nitrogen content in corn using optimal selection of multiple spectral variables. Sensors 2019, 19, 2898. [Google Scholar] [CrossRef] [Green Version]
  55. Kuangnan, F.; Jianbin, W.; Jianping, Z.; Bangchang, X. A review of technologies on random forests. Stat. Inf. Forum 2011, 26, 32–38. [Google Scholar]
  56. Shujun, W.; Dongsheng, G. Remote sensing method of forest biomass estimation by artificial neural network models. Ecol. Environ. 2007, 16, 108–111. [Google Scholar]
  57. Bendig, J.; Bolten, A.; Bennertz, S.; Broscheit, J.; Eichfuss, S.; Bareth, G. Estimating biomass of barley using crop surface models (CSMs) derived from UAV-based RGB imaging. Remote Sens. 2014, 6, 10395–10412. [Google Scholar] [CrossRef] [Green Version]
  58. Scotford, I.M.; Miller, P.C. Combination of spectral reflectance and ultrasonic sensing to monitor the growth of winter wheat. Biosyst. Eng. 2004, 87, 27–38. [Google Scholar] [CrossRef]
  59. Tilly, N.; Hoffmeister, D.; Cao, Q.; Huang, S.; Lenz-Wiedemann, V.; Miao, Y.; Bareth, G. Multitemporal crop surface models: Accurate plant height measurement and biomass estimation with terrestrial laser scanning in paddy rice. J. Appl. Remote Sens. 2014, 8, 083671. [Google Scholar] [CrossRef]
  60. Yue, J.; Feng, H.; Jin, X.; Yuan, H.; Li, Z.; Zhou, C.; Yang, G.; Tian, Q. A comparison of crop parameters estimation using images from UAV-mounted snapshot hyperspectral sensor and high-definition digital camera. Remote Sens. 2018, 10, 1138. [Google Scholar] [CrossRef] [Green Version]
  61. Atzberger, C.; Guérif, M.; Baret, F.; Werner, W. Comparative analysis of three chemometric techniques for the spectroradiometric assessment of canopy chlorophyll content in winter wheat. Comput. Electron. Agric. 2010, 73, 165–173. [Google Scholar] [CrossRef]
  62. Fu, Y.; Yang, G.; Wang, J.; Song, X.; Feng, H. Winter wheat biomass estimation based on spectral indices, band depth analysis and partial least squares regression using hyperspectral measurements. Comput. Electron. Agric. 2014, 100, 51–59. [Google Scholar] [CrossRef]
  63. Mirzaie, M.; Darvishzadeh, R.; Shakiba, A.; Matkan, A.A.; Atzberger, C.; Skidmore, A. Comparative analysis of different uni- and multi-variate methods for estimation of vegetation water content using hyper-spectral measurements. Int. J. Appl. Earth Obs. Geoinf. 2014, 26, 1–11. [Google Scholar] [CrossRef]
  64. Ferencz, C.; Bognár, P.; Lichtenberger, J.; Hamar, D.; Tarcsai, G.; Timár, G.; Molnár, G.; Pásztor, S.; Steinbach, P.; Székely, B.; et al. Crop yield estimation by satellite remote sensing. Int. J. Remote Sens. 2004, 25, 4113–4149. [Google Scholar] [CrossRef]
  65. Franch, B.; Skakun, S.; Roger, J.C.; Becker-Reshef, I.; Murphy, E.; Justice, C.; Franch, B.; Vermote, E.F.; Skakun, S.; Roger, J.C.; et al. Remote sensing based yield monitoring: Application to winter wheat in United States and Ukraine. Int. J. Appl Earth Obs Geoin. 2019, 76, 112–127. [Google Scholar] [CrossRef]
  66. Kurtser, P.; Ringdahl, O.; Rotstein, N.; Berenstein, R.; Edan, Y. In-Field Grape Cluster Size Assessment for Vine Yield Estimation Using a Mobile Robot and a Consumer Level RGB-D Camera. IEEE Robot. Autom. Lett. 2020, 5, 2031–2038. [Google Scholar] [CrossRef]
Sensors 20 01231 g001 550
Figure 1. Location and aerial images of the test area.
Figure 1. Location and aerial images of the test area.
Sensors 20 01231 g001
Sensors 20 01231 g002 550
Figure 2. The unmanned aerial vehicle (UAV) remote sensing platform (model DJI S1000) that was used to acquire hyperspectral images. UHD 185: UHD 185 Firefly hyperspectral sensor.
Figure 2. The unmanned aerial vehicle (UAV) remote sensing platform (model DJI S1000) that was used to acquire hyperspectral images. UHD 185: UHD 185 Firefly hyperspectral sensor.
Sensors 20 01231 g002
Sensors 20 01231 g003 550
Figure 3. Measured and estimated heights of winter wheat. The three colors represent different growth stages: blue: jointing stage; red: flagging stage; green: flowering stage.
Figure 3. Measured and estimated heights of winter wheat. The three colors represent different growth stages: blue: jointing stage; red: flagging stage; green: flowering stage.
Sensors 20 01231 g003
Sensors 20 01231 g004 550
Figure 4. The relationships between the ground-measured winter-wheat yield and the yield predicted using the PBI, H, and HCSM in different growth stages of winter wheat. (a–c) show the relationships between the measured yield and the yield predicted using the PBI, H, and HCSM at the jointing stage, respectively; (d–f) show the same as (a–c) for the flagging stage; and (g–i) show the same as (a–c) for the flowering stage.
Figure 4. The relationships between the ground-measured winter-wheat yield and the yield predicted using the PBI, H, and HCSM in different growth stages of winter wheat. (a–c) show the relationships between the measured yield and the yield predicted using the PBI, H, and HCSM at the jointing stage, respectively; (d–f) show the same as (a–c) for the flagging stage; and (g–i) show the same as (a–c) for the flowering stage.
Sensors 20 01231 g004
Sensors 20 01231 g005 550
Figure 5. The relationships between the measured yield and the yield predicted using a combination of the PBI and H, and the yield predicted using a combination of the PBI and HCSM, at different growth stages (a,b) show the relationships between the measured yield and the yield predicted using a combination of the PBI and H, and using a combination of the PBI and HCSM, respectively, for the jointing stage; (c,d) show the same as (a,b) for the flagging stage, and (e,f) show the same as (a,b) for the flowering stage.
Figure 5. The relationships between the measured yield and the yield predicted using a combination of the PBI and H, and the yield predicted using a combination of the PBI and HCSM, at different growth stages (a,b) show the relationships between the measured yield and the yield predicted using a combination of the PBI and H, and using a combination of the PBI and HCSM, respectively, for the jointing stage; (c,d) show the same as (a,b) for the flagging stage, and (e,f) show the same as (a,b) for the flowering stage.
Sensors 20 01231 g005
Sensors 20 01231 g006 550
Figure 6. The relationships between the ground-measured and predicted values of winter-wheat yield at different growth stages based on partial least squares regression (PLSR). (a–c) show the results for SIs, a combination of SIs and H, and a combination of SIs and HCSM, respectively, at the jointing stage. (d–f) show the same as (a–c) for the flagging stage; and (g–i) show the same as (a–c) for the flowering stage.
Figure 6. The relationships between the ground-measured and predicted values of winter-wheat yield at different growth stages based on partial least squares regression (PLSR). (a–c) show the results for SIs, a combination of SIs and H, and a combination of SIs and HCSM, respectively, at the jointing stage. (d–f) show the same as (a–c) for the flagging stage; and (g–i) show the same as (a–c) for the flowering stage.
Sensors 20 01231 g006
Sensors 20 01231 g007 550
Figure 7. The relationships between the ground-measured and predicted values of winter-wheat yield at different growth stages based on an artificial neural network (ANN). (a–c) show the results for SIs, a combination of SIs and H, and a combination of SIs and HCSM, respectively, at the jointing stage. (d–f) show the same as (a–c) for the flagging stage; and (g–i) show the same as (a–c) for the flowering stage.
Figure 7. The relationships between the ground-measured and predicted values of winter-wheat yield at different growth stages based on an artificial neural network (ANN). (a–c) show the results for SIs, a combination of SIs and H, and a combination of SIs and HCSM, respectively, at the jointing stage. (d–f) show the same as (a–c) for the flagging stage; and (g–i) show the same as (a–c) for the flowering stage.
Sensors 20 01231 g007
Sensors 20 01231 g008 550
Figure 8. The relationships between the ground-measured and predicted values of winter-wheat yield at different growth stages based on the random forest (RF) method. (a–c) show the results for SIs, a combination of SIs and H, and a combination of SIs and HCSM, respectively, at the jointing stage. (d–f) show the same as (a–c) for the flagging stage; and (g–i) show the same as (a–c) for the flowering stage.
Figure 8. The relationships between the ground-measured and predicted values of winter-wheat yield at different growth stages based on the random forest (RF) method. (a–c) show the results for SIs, a combination of SIs and H, and a combination of SIs and HCSM, respectively, at the jointing stage. (d–f) show the same as (a–c) for the flagging stage; and (g–i) show the same as (a–c) for the flowering stage.
Sensors 20 01231 g008
Sensors 20 01231 g009 550
Figure 9. Maps showing the predicted yield of winter wheat in the 48 experimental plots obtained using PLSR and a combination of the SIs and HCSM. (a) Jointing stage, (b) flagging stage, and (c) flowering stage.
Figure 9. Maps showing the predicted yield of winter wheat in the 48 experimental plots obtained using PLSR and a combination of the SIs and HCSM. (a) Jointing stage, (b) flagging stage, and (c) flowering stage.
Sensors 20 01231 g009
Table
Table 1. The spectral indices used in this study.
Table 1. The spectral indices used in this study.
Spectral IndexEquationReference
MSR(R800/R760 − 1)/(R800/R670 + 1)1/2[33]
NDVI(R750 − R706)/(R750 + R706)[34]
OSAVI1.16 × (R800 − R670)/(R800 + R670 + 0.16)[35]
PSND(R800 − R470)/(R800 + R470)[36]
NPCI(R670 − R460)/(R670 + R460)[37]
PBIR810/R560[38]
TVI0.5 × [120(R750 − R550) – 200 × (R670 − R550)][39]
RDVI(R800 − R670)/(R800 + R670)1/2[40]
SPVI0.4 × [3.7(R800 − R670) − 1.2 × |R530 − R670|][41]
SRR750/R550[42]
TCARI3 × [(R700 − R670) − 0.2 × (R700 − R550)(R700/R670)][43]
MCARI((R700 − R670) − 0.2 × (R700 − R550))(R700/R670)[43]
EVI22.5 × (R800 − R670)/(R800 + 2.4 × R670 + 1)[44]
PSSRR800/R500[36]
RARSR760/R500[45]
WDRVI(0.1 × R800 − R670)/(0.1 × R800 + R670)[46]
LCI(R850 − R710)/(R850 + R670)1/2[47]
PSRI(R680 − R500)/R750[48]
RVSI[(R712 + R752)/2] − R732[49]
GIR554/R677[50]
Note: MSR: modified simple ratio index; NDVI: normalized difference vegetation index; OSAVI: optimized soil adjusted vegetation index; PSND: pigment-specific normalized difference index; NPCI: normalized pigment chlorophyll ratio index; PBI: plant biochemical index; TVI: triangular vegetation index; RDVI: renormalized difference vegetation index; SPVI: spectral polygon vegetation index; SR: simple ratio vegetation index; TCARI: transformed chlorophyll absorption ratio index; MCARI: modified chlorophyll absorption ratio index; EVI2: two-band enhanced vegetation index; PSSR: pigment-specific simple ratio; RARS: ratio analysis of reflectance spectra; WDRVI: modified wide dynamic range vegetation index; LCI: linear combination index; PSRI: plant senescence reflectance index; RVSI: red-edge vegetation stress index; GI: greenness index.
Table
Table 2. The statistical results of yield estimation obtained using the optimal SIs—that is, the plant biochemical index (PBI)—the ground-measured winter-wheat plant height (H), and the winter-wheat plant height extracted from UAV-based hyperspectral images (HCSM), respectively, for different growth stages.
Table 2. The statistical results of yield estimation obtained using the optimal SIs—that is, the plant biochemical index (PBI)—the ground-measured winter-wheat plant height (H), and the winter-wheat plant height extracted from UAV-based hyperspectral images (HCSM), respectively, for different growth stages.
Growth StageParameterLinear Regression
R2RMSE (kg/ha)NRMSE (%)
JointingPBI0.211253.6921.51
H0.011404.4324.09
HCSM 0.051380.8523.69
Flagging PBI0.441056.3818.12
H0.091344.5923.07
HCSM 0.221250.7821.46
Flowering PBI0.63856.6114.70
H0.131319.2122.63
HCSM 0.231247.6721.41
Note: R2: coefficient of determination; RMSE: root-mean-square error; NRMSE: normalized root-mean-square error.
Table
Table 3. Results of yield estimation obtained using a combination of the PBI and H, and a combination of the PBI and HCSM, for different growth stages.
Table 3. Results of yield estimation obtained using a combination of the PBI and H, and a combination of the PBI and HCSM, for different growth stages.
Growth StageParametersLinear Regression
R2RMSE (kg/ha)NRMSE (%)
Jointing PBI+H0.231243.3921.33
PBI+HCSM0.231237.7021.23
FlaggingPBI+H0.451052.3018.05
PBI+HCSM0.481023.8717.57
Flowering PBI+H0.66819.6614.06
PBI+HCSM0.69781.5113.41
Table
Table 4. Results of the estimation of the yield of winter wheat in different growth stages by using partial least squares regression (PLSR).
Table 4. Results of the estimation of the yield of winter wheat in different growth stages by using partial least squares regression (PLSR).
PLSR
Growth StageInformationModelingVerification
R2RMSE (kg/ha)NRMSE (%)R2RMSE (kg/ha)NRMSE (%)
JointingSIs0.311118.2618.320.351415.6426.83
SIs+H0.321110.0218.180.371364.4425.86
SIs+HCSM0.401049.3217.190.401287.3324.40
Flagging SIs0.58878.5014.390.571155.7221.91
SIs+H0.60854.3013.990.621102.1920.89
SIs+HCSM0.66786.3012.880.651069.6020.27
FloweringSIs0.75676.8611.090.70989.4418.75
SIs+H0.76659.9310.810.74891.9916.91
SIs+HCSM0.77648.9010.630.75870.2516.49
Table
Table 5. Results of the estimation of the yield of winter wheat in different growth stages by using an artificial neural network (ANN).
Table 5. Results of the estimation of the yield of winter wheat in different growth stages by using an artificial neural network (ANN).
ANN
Growth StageInformationModelingVerification
R2RMSE (kg/ha)NRMSE (%)R2RMSE (kg/ha)NRMSE (%)
JointingSIs0.271191.7319.520.341429.0127.09
SIs+H0.281155.3818.970.351385.6326.26
SIs+HCSM0.351100.4918.020.371347.2925.54
Flagging SIs0.54919.0015.050.501197.2122.69
SIs+H0.58907.6314.870.521182.4322.49
SIs+HCSM0.63842.7313.800.561161.3622.01
FloweringSIs0.71746.5612.230.641072.9020.34
SIs+H0.72728.9911.940.671056.0320.02
SIs+HCSM0.74695.4511.390.681048.6619.88
Table
Table 6. Results of the estimation of the yield of winter wheat in different growth stages by using the random forest (RF) method.
Table 6. Results of the estimation of the yield of winter wheat in different growth stages by using the random forest (RF) method.
RF
Growth StageInformationModelingVerification
R2RMSE (kg/ha)NRMSE (%)R2RMSE (kg/ha)NRMSE (%)
Jointing SIs0.081312.3221.490.171569.4529.75
SIs+H0.131276.3720.910.231464.8727.77
SIs+HCSM0.161241.1420.330.281352.0725.63
Flagging SIs0.161296.3921.230.411232.0423.35
SIs+H0.221214.6419.890.461224.2823.21
SIs+HCSM0.271166.3619.100.481211.5622.96
FloweringSIs0.311148.6718.810.511190.4722.56
SIs+H0.361090.0917.850.551168.0122.14
SIs+HCSM0.441009.8216.540.591125.4721.33

Share and Cite

MDPI and ACS Style

Tao, H.; Feng, H.; Xu, L.; Miao, M.; Yang, G.; Yang, X.; Fan, L. Estimation of the Yield and Plant Height of Winter Wheat Using UAV-Based Hyperspectral Images. Sensors 2020, 20, 1231. https://doi.org/10.3390/s20041231

AMA Style

Tao H, Feng H, Xu L, Miao M, Yang G, Yang X, Fan L. Estimation of the Yield and Plant Height of Winter Wheat Using UAV-Based Hyperspectral Images. Sensors. 2020; 20(4):1231. https://doi.org/10.3390/s20041231

Chicago/Turabian Style

Tao, Huilin, Haikuan Feng, Liangji Xu, Mengke Miao, Guijun Yang, Xiaodong Yang, and Lingling Fan. 2020. "Estimation of the Yield and Plant Height of Winter Wheat Using UAV-Based Hyperspectral Images" Sensors 20, no. 4: 1231. https://doi.org/10.3390/s20041231

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop