Next Article in Journal
Sensitivity Enhancement of Silicon-on-Insulator CMOS MEMS Thermal Hot-Film Flow Sensors by Minimizing Membrane Conductive Heat Losses
Next Article in Special Issue
An Improved Multi-temporal and Multi-feature Tea Plantation Identification Method Using Sentinel-2 Imagery
Previous Article in Journal
Online Siamese Network for Visual Object Tracking
Previous Article in Special Issue
Detection and Classification of Root and Butt-Rot (RBR) in Stumps of Norway Spruce Using RGB Images and Machine Learning
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Novel Illumination Compensation Technique for Multi-Spectral Imaging in NDVI Detection

1
College of Engineering, South China Agricultural University/Guangdong Engineering Research Center for Agricultural Aviation Application (ERCAAA), Guangzhou 510642, China
2
National Center for International Collaboration Research on Precision Agricultural Aviation Pesticides Spraying Technology (NPAAC), Guangzhou 510642, China
3
Key Laboratory of Key Technology on Agricultural Machine and Equipment, South China Agricultural University, Ministry of Education, Guangzhou 510642, China
4
School of Electrical and Information Engineering, Jiangsu University, Zhenjiang 212013, China
*
Author to whom correspondence should be addressed.
Sensors 2019, 19(8), 1859; https://doi.org/10.3390/s19081859
Submission received: 9 December 2018 / Revised: 1 April 2019 / Accepted: 15 April 2019 / Published: 18 April 2019
(This article belongs to the Special Issue Agricultural Sensing and Image Analysis)

Abstract

:
To overcome the dependence on sunlight of multi-spectral cameras, an active light source multi-spectral imaging system was designed and a preliminary experimental study was conducted at night without solar interference. The system includes an active light source and a multi-spectral camera. The active light source consists of four integrated LED (Light Emitting Diode) arrays and adjustable constant current power supplies. The red LED arrays and the near-infrared LED arrays are each driven by an independently adjustable constant current power supply. The center wavelengths of the light source are 668 nm and 840 nm, which are consistent with that of filter lens of the Rededge-M multi-spectral camera. This paper shows that the radiation intensity measured is proportional to the drive current and is inversely proportional to the radiation distance, which is in accordance with the inverse square law of light. Taking the inverse square law of light into account, a radiation attenuation model was established based on the principle of image system and spatial geometry theory. After a verification test of the radiation attenuation model, it can be concluded that the average error between the radiation intensity obtained using this model and the actual measured value using a spectrometer is less than 0.0003 w/m2. In addition, the fitting curve of the multi-spectral image grayscale digital number (DN) and reflected radiation intensity at the 668 nm (Red light) is y = −3484230x2 + 721083x + 5558, with a determination coefficient of R2 = 0.998. The fitting curve with the 840 nm (near-infrared light) is y = 491469.88x + 3204, with a determination coefficient of R2 = 0.995, so the reflected radiation intensity on the plant canopy can be calculated according to the grayscale DN. Finally, the reflectance of red light and near-infrared light can be calculated, as well as the Normalized Difference Vegetation Index (NDVI) index. Based on the above model, four plants were placed at 2.85 m away from the active light source multi-spectral imaging system for testing. Meanwhile, NDVI index of each plant was measured by a Greenseeker hand-held crop sensor. The results show that the data from the two systems were linearly related and correlated with a coefficient of 0.995, indicating that the system in this article can effectively detect the vegetation NDVI index. If we want to use this technology for remote sensing in UAV, the radiation intensity attenuation and working distance of the light source are issues that need to be considered carefully.

1. Introduction

The Normalized Difference Vegetation Index (NDVI) crop growth parameter is an important indicator of crop growth status [1]. Rapid, non-destructive and accurate monitoring of the crop nitrogen status is important for diagnosing crop growth characteristics, improving the nitrogen management level and utilization efficiency, and reducing farmland environmental pollution brought by excessive nitrogen application [2,3,4]. It is of great significance to further promote precision agriculture and digital agriculture [5,6,7]. Canopy spectral sensing technology based on remote sensing sensors [8] is an important means to obtain crop growth information indicators [9,10]. Remote sensing sensors are divided into active light source sensors and passive light source sensors according to their working methods, and they are called active sensors and passive sensors respectively [11]. Passive sensors receive solar radiation reflected by the vegetation or their own thermal radiation energy [12]. However, since the passive light source measuring instrument mainly regards sunlight as a radiation source, its greatest limitation is that it is easily affected by insufficient sunlight intensity and the solar zenith angle. Therefore, it generally needs to be used when the weather is clear and using a small solar zenith angle [13,14,15].
Researchers have obviously begun to think about solving the problems and disadvantages of passive sensors [16]. To overcome the limitation of passive sensors being susceptible to light conditions, several sensors based on spectral principles and active light sources have appeared in many countries [17]. These devices use a software difference algorithm to remove the influence of sunlight. Ding et al. [18,19] from the National Agricultural Information Engineering Technology Center at Nanjing Agricultural University designed an active light source canopy reflectance spectrometer, and its stability was controlled well. A narrow-band LED was used as the active light source to emit a high-frequency pulsed light. A photoelectric induction circuit receives crop canopy reflectance spectrum to calculate vegetation index. However, existing active sensors have a small detection area and require close-range detection, it is difficult to obtain large-scale macro-vegetation index information [20,21].
Currently, some active light source canopy-scale nitrogen measurement sensors are available for commercial use, such as GreenSeeker handheld crop sensor (Trimble Inc., Sunnyvale, CA, USA), CropCircle™ sensor (Holland Scientific Inc., Lincoln, NC, USA), N-Sensor ALS (Yara Inc., Oslo, Norway) and Crop Spec (Topcon Inc., Tokyo, Japan) [22,23]. These products equipped with active light sources that are not subject to ambient light conditions and can work on cloudy days or at night. In addition, these instruments have the advantages of high measurement accuracy and good data reliability, but they still have issues, such as complicated operation and small coverage area [24]. Since these devices need to sweep point by point on the crop canopy, so the obtained vegetation index makes it difficult to characterize the overall growth of the crop in a large area [4]. Usually, a large number of collection points needs to be distributed in the field for data collection, and the efficiency of these kinds of active sensors is relatively low. Multi-spectral camera technology has developed rapidly in recent years with better controllability and lower costs [25,26,27]. However, at present, the small-sized, lightweight multi-spectral camera still uses sunlight as its light source, and it is still unable to operate normally when the sunlight intensity is insufficient and the solar zenith angle is big. Therefore, it’s necessary to expand the operating time window of multi-spectral camera. Related researches about combination of multi-spectral camera and active light source have not been reported. Considering the unique advantages of active light source remote sensing and of multi-spectral camera, this paper intends to combine the multi-spectral camera with active light source technology to design an active remote sensing system for increasing the working time window of Remote Sensing.

2. Materials

2.1. GreenSeeker Handheld Crop Sensor

The Greenseeker hand-held crop sensor manufactured by Trimble Navigation Company in the United States has two independent light-emitting diodes, which emit near infrared light at 774 nm and red light at 656 nm, respectively [28]. The light emitting diode emits 40 kHz pulsed light, and then captures two wavelengths of reflected light on the surface of the object through a silicon photodiode detector. The instrument is often used to calculate the normalized vegetation index NDVI (656,774):
NDVI   ( 656 , 774 ) = R 774 R 656 R 774 + R 656
where R774 is the reflectance of the near infrared light at 774 nm and R656 is the reflectance of the red light at 656 nm.

2.2. Multi-Spectral Camera

The RedEdge-M camera is a multi-spectral snapshot camera produced by the Micasense Company (Seattle, WA, USA). As shown in Figure 1, it is a multi-spectral imaging device that is advanced, light and compact and can be mounted on UAVs. It provides accurate multi-spectral data for agricultural remote sensing and has five independent imagers. Custom narrowband filters allow each imager to receive spectra in an accurate wavelength range. Table 1 lists the main specifications of the camera.
The Rededge-M multi-spectral camera has five independent CMOS sensors, which can acquire information of five spectral passbands at the same time. Table 2 shows the spectral passband parameters of the multi-spectral camera.
In this paper, only red (668 nm) with 10 nm of full width at half maximum (FWHM) and NIR (840 nm) with 40 nm (FWHM) were used.

2.3. Active Light Source

2.3.1. Integrated LED Array

The normalized difference vegetation index (NDVI) is one of the most important parameters reflecting the crop growth and nutrition information [29]. According to this parameter, crop growth can be judged effectively and fertilization can be guided. The equation is:
NDVI   ( 668 , 840 ) = N I R N I R 1 R R 1 N I R N I R 1 + R R 1
in which:
  • NIR is the reflection intensity of near-infrared light, w/m2.
  • NIR1 is the incident intensity of near-infrared light, w/m2.
  • R is the reflection intensity of red light, w/m2.
  • R1 is the incident intensity of red light, w/m2.
Because the red central wavelength of Rededge-M multi-spectral camera is 668 nm and the center wavelength of the near-infrared light is 840 nm, the active light sources need to have the same wavelengths. In this study, an integrated LED arrays were used as shown in Figure 2. The two red LED arrays adopted 6 parallel and 20 series electrical connection mode of which the maximum drive current and voltage are 1800 mA and 32 V, respectively. Two NIR LED arrays adopted 6 parallel and 16 series electrical connection modes that have a maximum drive current and voltage of 1000 mA and 32 V, respectively.
Considering that the radiation intensity of light decreases with the increase of distance, it is necessary to form a relatively uniform radiation intensity spot in the circle coinciding with the center of the camera lens in order to calibrate the radiation of the photographs taken by the multi-spectral camera. Therefore, the two groups of red light sources and near infrared light sources need to be symmetrical, as shown in Figure 3. Because there is no lens in front of the LED arrays, the light it emits is a uniform non-parallel light source, which is a kind of light similar to the sphere.

2.3.2. Constant Current Power Supply

The driving current of integrated LED array is more than 1000 mA and the voltage is as high as 32 V. The driving current of constant current power supply is only about 300 mA, so this active light source cannot drive normally. OB2269 is a low power consumption, noise-free, high conversion efficiency constant current driver chip, produced by On-Bright Electronics, Shanghai, China. A constant current drive power supply based on the chip is applied, as shown in Figure 4. The main parameters of constant current power supply are shown in Table 3, and all parameters can be controlled.

3. Methods and Results

3.1. Radiation Attenuation Test and Analysis

To accurately measure the spectral characteristics of the active light source, the EU2000+ spectrometer manufactured by Hangzhou Tongshang Optoelectronics Co., Ltd. (Hangzhou, China) was used to test the active light source. The EU2000 + spectrometer uses grating to separate light source, and then uses high sensitivity CCD arrays with 2048 units to measure. Its measurement range and wavelength resolution fully meet the accuracy requirements of this study. Table 4 shows the main specifications of the EU2000+ spectrometer.
In this section, the EU2000 + spectrometer is used to measure the radiation intensity of the active light source. Two red LED arrays of active light source and two near infrared LED arrays are in parallel mode. Two bands of LED arrays are driven by two constant current power sources. The test location is shown in Figure 5. The driving current is set to 0.5, 1, 1.5, 2 and 2.5A in turn. When each current drives the light source, the distance between the probe and the light source of the spectrometer is changed from 0.3, 0.4, 0.5, 0.9 and 1.0 m, respectively. The results are shown in Figure 6.
From Figure 6, we can see that the radiation intensity of the active light source is proportional to the driving current and inversely proportional to the distance between the optical fiber probe and the active light source. As shown in Table 5, the radiation intensity ratios of 668 nm red light and 840 nm near red light are close to 4 under different driving currents of 30 cm and 60 cm, 40 cm and 80 cm, 50 cm and 100 cm radiation distances, which conform to the square inverse ratio law of light [30]. That is, when the measuring distance is doubled, the light intensity is reduced by a factor of four. Therefore, the radiation intensity on the surface of an object is negatively exponentially with increasing distance. The result is calculated as follows:
L e c = L e D 2
in which: Lec is the incident radiation intensity reaching the surface of the object, w/m2; Le is the emitted light radiation intensity for one LED array source, w/m2 and D indicates the ratio of the distance between the back and the distance measured for the first time.

3.2. The Establishment of Radiation Attenuation Correction Model

As we have seen before, the intensity of radiation varies with the distance to the radiation source. It is necessary to establish a radiation attenuation model for calculating the radiation intensity on the surface of an object in real time according to the radiation distance. There are three steps to implement it. In the first step, the center axis of the multi-spectral camera is the same as that of the active light source, and the distance between the active light source and the multi-spectral camera is set to L2 = 1 m. In the second step, multi-spectral camera is used to directly face the active light source and take pictures. Finally, the coordinates of the four central points of the LED array in the multi-spectral image are obtained from the image using the center point O (0,0) as the coordinate origin. The imaging principle is shown in Figure 7a and the spectral image is shown in Figure 7b.
When the distance L2 is 1 m, the pixel coordinates of the four light sources in the image are 668[1](−91,91), 668[2](91,91), 840[1](−91,−91), and 840[2](91,−91).
As L2 gradually becomes larger, the center position of the four light sources in the image will be changed and the coordinates of 668[1], 668[2], 840[1], and 840[2] will gradually approach the center point O (0,0). The mathematical relationships between radiation intensity and distance are shown in Table 6. According to the pixel coordinates, the radiation intensity can be expressed by the pixel coordinates of four light sources in the image.
Different points in the new image represent different radiation intensities. In order to accurately obtain the radiation intensity of specific test points in the image, it is necessary to correct the radiation intensity at different locations. Among them, the radiation intensity of four light sources is only related to l2, but the radiation intensity of other points in the image needs geometric correction. It is certain that when the distance increases, the coordinates of the four light sources in the image and other coordinates (such as B (x,y)) in the image will change. Assume that B (x,y) is the test point in the first quadrant of the image, as shown in Figure 8.
Since the four light sources form a square of 0.13 m × 0.13 m, the actual distance represented by each pixel is:
D X = 0.13 91 2 0.00071   m
In the first quadrant, point B receives radiation from four sources: 668[1], 668[2], 840[1], and 840[2]. According to Equation (3) and space geometry, the radiation intensity of two 668 nm red LEDs at point B is as follows:
L e c 668 [ 1 ]   B = L e 668 L 2 2 + ( [ ( | x | + 91 ) D X ] 2 + [ ( | y | 91 ) D X ] 2 )
L e c 668 [ 2 ]   B = L e 668 L 2 2 + ( [ ( 91 | x | ) D X ] 2 + [ ( | y | 91 ) D X ] 2 )
Similarly, the radiation intensity of two 840 nm NIR LEDs at point B is:
L e c 840 [ 1 ]   B = L e 840 L 2 2 + ( [ ( | x | + 91 ) D X ] 2 + [ ( | y | + 91 ) D X ] 2 )
L e c 840 [ 2 ]   B = L e 840 L 2 2 + ( [ ( 91 | x | ) D X ] 2 + [ ( | y | + 91 ) D X ] 2 )
Therefore, the total radiation intensity of red and infrared light at point B is as follows:
L e c 668   B = L e c 668 [ 1 ]   B + L e c 668 [ 2 ]   B
L e c 840   B = L e c 840 [ 1 ]   B + L e c 840 [ 2 ]   B
Different quadrants have different calculation Equations, so it is necessary to calculate DX in actual test.

3.3. Optical Radiation Attenuation Correction Model Verification

In order to further determine the correctness of the optical attenuation calibration model and ensure the successful application of the combination of active light source and multi-spectral camera, the validation experiments were carried out.
When the driving currents are all set to 1.5A, the actual radiation intensity of each LED array at a distance of 1 m from the active light source is measured by EU2000 + spectrometer and the measured radiation intensity are denoted as either Le668 and Le840. After measuring, the radiation intensity of Le668 was 0.0469 w/m2 and Le840 was 0.0417 w/m2 when the distance is 1 m. When the distance is 2 m, the Dx = 0.00035 m and coordinates of 668[1], 668[2], 840[1], and 840[2] in image were (45.5,45.5), (−45.5,45.5), (−45.5,−45.5) and (45.5,−45.5), respectively.
The Rededge-M camera is placed in the central circular hole of the active light source, and a square test board with a side length of 0.9 m is placed 2 m away from the active light source. The test board is marked with marked with T0 (0,0), T1 (0.2 m,0.2 m), T2 (−0.3 m,0.3 m), T3 (−0.4 m,−0.4 m), and T4 (0.1 m,−0.1 m) for a total of five test points as shown in Figure 9. Based on the previous measurements of Le668 and Le840 as well as Equations (9) and (10).
We can calculate the radiation intensity of five points in the image. In the meantime, actual test radiation intensity was measured at the above five points using an EU2000+ spectrometer. The results were listed in Table 7.
The results show that when the distance between the object and the camera is known, the error between the measured radiation intensity of the object and the calculated value based on the established radiation correction model is less than 0.0003W/m2, and the effect is acceptable.

3.4. Grayscale Digital Number and Radiation Intensity

After the incident radiation intensity is obtained, the intensity of the reflection is the key to calculating the reflectance. The Rededge-M multi-spectral camera can store 16-bit TIF digital format with a digital number of 65536. In order to calculate the radiation intensity of reflection, it is necessary to determine the relationship between the digital number (DN) and the radiation intensity of each point taken by the camera. For this purpose, the current of constant current power supply is adjusted to 0.1, 0.2, 0.3 to 1.5 A in darkroom to drive the active light source, and a standard reflective whiteboard with about 100% reflectivity is placed at 250–2500 nm with a distance of 1 m. The exposure time of the multi-spectral camera is set to 7.8 ms manually. In this test, Rededge-M multi-spectral camera is used to collect grey images of standard reflective whiteboard, and EU2000 + spectrometer is used to measure the radiation intensity of each adjustment of driving current. Spectral images of standard reflection whiteboard at 668nm and 840nm under different driving currents are shown in Figure 10.
After the experiment, it is concluded that the display grey levels at 668 and 840 nm vary significantly with the change of driving current. The grey level DN of the multi-spectral camera has a quadratic regression relationship with the reflective radiation intensity at 668 nm (Figure 11), and a linear relationship with the reflective radiation intensity at 840 nm and the fixed exposure time (Figure 12). It can be seen from this that the radiation intensity of reflection can be calculated according to the grey level DN displayed in the image.
From Figure 11 and Figure 12, it can be seen that the 668 nm red light fitting curve is:
y = −3484230x2 + 721083x + 5558
The coefficient of determination R2 = 0.998. The 840 nm near-infrared light fitting curve is:
y = 491469.88x + 3204

3.5. Test Verification and Analysis

The GreenSeeker handheld crop sensor are often used to estimate the photosynthetic area or plant canopy nitrogen. Mature research and development techniques makes this device more accuracy in measuring the vegetation index. In order to verify the accuracy of NDVI index detection by active light source system, a validation experiment was carried out. Firstly, the multi-spectral camera is used to shoot the active light source at the distance of 2.85 m from the active light source, and the coordinates of four LED arrays in the spectral image are obtained. Then, 1.5 A constant current was used to drive the active light source, and the active light source was used to irradiate four potted plants placed 2.85 m away from the active light source. At the same time, the radiated potted plants were photographed with a multi-spectral camera.
The center coordinates of active light source were 668[1](−33,33), 668[2](33,33), 840[1](33,33), and 840[2](33,33),and the spectral images are as shown in Figure 13. Numbers 1, 2, 3, and 4 with a red rectangle area are the representative areas. The average NDVI values of 10 samples measured by Greenseeker at 1 m were 0.534, 0.569, 0.680 and 0.610, respectively. When the distance was 2.85 m, the Dx =0.00025 m and pixel coordinates of 668[1], 668[2], 840[1], and 840[2] in the image were (32,32), (−32,32), (−32,−32) and (32,−32). The 668 nm average grayscale DN of the 4 red rectangles were 5178, 5291, 5255, and 5090. The grey-scale DN of 840 nm plant red rectangle in the image is 7411, 7576, 7891 and 8200, respectively. The coordinates of the four rectangles are 1 (−293,82), 2 (−108,111), 3 (64,92) and 4 (238,137).
According to Equations (9) and (10), the intensity of incident light can be obtained. According to the Equations (11) and (12), the intensity of reflected light radiation can be obtained. Then, according to the data in Table 8, NDVI was calculated by Equation (13). The correlation coefficient between NDVI value of active light source system and Greenseeker hand-held crop sensor is R = 0.995:
N D V I ( 668 , 840 ) = L e c 840 L R 840 L e c 668 L R 668 L e c 840 L R 840 + L e c 668 L R 668

4. Discussion

In this paper, the difference between active and passive NDVI sensors in remote sensing is discussed, and their limitations are listed. The existing passive NDVI remote sensing technology mainly uses sunlight as the measuring light source, which depends heavily on the sunlight intensity and the zenith angle. The existing active NDVI remote sensing technology sensor has a small sensing area in one measurement and data from single measurements are scarce. Multi-spectral cameras can acquire a large amount of data in a single image acquisition, especially in remote sensing when carried by UAVs. In order to improve the efficiency of multi-spectral camera imaging technology, the combination of active non-parallel light source technology and multi-spectral imaging technology is proposed according to the respective advantages of active light source and spectral imaging technology. The basic characteristics of the active non-parallel light source and the optical attenuation caused by the geometrical structure of the imaging system are also considered. The attenuation of light will affect the quality of multi-spectral images and the correctness of final data. Because the light of the active light source in this paper is not parallel light, but a spherical light like scattered light, the radiation intensity of the vegetation surface is not equal. Therefore, it is necessary to measure and estimate the actual radiation intensity of vegetation sites, establish radiation attenuation model and radiation correction model to meet the radiation correction of non-parallel light.
We have conducted some experiments to verify The Inverse Square Law of light [30]. In other words, the radiation intensity of light decreases linearly with the square of distance. This theory is very important in the active remote sensing. Based on this optical rule and the geometric structure of the imaging system, the attenuation model and correction model of light are designed. In the attenuation model, we think that the radiation intensity of our light source is not enough. As can be seen from Figure 6, the radiation intensity decreases with the increase of distance. The longer the distance, the weaker the radiation intensity, even if the current is 2.5 A. As can be seen from Figure 7, at a distance of 2 m, the measured light radiation intensity is very weak, only about 0.02 W/m2. If long-distance light compensation is to be carried out, a higher power supply or a larger exposure time of the camera is required.
Our goal is to combine the active light source with the multi-spectral camera, and to take advantage of the advantages of the multi-spectral camera in collecting large amounts of data in an attempt to improve the operation time window. The light source we use here is a continuous light source, not a pulse light source, so the use of multi-spectral camera for photography and acquisition will still be affected by the external environment light. Because our experiments are carried out at night, the results and methods obtained are only suitable for testing without external light, but not for any light environment. If we want to use the combination of persistent light and multi-spectral cameras to obtain a larger remote sensing time window, we need to re-establish the radiation correction model, radiation attenuation model, and even the types of light sources in different lighting environments. In addition, a CW light source needs more power than a laser, so it is difficult for CW light source assistant technology to produce enough radiation intensity in multi-spectral camera remote sensing. Greenseeker’s NDVI is based on active laser pulse measurements and reflected sunlight measurements, so it should provide consistent readings no matter how the atmospheric or solar illumination conditions change [31]. A laser technology that can form a plane spot, such as vertical cavity surface emitting laser (VCSEL), is expected to be used in remote sensing of multi-spectral cameras. However, due to the limited response speed of the photosensitive elements of the multi-spectral camera to light and the image format compression technology required by the camera, it is difficult for the multi-spectral camera to measure the flash frequency of the laser source. This makes it difficult to filter out ambient light interference, even if the laser source can provide enough light intensity over a long distance. In the future, we believe that if we want to use active light source to achieve long-distance remote sensing monitoring, we need to further propose photosensitive technology.

5. Conclusions

In this paper, aiming at solving the problem of small working time window of passive NDVI sensor and small coverage area of single operation, we propose to combine multi-spectral imaging technology with active light source technology to collect the spectrum over a wide range. The results show that the intensity of radiation on the surface of different canopy points is different when radiated by a uniform light source. The main reason is that the distances between different points on the canopy surface and non-parallel light sources are different. In addition, the calculation factor of NDVI index is the reflectivity of infrared and near infrared light, so it is necessary to calibrate the incident light radiation at different points on the canopy surface. It is also necessary to analyse the correlation between the grayscale DN and the reflected radiation intensity value in the spectral image. We get the relationship between the grey-scale DN of red light and near-infrared light and the radiation intensity of reflection, and calculate the radiation intensity reflected from the measuring point according to the grey-scale DN. Finally, NDVI is obtained according to the intensity of reflected radiation and incident light. After four comparative experiments, the correlation coefficient between the proposed method and the results of the Greenseeker hand-held crop sensor professional spectral tester is 0.995, and the effect is remarkable. Although the system validates the feasibility of active spectral imaging technology in vegetation index detection without solar interference, if we want to apply this technology to UAV remote sensing, the radiation intensity and working distance of the light source need to be carefully considered. In the case of insufficient sunlight, the high sensitivity of the sensor and the intelligent supplementary light technology for obtaining high quality spectral images need to be further studied.

Author Contributions

R.J. was responsible for the framework design of the entire system in this research and arranged tests, conducted several verification tests, and wrote the article. Y.X. and P.W. assisted in collected all the test data and checked the paper carefully. Z.Z. proposed the main plans, ideas and guidance for the work and reviewed the paper, as well as acquired the funding. Y.L. and X.L. provided guidance and advice.

Funding

This work was supported by the National Natural Science Foundation of China (31871520), the National Key R&D Program of China (2018YFD0200301), Natural Science Foundation of Jiangsu Province of China (BK20160510), Science and Technology Plan of Guangdong Province of China (2017B090903007) and Science and Technology Plan of Guangzhou City of China (201807010111).

Acknowledgments

We thank the anonymous reviewers for their critical comments and suggestions to improve the manuscript.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Huang, Y.B.; Chen, Z.X.; Yu, T.; Huang, X.Z.; Gu, X.F. Agricultural remote sensing big data: Management and applications. J. Integr. Agric. 2018, 17, 1915–1931. [Google Scholar] [CrossRef]
  2. Wu, C.Y.; Wang, L.; Niu, Z.; Gao, S.; Wu, M.Q. Nondestructive estimation of canopy chlorophyll content using Hyperion and Landsat/TM images. Int. J. Remote Sens. 2010, 31, 2159–2167. [Google Scholar] [CrossRef]
  3. Wang, P.; Lan, Y.B.; Luo, X.W.; Zhou, Z.Y.; Wang, Z.G.; Wang, Y.H. Integrated sensor system for monitoring rice growth conditions based on unmanned ground vehicle system. Int. J. Agric. Biol. Eng. 2014, 7, 75–81. [Google Scholar]
  4. Purba, J.; Sharma, R.K.; Jat, M.L.; Thind, H.S.; Gupta, R.K.; Chaudhary, O.P.; Chandna, P.; Khurana, H.S.; Kumar, A.; Uppal, H.S.; et al. Site-specific fertilizer nitrogen management in irrigated transplanted rice (Oryza sativa) using an optical sensor. Precis. Agric. 2015, 16, 455–475. [Google Scholar]
  5. Ni, J.; Yao, X.; Tian, Y.C.; Cao, W.C.; Zhu, Y. Design and experiments of portable apparatus for plant growth monitoring and diagnosis. Trans. Chin. Soc. Agric. Eng. 2013, 29, 150–156. [Google Scholar]
  6. Sankaran, S.; MishraR, A.; Ehsani, A. A review of advanced techniques for detecting plant diseases. Comput. Electron. Agric. 2010, 1, 1–13. [Google Scholar] [CrossRef]
  7. Houborg, R.; Anderson, M.; Dzughtry, C. Utility of an image-based canopy reflectance modeling tool for remote estimation of LAI and leaf chlorophyII content at the field scale. Remote Sens. Environ. 2009, 1, 259. [Google Scholar] [CrossRef]
  8. Gong, W.; Song, S.L.; Zhu, B.; Shi, S.; Li, F.Q.; Cheng, X.W. Multi-wavelength canopy LiDAR for remote sensing of vegetation: Design and system performance. Isprs J. Photogramm. Remote Sens. 2012, 69, 1–9. [Google Scholar]
  9. Cao, Q.; Miao, Y.X.; Feng, G.H.; Gao, X.W.; Li, F.; Liu, B.; Yue, S.C.; Cheng, S.S.; Ustin, S.L.; Khosla, R. Active canopy sensing of winter wheat nitrogen status: An evaluation of two sensor systems. Comput. Electr. Agric. 2015, 112, 54–67. [Google Scholar] [CrossRef]
  10. Yao, Y.K.; Miao, Y.X.; Huang, S.Y.; Gao, L.; Ma, X.B.; Zhao, G.M.; Jiang, R.F.; Chen, X.P.; Zhang, F.S.; Yu, K.; et al. Active canopy sensor-based precision N management strategy for rice. Agron. Sustain. Dev. 2012, 32, 925–933. [Google Scholar] [CrossRef] [Green Version]
  11. Erdle, K.; Mistele, B.; Schmidhalter, U. Comparison of active and passive spectral sensors in discriminating biomass parameters and nitrogen status in wheat cultivars. Field Crop. Res. 2011, 124, 74–84. [Google Scholar] [CrossRef]
  12. Barmeier, G.; Schmidhalter, U. High-Throughput Phenotyping of Wheat and Barley Plants Grown in Single or Few Rows in Small Plots Using Active and Passive Spectral Proximal Sensing. Sensors 2016, 16, 1860. [Google Scholar] [CrossRef] [PubMed]
  13. Kipp, S.; Mistele, B.; Schmidhalter, U. The performance of active spectral reflectance sensors as influenced by measuring distance, device temperature and light intensity. Comput. Electron. Agric. 2014, 100, 24–33. [Google Scholar] [CrossRef]
  14. Winterhalter, L.; Mistele, B.; Schmidhalter, U. Evaluation of active and passive sensor systems in the field to phenotype maize hybrids with high-throughput. Crop. Res. 2013, 154, 236–245. [Google Scholar] [CrossRef]
  15. Solari, F.; Shanahan, J.; Ferguson, R.; Schepers, J.; Gitelson, A. Active Sensor Reflectance Measurements of Corn Nitrogen Status and Yield Potential. Agron. J. 2008, 100, 571–579. [Google Scholar] [CrossRef]
  16. Ni, J.; Wang, T.T.; Yao, X.; Cao, W.X.; Zhu, Y. Design and Experiments of Multi-spectral Sensor for Rice and Wheat Growth Information. Trans. Chin. Soc. Agric. Mach. 2013, 44, 207–212. [Google Scholar]
  17. Mishra, A.; KarimiR, D.; Reza, E. Evaluation of an active optical sensor for detection of Huanglongbing (HLB) disease. Biosyst. Eng. 2011, 110, 302–309. [Google Scholar] [CrossRef]
  18. Ding, Y.Q.; Li, Y.; Tan, X.X.; Cao, W.X.; Zhu, Y. Control Stability of Active Light Source Spectra during Measuring Reflectance of Canopy. Trans. Chin. Soc. Agric. Mach. 2014, 45, 284–290. [Google Scholar]
  19. Ding, Y.Q.; Zhu, Y.; Li, Y.; Wang, Z.Q.; Tan, X.X.; Cao, W.X. A Method for Measuring Reflection Spectrum of Crop Canopy Based on Active Light Source. Trans. Chin. Soc. Agric. Mach. 2013, 44, 209–214. [Google Scholar]
  20. Li, X.H.; Li, M.Z.; Cui, D.; Miao, Y.X. Monitoring of rice plant growth in Northeast China using dual-wavebands crop growth analyzer. Trans. Csae 2011, 27, 206–210. [Google Scholar]
  21. Souza, H.B.; Baio, F.H.R.; Neves, D.C. Using passive and active multi-spectral sensors on the correlation with the phenological indices of cotton. Eng. Agric. 2017, 37, 782–789. [Google Scholar]
  22. Ali, A.M.; Abou-Amer, I.; Ibrahim, S.M. Using GreenSeeker active optical sensor for optimizing maize nitrogen fertilization in calcareous soils of Egypt. Arch. Agron. Soil Sci. 2018, 64, 1083–1093. [Google Scholar] [CrossRef]
  23. Barker, D.W.; Sawyer, J.E. Using Active Canopy Sensors to Quantify Corn Nitrogen Stress and Nitrogen Application Rate. Agron. J. 2010, 102, 964–971. [Google Scholar] [CrossRef] [Green Version]
  24. Eitel, J.U.H.; Keefe, R.F.; Long, D.S.; Davis, A.; Vierling, L. Active Ground Optical Remote Sensing for Improved Monitoring of Seedling Stress in Nurseries. Sensors 2010, 4, 2843–2850. [Google Scholar] [CrossRef] [PubMed]
  25. Sebasitian, C.; Fabio, R.; Michaela, D.; Marrco, D.; Mario, G. Evaluating Multi-spectral Images and Vegetation Indices for Precision Farming Applications from UAV Images. Remote Sens. 2015, 7, 4026–4047. [Google Scholar]
  26. Zhang, D.Y.; Zhou, X.G.; Zhang, J.; Lan, Y.B.; Xu, C.; Liang, D. Detection of rice sheath blight using an unmanned aerial system with high-resolution color and multi-spectral imaging. PLoS ONE 2018, 13, e0187470. [Google Scholar]
  27. Gianluca, F.; Edoardo, C.; Mirco, M.; Galvagno, M.; Sonnentag, O.; Humphreys, E.; Hufkens, K.; Ryu, Y.; Verfaillie, J.; di Cella, U.M.; et al. NDVI derived from near-infrared-enabled digital cameras: Applicability across different plant functional types. Agric. For. Meteorol. 2018, 249, 275–285. [Google Scholar]
  28. Zhang, N.; Qi, B.; Zhao, J.M.; Zhang, X.Y.; Wang, S.; Zhao, T.G.; Gai, J.Y. Prediction for Soybean Grain Yield Using Active Sensor Green Seeker. Acta Agron. Sin. 2014, 40, 657–666. [Google Scholar] [CrossRef]
  29. Zhao, C.J.; Liu, L.Y.; Zhou, H.C.; Wang, J.H.; Xue, X.Z. Development and application of a novel NDVI instrument. Opt. Tech. 2004, 3, 324–326. [Google Scholar]
  30. Brownson, J.R.S. Chapter 03—Laws of Light. Solar Energy Conversion Systems; Academic Press: Boston, MA, USA, 2014; pp. 41–66. [Google Scholar]
  31. Cao, S.; Danielson, B.; Clare, S.; Koenig, S.; Campos-Vargas, C.; Sanchez-Azofeifa, A. Radiometric calibration assessments for UAS-borne multi-spectral cameras: Laboratory and field protocols. Isprs J. Photogramm. Remote Sens. 2019, 149, 132–145. [Google Scholar] [CrossRef]
Figure 1. Rededge- M multi-spectral camera. Note: 1. Blue band 2. Green band 3. Red band 4. NIR (near infrared red) band 5. Red Edge band.
Figure 1. Rededge- M multi-spectral camera. Note: 1. Blue band 2. Green band 3. Red band 4. NIR (near infrared red) band 5. Red Edge band.
Sensors 19 01859 g001
Figure 2. The active light source of the LED array.
Figure 2. The active light source of the LED array.
Sensors 19 01859 g002
Figure 3. Active light source.
Figure 3. Active light source.
Sensors 19 01859 g003
Figure 4. Adjustable constant current power supply.
Figure 4. Adjustable constant current power supply.
Sensors 19 01859 g004
Figure 5. Spectral attenuation test site.
Figure 5. Spectral attenuation test site.
Sensors 19 01859 g005
Figure 6. Relationship between the irradiation intensity and driving current and projection distance.
Figure 6. Relationship between the irradiation intensity and driving current and projection distance.
Sensors 19 01859 g006
Figure 7. Imaging principle diagram.
Figure 7. Imaging principle diagram.
Sensors 19 01859 g007
Figure 8. Distribution of the radiation intensity of incident light in multi-spectral images.
Figure 8. Distribution of the radiation intensity of incident light in multi-spectral images.
Sensors 19 01859 g008
Figure 9. Optical attenuation correction model verification panel.
Figure 9. Optical attenuation correction model verification panel.
Sensors 19 01859 g009
Figure 10. Spectral images of standard reflection whiteboard at 668nm and 840nm under different current drive.
Figure 10. Spectral images of standard reflection whiteboard at 668nm and 840nm under different current drive.
Sensors 19 01859 g010
Figure 11. The relationship between the DN of the image display and the 668 nm red light radiation intensity.
Figure 11. The relationship between the DN of the image display and the 668 nm red light radiation intensity.
Sensors 19 01859 g011
Figure 12. The relationship between the DN of the image display and the 840 nm infrared radiation intensity.
Figure 12. The relationship between the DN of the image display and the 840 nm infrared radiation intensity.
Sensors 19 01859 g012
Figure 13. Multi-spectral photos with 2.85 m radiation range.
Figure 13. Multi-spectral photos with 2.85 m radiation range.
Sensors 19 01859 g013
Table 1. Main specifications of Rededge-M.
Table 1. Main specifications of Rededge-M.
ParameterUnitValue
Weightg150 g
Dimensionscm312.1 cm × 6.6 cm × 4.6 cm
Powerw5.0 V DC, 4 w
Spectral bands blue, green, red, red edge, NIR
Capture rates1 s (max)
Format 16 bits TIFF, 12 bits DNG
Field of view°47.2°
Table 2. Spectral bands of the Rededge-M.
Table 2. Spectral bands of the Rededge-M.
Band NumberBandCenter Wavelength (nm)Band Width FWHM (nm)
1Blue47520
2Green56020
3Red66810
4Near IR84040
5Red Edge71710
Table 3. Specifications of the constant current source.
Table 3. Specifications of the constant current source.
ParameterUnitValue
Input voltageV100 ~ 240
Output voltageV26~36
Output currentmA300 ~ 3200
Table 4. Main specifications of EU2000+ spectrometer.
Table 4. Main specifications of EU2000+ spectrometer.
ParameterUnitValue
Range of bandnm400~1000
accuracynm±0.4
Linearity of photometry%±0.5
Integration timems3~60000
Sensor/2048 units CCD array
The optical fiber connector/SMA905
Table 5. Ratio of red light and infrared radiation intensity of different driving currents at twice the projection distance.
Table 5. Ratio of red light and infrared radiation intensity of different driving currents at twice the projection distance.
Twice Test Distance/cmCurrent/ ARIR (668)RIR (840)
30/600.53.703.91
13.553.91
1.53.853.95
23.654.22
2.53.544.59
40/800.54.333.80
13.783.38
1.53.983.62
23.984.13
2.53.813.87
50/1000.53.573.50
14.074.06
1.54.114.36
24.133.73
2.54.223.76
RIR (668) means radiation intensity ratio at 668 nm (w/m2); RIR (840) means radiation intensity ratio at 840 nm (w/m2).
Table 6. Coordinate value and radiation intensity.
Table 6. Coordinate value and radiation intensity.
Coordinate LabelPixel CoordinateRadiation Intensity(w/m2)
668[1]( 91 L 2 , 91 L 2 ) L e 668 L 2 2
668[2]( 91 L 2 , 91 L 2 ) L e 668 L 2 2
840[1]( 91 L 2 , 91 L 2 ) L e 840 L 2 2
840[2]( 91 L 2 , 91 L 2 ) L e 840 L 2 2
Le668 and Le840 are radiation intensity of one LED array when distance of EU2000+ spectrometer and LED array is 1 m; L2 > 1m.
Table 7. Predicted light intensity and measured light intensity.
Table 7. Predicted light intensity and measured light intensity.
Coordinate
(m)
Pixel CoordinatesP (668)/P (840),
(w/m2)
M (668)/M (840),
(w/m2)
Error
668 nm/840 nm,
(w/m2)
T0(0,0)0, 00.0234/0.02080.0233/0.02070.0001/0.0001
T1(0.2,0.2)138, 1380.0230/0.02030.0228/0.02030.0001/0.0000
T2(-0.3,0.3)−223, 2230.0226/0.01970.0226/0.01990.0002/0.0003
T3(-0.4,0.4)−283, 2830.0219/0.01900.0216/0.01880.0003/0.0002
T4(0.1,0.1)81, 810.0233/0.02060.0230/0.02040.0003/0.0002
P (668) and P (840) mean predicted radiation intensity (w/m2) based on attenuation correction model, respectively; M (668) and M (840) mean measured radiation intensity (w/m2) by the EU2000+ spectrometer, respectively.
Table 8. Test data comparison.
Table 8. Test data comparison.
NumberIRI (668nm)RRI (668nm)IRI (840nm)RRI (840nm)NDVI(AS)NDVI(GS)
10.011540.003650.010260.008560.4490.534
20.011540.003700.010270.009260.4750.569
30.011540.003680.010270.009530.4880.580
40.011520.003610.010260.010150.5190.610
IRI(668) means incident radiation intensity at 668 nm (w/m2); IRI(840) means incident radiation intensity at 840 nm (w/m2);RRI(668) means reflected radiation intensity at 668 nm(w/m2); RRI(840) means reflected radiation intensity at 840 nm(w/m2); NDVI(AS) means NDVI with Active light source; NDVI(GS) means NDVI with the GreenSeeker handheld crop sensor.

Share and Cite

MDPI and ACS Style

Jiang, R.; Wang, P.; Xu, Y.; Zhou, Z.; Luo, X.; Lan, Y. A Novel Illumination Compensation Technique for Multi-Spectral Imaging in NDVI Detection. Sensors 2019, 19, 1859. https://doi.org/10.3390/s19081859

AMA Style

Jiang R, Wang P, Xu Y, Zhou Z, Luo X, Lan Y. A Novel Illumination Compensation Technique for Multi-Spectral Imaging in NDVI Detection. Sensors. 2019; 19(8):1859. https://doi.org/10.3390/s19081859

Chicago/Turabian Style

Jiang, Rui, Pei Wang, Yan Xu, Zhiyan Zhou, Xiwen Luo, and Yubin Lan. 2019. "A Novel Illumination Compensation Technique for Multi-Spectral Imaging in NDVI Detection" Sensors 19, no. 8: 1859. https://doi.org/10.3390/s19081859

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop