Next Article in Journal
Automatic Frequency Controller for Power Amplifiers Used in Bio-Implanted Applications: Issues and Challenges
Previous Article in Journal
A Vondrak Low Pass Filter for IMU Sensor Initial Alignment on a Disturbed Base
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Digital Sensor Simulator of the Pushbroom Offner Hyperspectral Imaging Spectrometer

Key Laboratory of Precision Opto-Mechatronics Technology, Ministry of Education, School of Instrument Science & Opto-Electronics Engineering, Beihang University, Beijing 100191, China
*
Author to whom correspondence should be addressed.
Sensors 2014, 14(12), 23822-23842; https://doi.org/10.3390/s141223822
Submission received: 30 October 2014 / Revised: 28 November 2014 / Accepted: 3 December 2014 / Published: 11 December 2014
(This article belongs to the Section Remote Sensors)

Abstract

: Sensor simulators can be used in forecasting the imaging quality of a new hyperspectral imaging spectrometer, and generating simulated data for the development and validation of the data processing algorithms. This paper presents a novel digital sensor simulator for the pushbroom Offner hyperspectral imaging spectrometer, which is widely used in the hyperspectral remote sensing. Based on the imaging process, the sensor simulator consists of a spatial response module, a spectral response module, and a radiometric response module. In order to enhance the simulation accuracy, spatial interpolation-resampling, which is implemented before the spatial degradation, is developed to compromise the direction error and the extra aliasing effect. Instead of using the spectral response function (SRF), the dispersive imaging characteristics of the Offner convex grating optical system is accurately modeled by its configuration parameters. The non-uniformity characteristics, such as keystone and smile effects, are simulated in the corresponding modules. In this work, the spatial, spectral and radiometric calibration processes are simulated to provide the parameters of modulation transfer function (MTF), SRF and radiometric calibration parameters of the sensor simulator. Some uncertainty factors (the stability, band width of the monochromator for the spectral calibration, and the integrating sphere uncertainty for the radiometric calibration) are considered in the simulation of the calibration process. With the calibration parameters, several experiments were designed to validate the spatial, spectral and radiometric response of the sensor simulator, respectively. The experiment results indicate that the sensor simulator is valid.

1. Introduction

Compared with the whiskbroom imaging spectrometer, the pushbroom imaging spectrometer, with a higher signal-to-noise ratio (SNR), has been widely used in airborne and spaceborne remote sensing [1,2]. For the launched and developing pushbroom hyperspectral imaging spectrometers, the Offner dispersive imaging system is popular for its many advantages, such as low aberrations, a wide flat field, a compact size, and a high speed [37]. An Offner dispersive imaging system, which consists of three spherical and concentric surfaces: two concave mirrors and a classical convex grating, relies on the Offner unity magnification reflective relay [8].

Sensor simulators, translating the spatially and spectrally oversampled at-sensor radiance scene into the proposed digital number (DN) images, play an important role in forecasting the performance of the instrument when designing a hyperspectral imaging spectrometer [9]. A sensor simulator is generally composed of the simulation of imaging spectrometer's spatial response, spectral response and radiometric response. These responses are the key factors of the spectral quality metrics reported by Kerekes [10]. With responsibility for indicating the dispersive imaging ability of the hyperspectral imaging spectrometer, several sensor simulators were developed as part of the core sub-modules of the end-to-end remote sensing simulation model [1113]. However, some problems still need to be resolved more, especially, in the simulation of the spatial response and the spectral response.

Generally, in the spatial response simulation, the operations of image positioning, spatial degradation and spatial resampling are considered [14]. Image positioning is a process of establishing the relationship between each detector element and the imaging projections on the ground surface in the imaging time. Spatial degradation, which is caused by the platform motion, optical system aberrations, slit size, detector element size, and so on, blurs the spatial image. Spatial resampling is a transformation process which outputs the resampled image with the ground sampling distance (GSD) of the proposed sensor. In most sensor simulators, point spread function (PSF), the matrix multiplication of the line spread functions (LSFs) in along-track and in across-track [15], is used to convolve with the oversampled image to implement the spatial degradation first. Based on the image positioning, the degraded image is then resampled to each imaging pixel's position with the GSD of the proposed sensor. However, the along-track and across-track directions of the sensor imaging data (also the along-track and across-track directions of the PSF) are different from the line and sample directions of the over-sampled input image. This difference will result in some negative effects (called direction errors here) on the simulated data. Therefore, using the existing spatial response simulation method, the degree of spatial blur of the simulated image will have some deviations from the proposed sensor. Although the direction error could be avoided by implementing the spatial degradation after the spatial resampling operation, according to the sampling theory, a serious extra aliasing effect caused by the undersampling will arise in that case [16].

Besides the spatial response simulation, the existing spectral response simulation also needs further development. Based on the assumption that a hyperspectral imaging spectrometer is linear shift invariant (LSI), the spectral response of the sensor is traditionally simulated by the convolution of the given SRF and the oversampled input spectra [17]. However, the SRF of the sensor is unknown in the sensor design state, only the assumed SRF can be used. In this case, the traditional sensor simulator cannot accurately forecast the imaging ability of the proposed sensor in the spectral dimension. Compared with the simulators of the multispectral imaging spectrometer and the panchromatic imager, the accuracy of the spectral response simulation is more important for the hyperspectral imaging spectrometer simulator [18]. Hence, the traditional spectral response simulation will limit the application potential of the sensor simulator.

In this work, a novel digital sensor simulator, which consists of a spatial module, a spectral module and a radiometric module, is presented for the pushbroom Offner hyperspectral imaging spectrometer. In order to balance the direction error and the extra aliasing effect, the oversampled input data will firstly be interpolation-resampled into the image positioning with a thickened GSD. Then the spatial degradation is implemented, and the degraded image will be merged into the normal GSD. On the other hand, the spectral response is simulated not by the SRF but by modeling the dispersive imaging process using the configuration parameters of the proposed Offner optical system. Besides of more coincident with the imaging process, an accompanying benefit from the proposed simulation method is that the sensor simulator can be used to validate the spectral calibration method of the proposed sensor due to the fact that the SRF of the sensor simulator is an unknown parameter and need to be calibrated. Moreover, the non-uniformity characteristics, keystone and smile effects [19], are simulated in the spatial response module and the spectral response module, respectively. The sensor would not have to be assumed as a LSI system, as the PSF used in the spatial and spectral response modules is a function of the wavelength and the location in the field of view (FOV). The rest of the paper is organized as follows: Section 2 gives a detailed description of the novel sensor simulator. Section 3 presents the simulator validation and some discussion. Section 4 provides some conclusions, and gives a perspective of the future research.

2. Methods

2.1. The Imaging Process of a Pushbroom Offner Hyperspectral Imaging Spectrometer

A pushbroom Offner hyperspectral imaging spectrometer is generally made up of a telescope, a slit, an Offner optical system and a detector [20]. The imaging spectrometer images a swath of a ground object, and outputs a set of dispersive images in an integration time. With the motion of the platform, a hyperspectral data cube is produced [21]. Figure 1 shows the imaging process. The telescope images a ground object swath on its focal plane, which coincides with the slit, and then the Offner system disperses the panchromatic slit image along wavelength and focuses the monochromatic images on the focal plane where the detector resides, the irradiance received by the detector is finally responded to output the DN value. Unlike the whiskbroom imaging spectrometer, the pushbroom imaging spectrometer suffers some non-uniformity effects, which are so-called the smile and keystone optical aberrations [19,22,23]. In view of the non-uniformity effects, the imaging process is accurately modeled for building the sensor simulator in this paper.

The sensor simulator is composed of a spatial response module, a spectral response module and a radiometric response module. The spatial response module simulates the imaging process of the telescope, and outputs the “panchromatic slit image”. In this module, the oversampled input data is interpolation-resampled into the correspondingly thickened detector grids and degraded by the PSFs of platform motion, jitter, telescope, slit size and detector element size. The dispersive process and the degradation of the Offner system are simulated by the spectral response module, which generates the irradiance distribution of the “monochromatic silt image” on the detector. The radiometric response module simulates the detector response and outputs the simulated DN value image.

2.2. Spatial Response Module

The spatial response of the hyperspectral imaging spectrometer is the imaging and degradation processes in the spatial domain. Based on the image positioning, the imaging process means resampling the oversampled input image into the corresponding detector elements. An interpolation-resampling method is developed to make a compromise between the direction error and the extra aliasing effect. The PSF, which is the function of the wavelength and the location in FOV, has the same along-track and across-track directions as the resampled image, and it is used to simulate the spatial degradation process.

2.2.1. Spatial Interpolation-Resampling Method

The oversampled input scene is generally georeferenced, and it is resampled into imaging data on basis of the position relationship between the input data and the imaging data, shown in Figure 2. The resampling is based on the corner coordinates of each imaging pixel, which is modeled in our previous work [24].

Figure 2 indicates that the along-track and across-track directions of sensor PSF are the same as the imaging data but different from the oversampled input data, so the convolution of the input data and the system PSF will bring some direction error.

In order to avoid the direction error and limit the extra aliasing effect in simulated data, each imaging pixel is interpolated into n × n sub-pixels in the sensor simulator. This method is called spatial interpolation-resampling here, and the parameter n is used to balance the calculation quantity and the degree of the extra aliasing effect. Figure 3 shows the sketch of the interpolation-resampling process.

The lower left corner point of the imaging pixel, the point A in Figure 3, is considered as the standard point. The latitude and longitude scalars in along-track direction are noted as A D Lat ¯ and A D Lon ¯, and the latitude and longitude scalars in across-track direction are noted as A B Lat ¯ and A B Lon ¯. The four scalars are expressed by:

{ A D Lat ¯ = 1 n ( U L Lat L L Lat ) A D Lon ¯ = 1 n ( U L Lon L L Lon ) A B Lat ¯ = 1 n ( L R Lat L L Lat ) A B Lon ¯ = 1 n ( L R Lon L L Lon )
where ULLat is the latitude of the upper left point of the imaging pixel, LLLat is the latitude of the lower left point of the imaging pixel, LRLat is the latitude of the lower right point of the imaging pixel, ULLon is the longitude of the upper left point of the imaging pixel, LLLon is the longitude of the lower left point of the imaging pixel, and LRLon is the longitude of the lower right point of the imaging pixel.

Then the corner latitude and longitude coordinates of the sub-pixel (i, j) (i, j = 1, 2, …, n) are expressed by:

{ L L Lat ( i , j ) = L L Lat + ( j 1 ) × A D Lat ¯ + ( i 1 ) × A B Lat ¯ L L Lon ( i , j ) = L L Lon + ( j 1 ) × A D Lon ¯ + ( i 1 ) × A B Lon ¯ L R Lat ( i , j ) = L L Lat + ( j 1 ) × A D Lat ¯ + i × A B Lat ¯ L R Lon ( i , j ) = L L Lon + ( j 1 ) A D Lon ¯ + i × A B Lon ¯ U R Lat ( i , j ) = L L Lat + j × A D Lat ¯ + i × A B Lat ¯ U L Lon ( i , j ) = L L Lon + j × A D Lon ¯ + i × A B Lon ¯ U L Lat ( i , j ) = L L Lat + j × A D Lat ¯ + ( i 1 ) × A B Lat ¯ L L Lon ( i , j ) = L L Lon + j × A D Lon ¯ + ( i 1 ) × A B Lon ¯

The radiance value of the sub-pixel is the weighted average of the input radiance locating in the sub-pixel. It is expressed by [24]:

L 1 = L 0 k S k S k
where L1 is the radiance of the sub-pixel, L0k is the radiance value of the input data pixel which is totally or partially locates in the sub-pixel, Sk is the overlapping area between the input pixel and the sub-pixel, and ∑Si is the area of the sub-pixel.

Keystone effect refers to the inter-band spatial misregistration in imaging spectrometers. As a function of the wavelength and the location in FOV, the keystone effect of the imaging spectrometer can be described as a location offset and a scale variation of the imaging pixels in the spectral dimension [25]. In the sensor simulator, the keystone offset effect is simulated by adding an offset on the corner coordinates of the sub-pixel. The simulation of the keystone scale effect is implemented by the variation of the PSF for every imaging pixel.

2.2.2. Spatial Degradation

After the interpolation-resampling process, the across-track and along-track directions of the sensor PSF are the same as the resampled image, and the spatial degradation can be implemented without suffering from the direction error. For the pushbroom Offner hyperspectral imaging spectrometer, the spatial degradation in along-track direction is due to the diffraction and aberrations of the telescope, the motion and jitter of the platform, and the slit size. In across-track direction, the image is degraded by the diffraction and aberrations of the telescope and the dispersive system, the jitter of the platform, the detector element size, and the electrons transferring and diffusing of the detector. Additionally, the degradation caused by the optical system alignment and stray light presents in both across-track direction and along-track direction. The radiance of the sub-pixels in the sensor simulator is not the interpolation of the input image but the weighted average, and the sub-pixels will be merged after the spectral response module. Thus, the degradation effects of the slit size and the detector element size are contained in the resampling and mergence processes, and they are not implemented in the spatial degradation repeatedly. Moreover, the Offner system disperses the slit image and focuses the monochromatic images onto the focal plane. As a result, the Offner system degrades the imaging data in the across-track direction of the spatial dimension and the spectral dimension synchronously, which is the plane expanded by the across-track axis and the spectral axis in Figure 1. Therefore, the degradation of the Offner system will not be implemented here but in the spectral response module. PSF is the matrix multiplication of the LSFs, and the LSFs used in the sensor simulator are presented following.

MTF is widely used to evaluate the spatial performance of an imaging system [26], and the MTF values of the telescope and the dispersive system can be obtained by the commercial optical design packages, such as Zemax and Code V. Thus, with the assumption that the LSF of the optical system is Gaussian distributed, the LSF can be deduced from the MTF at the Nyquist frequency (MTFNyq). In this work, the LSF of an optical system is expressed by:

LSF ( x ) = exp ( x 2 2 σ 2 )
where σ = 2 π In ( 1 M T F Nyq ) is the standard deviation.

Motion blur occurs in the aero and orbital images, and the LSF, which is caused by the linear motion of the platform, is expressed by a rectangular function [27]:

LSF ( x ) = rec ( x v × t )
where v is the platform velocity, and t is the integration time of the imaging spectrometer. The jitter LSF comes from the high frequency line of sight vibrations, compared to the integration time. For the random and isotropic vibrations with a standard deviation of σjitter (pixel), the jitter LSF is expressed by [27]:
LSF ( x ) = 1 2 π σ jitter exp ( x 2 2 σ jitter 2 )

Generally, the degradation of the electrons transferring and diffusing of the detector is extremely slight, so it is ignored in the sensor simulator. The LSFs in the same direction are combined by the convolution. Then the PSF of the system is obtained by the matrix multiplication of the along-track LSF and the across-track LSF. The MTF of the optical system used in the sensor simulator is a function of the wavelength and the location in FOV, thus, the PSF is not constant as well. Unlike the traditional sensor simulator, the sensor would not have to be assumed as a LSI system in the work.

2.3. Spectral Response Module

The Offner optical system is the core part of the imaging spectrometer. The standard concentric Offner system is made up of a big concave mirror and a small convex mirror. Chrisp made a significant improvement on it, and he replaced the big concave mirror with two smaller concave mirrors, which receives the slit image and the dispersive images respectively [28]. The improved configuration has a compact size and flat meridional and sagittal focal planes. Based on the Rowland circle equipment, Prieto-Blanco further studied the meridional and sagittal focusing curves and provided a method to design an Offner imaging spectrometer [29].

Figure 4 shows an Offner imaging spectrometer with Rowland circle condition. The centers of the object plane, the image plane and the concentric system lie in a line. The central ray of the cone of light, called as the main light here, is used to analyze the light path. Then Rowland circle condition satisfies the following equations [29,30]:

{ R g sin θ 2 ( λ 1 ) = R 3 sin θ 3 ( λ 1 ) R g sin θ 2 ( λ 2 ) = R 3 sin θ 3 ( λ 2 )
where Rg is the radius of the convex grating, θ2 ′ is the diffraction angle of the grating, R3 is the radius of the Mirror 3 in Figure 4, θ3 is the exit angle of the Mirror 3, and λ1 and λ2 represent the wavelength.

In Figure 4, the diffraction lights of wavelength λ1 and λ2 project at the points A and B of Mirror 3 respectively. Points A and B are both close to the tangent point of Mirror 3 and its Rowland circle. Because of R 3 A B ^, it is reasonable to consider that R31) ≈ R32) ≈ R3, where R31) and R32) are the distance of OA and OB in Figure 4 respectively. The emergent lights from points A and B project on the focal plane. The distance of the projections h is expressed by:

h = R 3 ( λ 2 ) sin θ 3 ( λ 2 ) R 3 ( λ 1 ) sin θ 3 ( λ 1 ) R 3 ( sin θ 3 ( λ 2 ) sin θ 3 ( λ 1 ) )
where θ31) and θ32) are the exit angles of the lights with wavelength λ1 and λ2 in Figure 4, respectively.

Substituting Equation (7) into Equation (8), the distance of the monochromatic slit images with different wavelength h is obtained:

h = R g ( sin θ 2 ' ( λ 2 ) sin θ 2 ' ( λ 1 ) )

The grooves spacing of a Rowland ruled convex grating is not constant around the grating surface, but it is constant along the chord. Moreover, the facet angle of the grating remains constant with respect to that chord. As a result, the incidence angles of a convex grating for the whole FOV are approximately constant. The exit angle for the diffraction light with wavelength λ can be obtained by the grating equation, which is expressed as:

d ( sin θ exit sin θ in ) = m λ
where d is the grating period, θexit represents the exit angle, θin represents the incidence angle, m is grating operating order, and λ represents the proposed wavelength.

With the configuration parameters of the Offner imaging spectrometer presented, Equations (9) and (10) indicate the projections on the detector for every wavelength. Although the spectral resolution of the input data is very high, every band has a bandwidth. The SRF of the input data is supposed to be rectangular, as a result, the wavelength range for every band is [λi − 0.5 × bwi, λi + 0.5 × bwi], where λi is the central wavelength of band i, and bwi is the band width of band i. Considering Equation (10), the diffraction angles of the boundaries of band i are:

{ sin θ d i + = m ( λ i + 0.5 × w b i ) d + sin θ in sin θ d i = m ( λ i 0.5 × w b i ) d + sin θ in

Relative to the reference wavelength, the projections of the boundaries at the detector are:

{ s i + = ( sin θ dc sin θ d i + ) × R g s i = ( sin θ dc sin θ d i ) × R g
where θdc is the diffraction angle of the reference wavelength. Then the monochromatic slit image of band i covers the range of [si, si+] on the detector. The smile property is a center wavelength shift in across-track direction [31]. It is simulated by adding a location shift on the si and si+. The shift is the function of the wavelength and the location in FOV.

After the calculation of the boundary locations for each band of the spectrally oversampled input data, the irradiance received by each detector element is obtained. As in the aforementioned analysis, the Offner system degrades the imaging data in across-track direction and the spectral dimension synchronously. For the degradation operation, the spacing in spectral dimension needs to be the same as the spatial dimension. Thus a detector element is divided into n × n sub-elements monospaced. Like the spatial degradation, the MTF of the Offner system is used to calculate the PSF for every sub-element, and the degradation is implemented by convolving the PSF with the irradiance image received by the detector. After the degradation, the irradiance image is assembled (merging n × n sub-elements into a pixel).

2.4. Radiometric Response Module

The detector received irradiance is responded to stimulated electrons, then the electrons are transferred, amplified and A/D transformed into the output DN value. The transfer process, which is shown in Figure 5, is simulated in the radiometric response module.

The first step is the calculation of the number of stimulated electrons (signal electrons) freeing from a detector element by equation [32]:

n 0 = π 4 ( D f ) 2 A d t λ 1 λ 2 τ ( λ i ) η d ( λ i ) L ( λ i ) η e ( λ i ) h υ i η ( λ i ) b w i
where D is the pupil aperture, f is the focus, Ad is the area of the detector element, t is the integration time, τ is the transfer efficiency of the telescope, ηd is diffraction efficiency of the Offner system, L is the input at-sensor radiance, ηe is the quantum efficiency of the detector element, h is the Planck's constant, νi is the frequency of the wavelength λi, η is the ratio of the wavelength range of band i which lies on the element to the band width, and λ1 and λ2 are the wavelength boundaries which will locate in the element.

The DN values fluctuate due to the influence of noise. The considered noises are the photon noise, the dark noise, and the readout noise. The noise sources are the fluctuation of the signal electrons (photon noise), the dark current electrons (dark noise), and the readout circuit (readout noise, which comprises the KTC noise, amplifier white noise, 1/f noise, and so on), respectively. The photon noise and the dark noise follow the Poisson distribution, which can be described as the Gaussian distribution for a large number of samples. Here, the ggreadout noise is also assumed to be Gaussian distributed for simplifying the calculation. Thus the standard deviation of the total noise is expressed as:

σ noise = n 0 + n d × t + n readout × n readout
where nd is the dark electrons that a detector element generates in one second and nreadout is the readout noise. The total electrons are the summation of the signal electrons, dark current electrons, and the noise. Considering the process of the amplifying and the ADC, the DN value is expressed as:
D N 0 = ( 2 b 1 ) n total R c V ref
where b is the radiometric resolution, ntotal is the total electrons, Rc is the conversion gain, and Vref is the reference voltage. The non-uniform effect (including the striping artifacts and dead pixels in some literatures) is simulated by a gain parameter on the DN0, and the nonlinearity effects can be simulated by a look-up-table (LUT) [13].

3. Validation and Discussion

In this section, the spatial, spectral, and radiometric calibration processes of an imaging spectrometer in the laboratory are simulated, and the calibration results (MTF, SRF, and radiometric calibration parameters) are used to design experiments to validate the spatial, spectral and radiometric responses of the sensor simulator.

3.1. Spatial Response Validation

The spatial characteristics of an imaging system can be expressed by the MTF parameter, which is widely used in the spatial response evaluation of IKONOS, Quickbird, Hyperion, and so on [5,33]. In this work, the edge method [33] is implemented to calculate the MTF of the sensor simulator. A synthetic edge scene is “imaged” by the traditional sensor simulator and the proposed sensor simulator in the validation experiment. The MTFs from the two simulated data are compared with the theoretical MTF to validate the spatial response of the proposed sensor simulator in the paper.

The first step is to construct an edge scene. In this work, an oversampled synthetic edge scene with the edge azimuth of 45° is built, and the platform also moves along the azimuth of 45°. Figure 6 shows the edge scene and the imaging stripe. The horizontal edge and the vertical edge of the imaged scene (the right in Figure 6) are used to calculate the along-track MTF and across-track MTF, respectively. In order to simplify the comparison, the MTF values (at the Nyquist frequency) of the telescope and the Offner system in along-track direction and in across-track direction are all assumed to be constantly 0.8. It is also supposed that the alignment and stray light MTF is a constant 0.8, the platform moves a pixel during an integration time, and the standard deviation of the jitter is 0.1 pixels. The MTFs of the jitter and the motion are the Fourier transform of the LSFs. Moreover, the slit size, the detector element size, and the motion have the same MTF. Theoretically, the MTFs of the sensor in along-track and across-track directions at the Nyquist frequency are:

{ M T F AL = M T F telescopeAL × M T F motion × M T F jitter × M T F slit × M T F alignment = 0.2469 M T F AC = M T F telescopeAC × M T F OffnerAC × M T F jitter × M T F detector × M T F alignment = 0.3103
where MTFtelescope, MTFOffner, MTFmotion, MTFjitter, MTFslit, MTFdetector, MTFalignment are the MTF caused by the telescope, Offner system, platform motion, platform jitter, slit size, detector element size, alignment and stray light, respectively; and the subscripts AL and AC represent the along-track direction and the across-track direction, respectively. Generally, the MTF in along-track direction is smaller than in across-track direction because of the platform motion [14].

The synthetic scene is “imaged” by the traditional sensor simulator and the proposed sensor simulator along the green stripe, respectively. The along-track and across-track MTFs calculated from the imaged edge scenes are shown in Figure 7. Compared with the MTF results derived from the traditional sensor simulator imaged data, the MTF results of the proposed sensor simulator is much closer to the theoretical results. The fluctuations of the calculated MTF curves are due to the noise in the simulated data, which affects the stability of the edge method. The mean errors of the MTF for the traditional sensor simulator are 9.36% and 13.31% in along-track direction and across-track direction, respectively. As previously mentioned, the serious MTF error comes from the direction error. For the proposed sensor simulator, the mean errors are 0.96% and 3.37% in the along-track direction and in the across-track direction, respectively. Obviously, the proposed sensor simulator avoids the direction error effectively and advances the simulation accuracy of the imaging blurring greatly. It should be noticed that the sampling interval ratio between the input data and the simulated data results in some effects on the accuracy of the simulations [34], and the ratio used in this work is 7.0.

While Figure 7 also shows that the MTF error in across-track direction is slightly larger than that in along-track direction for the proposed sensor simulator. This phenomenon is caused by the spatial-spectral degradation in the spectral response module, as the spectral image of an imaging line is not a standard edge image but a stripe image. A spectral image is shown in Figure 8. Therefore, the data from different wavelength (different line in the right figure of the Figure 8) interplays when the spatial-spectral degradation process is implemented. The interplay brings an extra blurring effect which results in a slight MTF falling.

3.2. Spectral Response Validation

Generally, the SRF, which is produced by the spectral calibration, is used to evaluate the spectral response for the multispectral and hyperspectral imaging spectrometers [35,36]. Unlike the general sensor simulator, the output DN value in this work does not have a known SRF, so the SRF of the sensor simulator need to be calibrated. The spectral calibration methods include the monochromator method and the absorption feature method (emission lamp or atmosphere absorption feature) [37]. The monochromator method is used in the laboratory spectral calibration with all the bands’ SRF produced, while the absorption feature method is commonly used in the in-flight calibration applying partial bands’ SRF. Therefore, the monochromator method is employed to calibrate the sensor simulator in this work.

Figure 9 shows the configuration sketch of the monochromator method [38]. The polychromatic light illuminates the slit of the monochromator, and the output monochromatic light is expanded to fulfill the FOV of the imaging spectrometer. The center wavelength and the full width half maximum (FWHM) of the monochromatic light are changed by varying the grating angle and the slit size of the monochromator. Simulating this process, a uniform monochromatic light image is produced firstly. Then the monochromatic image is “imaged” by the sensor simulator, and outputs the DN value. The same operation is repeated with the wavelength of the monochromatic image stepwise upping. For the grating hyperspectral imaging spectrometer, Gaussian function is widely used to describe the SRF shape [5,35]. Hence, these simulated DN value images are finally fitted by the Gaussian function. Here, the Gaussian function is defined as following equation:

g ( λ ) = k 0 exp ( ( λ λ 0 ) 2 2 σ g 2 ) + b 0
where k0 is a gain parameter, b0 is a bias parameter, λ0 is the center wavelength of the fitted spectral band, σg is the standard deviation, and the band width of the fitted spectral band is F WHM = 2 σ 2 ln 2. The smile parameter is presented by implementing the same fitted operation to the whole FOV.

A VNIR hyperspectral imaging spectrometer [39], whose spectral resolution is about 5 nm, is simulated to validate the spectral response of the sensor simulator. Some calibration results of the sensor simulator are shown in Figure 10. It can be seen that Gaussian function accords with the SRF of the sensor simulator greatly. Several SRFs (locating at the center of FOV) of the imaging spectrometer are calibrated, and the comparison of the simulated results and true results is detailed in Table 1. It can be seen that the SRF of the sensor simulator is very close to the true result in bands 11 and 31, and the errors of the center wavelength and the FWHM are 2.57% and 0.86%, respectively. However, the errors in band 41 are 43.06% and 2.07%. The spectral resolution of a grating imaging spectrometer is constant in theory. Therefore, the deviation is most probably caused by the manufacture error of the imaging spectrometer which leads to some difference between the input parameters and the true configuration parameters.

Moreover, the sensor simulator can also be used to validate the spectral calibration method by applying tradeoff studies to characterize the impact of the monochromator parameter choices, such as the stability and the FWHM.

3.3. Radiometric Response Validation

The radiometric response of the sensor simulator is evaluated by the radiometric calibration. The laboratory radiometric calibration (standard-lamp-based method) is simulated to calibrate the sensor simulator. The calibration configuration is shown in Figure 11 [40,41]. First, the spectrometer, which is made up of a monochromator and a photomultiplier tube, is calibrated by a standard lamp and a spectralon panel. Then tuning the rotation platform, the integrating sphere is calibrated by the spectrometer. Finally the calibrated integrating sphere is used to calibrate the proposed imaging spectrometer. Every measurement process will have an uncertainty, so the above stated measurements also have uncertainties. When the analysis of the calibration uncertainty effects on the quality of the restored radiance data is demanded, these uncertainty caused by the measurement process should be considered.

3.3.1. Radiometric Calibration Uncertainty

Using the calibrated integrating sphere as the light source, the at-sensor radiance of the imaging spectrometer is expressed as:

L = V ' × ρ × E V × π
where V ′ is the response of the spectrometer when the integrating sphere is the light source, ρ is the reflectance of the spectralon panel, and E and V are the irradiance spectralon panel received and the response of the spectrometer when the standard lamp is the light source.

Each measurement of the parameters in Equation (18) has an uncertainty. Generally, the total uncertainty of the measured parameters, which equals to the root sum square of the partial uncertainty, is considered as the radiometric calibration uncertainty [42]. What is more, each measured parameters has its uncertainty distribution, which follows the Gaussian function on basis of the central limit theory. Therefore, the uncertainty distribution of the L is the synthesis of the partial uncertainty distribution, which is expressed as [41]:

f ( L ) = 1 2 π σ c e ( L L 0 ) 2 2 σ c 2
where L0 is the truth value of the L and σc is the synthesized uncertainty. The radiometric calibration uncertainty is simulated by adding the synthesized uncertainty on the radiance of the integrating sphere.

3.3.2. Radiometric Calibration of the Sensor Simulator

The detector generally works in the linear response region, thus there is a linear relationship between the simulated DN value and the at-sensor radiance [43]:

L = A × D N + B
where A and B are the gain and bias matrix of the calibration parameters, respectively. Considering the calibration uncertainty of 5%, a random error, which is distributed as Equation (19), is incorporated into the at-sensor radiance during the calibration process. Imaging two uniform scenes from the calibrated integrating sphere 15 times and averaging them, respectively, the calibration matrix parameters are obtained with the dark current subtracted. If the detector suffers from the response nonlinearity, the nonlinearity should be calibrated and corrected before the radiometric calibration [13].

For avoiding the spatial degradation effect in the simulating process, a uniform radiance scene, composed of the MODTRAN-simulated radiance spectrum [44], is built as the test data in the radiometric response validation experiment. The MODTRAN parameters are Mid-Latitude Summer, Rural aerosol model with 23 km visibility, elevation angle 30°, and ground albedo 0.5 constant. The uniform scene is “imaged” by the sensor simulator and calibrated to output the restored radiance data. In order to validate the radiometric response of the sensor simulator, the calibrated spectrum is compared with the standard spectrum, which is obtained by the spectral resampling of the uniform scene. The SRF, used for the spectral resampling, is the spectral calibration result of the sensor simulator. The comparison of the calibrated radiance spectrum and the spectrally resampled spectrum is shown in Figure 12. It can be seen that the two spectra are almost overlapped, and the slight deviation is caused by the sensor noise and the calibration uncertainty. The comparison indicates that the radiometric response simulation of the sensor simulator and the calibration simulation process are both valid.

4. Conclusions

In this paper, a novel sensor simulator for the pushbroom Offner hyperspectral imaging spectrometer has been presented. The simulator is comprised of a modular structure and includes the entire image data acquisition chain of the sensor. The simulator with the input of the spatially and spectrally oversampled scene data outputs the simulated DN value data with the proposed imaging spectrometer characteristics. The non-uniformity effects of the sensor, such as keystone and smile, can be simulated in the corresponding modules. The calibration processes were implemented to validate the sensor simulator through the respect of spatial response, spectral response and radiometric response, respectively. The validation experiments proved that the modules have highly accurate performance. Thus, the developed sensor simulator enables a detailed analysis of the effects of different instrumental configuration parameters on the imaging process, and will contribute to a great convenience to the instrument design.

Although the parameters and the processing steps are optimized for the pushbroom Offner hyperspectral imaging spectrometer, the sensor simulator is implemented in a modular and flexible way so that different optical sensors can be simulated by adjusting the spectral response module. Future work will focus on the preprocessing method development based on the simulated data. The uncertainty factors can be considered in the spectral and radiometric calibrations, thus the effect of these factors on the data application also need be further analyzed.

Acknowledgments

This work was supported in part by the National Natural Science Foundation of China (No. 41201324), the 863 High Technology Program of China (No. 2008AA121102 and No. 2009AA12Z119), the Changjiang Scholars and Innovative Research Team in University (No. IRT1203), and the China Geological Survey (No. 1212011087113).

Author Contributions

All authors have made significant contributions to the paper. Dongxing Tao, Huijie Zhao and Guorui Jia were responsible for the research design. Dongxing Tao performed the research and wrote the manuscript. Yan Yuan was involved in technical support for the experiment analysis.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Schläpfer, D.; Kaiser, J.W.; Brazile, J.; Schaepman, M.; Itten, K.I. Calibration concept for potential optical aberrations of the APEX pushbroom imaging spectrometer. Proc. SPIE 2004, 5234, 221–231. [Google Scholar]
  2. Markham, B.L.; Dabney, P.W.; Reuter, D.; Thome, K.J.; Irons, J.R.; Barsi, J.A.; Montanaro, M. Landsat data continuity mission operational land imager and Thermal InfraRed Sensor performance. Proc. SPIE 2011, 8153. [Google Scholar] [CrossRef]
  3. Zadnik, J.; Guerin, D.; Moss, R.; Orbeta, A.; Dixon, R.; Simi, C.; Dunbar, S.; Hill, A. Calibration procedures and measurements for the COMPASS hyperspectral imager. Proc. SPIE 2004, 5425, 182–188. [Google Scholar]
  4. Silverglate, P.R.; Fort, D.E. System design of the CRISM (compact reconnaissance imaging spectrometer for Mars) hyperspectral imager. Proc. SPIE 2003, 5159, 283–290. [Google Scholar]
  5. Pearlman, J.S.; Barry, P.S.; Segal, C.C.; Shepanski, J.; Beiso, D.; Carman, S.L. Hyperion, a space-based imaging spectrometer. IEEE Trans. Geosci. Remote Sens. 2003, 41, 1160–1173. [Google Scholar]
  6. Davis, C.O.; Kappus, M.; Bowles, J.; Fisher, J.; Antoniades, J.; Carney, M. Calibration, characterization and first results with the ocean PHILLS hyperspectral imager. Proc. SPIE 1999, 3753, 160–168. [Google Scholar]
  7. Kaiser, S.; Sang, B.; Schubert, J.; Hofer, S.; Stuffler, T. Compact prism spectrometer of pushbroom type for hyperspectral imaging. Proc. SPIE 2008, 7100. [Google Scholar] [CrossRef]
  8. Mouroulis, P.; Sellar, R.G.; Wilson, D.W.; Shea, J.J.; Green, R.O. Optical design of a compact imaging spectrometer for planetary mineralogy. Opt. Eng. 2007, 46. [Google Scholar] [CrossRef]
  9. Coppo, P.; Chiarantini, L.; Alparone, L. Design and validation of an end-to-end simulator for imaging spectrometers. Opt. Eng. 2012, 51. [Google Scholar] [CrossRef]
  10. Kerekes, J.P.; Cisz, A.P.; Simmons, R.E. A comparative evaluation of spectral quality metrics for hyperspectral imagery. Proc. SPIE 2005, 5806, 469–480. [Google Scholar]
  11. Segl, K.; Richter, R.; Küster, T.; Kaufmann, H. End-to-end sensor simulation for spectral band selection and optimization with application to the Sentinel-2 mission. Appl. Opt. 2012, 51, 439–449. [Google Scholar]
  12. Parente, M.; Clark, J.T.; Brown, A.J.; Bishop, J.L. End-to-end simulation and analytical model of remote-sensing systems: Application to CRISM. IEEE Trans. Geosci. Remote Sens. 2010, 48, 3877–3888. [Google Scholar]
  13. Segl, K.; Guanter, L.; Rogass, C.; Kuester, T.; Roessner, S.; Kaufmann, H.; Sang, B.; Mogulsky, V.; Hofer, S. EeteS—The EnMAP end-to-end simulation tool. IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens. 2012, 5, 522–530. [Google Scholar]
  14. Segl, K.; Guanter, L.; Kaufmann, H.; Schubert, J.; Kaiser, S.; Sang, B.; Hofer, S. Simulation of spatial sensor characteristics in the context of the EnMAP hyperspectral mission. IEEE Trans. Geosci. Remote Sens. 2010, 48, 3046–3054. [Google Scholar]
  15. Zanoni, V.; Davis, B.; Ryan, R.; Gasser, G.; Blonski, S. Remote sensing requirements development: A simulation-based approach. Proceedings of the 2002 ISPRS Commission I Mid-Term Symposium 2002: Integrated Remote Sensing at the Global, Regional and Local Scale, Denver, CO, USA, 10–15 November 2002; 10, pp. 419–423.
  16. Jacobs, E.L.; Edwards, T.C. Sampling criteria for sensor simulation. Opt. Eng. 1999, 38, 827–835. [Google Scholar]
  17. Börner, A.; Wiest, L.; Keller, P.; Reulke, R.; Richter, R.; Schaepman, M.; Schläpfer, D. SENSOR: A tool for the simulation of hyperspectral remote sensing systems. ISPRS J. Photogramm. Remote Sens. 2001, 55, 299–312. [Google Scholar]
  18. Goetz, A.F.H.; Vane, G.; Solomon, J.E.; Rock, B.N. Imaging spectrometry for earth remote sensing. Science 1985, 228, 1147–1153. [Google Scholar]
  19. Mouroulis, P.; Green, R.O.; Chrien, T.G. Design of pushbroom imaging spectrometers for optimum recovery of spectroscopic and spatial information. Appl. Opt. 2000, 39, 2210–2220. [Google Scholar]
  20. Murchie, S.; Arvidson, R.; Bedini, P.; Beisser, K.; Bibring, J.P.; Bishop, J.; Boldt, J.; Cavender, P.; Choo, T.; Clancy, R.T.; et al. Compact Reconnaissance Imaging Spectrometer for Mars (CRISM) on Mars Reconnaissance Orbiter (MRO). J. Geophys. Res. 2007, 112, E05S03. [Google Scholar]
  21. Schott, J.R. Imaging sensors and instrument calibration. In Remote Sensing: The Image Chain Approach, 2nd ed.; Oxford University Press: New York, NY, USA, 2007; pp. 207–211. [Google Scholar]
  22. Skauli, T. An upper-bound metric for characterizing spectral and spatial coregistration errors in spectral imaging. Opt. Express 2012, 20, 918–933. [Google Scholar]
  23. Schläpfer, D.; Nieke, J.; Itten, K.I. Spatial PSF nonuniformity effects in airborne pushbroom imaging spectrometry data. IEEE Trans. Geosci. Remote Sens. 2007, 45, 458–468. [Google Scholar]
  24. Jia, G.R.; Zhao, H.J.; Shang, H.; Lou, C.; Jiang, C. Pixel-size-varying method for simulation of remote sensing images. J. Appl. Remote Sens. 2014, 8. [Google Scholar] [CrossRef]
  25. Neville, R.A.; Sun, L.X.; Staenz, K. Detection of keystone in imaging spectrometer data. Proc. SPIE 2004, 5425, 208–217. [Google Scholar]
  26. Park, S.K.; Schowengerdt, R.; Kaczynski, M.A. Modulation-transfer-function analysis for sampled image systems. Appl. Opt. 1984, 23, 2572–2582. [Google Scholar]
  27. Jang, H.S.; Kim, Y.S. MTF analysis on the MSC design. Proceedings of the 2002 IEEE International Geoscience and Remote Sensing Symposium (IGARSS’02), Toronto, ON, Canada, 24–28 June 2002; 6, pp. 3167–3169.
  28. Offner, A. Unit Power Imaging Catoptric Anastigmat. U.S. Patent No. 3,748,015, 21 June 1973. [Google Scholar]
  29. Prieto-Blanco, X.; Montero-Orille, C.; Couce, B.; de la Fuente, R. Analytical design of an Offner imaging spectrometer. Opt. Express 2006, 14, 9156–9168. [Google Scholar]
  30. Hutley, M.C. Concave gratings. In Diffraction Gratings; Academic Press: London, UK, 1982; pp. 215–232. [Google Scholar]
  31. Neville, R.A.; Sun, L.X.; Staenz, K. Detection of spectral line curvature in imaging spectrometer data. Proc. SPIE 2003, 5093, 144–154. [Google Scholar]
  32. Bartell, R.J.; Schwartz, C.R.; Eismann, M.T.; Cederquist, J.N.; Nunez, J.A.; Sanders, L.C.; Ratcliff, A.H.; Lyons, B.W; Ingle, S.D. A comprehensive hyperspectral system simulation II: Hyperspectral sensor simulation and preliminary VNIR testing results. Proc. SPIE 2000, 4049, 105–119. [Google Scholar]
  33. Ryan, R.; Baldridge, B.; Schowengerdt, R.A.; Choi, T.; Helder, D.L.; Blonski, S. IKONOS spatial resolution and image interpretability characterization. Remote Sens. Environ. 2003, 88, 37–52. [Google Scholar]
  34. Tao, D.X.; Zhao, H.J.; Jia, G.R.; Yuan, Y. Analyzing the effect of synthetic scene resolution, sampling interval, and signal-to-noise ratio on hyperspectral imaging sensor simulations. Appl. Opt. 2014, 53, 6375–6381. [Google Scholar]
  35. Delwart, S.; Preusker, R.; Bourg, L.; Santer, R.; Ramon, D.; Fischer, J. MERIS in-flight spectral calibration. Int. J. Remote Sens. 2007, 28, 479–496. [Google Scholar]
  36. Mouroulis, P.; Gorp, B.V.; Green, R.O.; Dierssen, H.; Wilson, D.W.; Eastwood, M.; Boardman, J.; Gao, B.C.; Cohen, D.; Franklin, B.; et al. Portable Remote Imaging Spectrometer coastal ocean sensor: Design, characteristics, and first flight results. Appl. Opt. 2014, 53, 1363–1380. [Google Scholar]
  37. Robert, A.N.; Sun, L.X.; Karl, S. Spectral calibration of imaging spectrometers by atmospheric absorption feature matching. Can. J. Remote Sens. 2008, 34, S29–S42. [Google Scholar]
  38. Zheng, Y.Q. Precise spectral calibration for hyperspectral imager. Opt. Precis. Eng. 2010, 18, 2347–2354. (In Chinese). [Google Scholar]
  39. Wang, Y.M.; Liu, Y.N.; Wang, J.Y. A new spaceborne hyperspectral imaging spectrometer. Proceedings of the 2006 Workshop on Spectral Technology and Application, Yunnan, China, 15–19 June 2006; pp. 149–152. (In Chinese).
  40. Jia, G.R.; Zhao, H.J.; Lei, H. Uncertainty propagation algorithm from the radiometric calibration to the restored earth observation radiance. Opt. Express 2014, 22, 9442–9449. [Google Scholar]
  41. Lei, H. Research on the Key Technology of Laboratory Calibration of AOTF Imaging Spectrometer. Master's Thesis, Beihang University, Beijing, China, 2012. (In Chinese). [Google Scholar]
  42. Pagano, T.S.; Aumann, H.H.; Schindler, R.; Elliott, D.; Broberg, S.; Overoye, K.; Weiler, M.H. Absolute radiometric calibration accuracy of the Atmospheric Infrared Sounder (AIRS). Proc. SPIE 2008, 7081. [Google Scholar] [CrossRef]
  43. Dinguirard, M.; Slater, P.N. Calibration of space-multispectral imaging sensors: A review. Remote Sens. Environ. 1999, 68, 194–205. [Google Scholar]
  44. Anderson, G.P.; Berk, A.; Acharya, K.; Matthew, M.W.; Bemstein, L.S.; Chetwynd, J.H.; Dothe, H.; Adler-Golden, S.M.; Ratkowski, A.J.; Felde, G.W.; et al. MODTRAN4: Radiative transfer modeling for remote sensing. Proc. SPIE 1999, 3866, 2–10. [Google Scholar]
Figure 1. The imaging process of a pushbroom hyperspectral imaging spectrometer.
Figure 1. The imaging process of a pushbroom hyperspectral imaging spectrometer.
Sensors 14 23822f1 1024
Figure 2. The position relationship between the oversampled input scene and the imaging data. The input scene is the little green grids which are connected by their corner points, and the bigger blue grids are the imaging pixels.
Figure 2. The position relationship between the oversampled input scene and the imaging data. The input scene is the little green grids which are connected by their corner points, and the bigger blue grids are the imaging pixels.
Sensors 14 23822f2 1024
Figure 3. The sketch of the spatial interpolation-resampling method. In this figure, an imaging pixel is divided into 4 × 4 sub-pixels (red grid). In the interpolation-resampling process, the oversampled input data (green grid) is resampled into not the imaging pixels (blue grid) but the sub-pixels.
Figure 3. The sketch of the spatial interpolation-resampling method. In this figure, an imaging pixel is divided into 4 × 4 sub-pixels (red grid). In the interpolation-resampling process, the oversampled input data (green grid) is resampled into not the imaging pixels (blue grid) but the sub-pixels.
Sensors 14 23822f3 1024
Figure 4. An Offner imaging spectrometer with Rowland circle condition.
Figure 4. An Offner imaging spectrometer with Rowland circle condition.
Sensors 14 23822f4 1024
Figure 5. The sketch of detector and electronics system.
Figure 5. The sketch of detector and electronics system.
Sensors 14 23822f5 1024
Figure 6. The synthetic edge scene. The left is the synthetic edge scene, the region enclosed by green line is the imaging stripe, and the right is the imaged edge scene.
Figure 6. The synthetic edge scene. The left is the synthetic edge scene, the region enclosed by green line is the imaging stripe, and the right is the imaged edge scene.
Sensors 14 23822f6 1024
Figure 7. The MTF (Nyquist frequency) calculated from the simulated edge scenes for the traditional simulator and the proposed simulator. (a) MTF in along-track direction; (b) MTF in across-track direction.
Figure 7. The MTF (Nyquist frequency) calculated from the simulated edge scenes for the traditional simulator and the proposed simulator. (a) MTF in along-track direction; (b) MTF in across-track direction.
Sensors 14 23822f7 1024
Figure 8. The imaging data. The left is a data cube, and the right is the spectral image for a line, which is not a standard edge image.
Figure 8. The imaging data. The left is a data cube, and the right is the spectral image for a line, which is not a standard edge image.
Sensors 14 23822f8 1024
Figure 9. The sketch of the monochromator method for the spectral calibration.
Figure 9. The sketch of the monochromator method for the spectral calibration.
Sensors 14 23822f9 1024
Figure 10. The SRFs obtained with a simulated scanning monochromator. The curves with spots are the normalized simulated DN value, and the other curves are the fitted results.
Figure 10. The SRFs obtained with a simulated scanning monochromator. The curves with spots are the normalized simulated DN value, and the other curves are the fitted results.
Sensors 14 23822f10 1024
Figure 11. The configuration of the standard-lamp-based radiometric calibration in the laboratory.
Figure 11. The configuration of the standard-lamp-based radiometric calibration in the laboratory.
Sensors 14 23822f11 1024
Figure 12. The comparison of the calibrated radiance spectrum and the spectrally resampled spectrum.
Figure 12. The comparison of the calibrated radiance spectrum and the spectrally resampled spectrum.
Sensors 14 23822f12 1024
Table 1. The SRF comparison of the simulated calibration results of the sensor simulator and the results of the true sensor.
Table 1. The SRF comparison of the simulated calibration results of the sensor simulator and the results of the true sensor.
Band NumberThe True SRFsThe Simulated SRFs

Center WavelengthFWHMCenter WavelengthFWHM
11551.19 nm4.67 nm551.31 nm4.71 nm
31651.34 nm4.67 nm651.19 nm4.71 nm
41699.05 nm4.83 nm701.13 nm4.73 nm

Share and Cite

MDPI and ACS Style

Tao, D.; Jia, G.; Yuan, Y.; Zhao, H. A Digital Sensor Simulator of the Pushbroom Offner Hyperspectral Imaging Spectrometer. Sensors 2014, 14, 23822-23842. https://doi.org/10.3390/s141223822

AMA Style

Tao D, Jia G, Yuan Y, Zhao H. A Digital Sensor Simulator of the Pushbroom Offner Hyperspectral Imaging Spectrometer. Sensors. 2014; 14(12):23822-23842. https://doi.org/10.3390/s141223822

Chicago/Turabian Style

Tao, Dongxing, Guorui Jia, Yan Yuan, and Huijie Zhao. 2014. "A Digital Sensor Simulator of the Pushbroom Offner Hyperspectral Imaging Spectrometer" Sensors 14, no. 12: 23822-23842. https://doi.org/10.3390/s141223822

Article Metrics

Back to TopTop