1. Introduction
Laser polarimetric remote sensing is successfully used to study the optical characteristics of the atmosphere [
1,
2,
3,
4,
5,
6,
7]. The widespread polarization sensing method consists in measuring the cross-polarized components of irradiance scattered along the sensing path; however, within the limits of representation of the particle scattering using the Stokes parameters, this is only a part of the information on the scattering matrix elements. Complete information on the particle scattering matrix is obtained from measurements with a matrix polarization lidar (MPL) [
8,
9,
10,
11].
As it was shown at the presentation [
12] at the 28th International Conference, 4–8 July 2022, Tomsk, the calibration of the matrix polarization lidar parameters is an urgent problem for remote sensing of the atmosphere. According to the existing practice, the lidar parameters are estimated using the technique of correcting the optical element parameters [
8,
9,
10,
13,
14,
15,
16]; however, this correction method is pertinent only for laboratory studies. For mobile lidars operating in an autonomous mode in a wide range of external conditions, the calibration by measurements in the atmosphere becomes the main method.
The procedure of calibration by air has been partially implemented for the first time in the MPL to study Asian dust in the atmosphere [
11]. For calibration, a segment of the sensing path with a prevalence of molecular scattering was chosen. In a measurement series, four wave plates were alternately replaced in the optical lidar channel. As a result of calibration, the relative transmission coefficient of the two-channel receiver (below referred to as the relative transmission coefficient) and the angular positions of the transmission axes of the wave plates and polarization beam splitter (PBS) were estimated.
The calibration problem has been extensively reformulated and its solution has been significantly revised after MPL modernization. The lidar design was simplified using the procedure of an angular rotation of one wave plate of the laser radiation transmitter and another wave plate of the scattered radiation receiver. The calibration segment was chosen in air, and a series of measurements were carried out. The relative transmission coefficient in the optical channel of the MPL receiver was estimated by means of constructing and solving a linear system of equations. The angular positions of the transmission axes of the optical elements and retardance wave plates were estimated by solving the system of the nonlinear equations with the Gauss–Newton method.
The derivation of the calibration equation in terms of instrumental vectors is presented. A two-stage method for estimating the parameters from the obtained calibration equations with the generalized least squares method using available information is also described.
Using statistical methods, the stability of the method, rate of its convergence, deviations of estimates, and behavior for weak echo-signals were checked. For this purpose, a series of echo-signals for several signal levels were modeled. These data were then used to solve the inverse problem of a parameter reconstruction. The scalability of the method for a set of calibration parameters then allowed the method to be validated using the results of the MPL polarization sensing in Daejeon, Republic of Korea [
11].
In
Section 2 of the present work, the calibration problem is formulated and the principles of constructing the calibration equations for lidar echo signals are described. In
Section 3, methods for solving linear and nonlinear calibration problems are presented. In
Section 4, the procedure is described and the results of the verification and validation of the method are given. In the
Appendix A, the order of representation and the calculated partial derivatives of the instrumental vectors are presented.
2. Calibration Equations
Here, we mainly use the notations of [
11,
17]. In particular, electromagnetic waves are described in the (x, y, z) coordinate system in which the z axis is parallel to the radiation propagation direction. In addition, we follow the traditional agreement for the light beam passing through an ideal optical element: the direction of the rotation of vibrational ellipse axes is positive for the clockwise rotation in the direction of the radiation source. If we designate the vector basis of the optical element by
, we consider that the vector
defines the horizontal transmission axis relative to the y axis, and the direction of the vector
coincides with the z axis of the incident light beam.
Assume that the radiation source and the receiver of the scattered radiation of the MPL are located in one place. Then, for the scattering volume
of the particles located at the distance
from the receiver, the Stokes vectors of incident,
, and scattered radiation,
, are related by the formula [
8]:
where the elements of the backscatter matrix
, in
, are the volume backscattering coefficients and
is the transposition index. This is the first order approximation of the scattering theory.
The matrix
can be represented as the sum
of the scattering matrices of particles,
, and the molecular atmosphere,
. With an allowance for depolarization, the backscattering matrix in air,
, in which the element
is normalized by unity, has the form [
18]:
The form of the matrix
is well known; therefore, it is natural to calibrate the MPL parameters by measuring the radiation scattering characteristics in air. The simplified optical scheme of the MPL is shown in
Figure 1. Laser radiation is linearly polarized in the yoz scattering plane, and the irradiance
is normalized by unity. Then, the normalized Stokes vector of the laser radiation is
.
The receiver coordinate system is obtained via rotation through an angle of 180° in the scattering plane. At first, the beam is incident on the wave plate with the transmission axis at an angle of to the scattering plane, and is scattered in the atmosphere. In the receiver, the scattered radiation passes through the wave plate with the transmission axis at an angle of to the scattering plane. Then, the beam is split into two orthogonal components with the help of the polarization beam splitter (PBS) and is recorded as the signals and . The receiving collimator and the recording system are not shown in the figure.
Consider the MPL calibration based on the measurements of scattered light irradiance as a series of echo signals also designated as signals. Each th measurement in the series is made after rotations of the transmitter wave plate and the receiver wave plate . These are the rotations of the wave plates around the z axis in a series of angular states . The calibration is aimed at determining the systematic deviations of the MPL parameters: the relative transmission coefficient ; angular positions of the transmission axes; wave plate retardances , , , and ; the angle of the polarizer transmission axis.
Suppose that the signals
and
from the scattering layer
at the distance
are recorded in the photoelectron counting mode. Omitting for simplicity the serial number of the measurement, we consider the polarization sensing equations in the first approximation of multiple scattering theory as [
8,
11]:
Here,
is the coefficient due to the difference in the transmission of the channel optics and the photomultiplier sensitivity;
;
is the loss factor;
is the number of photons per laser pulse;
is the effective receiver aperture;
is the atmospheric transmission factor;
and
are the instrumental vectors of the receiver row;
is the instrumental vector of the transmitter column;
is the unit row vector;
are the PBS Mueller matrices [
16], where
are the Mueller matrices of the receiver and transmitter wave plates given by Equation (A5). We consider that hereinafter, the signal relationships in the form of the equations hold true with the accuracy determined by measurement statistics.
As shown in Ref. [
11], if we define the polarization ratio as
, where
, after a substitution of Equations (3) and (4), we obtain the MPL calibration equation:
where the transmitter and receiver instrumental vectors
and
, using the terminology of Ref. [
11], are given by Equations (A1) and (A2). With am=n allowance for the Equations (2), (A1) and (A2), Equation (5) is reduced to the form:
where:
Here, is the nonlinear functional of the calibration parameters except for .
Note that the matrix
is diagonal; therefore, the sum of the signals
is independent of the angular positions of the PBS and receiver and transmitter wave plates; therefore:
Equation (8) can also be written in the form of the functional:
Thus, to within small terms determined by the measurement statistics, the MPL calibration equations have the form:
3. Solution of the Calibration Equations
Consider the method of solving the MPL calibration equations. Note that the calibration parameters,
, define the initial angular positions of the wave plates. We consider that the wave plate rotation angles
in a series of states
are accurate, where
. In other words,
are known quantities included in the calibration equation as constants. We accept, as the available information, the Poisson statistics of the recorded signals [
19]. We also consider that the measurement errors are random and independent. As customary, we use signals instead of averages and variances in a series of measurements. Recall that there are only three methods of estimating the parameters: the method of moments, the least squares method (LSM), and the maximum likelihood method [
20]. Note that the regressors of the functionals (10) and (11) comprise the measurements
and
; therefore, the residuals in fitting the calibration parameters depend on the measurements. The functional
is linear in the parameters
and
, whereas the functional
is nonlinear in the angular parameters. In this case, the use of the LSM [
20] is the optimal (economic) strategy. In addition, we consider the two-stage solution method:
The linear parameters and are estimated as roots of the functional ;
Substitution of into is carried out;
The functional nonlinear in the angular parameters is solved with the Gauss–Newton method.
3.1. Stage 1 of Solving the Problem
The linear functional
is the classical model of pairwise regression with
measurements:
in which
is the model
, and the regressors can be represented in the form of the row vector
. The exogeneity of the regressors is violated since
and
. Then, the LMS estimates are unbiased, but non-effective. The standard error estimates are biased and inconsistent. The problem is solved by using the generalized least squares (GLS) [
21]. The system of Equations (12) in the matrix form has the form:
where
is the
matrix composed of the corresponding row vectors
,
is the column vector of the model coefficients, and
is the column vector.
The GLS model coefficients are estimated based on the Moore–Penrose pseudoinverse
[
22,
23] as:
and the errors in the parameters
and
are estimated as the corresponding diagonal matrix elements:
The
error covariance matrix estimate
in Equations (14) and (15) is defined as the diagonal matrix with elements:
The estimates
are found using an iterative procedure because it is necessary to set the initial value
of
. For the convenience of representation, the serial numbers of the iterations are omitted here. The subsequent estimates
are calculated from the previous estimates by solving Equations (14) and (15). The well-known convergence criterion is calculated from the residuals of the functional
. As a consequence of the Gauss–Markov theorem [
24,
25], the GLS vector estimate
is unbiased and effective. Since the matrix
is determined based on the available information, the GLS is often called the feasible GLS.
3.2. Stage 2 of Solving the Problem
In the next step (item 2) after the substitution, the functional
takes the form:
where
.
In the Gauss–Newton method, the nonlinear form
in the first approximation of the Taylor series expansion is reduced to the linear form in the increments
of the calibration parameters:
where the partial derivatives of
, taking into account Equation (7), are determined by the subsequent substitution as the partial derivative components of the instrumental vectors given by Equations (A1)–(A10).
Let us consider Equation (18) as a model of multiple regression with
measurements:
where
is the model, the vector of the model coefficients
is composed of the increments
, and the regressors in the form of the row vectors
are composed of the corresponding partial derivatives
,
, …,
given by Equations (A6)–(A10). In the matrix form, Equation (19) takes the following form:
where
is the
matrix of the Jacobi derivatives composed of the row vectors
and
. Here, Model (19) is endogenous with errors
that depend on measurements
. As in the preceding case, a solution can be found using the feasible GLS. The initial approximation vector is
. In the Gauss–Newton iterative method, the subsequent parameter estimates are related to the previous estimates through the increments:
where
is the serial iteration number. The GLS estimate of the coefficient increment vector
has the form:
where
is the
covariance matrix of error estimates defined by the first terms of the Taylor series expansion:
The errors of the parameters
are the corresponding diagonal elements of the matrix:
The well-known convergence criterion is also based of the residuals of the functional . The GLS estimate of the coefficient vector is unbiased and effective.
Note the key point in compiling the error matrices in Formulas (16) and (23) of the available data:
In stage 1 of the problem solution, the diagonal matrix is composed of the error estimates of measurements and as the initial data. As indicated above, taking into account the properties of the Poisson statistics, they are the signals themselves and ;
In the next stage, the diagonal matrix is composed of the error estimates for , , and as the initial data; they are the signals and and .
As shown in [
20,
26], if we denote the accuracy of estimates by
given that the number of unknowns coincides with the number of equations
, then the accuracy of the parameter estimates for
is increased as
.
4. Verification and Validation of the Calibration Method
The calibration method was verified for the MPL numerical model in which a series of measurements were performed with subsequent rotations of the transmitter and receiver
plates
and
, respectively. The method was validated on the results of MPL sensing of the Asian dust in Daejeon, Republic of Korea [
11].
The convergence and stability of the method are critical to the set of angular positions of the transmission axes of the plates in the measurement series below referred to as the ‘set of positions’ or simply the ‘set’. To solve this problem, the search of the optimal variants of the set was performed. For this purpose, we first formed a set . Then for this set, we modeled instrumental vectors for the MPL receiver and transmitter as a set of states . Then, the corresponding series of signals were calculated from Formulas (3) and (4). Then the ranks, determinants, and condition numbers of the matrices and were calculated and compared. As the efficiency criterion, we used the condition of good conditionality of the systems of Equations (14) and (22). For simplicity, the sets were composed of placements with repetitions in two variants and .
As a result, two optimal sets
were chosen: the fast set with
= 9 and the slow set with
= 16. The fast set was
, where the angles are in radians; the instrumental vector set
for it was:
Here, the instrumental vectors are column vectors, and the asterisks are equal to 1 for and for .
The slow set was
with a periodicity of
radians and the corresponding instrumental vector set
:
4.1. Verification
Figure 2,
Figure 3 and
Figure 4 show the results of the application of the calibration method to the MPL models with fast and slow sets
. For convenience, we call these results the fast and slow estimates, respectively.
Figure 2 shows the histograms of the fast and slow estimates of the parameters
(a) and
(b) of the transmitter and receiver
plates, respectively. Here, 5 × 10
4:F is the fast estimate and 5 × 10
4:S is the slow estimate for <N> = 5 × 10
4; 5 × 10
3:F is the fast estimate and 5 × 10
3:S is the slow estimate for <N> = 5 × 10
3; 500:F is the fast estimate and 500:S is the slow estimate for <N> = 500 for both (a) and (b). The sample comprised 10,000 estimates of the MPL model parameters. Hereinafter, the histograms are shown as linear envelopes of the cells for the best data visualization.
The following procedure of the verification of the calibration method was chosen. For convenience, it was assumed that the optical elements had no systematic angular position errors and . For the fast and slow sets , a series of values was composed of the known average values : 100, 500, 103, 5 × 103, 104, 5 × 104. Then, the series of average signal values were calculated from Equations (3) and (4). Furthermore, the series of random echo-signals with the Poisson distribution were generated for the average signals. After that, the inverse problem of estimating the calibration parameters was solved. The initial approximation vector was set in the form .
The estimation accuracy and the convergence of the method were estimated from statistical data. For this purpose, each procedure of generating a series and solving the inverse problem was repeated 10,000 times. Here, the calibration parameters are the initial angular positions of the plates and , deviations from retardance of the plates and , and the angle deviation of the PBS.
Figure 3 shows the histograms of the angle deviations of the transmission axes estimates
(a) and
(b) for the transmitter and receiver
plates, respectively.
Figure 4a shows the histograms of the angle deviations of the PBS transmission axis
, and
Figure 4b shows the histograms of the deviations of the relative transmission coefficient
.
Table 1 presents the estimates of the average deviations of the calibration parameters for the examined sample of 10,000 results (marked in
parentheses). The data are presented in columns of
Table 1 depending on the signal-to-noise ratios (SNR).
The standard deviation (STD) of the signal served as the noise estimate. Here, for the Poisson signal statistics. The upper figures in the table cells show the fast set average parameter estimates, and the lower figures show the slow set estimates.
The results demonstrate fast convergence to the functional minimum, on average, in two iterations and a good stability of the method for weak signals.
4.2. Validation
The proposed calibration method is scaled to the calibration parameters. This allowed us to validate the method using the data of polarization sensing in Daejeon, Republic of Korea, 36.34° N, 127.30° E on 1–2 June 2014 [
11].
Figure 5 shows the vertical profiles of the scattering ratio estimates from the data of atmospheric sensing with the MPL. The scattering ratio profiles were calculated using the technique described in [
8].
The matrix polarization lidar operated with a successive change of the receiver and transmitter
and
plates and without wave plates. These states are described as placement with repetitions
= 9 [
11]. There are six calibration parameters: the relative transmission coefficient
; angular positions
of the transmission axes of the
plate and
of the
plate of the receiver;
of the
plate and
of the
plate of the transmitter; the angle
of the PBS transmission axis. The vertical resolution of the measurements was 60 m. The altitude range from 2700 m to 4200 m with a prevalence of molecular scattering is clearly seen in
Figure 5. The MPL was calibrated in this altitude range.
Figure 6 shows the histograms of the signal estimates
. The characteristic shape of the histogram in
Figure 6 is due to lidar echo signal variations as was shown by Equations (3) and (4).
Here, the average signal estimate
= 784.26 with SNR = 28. The parameter estimates were obtained by the calibration method from the experimental data of 494 series of polarization measurements.
Figure 7a shows the histograms of the angle deviation estimates
and
of the transmission axes of the transmitter wave plates, the
and
of the receiver wave plates, respectively, and of the PBS transmission axis
.
Figure 7b shows the histogram of the relative transmission coefficient
.
The histograms are shown relative to the MPL average calibration parameter estimates (marked in
parentheses) given in
Table 2.
Figure 8 shows the histogram of the convergence rate of the calibration method from the data of the outdoor experiment as the number of calibration procedures versus the number of iterations in the procedure. The sample histogram comprised 494 calibration procedures.
On average, the convergence was reached in two iterations, which is characteristic for the least squares method. The results of the testing of the calibration method from the data of the outdoor experiment show a fast convergence and good stability of signals in the photoelectron counting mode.
5. Concluding Remarks
In this work, the principle of derivation and the method of solution of the equation of the MPL parameter calibration by air have been substantiated. To estimate the calibration parameters, the generalized least squares method was used. The minimum functional estimates obtained by this method are independent of the random variable distributions. The calibration parameter estimates are unbiased and effective.
The problem of the choice of the states of the wave plate set used for the calibration measurements was considered. In the mode of the MPL calibration by air, two sets of angular positions of the transmission axes of the lidar receiver and transmitter plates in series of measurements were suggested.
The results of the method verification on the MPL model showed a fast convergence in 1–3 iterations and a stability of the parameter estimation method. The validation of the calibration method on the data of MPL sensing in Daejeon, Republic of Korea, confirmed the correctness of the chosen concept of method construction. This suggests the possibility of a practical application of the method of MPL calibration by air in polarization sensing.
It should be noted that in practice, the directions of the basis vectors of optical MPL elements do not coincide with the z axis of the incident light beam. In addition, the MPL comprises other optical elements, for example, filters, lenses, etc., that introduce additional optical distortions. In the calibration by the proposed method, their contribution was taken into account in an implicit form; therefore, the MPL calibration parameter estimates should be considered effective. This is the advantage of the proposed calibration method compared to the correction technique.
Here, we have not considered the nature of the depolarization effect of the elements of the molecular scattering matrix; however, as shown in [
27], the bandwidth of the input filters in the recording equipment should be taken into account. For spectral filter widths of less than 0.5 nm, filtering of the Raman scattering lines can lead to a change in the scattered radiation depolarization coefficient.