1. Introduction
In the next generation of radar systems, new developing technologies are required for target detection at long range and with increased resolution in variable environments with broadened bandwidth. The lidar system, especially the imaging lidar system [
1,
2,
3], also demands a revolution in signal processing, with a much wider bandwidth. With the improvement of MEMS scanners [
4,
5], the pulsed lidar systems, such as phase-coded lidar [
6,
7], use narrow pulses to achieve better resolution. However, suffering from the limited bandwidth and sampling frequency of the digital components, the performance of lidar systems is restricted. In contrast, photonics can provide high precision [
8], ultra-broad bandwidth [
9] and low phase errors [
10], with the advantages of both the flexible generation [
11,
12] and detection of extremely stable signals [
13] and their precise direct digitization without down conversion [
14,
15]. In 2015, Pérez first built a software-defined reconfigurable microwave photonics processor which was capable of performing all the main functionalities by the suitable programming of its control signals [
16]. In 2018, Wang built an all-optical phosphorene phase modulator with enhanced stability under ambient conditions [
17]. All these efforts have explored the possibilities of replacing electrical devices with photonic devices. Most notably, the group of Yao has made great progress in photonic signal processing. In 2015, they proposed a technique to achieve broadband and precise microwave time reversal using a single linearly chirped fiber Bragg grating [
18]. From 2016 to 2022, the group reported the microwave signal convolution calculation based on microwave photonic signal processing technologies [
19,
20,
21,
22], which greatly improve the signal processing bandwidth. These photonic signal processing techniques have been already applied in large-scale imaging lidar since 2020 [
23,
24]. Because photonic signal processing is capable of providing higher bandwidth and lower signal interference, the application of photonic signal processing in lidar systems is promising.
The approach of time of flight (ToF) measurement is considered to be a promising technique [
25]. The approach known as direct ToF (dToF) calculates the time directly from an accurate time base [
26,
27]. It is generally considered to be a low-resolution technology, requiring complex (and expensive) mechanical scanning to achieve high resolutions. The approach of indirect ToF (iToF) calculates distance based on a phase shift to a known reference signal. This technique suits high-resolution applications with less detection range [
28]. However, the iToF technique may extend the ranging depth to avoid the ambiguity of phase by combining the detection of double frequencies. The approach makes iToF very useful in forward-looking applications where other technologies have limitations.
The phase-coded lidar system has great advantages in long-distance measurement with high resolution [
29]. Yang built a phase-coded modulation lidar based on a ghost imaging algorithm to get 3D images of distant targets in 2020 [
30]. Ding presented a coded-pulse-bunch-laser-based single-photon lidar for fast long-distance ranging in 2022 [
31]. In this scenario, the collection of every returned laser pulse is required and expensive detectors with broad bandwidth and expensive electrical signal processors are used for complicated calculations. For instance, the resolution of a phase-coded lidar system is limited to 15 m when the bit width is 100 ns and the sampling frequency is 10 MHz. A PIN detector can easily achieve such high frequency, whereas an ICCD will never do so. Lidar systems with low sampling frequency, such as imaging array lidar systems, are confronted with great difficulty regarding the conflicts of high resolution and low detector bandwidth [
32,
33].
In this paper, the structure of photonic signal processing in the phase-coded lidar system is proposed to solve the conflict between the range resolution and sampling frequency of detectors. This photonics-based structure decomposes the correlation calculation into multiplication and addition steps achieved by the demodulator and detector. The achieved range resolution is the same as the sub-pulse width of the modulated sequence. Additionally, the accuracy has been greatly improved. The experiment has shown that the system will achieve a 15 m range resolution with a sampling period of 1.6 μs. The error of the measurement reached 0.5 m. The photonic signal processing method has transferred the electric signal processing to optical signal processing. Moreover, as the interference of laser beams is little enough, the photonics devices are capable of processing parallel optical signals, which may greatly improve signal bandwidth. Therefore, the proposed architecture has great implementation potentialities in imaging lidar systems.
2. Photonic Signal Processing in Lidar Systems
Generally, the detectors in conventional lidar systems collect all laser signals and transfer the laser signals to electrical signals, which are then applied to the signal processing module. Although the mature signal processing algorithm and electronic circuit design greatly decrease the difficulty of lidar system design, the performance of the system is restricted by the sampling frequency of the detectors. Most notably, the imaging lidar systems with array detectors are not capable of recovering broadband signals.
Because the photonics devices are capable of providing high precision and broad bandwidth, the proposed lidar system transfers the signal processing from electrics to photonics, as shown in
Figure 1.
In the system, an AOM is used to generate the phase-coded laser sequence at the transmission arm. Another AOM, as the demodulator, is placed before the detector to control the passage status of the echo laser pulses according to the electric reference sequence, achieving the multiplication of the echo and reference sequences. The detector integrates the laser signals during the demodulation period and outputs the values of the correlation calculation of the echo laser sequence and the electric reference sequence at a very low speed.
In the transmission arm, the generated electrical modulation pulse signals with pulse width τ are sent to the modulator. The laser with the constant intensity is modulated by the modulator into a phase-coded sequence, T1, and transmits through the transmission antenna illuminating the target. The generated reference sequence T2, which is an electrical signal, is sent to the demodulator and controls the passing status of the echo laser sequence T3 in the demodulator, which is collected by the receiving antenna. The detector collects the laser signals which transmit through the demodulator and accumulates all the energy of the signals during the opening period, which is controlled by the gate controller. The output sequence of the detector is used to calculate the range information of the target in the computer by counting the position of the highest signal intensity.
In this lidar system, the correlation calculation of the echo and reference sequences does not emerge in the computer in the form of electrical signals. The correlation calculation is decomposed into three parts. (1) Multiplication operation: The demodulator is controlled by the electrical reference sequence T2 to decide the passage status of the echo laser pulses. This photonics instrument achieves the multiplication of the echo sequence in the form of laser signals and the reference sequence in the form of electrical signals. Typically, the demodulator can be an acousto-optic modulator (AOM) or an electro-optic modulator (EOM). (2) Addition operation: The detector conducts the addition of multiplied sequences by the accumulation of laser signals under the condition of a controlled opening gate. Because the accumulation period equals the period of the reference sequence, the output speed of the detector is quite low, which is fit for the defect of the array detectors. (3) Shift operation: The reference sequence is one bit more than the transmitted sequence, which will automatically shift the transmitted sequence by one bit. The computer recognizes the correlation peak position within the output of the detector and calculates the phase shift. With these three steps, the conventional electrical correlation calculation is transformed to the optical correlation calculation with the collaboration of photonics-based devices.
As shown in
Figure 2, a demonstration experiment was proposed to validate the proposed photonics-based phase-coded lidar system.
The system employed a CW laser transmitter emitting a laser signal with constant intensity, at the 532 nm wavelength, with the output power 75 mW. The laser was modulated to the coded pulse sequence by the acousto-optic modulator (AOM RF200 of Qingjin) (Shenzhen, China). The signal generator (AFG3102C of Tektronix) (Beaverton, OR, USA) generated two synchronous signals, the modulation sequence and reference sequence. The modulation sequence was selected as an m-sequence of 15 bits long with a bit width of 100 ns. Therefore, the periods of the modulation and reference sequences were 1.5 µs with 15 bits and 1.6 µs with 16 bits. To simplify the experiment, the activation period and silence period were both set to 24 µs.
Due to the Prague diffraction effect of the AOM, the direction of the modulated laser signal was deflected to the first-order diffraction fringe. Because the intensity of the laser signal was not high enough to support remote target detection, a wall about 24 m away was used as the target to reflect the laser. The echo laser signal was collected by the receiving lens and transmitted through an AOM, in the same manner as with the modulator. The deflected laser output of the first-order diffraction fringe was focused on a PIN detector (PDA10A2 of Thorlabs) (Newton, NJ, USA). The sampling frequency was set to 20 MHz. The output of the PIN detector was given to an integrator amplifier (AD8488 of Analog Devices) (Wilmington, MA, USA) and an oscilloscope (MDO3032 of Tektronix) to monitor the signal. The integrator amplifier was controlled by the gate signal to accumulate the laser signals during the accumulation period of 1.6 µs, and the accumulated signals were sent to the computer. The combined function of the PIN detector and integrator was used to simulate the function of an integrating detector, which is normally used in range-gated lidar systems.
3. The Phase Code Sequence
The basic purpose of the proposed lidar system is to get remote distance measurement with high resolution. Due to the required target detection of long range, the intensity of echo signals will be low. Meanwhile, the AOM located before the detector will further reduce the intensity of echo signals. Therefore, the system should employ the pulse compression method by taking the advantage of the high SNR. This paper takes the phase-coded method as an example.
Suppose that
represents an m-sequence with
N = 2
n − 1 bits, where
n is the length of shift registers. Additionally,
mi,
i = 1,…,
N are the bits of the sequence. The self-correlation function can be expressed as
Here, p is the number of the shifted bits.
When the values of
mi are only 1 and −1, the values of the self-correlation function become
In practical situations, the presented system will use the modulator to control the passage state of the laser signals, which will result in the modulation and demodulation having only two circumstances: pass or non-pass. The detected signal by the detector cannot be a negative value, either. Therefore, the modulation and demodulation signals can be regarded as non-negative sequences. The simplest solution is to add one to the m-sequence
S1, with the sequence being converted to
T1, whose values become 2 and 0.
The self-correlation function is expressed as
For the m-sequence, the number of ‘1’ s is one greater than the number of ‘0’ s, which results in
. Equation (4) becomes
The values are .
Suppose
is the emitted sequence of the lidar system. The period length of
T1 is
N.
T2 is the reference sequence and
T3 is the echo sequence. Suppose
. Take
as the phase difference of the emitted and echo sequences. The correlation function of
T1 and
T3 can be expressed as:
In the proposed photonics-based lidar system, to accomplish the shift operation, the reference sequence T2 is constructed based on the modulation sequence T1 with the same bit width. An additional ‘0’ is added to the end of T1, where . The period length of T2 is N + 1. For example, if the modulation sequence T1 is chosen to be a simple m-sequence [1 1 1 0 0 1 0] containing 7 bits, the reference sequence T2 will be [1 1 1 0 0 1 0 0], containing 8 bits. The controlled accumulation time of the detector will be set to be the period of T2. The extra bit ‘0’ makes the correlation calculation shift automatically and the position of the highest intensity of the detector output sequence indicates the result of the correlation calculation.
Define the demodulation function of
T2 and
T3 as:
According to the construction method of
, there is
, which leads to the result.
In this way, the correlation function of T1 and T3 can be deduced from the demodulation function of T2 and T3.
To determine the position of the correlation peak during the output sequence of the detector, the modulation signal was designed with two periods, shown in
Figure 3, an activation period with the system emitting the modulated laser sequences, and a silence period with no laser illumination. However, the reference sequence worked during the whole time with no silence period. The activation period contained
N + 1 m-sequence periods. The length of the activation period equaled the length of N reference sequence periods, as the reference sequence had 1 more bit than the modulation sequence. The detector accumulated the collected energy during each reference sequence period. The length of the silence period was set according to the duty ratio requirement of the laser.
4. Result of the Experiment
The results of the experiment are shown in the following figures.
Figure 4a shows the real-time waveform of the PIN detector output signal monitored by the oscilloscope without accumulation. The silence period, indicated by the signals with lower values, identified the start of the correlation calculation. In the activation period, the width of each bit was 100 ns. As shown in
Figure 4b, the correlation peak of the accumulated signal can be easily counted as the 3rd pulse, which indicates that the variation between the emitted laser sequence and reference sequence should be about 200 ns, which turned out to be 30 m, close to the distance of 24 m of the wall. This result demonstrates the validity of the proposed photonics-based phase-coded lidar system.
According to the result, the range resolution of the system reached 100 ns, the single bit width of transmitted signals, and the accumulation period of the PIN was 1.6 µs. This means that the sampling period of the detector is much longer than the single-bit width of the signal. For practical application, the length of the modulated sequence can be 1023 bits, which offers nanosecond resolution with a sampling rate of milliseconds. The available detectors with low performance will be capable of acquiring narrow pulse information with low sampling frequency. The cost of acquiring high-range resolution can be greatly reduced.
More importantly, as the laser has very low signal interference, the multiplication of reference signals and echo signals in laser form for thousands of pixels can be processed at the same time. This means that the imaging lidar system is capable of achieving 3D images with high-range resolution in remote detection when the detector is changed to an array detector, such as an ICCD camera, which has a very low sampling rate.
5. Discussion
5.1. Accuracy Improvement
Although the range resolution could be as narrow as the pulse width with a low sampling rate, the measurement accuracy may not be good enough yet. The pulse synchronization of the echo laser sequence and the reference sequence may cause a deviation of the correlation peak.
Suppose the echo sequence
T3 with length
N is delayed for
bits. The sequence can be regarded as the combination of two separated sequences,
T31 and
T32, shown in
Figure 5.
Under the circumstance of total synchronization,
m = 0, the correlation calculation is
. When
m ≠ 0, the energy of a single pulse in
T31 and
T32 becomes
and
of the original pulse, respectively. The correlation calculation equation shall become:
Then, the correlation calculation equation shall include the addition of
and
.
If
m <
n, the peak of the correlation calculation will be at the position
p, as
. If
m >
n, the peak of the correlation calculation will be at the position
p + 1. A simulation with different delayed bits for the modulation sequence was performed.
Figure 6a shows the detector output with a delay of 2 and 2/5 bits, in which case
,
,
.
Figure 6b shows the result of delaying 1 and 3/5 bits, in which case
,
,
.
As shown in
Figure 6a, the correlation peak remained at the 3rd pulse, representing a 2-bit delay of the echo sequence. The second-highest value of the pulses is after the correlation peak, which means that the echo sequence and the reference sequence were not synchronized and the echo sequence was delayed for more than 2 bits. The same 2-bit delay is shown in
Figure 6b, as the 3rd pulse was the correlation peak. The second-highest value of the pulses is before the correlation peak, representing that the delay of the echo sequence was less than 2 bits. Therefore, the position of the second-highest pulse represents the synchronization situation of the two sequences.
The degree of synchronization can also be concluded according to the values of the peak and the second-highest value. In
Figure 4b, it is very difficult to determine the values of
Rp and
. However, it is easy to calculate
and
, which are the differences between the top two highest values and the non-peak outputs. According to Equation (9), there are
,
and
. The delay can be represented by the following equation.
As shown in
Figure 4b, the peak appears at 17.6 µs with the value of 17.5, and the second-highest value appears at 16 µs with the value of 14.6, which can indicate that the phase difference between the echo signal sequence and reference sequence is less than 2 bits. Due to the noises, the values of the rest pulses are not the same. The average value of the rest pulses equals 10.5, which is used as the value of non-peak outputs. Then,
and
, which yields the result of
,
. The final result becomes 24.46 m, which is very close to the real distance in the experiment.
5.2. SNR of the System Output
For phase-coded lidar systems, the average power of the signal of each pulse in the sequence output by the detector can be denoted as:
where
is the power of the emitted pulse.
is the power of the output noise of the detector.
is the bit of the sequence.
is the responding function of the detector.
The detection process can be described as a statistical process. The power of the output signal includes the echo signal and noises. According to the research of Wu [
15], the output of the detector is a Gaussian process. The noises include background noise
, dark current noise
, and thermal noise
. The direct detection receiver model can be simplified as:
where
is the mean of the output signals of the detector.
is the variance of the output signals and can be regarded as the output noise.
is the primary photoelectrons’ counting of the photocathode.
,
,
,
represent the photoelectrons’ countings caused by echo signal, background noise, dark current noise and thermal noise.
is the electron charge.
is the load resistance.
is the noise coefficient.
is the system gain.
is the sampling period.
According to Equations (12) and (13), the mean and variance of the output signal are:
The output SNR of a single pulse of the detector becomes:
In the phase-coded system, the detector accumulates the input echo signals for the length of the sequence after the demodulator. The period of the accumulation is
. The average power of a single bit of the echo signal can be represented as:
The output signal after the demodulation becomes:
where
is the controlled bit of the reference sequence.
is the phase difference between the echo sequence and reference sequence.
After the accumulation in the detector, the output of the detector is:
There are
when the phase difference
is 0. According to the construction of the sequence, there is
. Therefore,
Then, the mean and variance of the output photons in a whole code sequence are:
The SNR of the output of the lidar system becomes:
According to Equation (21), the SNR of the lidar system is improved by times the SNR of a single bit of the sequence.
6. Conclusions
In summary, a photonics-based phase-coded lidar system is proposed in this paper. The system includes two modulators for modulation and demodulation, respectively. The modulator, such as an AOM, modulates the laser with constant intensity into an encoded pulse sequence. The demodulator is located between the collection antenna and the detector, and its function is to multiply the electrical reference sequence with the laser echo sequence. The detector, such as a PIN or an ICCD, with the gate controller, integrates the output of the demodulator at a very low speed. The combination of the demodulator and detector accomplishes the correlation calculation of the echo laser sequence in the form of laser and reference sequences in the form of electrical signals.
The system employs an m-sequence as the modulation sequence. A reference sequence is constructed based on the modulation sequence with an additional ‘0’ bit. The accumulation period of the detector is set to the period of the reference sequence. The output of the detector demonstrates the delayed phase of the laser echo sequence compared to the reference sequence.
This photonics-based signal processing method has transferred the classical correlation calculation electrically into an optical process. Because the laser beams have low signal interference, the system is capable of processing multiple pixels at the same time, resulting in great signal bandwidth expansion. Moreover, the system may achieve 3D imaging at higher range resolution, with the available devices, at low sampling rates. This potential implementation may have great impacts on imaging lidar systems with array detectors at low sampling rates and limited signal bandwidth.