Author Contributions
Conceptualization, K.K. and S.K.; methodology, Y.F. and K.K.; software, Y.F.; validation, Y.F.; formal analysis, Y.F.; investigation, Y.F.; resources, S.K.; data curation, Y.F.; writing—original draft preparation, Y.F.; writing–review and editing, K.K., K.M., K.Y., and S.K.; visualization, Y.F.; supervision, K.K. and S.K.; project administration, K.K. and S.K.; funding acquisition, S.K. All authors have read and agreed to the published version of the manuscript.
Figure 1.
(a) The 4-tap pixel diagram and (b) the pixel circuit. The charge corridor is indicated by red dashed lines, which is shared by the gates.
Figure 1.
(a) The 4-tap pixel diagram and (b) the pixel circuit. The charge corridor is indicated by red dashed lines, which is shared by the gates.
Figure 2.
A micrograph of the prototype chip. V. scanner: vertical scanner. SPI_BLK: serial–parallel interface block. PGA_BLK: programmable gain amplifier block. ADC_BLK: analog-to-digital converter block. HSL_BLK: horizontal scanner logic. LVDS: low-voltage differential signaling. PLL: phase-locked loop.
Figure 2.
A micrograph of the prototype chip. V. scanner: vertical scanner. SPI_BLK: serial–parallel interface block. PGA_BLK: programmable gain amplifier block. ADC_BLK: analog-to-digital converter block. HSL_BLK: horizontal scanner logic. LVDS: low-voltage differential signaling. PLL: phase-locked loop.
Figure 3.
Gating timing charts for (a) the conventional multi-exposure HDR method emulated using the 4-tap CIS; (b) the charge-splitting HDR method.
Figure 3.
Gating timing charts for (a) the conventional multi-exposure HDR method emulated using the 4-tap CIS; (b) the charge-splitting HDR method.
Figure 4.
The potential diagram of the charge modulator.
Figure 4.
The potential diagram of the charge modulator.
Figure 5.
(a) The top view of the pixel and (b) the cross-section view along the A-A’ line, where optical crosstalk and diffusion current causes charges to accumulate in the inactive tap.
Figure 5.
(a) The top view of the pixel and (b) the cross-section view along the A-A’ line, where optical crosstalk and diffusion current causes charges to accumulate in the inactive tap.
Figure 6.
(a) The top view of the pixel, (b) the cross-section potential along the A-B line, and (c) the cross-section potential along the A-A’ line.
Figure 6.
(a) The top view of the pixel, (b) the cross-section potential along the A-B line, and (c) the cross-section potential along the A-A’ line.
Figure 7.
The timing chart for the charge injection experiment.
Figure 7.
The timing chart for the charge injection experiment.
Figure 8.
The charge injection experiment results with all gates ON. (a) VRES-L = 0.5 V, (b) VRES-L = 1.1 V, and (c) VRES-L = 1.7 V. The dashed line shows the linearly fitted pixel values at Tap 4 with ranging from 2.0 V to 2.2 V.
Figure 8.
The charge injection experiment results with all gates ON. (a) VRES-L = 0.5 V, (b) VRES-L = 1.1 V, and (c) VRES-L = 1.7 V. The dashed line shows the linearly fitted pixel values at Tap 4 with ranging from 2.0 V to 2.2 V.
Figure 9.
(a) The timing chart for the draining measurement while all taps are turned OFF and drain turned ON during exposure; (b) luminance versus pixel value curve for the four taps.
Figure 9.
(a) The timing chart for the draining measurement while all taps are turned OFF and drain turned ON during exposure; (b) luminance versus pixel value curve for the four taps.
Figure 10.
(a) The 4-tap pixel diagram and (b) the potential barriers difference in the 4 transfer gates when G1-G4 are OFF and GD is ON.
Figure 10.
(a) The 4-tap pixel diagram and (b) the potential barriers difference in the 4 transfer gates when G1-G4 are OFF and GD is ON.
Figure 11.
Luminance versus pixel value curve of the 4-tap image sensor while only one of taps is turned ON during accumulation. (a) Tap 1 active, (b) Tap 2 active, (c) Tap 3 active, (d) Tap 4 active.
Figure 11.
Luminance versus pixel value curve of the 4-tap image sensor while only one of taps is turned ON during accumulation. (a) Tap 1 active, (b) Tap 2 active, (c) Tap 3 active, (d) Tap 4 active.
Figure 12.
(a) The tap setting of the HDR system and (b) luminance versus pixel value curve of the 4-tap image sensor with a reset gate low voltage range from 0.5 V to 1.7 V.
Figure 12.
(a) The tap setting of the HDR system and (b) luminance versus pixel value curve of the 4-tap image sensor with a reset gate low voltage range from 0.5 V to 1.7 V.
Figure 13.
Luminance versus pixel value curve of the 4-tap image sensor with different transfer gate low voltage.
Figure 13.
Luminance versus pixel value curve of the 4-tap image sensor with different transfer gate low voltage.
Figure 14.
(a) Luminance versus pixel value curve and (b) the SNR curve of the 4-tap image sensor with shortest time window.
Figure 14.
(a) Luminance versus pixel value curve and (b) the SNR curve of the 4-tap image sensor with shortest time window.
Figure 15.
A sample of captured images of an HDR scene from the four taps: (a) first tap, (b) second tap, (c) third tap, (d) fourth tap, using the 4-tap image sensor and the shortest time window at the fourth tap.
Figure 15.
A sample of captured images of an HDR scene from the four taps: (a) first tap, (b) second tap, (c) third tap, (d) fourth tap, using the 4-tap image sensor and the shortest time window at the fourth tap.
Table 1.
Specifications of the prototype 4-tap CIS.
Table 1.
Specifications of the prototype 4-tap CIS.
| Parameter | Value |
|---|
| Technology | 0.11 µm CIS process |
| Pixel count | 648 (H) × 480 (V) |
| Pixel size | 16.8 µm × 16.8 µm |
| Chip size | 14.92 mm × 15.5 mm |
| Shortest time window | 20 ns |
| ADC resolution | 12-bit |
| Readout time | 1.45 ms |
| Full well capacity * | 40 k e− |
| Dark noise ** | 69 e−RMS |
| Dark current | 254 e− @ tap 1 (Exposure: 28 ms) |
| Conversion gain | 22.2 µV/e− |
| Quantum efficiency | 18.6% @ 940 nm |
Table 2.
Example parameters of charge-splitting HDR method.
Table 2.
Example parameters of charge-splitting HDR method.
| Tap # | Photosensitivity | Total Exposure Time | Cycle Exposure Time (τ) |
Duty Cycle
|
Ex
pected
DR
Extension
|
|---|
| 1 | High | 28 ms | 280 μs | 90% | - |
| 2 | Medium | 2.8 ms | 28 μs | 9% | 20 dB |
| 3 | Low | 0.28 ms | 2.8 μs | 0.9% | 20 dB |
| 4 | Extremely low | 0.028 ms | 0.28 μs | 0.09% | 20 dB |
Table 3.
The measured pinning voltage at the four taps with different VRES-L.
Table 3.
The measured pinning voltage at the four taps with different VRES-L.
| | | Tap 1 | Tap 2 | Tap 3 | Tap 4 |
|---|
| VRES-L | |
|---|
| 0.5 V | 2.22 V | 2.22 V | 2.24 V | 2.33 V |
| 1.5 V | 2.22 V | 2.22 V | 2.23 V | 2.32 V |
| 1.7 V | 2.25 V | 2.26 V | 2.24 V | 2.32 V |
Table 4.
Measured maximum light intensity at saturation (EMAX) and gamma of the 4-tap system while all taps are turned OFF and drain turned ON during exposure.
Table 4.
Measured maximum light intensity at saturation (EMAX) and gamma of the 4-tap system while all taps are turned OFF and drain turned ON during exposure.
| | EMAX [cd/m2] | Gamma [-] |
|---|
| Tap 1 | 752 | 0.98 |
| Tap 2 | 1727 | 0.96 |
| Tap 3 | 7408 | 0.94 |
| Tap 4 | 4255 | 0.95 |
Table 5.
Luminance required to reach a 1000 LSB signal level at each tap.
Table 5.
Luminance required to reach a 1000 LSB signal level at each tap.
| | | Luminance at 1000 LSB [cd/m2] |
|---|
| The Active Tap | | Tap 1 | Tap 2 | Tap 3 | Tap 4 |
|---|
| Tap 1 | 0.3 | 351 | 1504 | 94 |
| Tap 2 | 188 | 0.3 | 992 | 701 |
| Tap 3 | 163 | 376 | 0.3 | 806 |
| Tap 4 | 175 | 285 | 2280 | 0.3 |
Table 6.
Measured DR and gamma of the four taps with reset gate low voltage range from 0.5 V to 1.7 V.
Table 6.
Measured DR and gamma of the four taps with reset gate low voltage range from 0.5 V to 1.7 V.
| | | Measured DR or DR Extension [dB]/Gamma [-] |
|---|
| | | VRES-L = 0.5 V | 1.5 V | 1.7 V |
|---|
| First tap | 55.9/1.00 | 55.9/1.00 | 55.9/1.00 |
| Second tap | 19.2/0.98 | 19.2/0.98 | 19.2/0.99 |
| Third tap | 18.6/0.88 | 18.6/0.88 | 18.6/0.89 |
| Fourth tap | 18.7/0.65 | 19.4/0.83 | 19.9/0.87 |
| Total DR | 112.5 | 113.1 | 113.6 |
Table 7.
Charge-splitting HDR with the shortest time window. (Previous setting/ new setting for fourth tap).
Table 7.
Charge-splitting HDR with the shortest time window. (Previous setting/ new setting for fourth tap).
| | | Total Exposure Time | Cycle Exposure Time (τ) | Expected DR Extension |
|---|
| | |
|---|
| First tap | 28 ms | 280 μs | - |
| Second tap | 2.8 ms | 28 μs | 20 dB |
| Third tap | 0.28 ms | 2.8 μs | 20 dB |
| Fourth tap | 0.028 ms/2 μs | 280 ns/20 ns | 20 dB/42.9 dB |
Table 8.
Measured DR and gamma of the 4-tap image sensor with different cycle exposure time at the fourth tap.
Table 8.
Measured DR and gamma of the 4-tap image sensor with different cycle exposure time at the fourth tap.
| | |
Total DR [dB]
|
Fourth Tap
|
|---|
| |
Measured DR/
Ex
pected DR [dB]
|
Gamma [-]
|
|---|
| 280 ns | 113 | 19.9/20.0 | 0.87 |
| 20 ns | 126 | 32.9/42.9 | 0.71 |
| Draining | - | 37.8 | 0.94 |
Table 9.
Sensor performance summary and comparisons.
Table 9.
Sensor performance summary and comparisons.
| | This Work | [17] | [18] | [19] |
|---|
| Technology [nm] | 110 | 45 | N/A | 45 |
| Pixel count | 648 (H) × 480 (V) | 3840 (H) × 2160 (V) | 1.3 MP | 5.7 MP |
| Pixel pitch [µm] | 16.8 | 2.1 | 3.0 | 1.5, 3.0 |
| HDR method | Charge-splitting | LOFIC and TCG * | Dual PD and LOFIC & DCG | Dual PD and LOFIC |
| Single exposure DR | 55.9–126 | 110 | 120 | 106 |
| Min. SNR at transition [dB] | 30 @ 25 °C | 25 @ 125 °C | 30 @ 100 °C | 30 @ 85 °C |
| Dark noise (random noise) | 69 e− | 622 µV | N/A | 1.4 e− |
| FWC [e−] | 40 k | 600 k | N/A | 280 k |
| Cycle exposure time [µs] | 0.02–280 | - | - | - |
| Total exposure time [ms] | 0.0002–28 | 10 | 16 | 11 |