Development of 3D-Stacked 1Megapixel Dual-Time-Gated SPAD Image Sensor with Simultaneous Dual Image Output Architecture for Efficient Sensor Fusion †
Abstract
1. Introduction
2. Materials and Methods
2.1. Sensor Architecture
2.2. Pixel Architecture and Operations
3. Experimental Results
3.1. SPAD Pixel Performance
3.2. Time-Gating Performance
3.3. RGB-D Imaging Demonstration
3.4. HDR Imaging Demonstration
3.5. Chip Power Consumption
4. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Kim, W.; Yibing, W.; Ovsiannikov, I.; Lee, S.; Park, Y.; Chung, C.; Fossum, E. A 1.5Mpixel RGBZ CMOS Image Sensor for Simultaneous Color and Range Image Capture. In Proceedings of the 2012 IEEE International Solid-State Circuits Conference, San Francisco, CA, USA, 19–23 February 2012; pp. 392–394. [Google Scholar]
- Jamin-Mornet, C.; Dewitte, H.; Guicquero, W.; Palmigiani, G.; Saxod, O.; Gerard, L.; Bellegarde, C.; Coindoz-Bernard, L.; Fonteneau, P.; Tournier, A. A RGBZ 1.4 µm Image Sensor for Color and Near-Infrared Indirect Time-Of-Flight Depth Sensing on Monolithic Silicon. In Proceedings of the 2025 International Image Sensor Workshop, Hyogo, Japan, 2–5 June 2025; p. R1.5. [Google Scholar]
- Kim, S.-J.; Kim, J.D.K.; Han, S.-W.; Kang, B.; Lee, K.; Kim, C.-Y. A 640 × 480 Image Sensor with Unified Pixel Architecture for 2D/3D Imaging in 0.11 µm CMOS. In Proceedings of the 2011 Symposium on VLSI Circuits—Digest of Technical Papers, Kyoto, Japan, 15–17 June 2011; pp. 92–93. [Google Scholar]
- Ohkubo, T.; Kawai, N.; Shiina, K.; Fukuhara, K.; Takaguchi, R.; Takada, T.; Nagashima, Y.; Niwa, T.; Joei, M.; Maeda, K.; et al. A Color Image Sensor Using 1.0-μm Organic Photoconductive Film Pixels Stacked on 4.0-μm Si Pixels for Near-Infrared Time-of-Flight Depth Sensing. In Proceedings of the 2024 IEEE International Electron Devices Meeting (IEDM), San Francisco, CA, USA, 7–11 December 2024; pp. 1–4. [Google Scholar]
- Tournier, A.; Roy, F.; Cazaux, Y.; Lalanne, F.; Malinge, P.; Mcdonald, M.; Monnot, G.; Roux, N. A HDR 98 dB 3.2 μm Charge Domain Global Shutter CMOS Image Sensor. In Proceedings of the 2018 IEEE International Electron Devices Meeting (IEDM), San Francisco, CA, USA, 1–5 December 2018; pp. 10.4.1–10.4.4. [Google Scholar]
- Dutton, N.A.W.; Abbas, T.A.; Gyongy, I.; Rocca, F.M.D.; Henderson, R.K. High Dynamic Range Imaging at the Quantum Limit with Single Photon Avalanche Diode-Based Image Sensors. Sensors 2018, 18, 1166. [Google Scholar] [CrossRef] [PubMed]
- Ota, Y.; Morimoto, K.; Sasago, T.; Shinohara, M.; Kuroda, Y.; Endo, W.; Maehashi, Y.; Maekawa, S.; Tsuchiya, H.; Abdelghafar, A.; et al. A 0.37 W 143 dB-Dynamic-Range 1Mpixel Backside-Illuminated Charge-Focusing SPAD Image Sensor with Pixel-Wise Exposure Control and Adaptive Clocked Recharging. In Proceedings of the 2022 IEEE International Solid-State Circuits Conference (ISSCC), San Francisco, CA, USA, 20–26 February 2022; pp. 94–96. [Google Scholar]
- Takatsuka, T.; Ogi, J.; Ikeda, Y.; Hizu, K.; Inaoka, Y.; Sakama, S.; Watanabe, I.; Ishikawa, T.; Shimada, S.; Suzuki, J.; et al. A 3.36-µm-Pitch SPAD Photon-Counting Image Sensor Using a Clustered Multi-Cycle Clocked Recharging Technique with an Intermediate Most-Significant-Bit Readout. IEEE J. Solid-State Circuits 2024, 59, 1137–1145. [Google Scholar] [CrossRef]
- Kumagai, O.; Ohmachi, J.; Matsumura, M.; Yagi, S.; Tayu, K.; Amagawa, K.; Matsukawa, T.; Ozawa, O.; Hirono, D.; Shinozuka, Y.; et al. A 189 × 600 Back-Illuminated Stacked SPAD Direct Time-of-Flight Depth Sensor for Automotive LiDAR Systems. In Proceedings of the 2021 IEEE International Solid-State Circuits Conference (ISSCC), San Francisco, CA, USA, 13–22 February 2021; pp. 110–111. [Google Scholar]
- Morimoto, K.; Ardelean, A.; Wu, M.-L.; Ulku, A.C.; Antolovic, I.M.; Bruschini, C.; Charbon, E. Megapixel Time-Gated SPAD Image Sensor for 2D and 3D Imaging Applications. Optica 2020, 7, 346–354. [Google Scholar] [CrossRef]
- Perenzoni, M.; Massari, N.; Perenzoni, D.; Gasparini, L.; Stoppa, D. A 160 × 120 Pixel Analog-Counting Single-Photon Imager with Time-Gating and Self-Referenced Column-Parallel A/D Conversion for Fluorescence Lifetime Imaging. IEEE J. Solid-State Circuits 2016, 51, 155–167. [Google Scholar] [CrossRef]
- Gyongy, I.; Calder, N.; Davies, A.; Dutton, N.A.W.; Duncan, R.R.; Rickman, C.; Dalgarno, P.; Henderson, R.K. A 256 × 256, 100-kfps, 61% Fill-Factor SPAD Image Sensor for Time-Resolved Microscopy Applications. IEEE Trans. Electron Devices 2018, 65, 547–554. [Google Scholar] [CrossRef]
- Morimoto, K.; Isoda, N.; Sekine, H.; Sasago, T.; Maehashi, Y.; Mikajiri, S.; Tojima, K.; Shinohara, M.; Abdelghafar, A.; Tsuchiya, H.; et al. 3D-Stacked 1Megapixel Time-Gated SPAD Image Sensor with 2D Interactive Gating Network for Image Alignment-Free Sensor Fusion. In Proceedings of the 2024 IEEE Symposium on VLSI Technology and Circuits (VLSI Technology and Circuits), Honolulu, HI, USA, 16–20 June 2024; pp. 1–2. [Google Scholar]
- Erdogan, A.T.; Abbas, T.A.; Finlayson, N.; Hopkinson, C.; Gyongy, I.; Almer, O.; Dutton, N.A.W.; Henderson, R.K. A High Dynamic Range 128 × 120 3-D Stacked CMOS SPAD Image Sensor SoC for Fluorescence Microendoscopy. IEEE J. Solid-State Circuits 2022, 57, 1649–1660. [Google Scholar] [CrossRef]
- Wayne, M.; Ulku, A.; Ardelean, A.; Mos, P.; Bruschini, C.; Charbon, E. A 500 × 500 Dual-Gate SPAD Imager With 100% Temporal Aperture and 1 ns Minimum Gate Length for FLIM and Phasor Imaging Applications. IEEE Trans. Electron Devices 2022, 69, 2865–2872. [Google Scholar] [CrossRef]
- Wayne, M.A.; Sie, E.J.; Ulku, A.C.; Mos, P.; Ardelean, A.; Marsili, F.; Bruschini, C.; Charbon, E. Massively Parallel, Real-Time Multispeckle Diffuse Correlation Spectroscopy Using a 500 × 500 SPAD Camera. Biomed. Opt. Express 2023, 14, 703–713. [Google Scholar] [CrossRef] [PubMed]
- Chida, K.; Morimoto, K.; Isoda, N.; Sekine, H.; Sasago, T.; Maehashi, Y.; Mikajiri, S.; Tojima, K.; Shinohara, M.; Abdelghafar, A.; et al. 3D-Stacked 1Megapixel Dual-Time-Gated Color SPAD Image Sensor with Simultaneous Dual Image Output Architecture for Efficient Sensor Fusion. In Proceedings of the 2025 International Image Sensor Workshop, Hyogo, Japan, 2–5 June 2025; p. R9.1. [Google Scholar]
- Morimoto, K. Charge-Focusing SPAD Image Sensors for Low Light Imaging Applications. In Proceedings of the 2020 International SPAD Sensor Workshop, Edinburgh, UK, 8–10 June 2020. [Google Scholar]
















| Bit Depth of Single Frame | Frame Rate | Dynamic Range | |
|---|---|---|---|
| Dual Recharge Mode | Single Recharge Mode | ||
| 10 bit | 20.54 fps | 100.4 dB (calculated from measured data) | 119.5 dB (calculated from measured data) |
| 11 bit | 10.27 fps | 106.2 dB | 125.3 dB |
| 12 bit | 5.14 fps | 112.2 dB | 131.3 dB |
| Perenzoni (2016) [11] | Gyongy (2018) [12] | Morimoto (2020) [10] | Wayne (2022) [15] | Morimoto (2024) [13] | This Work (Gate1/Gate2) | |
|---|---|---|---|---|---|---|
| Process technology | 350 nm HV CMOS | 130 nm CIS | 180 nm CMOS | 180 nm CMOS | 90 nm/55 nm 3D-BSI CMOS | 90 nm/55 nm 3D-BSI CMOS |
| Die size (mm × mm) | 3.42 × 3.55 | 5 × 5 | 11 × 11 | 9.6 × 9.7 | 6.3 × 10.9 | 6.3 × 14.8 |
| Sensor resolution | 160 × 120 | 256 × 256 | 1024 × 1000 | 500 × 500 | 1020 × 1020 | 1020 × 1020 |
| Pixel pitch (µm) | 15 | 16 | 9.4 | 16.38 | 5 | 5 |
| Exposure modes | GS | RS/GS | RS/GS | RS | Seamless GS | Seamless GS |
| Frame rate (fps) | 486 (5.4 bit) | 100,000 (1 bit) | 24,000 (1 bit) | 49,800 (1 bit × 2) | 1310 (4 bit) | 1314.7 (4 bit × 2) |
| Fill factor (%) | 21 | 61 | 7 | 10.5 | ~100 | ~100 |
| PDE at 940 nm (%) | N/A | N/A | <0.5 | N/A | 23 | 23 |
| Min. gate length (ns) | 0.75 | 4.0 | 3.8 | 1.0 | 1.85 | 1.60/1.70 |
| Gate length variation (ps) | 80.2 (std. dev.) 189 (FWHM) * | N/A | 120 (FWHM) | 70 (std. dev.) 165 (FWHM) * | 125 (FWHM) | 135/118 (FWHM) |
| Gate skew (ps) | N/A | N/A | 410 (FWHM) | 109.4 (FWHM) | 80 (FWHM) | 94/119 (FWHM) |
| Power consumption at saturation (mW) | N/A | N/A | 18,236 (per 1 Mpixel) | N/A | 505 | 1053 |
| Pixel output bit depth | 5.4 bit (analog) | 1 bit | 1 bit | 1 bit × 2 channels | 4 bit | 4 bit × 2 channels |
| Mono/Color | Monochrome | Monochrome | Monochrome | Monochrome | Monochrome | Color |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Chida, K.; Morimoto, K.; Isoda, N.; Sekine, H.; Sasago, T.; Maehashi, Y.; Mikajiri, S.; Tojima, K.; Shinohara, M.; Abdelghafar, A.T.; et al. Development of 3D-Stacked 1Megapixel Dual-Time-Gated SPAD Image Sensor with Simultaneous Dual Image Output Architecture for Efficient Sensor Fusion. Sensors 2025, 25, 6563. https://doi.org/10.3390/s25216563
Chida K, Morimoto K, Isoda N, Sekine H, Sasago T, Maehashi Y, Mikajiri S, Tojima K, Shinohara M, Abdelghafar AT, et al. Development of 3D-Stacked 1Megapixel Dual-Time-Gated SPAD Image Sensor with Simultaneous Dual Image Output Architecture for Efficient Sensor Fusion. Sensors. 2025; 25(21):6563. https://doi.org/10.3390/s25216563
Chicago/Turabian StyleChida, Kazuma, Kazuhiro Morimoto, Naoki Isoda, Hiroshi Sekine, Tomoya Sasago, Yu Maehashi, Satoru Mikajiri, Kenzo Tojima, Mahito Shinohara, Ayman T. Abdelghafar, and et al. 2025. "Development of 3D-Stacked 1Megapixel Dual-Time-Gated SPAD Image Sensor with Simultaneous Dual Image Output Architecture for Efficient Sensor Fusion" Sensors 25, no. 21: 6563. https://doi.org/10.3390/s25216563
APA StyleChida, K., Morimoto, K., Isoda, N., Sekine, H., Sasago, T., Maehashi, Y., Mikajiri, S., Tojima, K., Shinohara, M., Abdelghafar, A. T., Tsuchiya, H., Inoue, K., Omodani, S., Ehara, A., Iwata, J., Itano, T., Matsuno, Y., Sakurai, K., & Ichikawa, T. (2025). Development of 3D-Stacked 1Megapixel Dual-Time-Gated SPAD Image Sensor with Simultaneous Dual Image Output Architecture for Efficient Sensor Fusion. Sensors, 25(21), 6563. https://doi.org/10.3390/s25216563

