- freely available
Sensors 2012, 12(6), 6920-6929; doi:10.3390/s120606920
Published: 25 May 2012
Abstract: We demonstrate an ultrafast displaying Spectral Domain Optical Doppler Tomography system using Graphics Processing Unit (GPU) computing. The calculation of FFT and the Doppler frequency shift is accelerated by the GPU. Our system can display processed OCT and ODT images simultaneously in real time at 120 fps for 1,024 pixels × 512 lateral A-scans. The computing time for the Doppler information was dependent on the size of the moving average window, but with a window size of 32 pixels the ODT computation time is only 8.3 ms, which is comparable to the data acquisition time. Also the phase noise decreases significantly with the window size. Since the performance of a real-time display for OCT/ODT is very important for clinical applications that need immediate diagnosis for screening or biopsy. Intraoperative surgery can take much benefit from the real-time display flow rate information from the technology. Moreover, the GPU is an attractive tool for clinical and commercial systems for functional OCT features as well.
Optical Coherence Tomography (OCT) has been widely accepted as a non-invasive high resolution imaging modality for in vivo biological specimens . After the emergence of spectral domain OCT (SD-OCT) and swept source OCT (SSOCT), the real time imaging and displaying feature has become one of the major competing categories [2–4]. Real time displaying feature is another key parameter to deliver the OCT technology to clinical and industrial fields because dynamic changes of the targets are often screened by human vision. Current real-time video-rate display is commonly limited to displaying OCT intensity images. Phase information related to flowing objects requires a significant post-processing effort, and also most flow dynamics require high speed acquisition to trigger certain interesting events. The need for real-time display of Doppler frequency shift images is urgently required for monitoring flow samples, but such a feature has not been reported yet.
Recent commercialization for massive parallel processing units provides an easily adaptable solution to this problem. Recently developed Graphics Processing Units (GPUs) enable very fast processing of OCT signals, but also can execute parallel, general purpose numerical solutions surpassing the use of CPUs. Several years ago NVIDIA Corporation presented a parallel computing architecture named Compute Unified Device Architecture (CUDA) commonly adapted in computer games for more natural presentation of sceneries. Use of GPUs in the OCT research field for fast display of intensity images has been reported several times [5–8]. In this paper, we report a novel ultra-fast displaying Spectral Domain Optical Doppler Tomography (SD-ODT) by use of CUDA processes for real-time display of OCT intensity and Doppler images simultaneously at a frame rate of 120 fps for a 2,048 × 512 pixel image size.
2. System Configuration and Signal Processing Architecture
The schematic diagram of the developed SD-OCT system is shown at Figure 1. A 12-bit CMOS line scanning camera (Sprint spL2048-140 k, Basler AG) with 70,000 line/s effective line rate at 2,048 pixel mode was used as the detector of the SD-OCT system. The transmission type diffraction grating (Spatial Frequency 1,800 lpmm, Nominal AOI/AOD 46.05 Degrees, Wasatch Photonics) was adapted to enhance light efficiency in the detection path. Combined with a superluminescence diode (SLED) (λ0 = 850 nm, Δλ = 55 nm, Exalos AG) as a light source, a fiber-based interferometer was implemented. The light source was split into sample and reference arms with the latter terminated by a stationary mirror. A probe at the end of the sample arm delivered light to a sample and collected back-scattered light from different depths in the sample. B-mode scanning was performed using a galvanometer scanning mirror (GVS002, Thorlabs) at the back focal plane of the objective lens at the sample arm. The developed system with the axial and lateral resolutions of 4 μm and about 12 μm, respectively. The measured depth range was 4 mm.
A scattering particle filled capillary tube with a 750 μm diameter was used to demonstrate the flow rate imaging feature. A syringe pump (Harvard Apparatus, accuracy ±0.5%, flow rate maximum 7.909 mL/mm, flow rate minimum 0.0014 μL/h) provided changes of the flow rate in the tube. The detected OCT signals were transferred to a host memory in the PC (Personal Computer) mounted with six CPUs (Core i7 980X Hexa cores, 3.33 GHz Clock rate, Intel) through a frame grabber (PCIe-1433, 850 MB/s Bandwidth, National Instruments, USA). The galvanometer scanning mirror was driven by the PC with a data acquisition board (PCIe-6321, National Instruments). The PC also contained a graphics card (Geforce GTX480, 700 MHz Clock rate, 480 CUDA processor, NVIDIA).
In order to apply the GPU technology to both OCT and ODT signal processing, an optimum combination of CPU and GPU is designed. Two separate buffers are allocated in the host memory of CPU and they are assigned as CPU thread one. These buffers are mainly dedicated for temporal data storage right after data acquisition. Due to the limited data transfer channel between CPU and GPU careful data handling was necessary to minimize any bottleneck events during the data transfer. We report a significant decrease in the processing time when we host memory to allocate the acquired data. The conventional method utilizing the memory in the frame grabber measures 16 ms processing for 2,048 × 512 pixel data size compared to 8.3 ms of the proposed two-separate buffer method. As a device memory in the GPU, the signal processing job is divided into 480 CUDA processors.
Figure 2 displays the data flow chart for the system including the flow of data path, thread events, and the buffer ring. First the data acquisition thread stored incoming two dimensional signals into the first buffer allocated in the host memory and called a signal processing thread. Later, the self-iterated acquisition thread continuously transferred the incoming signals to the second buffer without any temporal delay between the acquisition events. The signal processing thread copied the frame data stored in the buffers of the host memory through the PCI express x16 2.0 interface into the device memory. Later, the processing divided 480 CUDA sub-processors to process further signal processing for OCT and ODT. K-domain linearization was completed using the full-range k-domain linearization . The reconstructed OCT and ODT image were transferred back to the host memory to be displayed.
3. Doppler Frequency Shift
The interference fringe pattern can include structural and phase information. After Fourier transformation of the complex signal I + jQ, the structural OCT image was calculated from Equation (1) [10,11]. The phase information was extracted from real and imaginary values and the Doppler frequency shift was calculated from Equation (2) [10–12]:where fa is the sampling rate, and I and Q represent in-phase and quadrature phase information in the interference signal. M and N are the moving average window size for axial and lateral directions, respectively, whereas m and n is the data position in the window. Calculation of the kasai autocorrelation algorithm [13,14] was divided to two different steps for GPU processing as shown in Figure 3. Firstly, <X> and <Y> are calculated by Equation (3). All the OCT data is processed by parallel processing, because GPU computing is specialized for highly parallel computation. The moving average calculation can be processed after the Equation (3) is complete:
Then M × N window averaging and fD was evaluated using Equation (4) after cropping phase noise below a predefined threshold:
4. ODT Data Processing
The moving average calculation is still the most computation intensive procedure in the CUDA processing and the calculation time is linearly proportional to the window size. The effect of the moving average window size to the frame rate was examined by measuring the OCT and ODT processing time at different window sizes as shown in Figure 4. The time interval between frames for a 2,048 × 512 pixel sized data took 8.3 ms in the developed system. The frame interval time is determined by other processing threads than the moving average calculation when the window size is below 32 pixels. Figure 5 shows the processing time variation according to the change of the lateral scan size when the window size was 32 pixels.
The resultant ODT images are shown at Figure 6 after B-mode scanning of the flowing particle filled tube at different averaging window sizes. ODT calculation results using CUDA also confirm that the window size is inversely proportional the phase noise as previously reported in the conventional ODT technique. The velocity variance each was calculated by using the four-quadrant arctan method and displayed color coded .
5. Results and ODT Imaging
Figure 7 shows ODT images of a capillary tube with flowing particles at different flow rates. The average window size was 12 × 20 pixels in the axial and lateral direction, respectively. The ODT displaying frame rate was 120 fps for the image size of 1,024 × 512 pixels. The central velocity variance profiles at each flow rate (Figure 7) are calculated at Figure 8.
Figure 9 shows the captured movie of experiment for OCT and ODT images of flowing particles in a capillary tube. The movie contains a scattering flow channel with different flow velocities from 0 to 120 mm/s with increase of 20 mm/s. The frame rate was calculated by averaging the total processing time for 500 frame displays including acquisition and display time. The average frame rate was 120 fps for simultaneous display OCT and ODT images.
6. Discussion and Conclusions
We demonstrate an ultrafast displaying SD-ODT using GPU computing. The calculation of FFT and Doppler frequency shift is accelerated by the GPU. The computing time for the Doppler information was dependent on the size of the moving average window, but for a window size of 32 pixels the ODT computing time is 8.3 ms, which is comparable with the data acquisition thread time. The phase noise also decreases significantly with size. Our system can display processed OCT and ODT images simultaneously in real time at 120 fps for 1,024 pixels × 512 lateral A-scans. Since the performance of a real-time display for OCT/ODT is very important for clinical applications that need immediate diagnosis for screening or biopsy, intraoperative surgery can benefit greatly from the real-time display flow rate information possible with this technology. Moreover, the GPU is an attractive tool for clinical and commercial systems for its functional OCT features as well.
This work was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea government (MEST) (No. 2010-0014461), DAEGU Metropolitan City R&D Project, Ministry of Health & Welfare, Republic of Korea through the Korea Healthcare technology R&D Project (No. A102024-1011-0000200), the Ministry of Knowledge Economy (MKE), Korea Institute for Advancement of Technology (KIAT) and DAEGU Leading Industry Office through the Leading Industry Development for Economic Region (No. 2010-T-2-A-Y0-C-15) and the National Research Foundation of Korea (No. 2011-0006286).
- Bouma, B.E.; Tearney, G.J. Handbook of Optical Coherence Tomography; Marcel Dekker: New York, NY, USA, 2002; p. 741.
- Potsaid, B.; Gorczynska, I.; Srinivasan, V.J.; Chen, Y.L.; Jiang, J.; Cable, A.; Fujimoto, J.G. Ultrahigh speed Spectral/Fourier domain OCT ophthalmic imaging at 70,000 to 312,500 axial scans per second. Opt. Express 2008, 16, 15149–15169, doi:10.1364/OE.16.015149. 18795054
- Oh, W.Y.; Vakoc, B.J.; Shishkov, M.; Tearney, G.J.; Bouma, B.E. >400 kHz repetition rate wavelength-swept laser and application to high-speed optical frequency domain imaging. Opt. Lett. 2010, 35, 2919–2921, doi:10.1364/OL.35.002919. 20808369
- Kim, J.; Oh, J.; Milner, T.E.; Nelson, J.S. Hemoglobin contrast in magnetomotive optical Doppler tomography. Opt. Lett. 2006, 31, 778–780, doi:10.1364/OL.31.000778. 16544621
- Watanabe, Y.; Itagaki, T. Real-time display on Fourier domain optical coherence tomography system using a graphics processing unit. J. Biomed. Opt. 2009, 14, doi:10.1117/1.JBO.17.5.050503..
- Zhang, K.; Kang, J.U. Real-time 4D signal processing and visualization using graphics processing unit on a regular nonlinear-k Fourier-domain OCT system. Opt. Express 2010, 18, 11772–11784, doi:10.1364/OE.18.011772. 20589038
- Zhang, K.; Kang, J.U. Real-time intraoperative 4D full-range FD-OCT based on the dual graphics processing units architecture for microsurgery guidance. Biomed. Opt. Express 2011, 2, 764–770, doi:10.1364/BOE.2.000764. 21483601
- Watanabe, Y.; Maeno, S.; Aoshima, K.; Hasegawa, H.; Koseki, H. Real-time processing for full-range fourier-domain optical-coherence tomography with zero-filling interpolation using multiple graphic processing units. Appl. Opt. 2010, 49, 4756–4762, doi:10.1364/AO.49.004756. 20820218
- Jeon, M.; Kim, J.; Jung, U.; Lee, C.; Jung, W.; Boppart, S.A. Full-range k-domain linearization in spectral-domain optical coherence tomography. Appl. Opt. 2011, 50, 1158–1163, doi:10.1364/AO.50.001158. 21394187
- Mariampillai, A.; Standish, B.A.; Munce, N.R.; Randall, C.; Liu, G.; Jiang, J.Y.; Cable, A.E.; Vitkin, I.A.; Yang, V.X.D. Doppler optical cardiogram gated 2D color flow imaging at 1,000 fps and 4D in vivo visualization of embryonic heart at 45 fps on a swept source OCT system. Opt. Express 2007, 15, 1627–1638, doi:10.1364/OE.15.001627. 19532397
- Yang, V.X.D.; Gordon, M.L.; Mok, A.; Zhao, Y.H.; Chen, Z.P.; Cobbold, R.S.C.; Wilson, B.C.; Vitkin, I.A. Improved phase-resolved optical Doppler tomography using the kasai velocity estimator and histogram segmentation. Opt. Commun. 2002, 208, 209–214, doi:10.1016/S0030-4018(02)01501-8.
- Yang, V.X.D.; Gordon, M.L.; Qi, B.; Pekar, J.; Lo, S.; Seng-Yue, E.; Mok, A.; Wilson, B.C.; Vitkin, I.A. High speed, wide velocity dynamic range Doppler optical coherence tomography (Part I): System design, signal processing, and performance. Opt. Express 2003, 11, 794–809, doi:10.1364/OE.11.000794. 19461792
- Makita, S.; Fabritius, T.; Yasuno, Y. Quantitative retinal-blood flow measurement with three-dimensional vessel geometry determination using ultrahigh-resolution Doppler optical coherence angiography. Opt. Lett. 2008, 33, 836–838, doi:10.1364/OL.33.000836. 18414549
- Ahn, Y.C.; Jung, W.; Chen, Z.P. Quantification of a three-dimensional velocity vector using spectral-domain Doppler optical coherence tomography. Opt. Lett. 2007, 32, 1587–1589, doi:10.1364/OL.32.001587. 17546197
© 2012 by the authors; licensee MDPI, Basel, Switzerland This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution license (http://creativecommons.org/licenses/by/3.0/).