Next Article in Journal
A Survey to Assess the Quality of the Data Obtained by Radio-Frequency Technologies and Microelectromechanical Systems to Measure External Workload and Collective Behavior Variables in Team Sports
Next Article in Special Issue
Person Re-ID by Fusion of Video Silhouettes and Wearable Signals for Home Monitoring Applications
Previous Article in Journal
Free-Standing Complementary Asymmetric Metasurface for Terahertz Sensing Applications
Previous Article in Special Issue
Detection of Atrial Fibrillation Using 1D Convolutional Neural Network
Article

Foveation Pipeline for 360° Video-Based Telemedicine

Imaging Media Research Center, Korea Institute of Science and Technology (KIST), Seoul 02792, Korea
*
Author to whom correspondence should be addressed.
Division of Nano & Information Technology, KIST School, University of Science and Technology (UST), Seoul 02792, Korea.
Sensors 2020, 20(8), 2264; https://doi.org/10.3390/s20082264
Received: 10 February 2020 / Revised: 7 April 2020 / Accepted: 13 April 2020 / Published: 16 April 2020
(This article belongs to the Special Issue Multimodal Data Fusion and Machine-Learning for Healthcare)
Pan-tilt-zoom (PTZ) and omnidirectional cameras serve as a video-mediated communication interface for telemedicine. Most cases use either PTZ or omnidirectional cameras exclusively; even when used together, images from the two are shown separately on 2D displays. Conventional foveated imaging techniques may offer a solution for exploiting the benefits of both cameras, i.e., the high resolution of the PTZ camera and the wide field-of-view of the omnidirectional camera, but displaying the unified image on a 2D display would reduce the benefit of “omni-” directionality. In this paper, we introduce a foveated imaging pipeline designed to support virtual reality head-mounted displays (HMDs). The pipeline consists of two parallel processes: one for estimating parameters for the integration of the two images and another for rendering images in real time. A control mechanism for placing the foveal region (i.e., high-resolution area) in the scene and zooming is also proposed. Our evaluations showed that the proposed pipeline achieved, on average, 17 frames per second when rendering the foveated view on an HMD, and showed angular resolution improvement on the foveal region compared with the omnidirectional camera view. However, the improvement was less significant when the zoom level was 8× and more. We discuss possible improvement points and future research directions. View Full-Text
Keywords: HMD; telemedicine; foveation; multi-resolution HMD; telemedicine; foveation; multi-resolution
Show Figures

Figure 1

MDPI and ACS Style

Syawaludin, M.F.; Lee, M.; Hwang, J.-I. Foveation Pipeline for 360° Video-Based Telemedicine. Sensors 2020, 20, 2264. https://doi.org/10.3390/s20082264

AMA Style

Syawaludin MF, Lee M, Hwang J-I. Foveation Pipeline for 360° Video-Based Telemedicine. Sensors. 2020; 20(8):2264. https://doi.org/10.3390/s20082264

Chicago/Turabian Style

Syawaludin, Muhammad F., Myungho Lee, and Jae-In Hwang. 2020. "Foveation Pipeline for 360° Video-Based Telemedicine" Sensors 20, no. 8: 2264. https://doi.org/10.3390/s20082264

Find Other Styles
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Back to TopTop