Next Article in Journal
A Survey to Assess the Quality of the Data Obtained by Radio-Frequency Technologies and Microelectromechanical Systems to Measure External Workload and Collective Behavior Variables in Team Sports
Next Article in Special Issue
Person Re-ID by Fusion of Video Silhouettes and Wearable Signals for Home Monitoring Applications
Previous Article in Journal
Free-Standing Complementary Asymmetric Metasurface for Terahertz Sensing Applications
Previous Article in Special Issue
Detection of Atrial Fibrillation Using 1D Convolutional Neural Network

Foveation Pipeline for 360° Video-Based Telemedicine

Imaging Media Research Center, Korea Institute of Science and Technology (KIST), Seoul 02792, Korea
Author to whom correspondence should be addressed.
Division of Nano & Information Technology, KIST School, University of Science and Technology (UST), Seoul 02792, Korea.
Sensors 2020, 20(8), 2264;
Received: 10 February 2020 / Revised: 7 April 2020 / Accepted: 13 April 2020 / Published: 16 April 2020
(This article belongs to the Special Issue Multimodal Data Fusion and Machine-Learning for Healthcare)
Pan-tilt-zoom (PTZ) and omnidirectional cameras serve as a video-mediated communication interface for telemedicine. Most cases use either PTZ or omnidirectional cameras exclusively; even when used together, images from the two are shown separately on 2D displays. Conventional foveated imaging techniques may offer a solution for exploiting the benefits of both cameras, i.e., the high resolution of the PTZ camera and the wide field-of-view of the omnidirectional camera, but displaying the unified image on a 2D display would reduce the benefit of “omni-” directionality. In this paper, we introduce a foveated imaging pipeline designed to support virtual reality head-mounted displays (HMDs). The pipeline consists of two parallel processes: one for estimating parameters for the integration of the two images and another for rendering images in real time. A control mechanism for placing the foveal region (i.e., high-resolution area) in the scene and zooming is also proposed. Our evaluations showed that the proposed pipeline achieved, on average, 17 frames per second when rendering the foveated view on an HMD, and showed angular resolution improvement on the foveal region compared with the omnidirectional camera view. However, the improvement was less significant when the zoom level was 8× and more. We discuss possible improvement points and future research directions. View Full-Text
Keywords: HMD; telemedicine; foveation; multi-resolution HMD; telemedicine; foveation; multi-resolution
Show Figures

Figure 1

MDPI and ACS Style

Syawaludin, M.F.; Lee, M.; Hwang, J.-I. Foveation Pipeline for 360° Video-Based Telemedicine. Sensors 2020, 20, 2264.

AMA Style

Syawaludin MF, Lee M, Hwang J-I. Foveation Pipeline for 360° Video-Based Telemedicine. Sensors. 2020; 20(8):2264.

Chicago/Turabian Style

Syawaludin, Muhammad Firdaus, Myungho Lee, and Jae-In Hwang. 2020. "Foveation Pipeline for 360° Video-Based Telemedicine" Sensors 20, no. 8: 2264.

Find Other Styles
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

Back to TopTop