Next Article in Journal
Rail Pad Corrosion Effects on the Dynamic Behavior of Direct Fixation Track Systems in Marine Environments
Next Article in Special Issue
ALCC-Glasses: Arriving Light Chroma Controllable Optical See-Through Head-Mounted Display System for Color Vision Deficiency Compensation
Previous Article in Journal
Thermal and Mechanical Properties of Cement Mortar Composite Containing Recycled Expanded Glass Aggregate and Nano Titanium Dioxide
Previous Article in Special Issue
Comparative Performance Characterization of Mobile AR Frameworks in the Context of AR-Based Grocery Shopping Applications
Open AccessArticle

Real-Time Application for Generating Multiple Experiences from 360° Panoramic Video by Tracking Arbitrary Objects and Viewer’s Orientations

Department of Software Convergence, Sejong University, 209 Neungdong-ro, Gwangjin-gu, Seoul 05006, Korea
*
Author to whom correspondence should be addressed.
Appl. Sci. 2020, 10(7), 2248; https://doi.org/10.3390/app10072248
Received: 24 February 2020 / Revised: 13 March 2020 / Accepted: 18 March 2020 / Published: 26 March 2020
(This article belongs to the Special Issue Applications of Virtual, Augmented, and Mixed Reality)
We propose a novel authoring and viewing system for generating multiple experiences with a single 360° video and efficiently transferring these experiences to the user. An immersive video contains much more interesting information within the 360° environment than normal videos. There can be multiple interesting areas within a 360° frame at the same time. Due to the narrow field of view in virtual reality head-mounted displays, a user can only view a limited area of a 360° video. Hence, our system is aimed at generating multiple experiences based on interesting information in different regions of a 360° video and efficient transferring of these experiences to prospective users. The proposed system generates experiences by using two approaches: (1) Recording of the user’s experience when the user watches a panoramic video using a virtual reality head-mounted display, and (2) tracking of an arbitrary interesting object in a 360° video selected by the user. For tracking of an arbitrary interesting object, we have developed a pipeline around an existing simple object tracker to adapt it for 360° videos. This tracking algorithm was performed in real time on a CPU with high precision. Moreover, to the best of our knowledge, there is no such existing system that can generate a variety of different experiences from a single 360° video and enable the viewer to watch one 360° visual content from various interesting perspectives in immersive virtual reality. Furthermore, we have provided an adaptive focus assistance technique for efficient transferring of the generated experiences to other users in virtual reality. In this study, technical evaluation of the system along with a detailed user study has been performed to assess the system’s application. Findings from evaluation of the system showed that a single 360° multimedia content has the capability of generating multiple experiences and transfers among users. Moreover, sharing of the 360° experiences enabled viewers to watch multiple interesting contents with less effort. View Full-Text
Keywords: authoring system; 360° video experiences; object tracking; virtual reality; experience transfer; focus assistance; visualization; human–computer interaction (HCI) authoring system; 360° video experiences; object tracking; virtual reality; experience transfer; focus assistance; visualization; human–computer interaction (HCI)
Show Figures

Graphical abstract

MDPI and ACS Style

Shah, S.H.H.; Han, K.; Lee, J.W. Real-Time Application for Generating Multiple Experiences from 360° Panoramic Video by Tracking Arbitrary Objects and Viewer’s Orientations. Appl. Sci. 2020, 10, 2248.

Show more citation formats Show less citations formats
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Back to TopTop