Next Article in Journal
LocPass: A Graphical Password Method to Prevent Shoulder-Surfing
Previous Article in Journal
Investigation on Surface Properties of Mn-Doped CdSe Quantum Dots Studied by X-ray Photoelectron Spectroscopy
Open AccessArticle

A Fast 4K Video Frame Interpolation Using a Multi-Scale Optical Flow Reconstruction Network

1
Department of Electronic Engineering, Kwangnwoon University, Seoul 01897, Korea
2
Korea Electronics Technology Institute, Sungnam 13509, Korea
*
Author to whom correspondence should be addressed.
Symmetry 2019, 11(10), 1251; https://doi.org/10.3390/sym11101251
Received: 30 August 2019 / Revised: 21 September 2019 / Accepted: 1 October 2019 / Published: 7 October 2019
Recently, video frame interpolation research developed with a convolutional neural network has shown remarkable results. However, these methods demand huge amounts of memory and run time for high-resolution videos, and are unable to process a 4K frame in a single pass. In this paper, we propose a fast 4K video frame interpolation method, based upon a multi-scale optical flow reconstruction scheme. The proposed method predicts low resolution bi-directional optical flow, and reconstructs it into high resolution. We also proposed consistency and multi-scale smoothness loss to enhance the quality of the predicted optical flow. Furthermore, we use adversarial loss to make the interpolated frame more seamless and natural. We demonstrated that the proposed method outperforms the existing state-of-the-art methods in quantitative evaluation, while it runs up to 4.39× faster than those methods for 4K videos. View Full-Text
Keywords: video processing; frame interpolation; high-resolution image processing; coarse-to-fine optical flow; 4K image video processing; frame interpolation; high-resolution image processing; coarse-to-fine optical flow; 4K image
Show Figures

Figure 1

MDPI and ACS Style

Ahn, H.-E.; Jeong, J.; Kim, J.W.; Kwon, S.; Yoo, J. A Fast 4K Video Frame Interpolation Using a Multi-Scale Optical Flow Reconstruction Network. Symmetry 2019, 11, 1251.

Show more citation formats Show less citations formats
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Back to TopTop