Next Article in Journal
Three-Dimensional Resource Allocation in D2D-Based V2V Communication
Previous Article in Journal
Design, Analysis, and Modeling of an Isolated Constant-Current to Constant-Voltage Converter in Cabled Underwater Information Networks
Open AccessArticle

Impact of Video Compression and Multimodal Embedding on Scene Description

School of Intelligent Mechatronics Engineering, Sejong University, Seoul 05006, Korea
Electronics 2019, 8(9), 963; https://doi.org/10.3390/electronics8090963
Received: 22 July 2019 / Revised: 21 August 2019 / Accepted: 28 August 2019 / Published: 30 August 2019
(This article belongs to the Section Computer Science & Engineering)
Scene description refers to the automatic generation of natural language descriptions from videos. In general, deep learning-based scene description networks utilize multimodalities, such as image, motion, audio, and label information, to improve the description quality. In particular, image information plays an important role in scene description. However, scene description has a potential issue, because it may handle images with severe compression artifacts. Hence, this paper analyzes the impact of video compression on scene description, and then proposes a simple network that is robust to compression artifacts. In addition, a network cascading more encoding layers for efficient multimodal embedding is also proposed. Experimental results show that the proposed network is more efficient than conventional networks. View Full-Text
Keywords: deep learning; video compression; multimodal embedding; scene description deep learning; video compression; multimodal embedding; scene description
Show Figures

Figure 1

MDPI and ACS Style

Lee, J.Y. Impact of Video Compression and Multimodal Embedding on Scene Description. Electronics 2019, 8, 963.

Show more citation formats Show less citations formats
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Back to TopTop