Next Article in Journal
Correction: Park, J.-H. et al. 915-MHz Continuous-Wave Doppler Radar Sensor for Detection of Vital Signs. Electronics 2019, 8, 561
Previous Article in Journal
Design of a Novel Double Negative Metamaterial Absorber Atom for Ku and K Band Applications
Open AccessArticle

Practical Evaluation of VMAF Perceptual Video Quality for WebRTC Applications

1
Theory on Signal and Communication and Telematic Systems and Computing, Universidad Rey Juan Carlos, 28943 Fuenlabrada, Spain
2
Computing Science, Computer Architecture, Programming Languages and Systems and Statistics and Operative Investigation, Universidad Rey Juan Carlos, 28933 Móstoles, Spain
*
Author to whom correspondence should be addressed.
Electronics 2019, 8(8), 854; https://doi.org/10.3390/electronics8080854
Received: 1 July 2019 / Revised: 18 July 2019 / Accepted: 30 July 2019 / Published: 31 July 2019
(This article belongs to the Section Computer Science & Engineering)
WebRTC is the umbrella term for several emergent technologies aimed to exchange real-time media in the Web. Like other media-related services, the perceived quality of WebRTC communication can be measured using Quality of Experience (QoE) indicators. QoE assessment methods can be classified as subjective (users’ evaluation scores) or objective (models computed as a function of different parameters). In this paper, we focus on VMAF (Video Multi-method Assessment Fusion), which is an emergent full-reference objective video quality assessment model developed by Netflix. VMAF is typically used to assess video streaming services. This paper evaluates the use of VMAF in a different type of application: WebRTC. To that aim, we present a practical use case built on the top of well-known open source technologies, such as JUnit, Selenium, Docker, and FFmpeg. In addition to VMAF, we also calculate other objective QoE video metrics such as Visual Information Fidelity in the pixel domain (VIFp), Structural Similarity (SSIM), or Peak Signal-to-Noise Ratio (PSNR) applied to a WebRTC communication in different network conditions in terms of packet loss. Finally, we compare these objective results with a subjective evaluation using a Mean Opinion Score (MOS) scale to the same WebRTC streams. As a result, we found a strong correlation of the subjective video quality perceived in WebRTC video calls with the objective results computed with VMAF and VIFp in comparison with SSIM and PSNR and their variants. View Full-Text
Keywords: QoE; WebRTC; VMAF; video quality QoE; WebRTC; VMAF; video quality
Show Figures

Figure 1

MDPI and ACS Style

García, B.; López-Fernández, L.; Gortázar, F.; Gallego, M. Practical Evaluation of VMAF Perceptual Video Quality for WebRTC Applications. Electronics 2019, 8, 854.

Show more citation formats Show less citations formats
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map

1
Back to TopTop