Next Article in Journal
Real-Time System for Driver Fatigue Detection Based on a Recurrent Neuronal Network
Previous Article in Journal
Lung Nodule Detection in CT Images Using Statistical and Shape-Based Features
Previous Article in Special Issue
Multivariate Statistical Approach to Image Quality Tasks
 
 
Article

Study of Subjective Data Integrity for Image Quality Data Sets with Consumer Camera Content

1
AGH University of Science and Technology, MP 30059 Kraków, Poland
2
Institute for Telecommunication Sciences, National Telecommunications and Information Administration, Boulder, CO 80305, USA
*
Author to whom correspondence should be addressed.
J. Imaging 2020, 6(3), 7; https://doi.org/10.3390/jimaging6030007
Received: 22 January 2020 / Accepted: 12 February 2020 / Published: 25 February 2020
(This article belongs to the Special Issue Image Quality)
We need data sets of images and subjective scores to develop robust no reference (or blind) visual quality metrics for consumer applications. These applications have many uncontrolled variables because the camera creates the original media and the impairment simultaneously. We do not fully understand how this impacts the integrity of our subjective data. We put forward two new data sets of images from consumer cameras. The first data set, CCRIQ2, uses a strict experiment design, more suitable for camera performance evaluation. The second data set, VIME1, uses a loose experiment design that resembles the behavior of consumer photographers. We gather subjective scores through a subjective experiment with 24 participants using the Absolute Category Rating method. We make these two new data sets available royalty-free on the Consumer Digital Video Library. We also present their integrity analysis (proposing one new approach) and explore the possibility of combining CCRIQ2 with its legacy counterpart. We conclude that the loose experiment design yields unreliable data, despite adhering to international recommendations. This suggests that the classical subjective study design may not be suitable for studies using consumer content. Finally, we show that Hoßfeld–Schatz–Egger α failed to detect important differences between the two data sets. View Full-Text
Keywords: image quality; data integrity; consumer camera; blind quality assessment; evaluation; subjective data; no reference; NR metrics; subjective study image quality; data integrity; consumer camera; blind quality assessment; evaluation; subjective data; no reference; NR metrics; subjective study
Show Figures

Figure 1

MDPI and ACS Style

Nawała, J.; Pinson, M.H.; Leszczuk, M.; Janowski, L. Study of Subjective Data Integrity for Image Quality Data Sets with Consumer Camera Content. J. Imaging 2020, 6, 7. https://doi.org/10.3390/jimaging6030007

AMA Style

Nawała J, Pinson MH, Leszczuk M, Janowski L. Study of Subjective Data Integrity for Image Quality Data Sets with Consumer Camera Content. Journal of Imaging. 2020; 6(3):7. https://doi.org/10.3390/jimaging6030007

Chicago/Turabian Style

Nawała, Jakub, Margaret H. Pinson, Mikołaj Leszczuk, and Lucjan Janowski. 2020. "Study of Subjective Data Integrity for Image Quality Data Sets with Consumer Camera Content" Journal of Imaging 6, no. 3: 7. https://doi.org/10.3390/jimaging6030007

Find Other Styles
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Back to TopTop