Human Affective Behavior for Quality of Experience Estimation

A special issue of Electronics (ISSN 2079-9292). This special issue belongs to the section "Computer Science & Engineering".

Deadline for manuscript submissions: closed (1 May 2023) | Viewed by 4338

Special Issue Editors


E-Mail Website
Guest Editor
National Inter-University Consortium for Telecommunications (CNIT), University of Cagliari, 09123 Cagliari, Italy
Interests: quality of experience; multimedia; affective computing; internet of things; smart cities
Special Issues, Collections and Topics in MDPI journals

E-Mail Website
Guest Editor
Department of Electrical and Electronic Engineering (DIEE), University of Cagliari, 09123 Cagliari, Italy
Interests: artificial intelligence; machine learning; quality of experience; affective computing; smart cities

E-Mail Website
Guest Editor
Department of Computer Science, Cardiff School of Technologies (CST), Cardiff Metropolitan University, Cardiff CF5 2YB, UK
Interests: QoE; multimedia communication; 5G/6G; network management; SDN/NFV; AI/ML
Special Issues, Collections and Topics in MDPI journals

Special Issue Information

Dear Colleagues,

We invite submissions to a Special Issue of Electronics on the subject of “Human Affective Behavior for Quality of Experience Estimation”. The Quality of Experience (QoE) reflects the subjective quality perceived by the users and it has become vital for the successful deployment of multimedia services and applications. Although the collection of users’ subjective perceived quality and feedback is crucial to identify the root causes of quality degradation, the common utilization of interviews and self-report techniques may be subject to biases from factors not related to the stimulus, such as the interviewer’s reaction to the questions, the way the questions are formulated, and the laboratory context.

For these reasons, alternative approaches to QoE estimation can be considered, including human affective behaviors, which are driven by the human emotions naturally revealed during the user–system interaction. These emotions can be automatically inferred by analyzing human facial expressions, speech, and body gestures, and can be used to estimate the user’s perceived QoE automatically and unobtrusively without the user’s feedback. Therefore, the latest innovations in the artificial intelligence (AI) field may be relevant in terms of feature extraction and manipulation, data selection, and the creation of models and neural networks for QoE estimation.

This Special Issue includes papers that either discuss new engineering and science or review the existing literature. Potential topics include but are not limited to:

  • Relationship between human affective behavior and QoE;
  • Subjective studies investigating human affective behavior and QoE for multimedia services;
  • Algorithms and features for the recognition of human affective behavior from face, speech, and body gestures;
  • Analysis of spoken language for speech emotion recognition (SER);
  • Analysis of prosody and voice quality of affective speech;
  • Analysis of face for facial expression recognition (FER);
  • Analysis of gestures for emotional body gesture recognition;
  • Machine-learning-based QoE estimation models based on features extracted from face, speech, and/or body gestures;
  • AI-driven QoE estimation of emerging multimedia services;
  • Methods for the multi-modal recognition of human affective behavior;
  • Human–computer Interaction systems with emotional intelligence;
  • Methods to manage and optimize the QoE based on the monitored human affective behavior;
  • Application of affective computing on multimedia services and QoE estimation;
  • Datasets for the emotional analysis of human behavior.

Dr. Alessandro Floris
Dr. Simone Porcu
Dr. Arslan Ahmad
Guest Editors

Manuscript Submission Information

Manuscripts should be submitted online at www.mdpi.com by registering and logging in to this website. Once you are registered, click here to go to the submission form. Manuscripts can be submitted until the deadline. All submissions that pass pre-check are peer-reviewed. Accepted papers will be published continuously in the journal (as soon as accepted) and will be listed together on the special issue website. Research articles, review articles as well as short communications are invited. For planned papers, a title and short abstract (about 100 words) can be sent to the Editorial Office for announcement on this website.

Submitted manuscripts should not have been published previously, nor be under consideration for publication elsewhere (except conference proceedings papers). All manuscripts are thoroughly refereed through a single-blind peer-review process. A guide for authors and other relevant information for submission of manuscripts is available on the Instructions for Authors page. Electronics is an international peer-reviewed open access semimonthly journal published by MDPI.

Please visit the Instructions for Authors page before submitting a manuscript. The Article Processing Charge (APC) for publication in this open access journal is 2400 CHF (Swiss Francs). Submitted papers should be well formatted and use good English. Authors may use MDPI's English editing service prior to publication or during author revisions.

Keywords

  • quality of experience
  • human affective behavior
  • affective computing
  • facial emotion recognition
  • speech emotion recognition
  • emotional body gesture recognition
  • artificial intelligence
  • machine learning
  • QoE estimation models

Published Papers (2 papers)

Order results
Result details
Select all
Export citation of selected articles as:

Research

9 pages, 747 KiB  
Article
Effects of Approach–Avoidance Swiping Interactions on the Valence Estimation Using Tablet AAT
by Xinyan Wang, Yen Hsu and Rui Xu
Electronics 2022, 11(24), 4098; https://doi.org/10.3390/electronics11244098 - 09 Dec 2022
Viewed by 906
Abstract
Bodily activity may influence subjects’ cognitive processing against embodied cognition. Approaching positive objects and avoiding negative ones facilitate the cognitive processing of emotional information by enhancing valence estimation. The effect may be termed the “Approaching positive and Avoiding negative Compatibility Effect (AACE)”. Implicit [...] Read more.
Bodily activity may influence subjects’ cognitive processing against embodied cognition. Approaching positive objects and avoiding negative ones facilitate the cognitive processing of emotional information by enhancing valence estimation. The effect may be termed the “Approaching positive and Avoiding negative Compatibility Effect (AACE)”. Implicit approach–avoidance behavior towards stimuli can be measured using the Approach–Avoidance Task (AAT). We recently expanded a touchscreen tablet AAT which seems a more flexible tool for measuring approach–avoidance effects on the valence estimation. In addition, the impact of emotional information on physical behavior might vary depending on the level of arousal. Therefore, we here integrated affective arousal with the AACE to investigate the change of valence estimations of emotional pictures with different (high/low) arousal levels before and after swiping them (toward/away) directly by hand on a touchscreen tablet. Eighty participants evaluated the valence of 40 emotional pictures from the International Affective Picture System (IAPS) twice, first after watching them and second after swiping them, either toward or away from their bodies. As hypothesized, the results are consistent with the AACE, that is, swiping positive pictures toward the body or swiping negative ones away on the touchscreen tablet directly by hand led to a positive change in their valence estimation. Additionally, the change of the valence estimation was significantly enlarged when approaching emotional pictures with higher affective arousal. However, this higher arousal effect was not found when swiping pictures away. We argue that the effect of affective arousal and valence on approach–avoidance behavior seems to be separated. The approaching movement (toward) was more susceptible to the higher arousal of the stimuli, while the avoidance movement (away) was more sensitive to the valence. Furthermore, the touchscreen tablet AAT seems efficient and can reliably measure known approach–avoidance behavior toward cognitive processing testing both in the laboratory and in the field. Full article
(This article belongs to the Special Issue Human Affective Behavior for Quality of Experience Estimation)
Show Figures

Figure 1

12 pages, 678 KiB  
Article
Comparing the Robustness of Humans and Deep Neural Networks on Facial Expression Recognition
by Lucie Lévêque, François Villoteau, Emmanuel V. B. Sampaio, Matthieu Perreira Da Silva and Patrick Le Callet
Electronics 2022, 11(23), 4030; https://doi.org/10.3390/electronics11234030 - 05 Dec 2022
Cited by 4 | Viewed by 2068
Abstract
Emotion recognition, and more particularly facial expression recognition (FER), has been extensively used for various applications (e.g., human–computer interactions). The ability to automatically recognize facial expressions has been facilitated with recent progress in the fields of computer vision and artificial intelligence. Nonetheless, FER [...] Read more.
Emotion recognition, and more particularly facial expression recognition (FER), has been extensively used for various applications (e.g., human–computer interactions). The ability to automatically recognize facial expressions has been facilitated with recent progress in the fields of computer vision and artificial intelligence. Nonetheless, FER algorithms still seem to face difficulties with image degradations due to real-life conditions (e.g., because of image compression or transmission). In this paper, we propose to investigate the impact of different distortion configurations on a large number of images of faces on human performance, thanks to the conduct of a crowdsourcing experiment. We further compare human performance with two open-source FER algorithms. Results show that, overall, models are more sensitive to distortions than humans—even when fine-tuned. Furthermore, we broach the subject of annotation errors and bias which exist in several well-established datasets, and suggest approaches to improve the latter. Full article
(This article belongs to the Special Issue Human Affective Behavior for Quality of Experience Estimation)
Show Figures

Figure 1

Back to TopTop