Multimodal Pattern Recognition of Social Signals in HCI (2nd Edition)

A special issue of Computers (ISSN 2073-431X). This special issue belongs to the section "AI-Driven Innovations".

Deadline for manuscript submissions: 31 October 2025 | Viewed by 1544

Special Issue Editors


E-Mail Website
Guest Editor
Department of Computer Science, University of Arkansas at Little Rock, Little Rock, AR 72204, USA
Interests: computer vision; human computer interaction; AI; machine learning; evolutionary computation; augmented reality; computer graphics
Special Issues, Collections and Topics in MDPI journals

E-Mail Website
Guest Editor
Insitute of Neural Information Processing, Ulm University, James Frank Ring, 89081 Ulm, Germany
Interests: artificial neural networks; pattern recognition; cluster analysis; statistical learning theory; data mining; multiple classifier systems; sensor fusion; affective computing
Special Issues, Collections and Topics in MDPI journals

Special Issue Information

Dear Colleagues,

The eighth workshop on the multimodal pattern recognition of social signals in human–computer interactions (MPRSS 2024) was held as part of the 27th International Conference on Pattern Recognition (ICPR), December 01 2024, Kolkata, India. For more details, see the following link: https://sites.google.com/ualr.edu/icpr2024/home. Building intelligent artificial companions capable of interacting with humans in the same way humans interact with each other is a major challenge in affective computing. This type of interactive companion must be capable of perceiving and interpreting multimodal information about the user in order to be able to produce an appropriate response. As part of this, the aforementioned workshop mainly focused on pattern recognition and machine learning methods for the perception of the user’s affective states, activities, and intentions.

The authors of selected papers which were presented at the workshop are invited to submit extended versions to this Special Issue of Computers. Submitted papers should be extended to the size of regular research or review articles, with at least a 50% extension of new results. All submitted papers will undergo our standard peer review process. Accepted papers will be published in open access format in Computers and presented together on this Special Issue’s website. There are no page limitations in this journal.

We also invite regular submissions related to the latest challenges, technologies, solutions, techniques, and fundamental aspects pertaining to the subjects of this Special Issue. Topics of interest include, but are not limited to, the following:

  • Algorithms used to recognize emotions, behaviors, activities, and intentions:
    • Facial expression recognition;
    • The recognition of gestures and head/body poses;
    • Audiovisual emotion recognition;
    • The analysis of biophysiological data for emotion recognition;
    • Multimodal information fusion architectures;
    • Multiclassifier systems and multiview classifiers;
    • Gesture recognition, activity recognition, and behavior recognition;
    • Temporal information fusion.
  • Learning algorithms for social signal processing:
    • Learning from unlabeled and partially labeled data;
    • Learning with noisy/uncertain labels;
    • Deep learning architectures;
    • Learning time series.
  • Applications relevant to the workshop:
    • Companion technologies;
    • Robotics;
    • Assistive systems.
  • Benchmark datasets relevant to workshop topics.

Prof. Dr. Mariofanna Milanova
Prof. Dr. Friedhelm Schwenker
Guest Editors

Manuscript Submission Information

Manuscripts should be submitted online at www.mdpi.com by registering and logging in to this website. Once you are registered, click here to go to the submission form. Manuscripts can be submitted until the deadline. All submissions that pass pre-check are peer-reviewed. Accepted papers will be published continuously in the journal (as soon as accepted) and will be listed together on the special issue website. Research articles, review articles as well as short communications are invited. For planned papers, a title and short abstract (about 100 words) can be sent to the Editorial Office for announcement on this website.

Submitted manuscripts should not have been published previously, nor be under consideration for publication elsewhere (except conference proceedings papers). All manuscripts are thoroughly refereed through a single-blind peer-review process. A guide for authors and other relevant information for submission of manuscripts is available on the Instructions for Authors page. Computers is an international peer-reviewed open access monthly journal published by MDPI.

Please visit the Instructions for Authors page before submitting a manuscript. The Article Processing Charge (APC) for publication in this open access journal is 1800 CHF (Swiss Francs). Submitted papers should be well formatted and use good English. Authors may use MDPI's English editing service prior to publication or during author revisions.

Keywords

  • multimodal pattern recognition
  • social signals
  • human–computer interactions
  • affective computing
  • artificially intelligent companions
  • user affect recognition
  • machine learning
  • emotion recognition
  • gesture recognition

Benefits of Publishing in a Special Issue

  • Ease of navigation: Grouping papers by topic helps scholars navigate broad scope journals more efficiently.
  • Greater discoverability: Special Issues support the reach and impact of scientific research. Articles in Special Issues are more discoverable and cited more frequently.
  • Expansion of research network: Special Issues facilitate connections among authors, fostering scientific collaborations.
  • External promotion: Articles in Special Issues are often promoted through the journal's social media, increasing their visibility.
  • Reprint: MDPI Books provides the opportunity to republish successful Special Issues in book format, both online and in print.

Further information on MDPI's Special Issue policies can be found here.

Published Papers (3 papers)

Order results
Result details
Select all
Export citation of selected articles as:

Research

Jump to: Review

14 pages, 1893 KiB  
Article
Unlocking the Potential of Smart Environments Through Deep Learning
by Adnan Ramakić and Zlatko Bundalo
Computers 2025, 14(8), 296; https://doi.org/10.3390/computers14080296 - 22 Jul 2025
Viewed by 219
Abstract
This paper looks at and describes the potential of using artificial intelligence in smart environments. Various environments such as houses and residential and commercial buildings are becoming smarter through the use of various technologies, i.e., various sensors, smart devices and elements based on [...] Read more.
This paper looks at and describes the potential of using artificial intelligence in smart environments. Various environments such as houses and residential and commercial buildings are becoming smarter through the use of various technologies, i.e., various sensors, smart devices and elements based on artificial intelligence. These technologies are used, for example, to achieve different levels of security in environments, for personalized comfort and control and for ambient assisted living. We investigated the deep learning approach, and, in this paper, describe its use in this context. Accordingly, we developed four deep learning models, which we describe. These are models for hand gesture recognition, emotion recognition, face recognition and gait recognition. These models are intended for use in smart environments for various tasks. In order to present the possible applications of the models, in this paper, a house is used as an example of a smart environment. The models were developed using the TensorFlow platform together with Keras. Four different datasets were used to train and validate the models. The results are promising and are presented in this paper. Full article
(This article belongs to the Special Issue Multimodal Pattern Recognition of Social Signals in HCI (2nd Edition))
Show Figures

Figure 1

13 pages, 1181 KiB  
Article
Design of an Emotional Facial Recognition Task in a 3D Environment
by Gemma Quirantes-Gutierrez, Ángeles F. Estévez, Gabriel Artés Ordoño and Ginesa López-Crespo
Computers 2025, 14(4), 153; https://doi.org/10.3390/computers14040153 - 18 Apr 2025
Viewed by 463
Abstract
The recognition of emotional facial expressions is a key skill for social adaptation. Previous studies have shown that clinical and subclinical populations, such as those diagnosed with schizophrenia or autism spectrum disorder, have a significant deficit in the recognition of emotional facial expressions. [...] Read more.
The recognition of emotional facial expressions is a key skill for social adaptation. Previous studies have shown that clinical and subclinical populations, such as those diagnosed with schizophrenia or autism spectrum disorder, have a significant deficit in the recognition of emotional facial expressions. These studies suggest that this may be the cause of their social dysfunction. Given the importance of this type of recognition in social functioning, the present study aims to design a tool to measure the recognition of emotional facial expressions using Unreal Engine 4 software to develop computer graphics in a 3D environment. Additionally, we tested it in a small pilot study with a sample of 37 university students, aged between 18 and 40, to compare the results with a more classical emotional facial recognition task. We also administered the SEES Scale and a set of custom-formulated questions to both groups to assess potential differences in activation levels between the two modalities (3D environment vs. classical format). The results of this initial pilot study suggest that students who completed the task in the classical format exhibited a greater lack of activation compared to those who completed the task in the 3D environment. Regarding the recognition of emotional facial expressions, both tasks were similar in two of the seven emotions evaluated. We believe that this study represents the beginning of a new line of research that could have important clinical implications. Full article
(This article belongs to the Special Issue Multimodal Pattern Recognition of Social Signals in HCI (2nd Edition))
Show Figures

Figure 1

Review

Jump to: Research

25 pages, 1072 KiB  
Review
EEG-Based Biometric Identification and Emotion Recognition: An Overview
by Miguel A. Becerra, Carolina Duque-Mejia, Andres Castro-Ospina, Leonardo Serna-Guarín, Cristian Mejía and Eduardo Duque-Grisales
Computers 2025, 14(8), 299; https://doi.org/10.3390/computers14080299 - 23 Jul 2025
Viewed by 544
Abstract
This overview examines recent advancements in EEG-based biometric identification, focusing on integrating emotional recognition to enhance the robustness and accuracy of biometric systems. By leveraging the unique physiological properties of EEG signals, biometric systems can identify individuals based on neural responses. The overview [...] Read more.
This overview examines recent advancements in EEG-based biometric identification, focusing on integrating emotional recognition to enhance the robustness and accuracy of biometric systems. By leveraging the unique physiological properties of EEG signals, biometric systems can identify individuals based on neural responses. The overview discusses the influence of emotional states on EEG signals and the consequent impact on biometric reliability. It also evaluates recent emotion recognition techniques, including machine learning methods such as support vector machines (SVMs), convolutional neural networks (CNNs), and long short-term memory networks (LSTMs). Additionally, the role of multimodal EEG datasets in enhancing emotion recognition accuracy is explored. Findings from key studies are synthesized to highlight the potential of EEG for secure, adaptive biometric systems that account for emotional variability. This overview emphasizes the need for future research on resilient biometric identification that integrates emotional context, aiming to establish EEG as a viable component of advanced biometric technologies. Full article
(This article belongs to the Special Issue Multimodal Pattern Recognition of Social Signals in HCI (2nd Edition))
Show Figures

Figure 1

Back to TopTop