sensors-logo

Journal Browser

Journal Browser

Integrated Sensor Systems for Multi-modal Emotion Recognition

A special issue of Sensors (ISSN 1424-8220). This special issue belongs to the section "Biomedical Sensors".

Deadline for manuscript submissions: 31 May 2025 | Viewed by 2087

Special Issue Editor


E-Mail Website
Guest Editor
Department of Computer and Information Sciences, Northumbria University, Tyne NE1 8ST, UK
Interests: evolutionary feature selection; computer vision

Special Issue Information

Dear Colleagues,

Emotion recognition stands at the nexus of human–computer interaction, imbuing intelligent systems with the capacity to comprehend and respond to human affective states. In recent years, the paradigm of multi-modal emotion recognition has emerged as a focal point of research, harnessing the synergistic integration of diverse sensory modalities to achieve enhanced accuracy and robustness in discerning emotional cues.

This Special Issue seeks to explore the rich tapestry of challenges and opportunities inherent in multi-modal emotion recognition. By capitalizing on the sensor fusion of visual, auditory, physiological, and textual cues, researchers aim to unravel the intricate nuances of human emotions, paving the way for more empathetic and responsive artificial intelligence systems.

The proliferation of computer vision and machine learning technologies has underpinned remarkable advancements in multi-modal emotion recognition. Through the judicious application of convolutional neural networks, recurrent neural networks, and attention mechanisms, researchers have endeavored to distill meaningful insights from multimodal data streams, enabling machines to perceive, interpret, and respond to human emotions with unprecedented fidelity.

Key themes to be explored in this Special Issue include:

  • Multi-Modal Fusion Techniques: Investigating methodologies for integrating information from disparate sensory modalities to enhance the robustness and discriminative power of emotion recognition systems.
  • Cross-Modal Transfer Learning: Exploring strategies for leveraging knowledge across modalities to mitigate data sparsity and domain shift, facilitating more generalized and adaptive emotion recognition models.
  • Contextual and Temporal Dynamics: Examining the influence of contextual factors and temporal dynamics on the perception and interpretation of emotions, and devising models capable of capturing the evolving nature of affective states over time.
  • Ethical and Social Implications: Delving into the ethical considerations surrounding the deployment of multi-modal emotion recognition systems, and addressing concerns related to privacy, bias, and algorithmic fairness.

Researchers are invited to contribute original research articles, review papers, and case studies that shed light on the theoretical underpinnings, methodological innovations, and practical applications of multi-modal emotion recognition. By fostering interdisciplinary dialogue and collaboration, this Special Issue endeavors to propel the frontier of emotion-aware computing, unlocking new frontiers in human-centered artificial intelligence.

Through the synthesis of diverse perspectives and methodologies, we aim to chart a course towards more empathetic and emotionally intelligent machines, capable of forging deeper and more meaningful connections with their human counterparts. Join us in this collective endeavor to unravel the mysteries of human emotion and usher in a new era of emotionally aware computing.

Dr. Kamlesh Mistry
Guest Editor

Manuscript Submission Information

Manuscripts should be submitted online at www.mdpi.com by registering and logging in to this website. Once you are registered, click here to go to the submission form. Manuscripts can be submitted until the deadline. All submissions that pass pre-check are peer-reviewed. Accepted papers will be published continuously in the journal (as soon as accepted) and will be listed together on the special issue website. Research articles, review articles as well as short communications are invited. For planned papers, a title and short abstract (about 100 words) can be sent to the Editorial Office for announcement on this website.

Submitted manuscripts should not have been published previously, nor be under consideration for publication elsewhere (except conference proceedings papers). All manuscripts are thoroughly refereed through a single-blind peer-review process. A guide for authors and other relevant information for submission of manuscripts is available on the Instructions for Authors page. Sensors is an international peer-reviewed open access semimonthly journal published by MDPI.

Please visit the Instructions for Authors page before submitting a manuscript. The Article Processing Charge (APC) for publication in this open access journal is 2600 CHF (Swiss Francs). Submitted papers should be well formatted and use good English. Authors may use MDPI's English editing service prior to publication or during author revisions.

Keywords

  • multi-modal fusion
  • cross-modal transfer learning
  • contextual and temporal dynamics
  • ethical and social implications

Benefits of Publishing in a Special Issue

  • Ease of navigation: Grouping papers by topic helps scholars navigate broad scope journals more efficiently.
  • Greater discoverability: Special Issues support the reach and impact of scientific research. Articles in Special Issues are more discoverable and cited more frequently.
  • Expansion of research network: Special Issues facilitate connections among authors, fostering scientific collaborations.
  • External promotion: Articles in Special Issues are often promoted through the journal's social media, increasing their visibility.
  • e-Book format: Special Issues with more than 10 articles can be published as dedicated e-books, ensuring wide and rapid dissemination.

Further information on MDPI's Special Issue policies can be found here.

Published Papers (1 paper)

Order results
Result details
Select all
Export citation of selected articles as:

Research

22 pages, 2740 KiB  
Article
Unsupervised Canine Emotion Recognition Using Momentum Contrast
by Aarya Bhave, Alina Hafner, Anushka Bhave and Peter A. Gloor
Sensors 2024, 24(22), 7324; https://doi.org/10.3390/s24227324 - 16 Nov 2024
Cited by 2 | Viewed by 1656
Abstract
We describe a system for identifying dog emotions based on dogs’ facial expressions and body posture. Towards that goal, we built a dataset with 2184 images of ten popular dog breeds, grouped into seven similarly sized primal mammalian emotion categories defined by neuroscientist [...] Read more.
We describe a system for identifying dog emotions based on dogs’ facial expressions and body posture. Towards that goal, we built a dataset with 2184 images of ten popular dog breeds, grouped into seven similarly sized primal mammalian emotion categories defined by neuroscientist and psychobiologist Jaak Panksepp as ‘Exploring’, ‘Sadness’, ‘Playing’, ‘Rage’, ‘Fear’, ‘Affectionate’ and ‘Lust’. We modified the contrastive learning framework MoCo (Momentum Contrast for Unsupervised Visual Representation Learning) to train it on our original dataset and achieved an accuracy of 43.2% and a baseline of 14%. We also trained this model on a second publicly available dataset that resulted in an accuracy of 48.46% but had a baseline of 25%. We compared our unsupervised approach with a supervised model based on a ResNet50 architecture. This model, when tested on our dataset with the seven Panksepp labels, resulted in an accuracy of 74.32% Full article
(This article belongs to the Special Issue Integrated Sensor Systems for Multi-modal Emotion Recognition)
Show Figures

Figure 1

Back to TopTop