Skip to Content
Applied SciencesApplied Sciences
  • Article
  • Open Access

28 June 2024

25 Pages

No Pain, No Gain—Giving Real-Time Emotional Feedback in a Virtual Mirror Improves Collaboration in Virtual Teamwork

,
and
1
Center for Collective Intelligence, Massachusetts Institute of Technology, Cambridge, MA 02142, USA
2
TUM School of Management, Technical University of Munich, 80333 Munich, Germany
3
System Design and Management, Massachusetts Institute of Technology, Cambridge, MA 02139, USA
4
Cologne Institute for Information Systems (CIIS), University of Cologne, 50969 Cologne, Germany

Abstract

This study investigates the impact of real-time emotional feedback on the quality of teamwork conducted over videoconferencing. We developed a framework that provides real-time feedback through a virtual mirror based on facial and voice emotion recognition. In an experiment with 28 teams (84 participants), teams collaborated over Zoom (version 5.16.6) to set up a virtual Mars station using custom simulation software (Mars Star City, version 4.0). Participants were divided into 14 experimental teams, which were shown the virtual mirror, and 14 control teams without it. Team performance was measured by the improvement in the Mars simulation output quality. Our analysis using correlation, multi-level regression, and machine learning revealed that fewer interruptions but an increasing number over time correlated with higher performance. Higher vocal arousal and happiness also enhanced performance. We confirmed that female presence in teams boosts performance. SHAP values indicated that high variability in happiness, head movement, and positive facial valence—an “emotional rollercoaster”—positively predicted team performance. The experimental group outperformed the control group, suggesting that virtual mirroring improves virtual teamwork and that interrupting each other more while speaking less, leads to better results.

Article Metrics

Citations

Article Access Statistics

Multiple requests from the same IP address are counted as one view.