Next Article in Journal
A Review of DSP-Based Enabling Technologies for Cloud Access Networks
Next Article in Special Issue
Privacy and Security Issues in Online Social Networks
Previous Article in Journal
Composting as a Service: A Real-World IoT Implementation
Previous Article in Special Issue
Reframing HRI Design Opportunities for Social Robots: Lessons Learnt from a Service Robotics Case Study Approach Using UX for HRI
Article Menu
Issue 11 (November) cover image

Export Article

Open AccessArticle
Future Internet 2018, 10(11), 108; https://doi.org/10.3390/fi10110108

Quality of Experience in Cyber-Physical Social Systems Based on Reinforcement Learning and Game Theory

1
Department of Electrical and Computer Engineering, University of New Mexico, Albuquerque, NM 87131, USA
2
School of Electrical and Computer Engineering, National Technical University of Athens, 15780 Athina, Greece
3
Department of Information and Computing Sciences, Faculty of Science, Utrecht University, PO Box 80125, 3508 TC Utrecht, The Netherlands
*
Author to whom correspondence should be addressed.
Received: 28 September 2018 / Revised: 31 October 2018 / Accepted: 5 November 2018 / Published: 7 November 2018
(This article belongs to the Special Issue 10th Anniversary Feature Papers)
Full-Text   |   PDF [2314 KB, uploaded 7 November 2018]   |  

Abstract

This paper addresses the problem of museum visitors’ Quality of Experience (QoE) optimization by viewing and treating the museum environment as a cyber-physical social system. To achieve this goal, we harness visitors’ internal ability to intelligently sense their environment and make choices that improve their QoE in terms of which the museum touring option is the best for them and how much time to spend on their visit. We model the museum setting as a distributed non-cooperative game where visitors selfishly maximize their own QoE. In this setting, we formulate the problem of Recommendation Selection and Visiting Time Management (RSVTM) and propose a two-stage distributed algorithm based on game theory and reinforcement learning, which learns from visitor behavior to make on-the-fly recommendation selections that maximize visitor QoE. The proposed framework enables autonomic visitor-centric management in a personalized manner and enables visitors themselves to decide on the best visiting strategies. Experimental results evaluating the performance of the proposed RSVTM algorithm under realistic simulation conditions indicate the high operational effectiveness and superior performance when compared to other recommendation approaches. Our results constitute a practical alternative for museums and exhibition spaces meant to enhance visitor QoE in a flexible, efficient, and cost-effective manner. View Full-Text
Keywords: quality of experience; congestion; reinforcement learning; time management; game theory; personalization and recommendation quality of experience; congestion; reinforcement learning; time management; game theory; personalization and recommendation
Figures

Figure 1

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited (CC BY 4.0).
SciFeed

Share & Cite This Article

MDPI and ACS Style

Tsiropoulou, E.E.; Kousis, G.; Thanou, A.; Lykourentzou, I.; Papavassiliou, S. Quality of Experience in Cyber-Physical Social Systems Based on Reinforcement Learning and Game Theory. Future Internet 2018, 10, 108.

Show more citation formats Show less citations formats

Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Related Articles

Article Metrics

Article Access Statistics

1

Comments

[Return to top]
Future Internet EISSN 1999-5903 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top