Quality of Experience in Cyber-Physical Social Systems Based on Reinforcement Learning and Game Theory

Eirini Eleni Tsiropoulou, George Kousis, Athina Thanou, Ioanna Lykourentzou and Symeon Papavassiliou
Additional contact information
Eirini Eleni Tsiropoulou: Department of Electrical and Computer Engineering, University of New Mexico, Albuquerque, NM 87131, USA
George Kousis: School of Electrical and Computer Engineering, National Technical University of Athens, 15780 Athina, Greece
Athina Thanou: School of Electrical and Computer Engineering, National Technical University of Athens, 15780 Athina, Greece
Ioanna Lykourentzou: Department of Information and Computing Sciences, Faculty of Science, Utrecht University, PO Box 80125, 3508 TC Utrecht, The Netherlands
Symeon Papavassiliou: School of Electrical and Computer Engineering, National Technical University of Athens, 15780 Athina, Greece

Future Internet, 2018, vol. 10, issue 11, 1-22

Abstract: This paper addresses the problem of museum visitors’ Quality of Experience (QoE) optimization by viewing and treating the museum environment as a cyber-physical social system. To achieve this goal, we harness visitors’ internal ability to intelligently sense their environment and make choices that improve their QoE in terms of which the museum touring option is the best for them and how much time to spend on their visit. We model the museum setting as a distributed non-cooperative game where visitors selfishly maximize their own QoE. In this setting, we formulate the problem of Recommendation Selection and Visiting Time Management (RSVTM) and propose a two-stage distributed algorithm based on game theory and reinforcement learning, which learns from visitor behavior to make on-the-fly recommendation selections that maximize visitor QoE. The proposed framework enables autonomic visitor-centric management in a personalized manner and enables visitors themselves to decide on the best visiting strategies. Experimental results evaluating the performance of the proposed RSVTM algorithm under realistic simulation conditions indicate the high operational effectiveness and superior performance when compared to other recommendation approaches. Our results constitute a practical alternative for museums and exhibition spaces meant to enhance visitor QoE in a flexible, efficient, and cost-effective manner.

Keywords: quality of experience; congestion; reinforcement learning; time management; game theory; personalization and recommendation (search for similar items in EconPapers)
JEL-codes: O3 (search for similar items in EconPapers)
Date: 2018
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/1999-5903/10/11/108/pdf (application/pdf)
https://www.mdpi.com/1999-5903/10/11/108/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jftint:v:10:y:2018:i:11:p:108-:d:181239

Access Statistics for this article

Future Internet is currently edited by Ms. Grace You

More articles in Future Internet from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().