What is a Fair Value of Your Recommendation List?

Vladimir Bobrikov, Elena Nenova and Dmitry Ignatov ()

MPRA Paper from University Library of Munich, Germany

Abstract: We propose a new quality metric for recommender systems. The main feature of our approach is the fact, that we take into account the set of requirements, which are important for business application of a recommender. Thus, we construct a general criterion, named “audience satisfaction”, which thoroughly describe the result of interaction between users and recommendation service. During the criterion construction we had to deal with a number of common recommenders’ problems: a) Most of users rate only a random part of the objects they consume and a part of the objects that were recommended to them; b) Attention of users is distributed very unevenly over the list of recommendations and it requires a special behavioral model; c) The value of the user’s rate measures the level of his/her satisfaction, hence these values should be naturally incorporated in the criterion intrinsically; d) Different elements may often dramatically differ from each other by popularity (long tail – short head problem) and this effect prevents accurate measuring of user’s satisfaction. The final metric takes into account all these issues, leaving opportunity to adjust the metric performance based on proper behavioral models and parameters of short head problem treatment.

Keywords: recommender systems; quality metric; explicit feedback; movie recommendations; AUC; cold start; recommendations for novices (search for similar items in EconPapers)
JEL-codes: C0 C02 C10 D46 Y10 (search for similar items in EconPapers)
Date: 2016-07-18
References: View complete reference list from CitEc
Citations:

Published in Proceedings of the Third Workshop on Experimental Economics and Machine Learning urn:nbn:de:0074-1627-1.1627(2016): pp. 1-12

Downloads: (external link)
https://mpra.ub.uni-muenchen.de/77604/1/inv1.pdf original version (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:pra:mprapa:77604

Access Statistics for this paper

More papers in MPRA Paper from University Library of Munich, Germany Ludwigstraße 33, D-80539 Munich, Germany. Contact information at EDIRC.
Bibliographic data for series maintained by Joachim Winter ().