Understanding recommendation quality using embeddings

Michael Reusens, Tom Haegemans, Wilfried Lemahieu, Monique Snoeck, Bart Baesens and Luc Sels

No 588680, Working Papers of Department of Work and Organisation Studies, Leuven from KU Leuven, Faculty of Economics and Business (FEB), Department of Work and Organisation Studies, Leuven

Abstract: Current methods of evaluating the quality of recommender systems are based on averages of metrics such as the average normalized discounted cumulative gain, average diversity and average reciprocity. Averages of metrics give a good sense of the overall quality of the recommendations, but not of how their quality is distributed with respect to the recommendation system’s users or items. This paper presents a visual method, based on embedding a high dimensional content feature-space into a 2D image, that is capable of providing insights in which users are receiving high quality recommendations and how biased recommendation quality is with respect to different types of users. Through a proof of concept in the domain of job recommendation we show that our method allows business people to come to relevant answers to the question “For which of my users does my recommender system work well/poorly?”.

Date: 2017-08
References: Add references at CitEc
Citations:

Published in FEB Research Report KBI_1712

Downloads: (external link)
https://lirias.kuleuven.be/retrieve/462591 Understanding recommendation quality using embeddings (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ete:woswps:588680

Access Statistics for this paper

More papers in Working Papers of Department of Work and Organisation Studies, Leuven from KU Leuven, Faculty of Economics and Business (FEB), Department of Work and Organisation Studies, Leuven
Bibliographic data for series maintained by library EBIB ().