Recommendation by Multiscale Semantic-Visual Analysis of User Reviews and Product Images

Zhu Zhan () and Bugao Xu ()
Additional contact information
Zhu Zhan: University of North Texas
Bugao Xu: University of North Texas

A chapter in Advances in Digital Marketing and eCommerce, 2023, pp 29-36 from Springer

Abstract: Abstract Recommendation for items that users have not interacted with is often based on the predicted ratings. However, predicting an item rating can be challenging due to a fact that the user-item paired data are not easily. Many studies addressed this problem by modeling latent factors of users (and/or items) using semantic reviews, as they are available on most ecommerce websites. However, this approach ignored the visual features of items, or product images, which reflect users’ personal preference. In this paper, we present a novel method that exploits multiscale semantic-visual representations (MSVR) to perform rating predictions with two paralleled submodules. The first submodule identifies the review features with respect to various aspects through word-aware and scale-aware attention mechanisms. The second submodule extracts block-level visual features at multi-scales with a pre-trained deep net, and then embeds the features with visual word vocabularies followed by a projection layer to reduce dimensions and an attention layer to re-weight multiscale blocks. Extensive experiments performed on 22 Amazon datasets demonstrates that our model significantly outperforms several state-of-the-art recommendation methods.

Keywords: Semantic analysis; visual analysis; aspect-sentiment; scale-aware attention (search for similar items in EconPapers)
Date: 2023
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:prbchp:978-3-031-31836-8_4

Ordering information: This item can be ordered from
http://www.springer.com/9783031318368

DOI: 10.1007/978-3-031-31836-8_4

Access Statistics for this chapter

More chapters in Springer Proceedings in Business and Economics from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().