Tag‐based social image retrieval: An empirical evaluation

Aixin Sun, Sourav S. Bhowmick, Khanh Tran Nam Nguyen and Ge Bai

Journal of the American Society for Information Science and Technology, 2011, vol. 62, issue 12, 2364-2381

Abstract: Tags associated with social images are valuable information source for superior image search and retrieval experiences. Although various heuristics are valuable to boost tag‐based search for images, there is a lack of general framework to study the impact of these heuristics. Specifically, the task of ranking images matching a given tag query based on their associated tags in descending order of relevance has not been well studied. In this article, we take the first step to propose a generic, flexible, and extensible framework for this task and exploit it for a systematic and comprehensive empirical evaluation of various methods for ranking images. To this end, we identified five orthogonal dimensions to quantify the matching score between a tagged image and a tag query. These five dimensions are: (i) tag relatedness to measure the degree of effectiveness of a tag describing the tagged image; (ii) tag discrimination to quantify the degree of discrimination of a tag with respect to the entire tagged image collection; (iii) tag length normalization analogous to document length normalization in web search; (iv) tag‐query matching model for the matching score computation between an image tag and a query tag; and (v) query model for tag query rewriting. For each dimension, we identify a few implementations and evaluate their impact on NUS‐WIDE dataset, the largest human‐annotated dataset consisting of more than 269K tagged images from Flickr. We evaluated 81 single‐tag queries and 443 multi‐tag queries over 288 search methods and systematically compare their performances using standard metrics including Precision at top‐K, Mean Average Precision (MAP), Recall, and Normalized Discounted Cumulative Gain (NDCG).

Date: 2011
References: Add references at CitEc
Citations:

Downloads: (external link)
https://doi.org/10.1002/asi.21659

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:jamist:v:62:y:2011:i:12:p:2364-2381

Ordering information: This journal article can be ordered from
https://doi.org/10.1002/(ISSN)1532-2890

Access Statistics for this article

More articles in Journal of the American Society for Information Science and Technology from Association for Information Science & Technology
Bibliographic data for series maintained by Wiley Content Delivery ().