PALM: Personalized Attention-based Language Model for Long-tail Query Understanding in Enterprise Search Systems

Qiwen Zhao (), Zhongwen Zhou () and Yibang Liu ()

Journal of AI-Powered Medical Innovations (International online ISSN 3078-1930), 2024, vol. 2, issue 1, 125-140

Abstract: Enterprise search systems face significant challenges in handling long-tail queries, which constitute a substantial portion of search traffic but often receive inadequate attention in traditional systems. This paper introduces PALM (Personalized Attention-based Language Model), a novel framework designed to enhance long-tail query understanding in enterprise search environments. PALM integrates personalization capabilities with an advanced attention mechanism to improve search accuracy for infrequent queries while maintaining high performance on common queries. The framework employs a unique hierarchical architecture that combines user context, query semantics, and organizational knowledge through a sophisticated attention mechanism. The system features an innovative query embedding approach that adapts to individual user contexts while leveraging collective organizational knowledge. Extensive experiments on a large-scale enterprise dataset, comprising over 5 million queries from 50,000 users, demonstrate PALM's superior performance compared to state-of-the-art baselines. The results show significant improvements across multiple metrics, with a 17.5% increase in MAP for ultra-rare queries and a 10.4% overall improvement in NDCG@10. The framework exhibits robust performance across different organizational units and query types, making it particularly valuable for enterprise environments where query patterns are highly diverse and context-dependent. Our ablation studies confirm the effectiveness of each component in the PALM architecture, while case analyses provide insights into the framework's practical applications.

Keywords: Enterprise Search; Long-tail Queries; Attention Mechanism; Personalized Search (search for similar items in EconPapers)
Date: 2024
References: Add references at CitEc
Citations:

Downloads: (external link)
https://japmi.org/index.php/japmi/article/view/14/14 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:abu:abuabu:v:2:y:2024:i:1:p:125-140:id:14

Access Statistics for this article

More articles in Journal of AI-Powered Medical Innovations (International online ISSN 3078-1930) from Open Knowledge
Bibliographic data for series maintained by By Openjournaltheme ().