Enhancing sentence‐level clustering with integrated and interactive frameworks for theme‐based summarization

Xiaoyan Cai and Wenjie Li

Journal of the American Society for Information Science and Technology, 2011, vol. 62, issue 10, 2067-2082

Abstract: Sentence clustering plays a pivotal role in theme‐based summarization, which discovers topic themes defined as the clusters of highly related sentences to avoid redundancy and cover more diverse information. As the length of sentences is short and the content it contains is limited, the bag‐of‐words cosine similarity traditionally used for document clustering is no longer suitable. Special treatment for measuring sentence similarity is necessary. In this article, we study the sentence‐level clustering problem. After exploiting concept‐ and context‐enriched sentence vector representations, we develop two co‐clustering frameworks to enhance sentence‐level clustering for theme‐based summarization—integrated clustering and interactive clustering—both allowing word and document to play an explicit role in sentence clustering as independent text objects rather than using word or concept as features of a sentence in a document set. In each framework, we experiment with two‐level co‐clustering (i.e., sentence‐word co‐clustering or sentence‐document co‐clustering) and three‐level co‐clustering (i.e., document‐sentence‐word co‐clustering). Compared against concept‐ and context‐oriented sentence‐representation reformation, co‐clustering shows a clear advantage in both intrinsic clustering quality evaluation and extrinsic summarization evaluation conducted on the Document Understanding Conferences (DUC) datasets.

Date: 2011
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://doi.org/10.1002/asi.21593

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:jamist:v:62:y:2011:i:10:p:2067-2082

Ordering information: This journal article can be ordered from
https://doi.org/10.1002/(ISSN)1532-2890

Access Statistics for this article

More articles in Journal of the American Society for Information Science and Technology from Association for Information Science & Technology
Bibliographic data for series maintained by Wiley Content Delivery ().