ENTROPIC ANALYSIS OF THE ROLE OF WORDS IN LITERARY TEXTS

Marcelo A. Montemurro () and Damián H. Zanette ()
Additional contact information
Marcelo A. Montemurro: Facultad de Matemática, Astronomía y Física, Universidad Nacional de Córdoba, Ciudad Universitaria, 5000 Córdoba, Argentina
Damián H. Zanette: Consejo Nacional de Investigaciones Cientí ficas y Técnicas, Centro Atómico Bariloche and Instituto Balseiro, 8400 Bariloche, Río Negro, Argentina

Advances in Complex Systems (ACS), 2002, vol. 05, issue 01, 7-17

Abstract: Beyond the local constraints imposed by grammar, words concatenated in long sequences carrying a complex message show statistical regularities that may reflect their linguistic role in the message. In this paper, we perform a systematic statistical analysis of the use of words in literary English corpora. We show that there is a quantitative relation between the role of content words in literary English and the Shannon information entropy defined over an appropriate probability distribution. Without assuming any previous knowledge about the syntactic structure of language, we are able to cluster certain groups of words according to their specific role in the text.

Keywords: Quantitative linguistics; language; word clustering; Shannon information entropy; Zipf's analysis (search for similar items in EconPapers)
Date: 2002
References: Add references at CitEc
Citations: View citations in EconPapers (4)

Downloads: (external link)
http://www.worldscientific.com/doi/abs/10.1142/S0219525902000493
Access to full text is restricted to subscribers

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:wsi:acsxxx:v:05:y:2002:i:01:n:s0219525902000493

Ordering information: This journal article can be ordered from

DOI: 10.1142/S0219525902000493

Access Statistics for this article

Advances in Complex Systems (ACS) is currently edited by Frank Schweitzer

More articles in Advances in Complex Systems (ACS) from World Scientific Publishing Co. Pte. Ltd.
Bibliographic data for series maintained by Tai Tone Lim ().