Multifractal correlations in natural language written texts: Effects of language family and long word statistics

M. Chatzigeorgiou, V. Constantoudis, F. Diakonos, K. Karamanos, C. Papadimitriou, M. Kalimeri and H. Papageorgiou

Physica A: Statistical Mechanics and its Applications, 2017, vol. 469, issue C, 173-182

Abstract: During the last years, several methods from the statistical physics of complex systems have been applied to the study of natural language written texts. They have mostly been focused on the detection of long-range correlations, multifractal analysis and the statistics of the content word positions. In the present paper, we show that these statistical aspects of language series are not independent but may exhibit strong interrelations. This is done by means of a two-step investigation. First, we calculate the multifractal spectra using the word-length representation of huge parallel corpora from ten European languages and compare with the shuffled data to assess the contribution of long-range correlations to multifractality. In the second step, the detected multifractal correlations are shown to be related to the scale-dependent clustering of the long, highly informative content words. Furthermore, exploiting the language sensitivity of the used word-length representation, we demonstrate the consistent impact of the classification of languages into families on the multifractal correlations and long-word clustering patterns.

Keywords: Multifractality; Box counting; Long-range correlations; Language; Language families; Written texts (search for similar items in EconPapers)
Date: 2017
References: View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0378437116308330
Full text for ScienceDirect subscribers only. Journal offers the option of making the article available online on Science direct for a fee of $3,000

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:phsmap:v:469:y:2017:i:c:p:173-182

DOI: 10.1016/j.physa.2016.11.028

Access Statistics for this article

Physica A: Statistical Mechanics and its Applications is currently edited by K. A. Dawson, J. O. Indekeu, H.E. Stanley and C. Tsallis

More articles in Physica A: Statistical Mechanics and its Applications from Elsevier
Bibliographic data for series maintained by Catherine Liu ().