The growth statistics of Zipfian ensembles: Beyond Heaps’ law

Iddo Eliazar

Physica A: Statistical Mechanics and its Applications, 2011, vol. 390, issue 20, 3189-3203

Abstract: We consider an evolving ensemble assembled from a set of n different elements via a stochastic growth process in which independent and identically distributed copies of the elements arrive randomly in time, and their statistics are governed by Zipf’s law. The associated “Heaps process” is the stochastic process tracking the fraction of different element copies present in the evolving ensemble at any given time point. For example, the evolving ensemble is a text assembled from a stream of words, and the Heaps process keeps count of the number of different words in the evolving text. A detailed asymptotic statistical analysis of the Heaps process, in the limit n→∞, is conducted. This paper establishes a comprehensive “Heapsian analysis” of the growth statistics of Zipfian ensembles. The analysis presented far extends and generalizes Heaps’ law, which asserts that the number of different words in a text of length l follows a power law in the variable l.

Keywords: Zipf’s law; Heaps’ law; Power laws; Rank distributions; Growth processes; Poisson processes; Heaps process; Heaps curve; Functional Central Limit Theorems (FCLTs) (search for similar items in EconPapers)
Date: 2011
References: View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0378437111003499
Full text for ScienceDirect subscribers only. Journal offers the option of making the article available online on Science direct for a fee of $3,000

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:phsmap:v:390:y:2011:i:20:p:3189-3203

DOI: 10.1016/j.physa.2011.05.003

Access Statistics for this article

Physica A: Statistical Mechanics and its Applications is currently edited by K. A. Dawson, J. O. Indekeu, H.E. Stanley and C. Tsallis

More articles in Physica A: Statistical Mechanics and its Applications from Elsevier
Bibliographic data for series maintained by Catherine Liu ().