The Distribution of N-Grams

Leo Egghe
Additional contact information
Leo Egghe: LUC

Scientometrics, 2000, vol. 47, issue 2, No 5, 237-252

Abstract: Abstract N-grams are generalized words consisting of N consecutive symbols, as they are used in a text. This paper determines the rank-frequency distribution for redundant N-grams. For entire texts this is known to be Zipf's law (i.e., an inverse power law). For N-grams, however, we show that the rank (r)-frequency distribution is $${\text{P}}_{\text{N}} \left( {\text{r}} \right) = \frac{{\text{C}}}{{{\text{(}}\psi _{\text{N}} ({\text{r))}}^\beta }},$$ , where ψN is the inverse function of fN(x)=x lnN−1x. Here we assume that the rank-frequency distribution of the symbols follows Zipf's law with exponent β.

Date: 2000
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (6)

Downloads: (external link)
http://link.springer.com/10.1023/A:1005634925734 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:scient:v:47:y:2000:i:2:d:10.1023_a:1005634925734

Ordering information: This journal article can be ordered from
http://www.springer.com/economics/journal/11192

DOI: 10.1023/A:1005634925734

Access Statistics for this article

Scientometrics is currently edited by Wolfgang Glänzel

More articles in Scientometrics from Springer, Akadémiai Kiadó
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().