Are all the word ranking methods the same?

Elham Najafi, Alireza Valizadeh () and Amir H. Darooneh
Additional contact information
Elham Najafi: Department of Physics, Institute for Advanced Studies in Basic Sciences (IASBS), Zanjan, Iran
Alireza Valizadeh: Department of Physics, Institute for Advanced Studies in Basic Sciences (IASBS), Zanjan, Iran
Amir H. Darooneh: ��Department of Applied Mathematics, University of Waterloo, Waterloo, Ontario, Canada‡University of Zanjan, P. O. Box 45196-313, Zanjan, Iran

International Journal of Modern Physics C (IJMPC), 2021, vol. 32, issue 11, 1-11

Abstract: Text as a complex system is commonly studied by various methods, like complex networks or time series analysis, in order to discover its properties. One of the most important properties of each text is its keywords, which are extracted by word ranking methods. There are various methods to rank words of a text. Each method differently ranks words according to their frequency, spatial distribution or other word properties. Here, we aimed to explore how similar various word ranking methods are. For this purpose, we studied the rank correlation of some important word ranking methods for number of sample texts with different subjects and text sizes. We found that by increasing text size the correlation between ranking methods grows. It means that as the text size increases, the associated word ranks calculated by different ranking methods converge. Also, we found out that the rank correlations of word ranking methods approach their maximum value in the case of large enough texts.

Keywords: Statistical physics; complex systems; word ranking; correlation (search for similar items in EconPapers)
Date: 2021
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.worldscientific.com/doi/abs/10.1142/S0129183121501448
Access to full text is restricted to subscribers

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:wsi:ijmpcx:v:32:y:2021:i:11:n:s0129183121501448

Ordering information: This journal article can be ordered from

DOI: 10.1142/S0129183121501448

Access Statistics for this article

International Journal of Modern Physics C (IJMPC) is currently edited by H. J. Herrmann

More articles in International Journal of Modern Physics C (IJMPC) from World Scientific Publishing Co. Pte. Ltd.
Bibliographic data for series maintained by Tai Tone Lim ().