ESTIMATING THE MINIMUM ENTROPY OF CHINESE AND JAPANESE LANGUAGES
Fuji Ren () and
Kang Yen ()
Additional contact information
Fuji Ren: Faculty of Engineering, Tokushima University, Tokushima, 770-8506, Japan
Kang Yen: Department of Electrical & Computer Engineering, Florida International University, Miami, FL 33174, USA
International Journal of Information Technology & Decision Making (IJITDM), 2005, vol. 04, issue 04, 679-689
Abstract:
The study of minimum entropy of a natural language has been an interesting research subject. For English, great progress has been made, but few reports on other languages have been found in literature. Based on two hypotheses on the conservation of information quantity, we proposed a method which can be used to estimate the minimum entropy of characters in natural languages. With a large quantity of translation corpus, this method enables us to estimate the minimum entropy without calculating the probability. Besides, as the scale of translation corpus increases, the fluctuation of the ratio between character quantities in any two languages becomes negligible. In this paper, we apply this method to the study of two languages of a large character total — Japanese and Chinese.
Keywords: Minimum entropy; conservation of information quantity; natural language processing (search for similar items in EconPapers)
Date: 2005
References: View complete reference list from CitEc
Citations: View citations in EconPapers (1)
Downloads: (external link)
http://www.worldscientific.com/doi/abs/10.1142/S0219622005001702
Access to full text is restricted to subscribers
Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
HTML/Text
Persistent link: https://EconPapers.repec.org/RePEc:wsi:ijitdm:v:04:y:2005:i:04:n:s0219622005001702
Ordering information: This journal article can be ordered from
DOI: 10.1142/S0219622005001702
Access Statistics for this article
International Journal of Information Technology & Decision Making (IJITDM) is currently edited by Yong Shi
More articles in International Journal of Information Technology & Decision Making (IJITDM) from World Scientific Publishing Co. Pte. Ltd.
Bibliographic data for series maintained by Tai Tone Lim ().