ESTIMATING THE MINIMUM ENTROPY OF CHINESE AND JAPANESE LANGUAGES

Fuji Ren () and Kang Yen ()
Additional contact information
Fuji Ren: Faculty of Engineering, Tokushima University, Tokushima, 770-8506, Japan
Kang Yen: Department of Electrical & Computer Engineering, Florida International University, Miami, FL 33174, USA

International Journal of Information Technology & Decision Making (IJITDM), 2005, vol. 04, issue 04, 679-689

Abstract: The study of minimum entropy of a natural language has been an interesting research subject. For English, great progress has been made, but few reports on other languages have been found in literature. Based on two hypotheses on the conservation of information quantity, we proposed a method which can be used to estimate the minimum entropy of characters in natural languages. With a large quantity of translation corpus, this method enables us to estimate the minimum entropy without calculating the probability. Besides, as the scale of translation corpus increases, the fluctuation of the ratio between character quantities in any two languages becomes negligible. In this paper, we apply this method to the study of two languages of a large character total — Japanese and Chinese.

Keywords: Minimum entropy; conservation of information quantity; natural language processing (search for similar items in EconPapers)
Date: 2005
References: View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://www.worldscientific.com/doi/abs/10.1142/S0219622005001702
Access to full text is restricted to subscribers

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:wsi:ijitdm:v:04:y:2005:i:04:n:s0219622005001702

Ordering information: This journal article can be ordered from

DOI: 10.1142/S0219622005001702

Access Statistics for this article

International Journal of Information Technology & Decision Making (IJITDM) is currently edited by Yong Shi

More articles in International Journal of Information Technology & Decision Making (IJITDM) from World Scientific Publishing Co. Pte. Ltd.
Bibliographic data for series maintained by Tai Tone Lim ().