An estimate method of the minimum entropy of natural languages

Authors:
Fuji Ren;Shunji Mitsuyoshi;Kang Yen;Chengqing Zong;Hongbing Zhu
Affiliations:
Faculty of Engineering, The University of Tokushima, Tokushima, Japan;Department of Research, A.G.I. Inc., Tokyo, Japan;Dept. of Electrical and Computer Eng., Florida Int'l University, Miami, Florida;Institute of Automation, Chinese Academy of Science, Beijing, China;Faculty of Engineering, Hiroshima Kokusai Gakuin University, Hiroshima, Japan
Venue:
CICLing'03 Proceedings of the 4th international conference on Computational linguistics and intelligent text processing
Year:
2003

Citing 2
Cited 0

An estimate of an upper bound for the entropy of English

Computational Linguistics
Class-based n-gram models of natural language

Computational Linguistics

Quantified Score

Hi-index	0.00

Visualization

Abstract

The study of minimum entropy of English has a long history and has made a great progress, but only a few studies on other languages have been reported in literature so far. In this paper, we present a new method to estimate the minimum entropy of character in natural languages, based on two hypotheses of conservation of information quantity. We also verified the hypotheses empirically through experiments with two natural languages, Japanese and Chinese.