What is the basic semantic unit of Chinese language? a computational approach based on topic models

  • Authors:

  • Qi Zhao;Zengchang Qin;Tao Wan

  • Affiliations:

  • Intelligent Computing and Machine Learning Lab, School of Automation Science and Electrical Engineering, Beihang University, Beijing, China;Intelligent Computing and Machine Learning Lab, School of Automation Science and Electrical Engineering, Beihang University, Beijing, China and Robotics Institute, Carnegie Mellon University;Robotics Institute, Carnegie Mellon University

  • Venue:
  • MOL'11 Proceedings of the 12th biennial conference on The mathematics of language
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Chinese language has been generally regarded as a Subject-Verb - Object (SVO) language and the basic semantic unit is the Chinese word that is usually consisted by two or more Chinese characters. However, word-centered structure of Chinese language has been controversial in linguistics. Some recent research in computational linguistics in Chinese language suggests that the character-based models perform better than the word-based models in some applications such word segmentation. In this paper, the word-based topic models and the character-based models are tested for modeling Chinese language, respectively. By empirical studies, we demonstrated the effectiveness of using Chinese characters as the basic semantic units. These two models have close performance in text classifications while the character-based model has a better quality in language modeling and a much smaller vocabulary. By testing on a bilingual corpus, three independent topic models based on Chinese words, Chinese characters and English words are trained and compared to each other. we verify the capability of topic models in modeling semantics by experiments across Chinese and English. The classification accuracy can also be boosted up by aggregating the classification results from the three independent topic models.