Learning regional transliteration variants

  • Authors:
  • Jin-Shea Kuo;Haizhou Li

  • Affiliations:
  • Chunghwa Telecommunication Laboratories, 12, Lane 551, Min-Tsu Rd., Sec. 5, Yang-Mei, Taoyuan 326, Taiwan;Institute for Infocomm Research, 1 Fusionopolis Way, #08-05 South Tower, Connexis 138632, Singapore

  • Venue:
  • Information Processing and Management: an International Journal
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper conducts an inquiry into regional transliteration variants across Chinese speaking regions. We begin by studying the social association of regional transliterations, followed by postulating a computational model for effective transliteration extraction from the Web. In the computational model, we first propose constraint-based exploration by incorporating transliteration knowledge from transliteration modeling and predictive query suggestions from search engines into query formulation as constraints so as to increase the chance of desired transliteration returns in learning regional transliteration variants. Then, we study a cross-training algorithm, which explores the attainably helpful information of transliteration mappings across related regional corpora for the learning of transliteration models, to improve the overall extraction performance. The experimental results show that the proposed method not only effectively harvests a lexicon of regional transliteration variants but also mitigates the need of manual data labeling for transliteration modeling. We also carry out an investigation into the underlying characteristics of regional transliterations that motivate the cross-training algorithm.