Web-based pattern learning for named entity translation in Korean-Chinese cross-language information retrieval

Authors:
Yu-Chun Wang;Richard Tzong-Han Tsai;Wen-Lian Hsu
Affiliations:
Institute of Information Science, Academia Sinica, Taiwan and Department of Electrical Engineering, National Taiwan University, Taiwan;Department of Computer Science and Engineering, Yuan Ze University, Taiwan;Institute of Information Science, Academia Sinica, Taiwan
Venue:
Expert Systems with Applications: An International Journal
Year:
2009

Citing 5
Cited 0

Relevance weighting of search terms

Document retrieval systems
Proper name translation in cross-language information retrieval

COLING '98 Proceedings of the 17th international conference on Computational linguistics - Volume 1
Translating named entities using monolingual and bilingual resources

ACL '02 Proceedings of the 40th Annual Meeting on Association for Computational Linguistics
Document reranking by term distribution and maximal marginal relevance for Chinese information retrieval

Information Processing and Management: an International Journal - Special issue: AIRS2005: Information retrieval research in Asia
Intra-sentence segmentation based on support vector machines in English-Korean machine translation systems

Expert Systems with Applications: An International Journal

Quantified Score

Hi-index	12.05

Visualization

Abstract

Named entity (NE) translation plays an important role in many applications, such as information retrieval and machine translation. In this paper, we focus on translating NEs from Korean to Chinese in order to improve Korean-Chinese cross-language information retrieval (KCIR). The ideographic nature of Chinese makes NE translation difficult because one syllable may map to several Chinese characters. We propose a hybrid NE translation system. First, we integrate two online databases to extend the coverage of our bilingual dictionaries. We use Wikipedia as a translation tool based on the inter-language links between the Korean edition and the Chinese or English editions. We also use Naver.com's people search engine to find a query name's Chinese or English translation. The second component of our system is able to learn Korean-Chinese (K-C), Korean-English (K-E), and English-Chinese (E-C) translation patterns from the web. These patterns can be used to extract K-C, K-E and E-C pairs from Google snippets. We found KCIR performance using this hybrid configuration over five times better than that a dictionary-based configuration using only Naver people search. Mean average precision was as high as 0.3385 and recall reached 0.7578. Our method can handle Chinese, Japanese, Korean, and non-CJK NE translation and improve performance of KCIR substantially.