A Multilingual Text Mining Approach Based on Self-Organizing Maps

Authors:
Chung-Hong Lee;Hsin-Chang Yang
Affiliations:
Department of Electrical Engineering, National Kaohsiung University of Applied Sciences, Kaohsiung, Taiwan. leechung@mail.ee.kaus.edu.tw;Department of Electrical Engineering, National Kaohsiung University of Applied Sciences, Kaohsiung, Taiwan. hcyang@mail.cju.edu.tw
Venue:
Applied Intelligence
Year:
2003

Citing 0
Cited 9

Distributed multi-lingual content based text mining DML - CBTM

ACST'07 Proceedings of the third conference on IASTED International Conference: Advances in Computer Science and Technology
Construction of supervised and unsupervised learning systems for multilingual text categorization

Expert Systems with Applications: An International Journal
A method for multilingual text mining and retrieval using growing hierarchical self-organizing maps

Journal of Information Science
Multilingual document mining and navigation using self-organizing maps

Information Processing and Management: an International Journal
Self-Organizing-Map-Based metamodeling for massive text data exploration

ISNN'06 Proceedings of the Third international conference on Advances in Neural Networks - Volume Part I
Automatic folder allocation system using Bayesian-support vector machines hybrid classification approach

Applied Intelligence
Double enhancement learning for explicit internal representations: unifying self-enhancement and information enhancement to incorporate information on input variables

Applied Intelligence
A hybrid text classification approach with low dependency on parameter by integrating K-nearest neighbor and support vector machine

Expert Systems with Applications: An International Journal
An enhanced Support Vector Machine classification framework by using Euclidean distance function for text document categorization

Applied Intelligence

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper describes our work on developing a language-independent technique for discovery of implicit knowledge from multilingual information sources. Text mining has been gaining popularity in the knowledge discovery field, particularity with the increasing availability of digital documents in various languages from all around the world. However, currently most text mining tools mainly focus only on processing monolingual documents (particularly English documents): little attention has been paid to apply the techniques to handle the documents in Asian languages, and further extend the mining algorithms to support the aspects of multilingual information sources. In this work, we attempt to develop a language-neutral method to tackle the linguistics difficulties in the text mining process. Using a variation of automatic clustering techniques, which apply a neural net approach, namely the Self-Organizing Maps (SOM), we have conducted several experiments to uncover associated documents based on a Chinese corpus, Chinese-English bilingual parallel corpora, and a hybrid Chinese-English corpus. The experiments show some interesting results and a couple of potential paths for future work in the field of multilingual information discovery. Besides, this work is expected to act as a starting point for exploring the impacts on linguistics issues with the machine-learning approach to mining sensible linguistics elements from multilingual text collections.