Distributed representation of word by using Elman network

Authors:
Jiun-Wei Liou;Wei-Chen Cheng;Jau-Chi Huang;Cheng-Yuan Liou
Affiliations:
Department of Computer Science and Information Engineering, National Taiwan University, No. 1, Sec. 4, Roosevelt Rd., Taipei, 10617, Taiwan;Institute of Statistical Science, Academia Sinica, 128 Academia Road, Section 2, Nankang, Taipei 115, Taiwan;Information and Communication Security Laboratory, Telecommunication Laboratories, Chunghwa Telecom Co., Ltd. No. 99, Dianyan Rd., Yangmei City, Taoyuan County, 32601, Taiwan;Department of Computer Science and Information Engineering, National Taiwan University, No. 1, Sec. 4, Roosevelt Rd., Taipei 10617, Taiwan
Venue:
International Journal of Intelligent Information and Database Systems
Year:
2013

Citing 4
Cited 0

Learning internal representations by error propagation

Parallel distributed processing: explorations in the microstructure of cognition, vol. 1
Neural networks and analog computation: beyond the Turing limit

Neural networks and analog computation: beyond the Turing limit
Modeling word perception using the Elman network

Neurocomputing
Semantic addressable encoding

ICONIP'06 Proceedings of the 13 international conference on Neural Information Processing - Volume Part I

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents a novel training method for Elman network to encode the words in literary works. This network has been used in studying limited simple artificial sentences with varying degrees of success. This paper shows how to use it to process real-world works. Both word codes and network weights can be accomplished by the method. Each trained code is a distributed representation of its word. The training error can be drastically reduced by iteratively re-encoding the representations. Several distinct findings and results during the training process are reported.