Automatic Korean word spacing using Pegasos algorithm

Authors:
Changki Lee;Hyunki Kim
Affiliations:
Department of Computer Science, College of Information Technology, Kangwon National University, Republic of Korea;Speech Language Technology Research Department, Electronics and Telecommunications Research Institute, Daejeon, Republic of Korea
Venue:
Information Processing and Management: an International Journal
Year:
2013

Citing 11
Cited 0

TnT: a statistical part-of-speech tagger

ANLC '00 Proceedings of the sixth conference on Applied natural language processing
Support vector machine learning for interdependent and structured output spaces

ICML '04 Proceedings of the twenty-first international conference on Machine learning
Training linear SVMs in linear time

Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining
Chinese and Japanese word segmentation using word-level and character-level information

COLING '04 Proceedings of the 20th international conference on Computational Linguistics
Chinese segmentation and new word detection using conditional random fields

COLING '04 Proceedings of the 20th international conference on Computational Linguistics
Automatic Word Spacing Using Probabilistic Models Based on Character n-grams

IEEE Intelligent Systems
Pegasos: Primal Estimated sub-GrAdient SOlver for SVM

Proceedings of the 24th international conference on Machine learning
A hybrid approach to word segmentation and POS tagging

ACL '07 Proceedings of the 45th Annual Meeting of the ACL on Interactive Poster and Demonstration Sessions
Cutting-plane training of structural SVMs

Machine Learning
An error-driven word-character hybrid model for joint Chinese word segmentation and POS tagging

ACL '09 Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 1 - Volume 1
Pegasos: primal estimated sub-gradient solver for SVM

Mathematical Programming: Series A and B - Special Issue on "Optimization and Machine learning"; Alexandre d’Aspremont • Francis Bach • Inderjit S. Dhillon • Bin Yu

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we describe an automatic Korean word spacing approach using structural SVMs to relax the independence assumptions required by HMMs. We use a Pegasos algorithm for fast training of structural SVMs. We show the Pegasos algorithm for structural SVMs outperforms significantly HMMs and traditional binary SVMs, and it is much faster than CRFs and structural SVMs without loss of performance.