The first international Chinese word segmentation Bakeoff

Authors:
Richard Sproat;Thomas Emerson
Affiliations:
AT&T Labs - Research, Florham Park, NJ;Basis Technology, Cambridge, MA
Venue:
SIGHAN '03 Proceedings of the second SIGHAN workshop on Chinese language processing - Volume 17
Year:
2003

Citing 1
Cited 44

Chinese text segmentation for text retrieval: achievements and problems

Journal of the American Society for Information Science

The Penn Chinese TreeBank: Phrase structure annotation of a large corpus

Natural Language Engineering
Chinese Word Segmentation and Named Entity Recognition: A Pragmatic Approach

Computational Linguistics
Chinese word segmentation using minimal linguistic knowledge

SIGHAN '03 Proceedings of the second SIGHAN workshop on Chinese language processing - Volume 17
Systran's Chinese word segmentation

SIGHAN '03 Proceedings of the second SIGHAN workshop on Chinese language processing - Volume 17
Adaptive Chinese word segmentation

ACL '04 Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics
Chinese and Japanese word segmentation using word-level and character-level information

COLING '04 Proceedings of the 20th international conference on Computational Linguistics
Chinese segmentation and new word detection using conditional random fields

COLING '04 Proceedings of the 20th international conference on Computational Linguistics
Subword-based tagging for confidence-dependent Chinese word segmentation

COLING-ACL '06 Proceedings of the COLING/ACL on Main conference poster sessions
Chinese word segmentation as morpheme-based lexical chunking

Information Sciences: an International Journal
Statistical Properties of Overlapping Ambiguities in Chinese Word Segmentation and a Strategy for Their Disambiguation

TSD '08 Proceedings of the 11th international conference on Text, Speech and Dialogue
A survey on session detection methods in query logs and a proposal for future evaluation

Information Sciences: an International Journal
Rethinking Chinese word segmentation: tokenization, character classification, or wordbreak identification

ACL '07 Proceedings of the 45th Annual Meeting of the ACL on Interactive Poster and Demonstration Sessions
Training Global Linear Models for Chinese Word Segmentation

Canadian AI '09 Proceedings of the 22nd Canadian Conference on Artificial Intelligence: Advances in Artificial Intelligence
TBL-improved non-deterministic segmentation and POS tagging for a Chinese parser

EACL '09 Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics
Character-level dependencies in Chinese: usefulness and learning

EACL '09 Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics
Semi-supervised sequence modeling with syntactic topic models

AAAI'05 Proceedings of the 20th national conference on Artificial intelligence - Volume 2
A dual-layer CRFs based joint decoding method for cascaded segmentation and labeling tasks

IJCAI'07 Proceedings of the 20th international joint conference on Artifical intelligence
Automatic semantic role labeling for Chinese verbs

IJCAI'05 Proceedings of the 19th international joint conference on Artificial intelligence
Incorporating user behaviors in new word detection

IJCAI'09 Proceedings of the 21st international jont conference on Artifical intelligence
An error-driven word-character hybrid model for joint Chinese word segmentation and POS tagging

ACL '09 Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 1 - Volume 1
Chinese text segmentation: A hybrid approach using transductive learning and statistical association measures

Expert Systems with Applications: An International Journal
A Unified Character-Based Tagging Framework for Chinese Word Segmentation

ACM Transactions on Asian Language Information Processing (TALIP)
From frequency to meaning: vector space models of semantics

Journal of Artificial Intelligence Research
Integrating unsupervised and supervised word segmentation: The role of goodness measures

Information Sciences: an International Journal
Incremental Chinese lexicon extraction with minimal resources on a domain-specific corpus

COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics: Posters
Syntactic processing using the generalized perceptron and beam search

Computational Linguistics
An integrative Chinese lexical analyzer based on maximum matching and second-maximum matching segmentation

ICCOMP'06 Proceedings of the 10th WSEAS international conference on Computers
Chinese new word identification: a latent discriminative model with global features

Journal of Computer Science and Technology - Special issue on natural language processing
Parsing the internal structure of words: a new paradigm for Chinese word segmentation

HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies - Volume 1
User Behaviors in Related Word Retrieval and New Word Detection: A Collaborative Perspective

ACM Transactions on Asian Language Information Processing (TALIP)
A new unsupervised approach to word segmentation

Computational Linguistics
Word frequency approximation for chinese using raw, MM-Segmented and manually segmented corpora

ICCPOL'06 Proceedings of the 21st international conference on Computer Processing of Oriental Languages: beyond the orient: the research challenges ahead
An integrated approach to chinese word segmentation and part-of-speech tagging

ICCPOL'06 Proceedings of the 21st international conference on Computer Processing of Oriental Languages: beyond the orient: the research challenges ahead
Chinese unknown word identification using class-based LM

IJCNLP'04 Proceedings of the First international joint conference on Natural Language Processing
An example-based study on chinese word segmentation using critical fragments

IJCNLP'04 Proceedings of the First international joint conference on Natural Language Processing
The use of SVM for chinese new word identification

IJCNLP'04 Proceedings of the First international joint conference on Natural Language Processing
Word frequency approximation for chinese without using manually-annotated corpus

CICLing'06 Proceedings of the 7th international conference on Computational Linguistics and Intelligent Text Processing
A unified framework for text analysis in chinese TTS

ISCSLP'06 Proceedings of the 5th international conference on Chinese Spoken Language Processing
A lexicon-constrained character model for chinese morphological analysis

IJCNLP'05 Proceedings of the Second international joint conference on Natural Language Processing
Unsupervised overlapping feature selection for conditional random fields learning in Chinese word segmentation

ROCLING '11 Proceedings of the 23rd Conference on Computational Linguistics and Speech Processing
A classical Chinese corpus with nested part-of-speech tags

LaTeCH '12 Proceedings of the 6th Workshop on Language Technology for Cultural Heritage, Social Sciences, and Humanities
The Left and Right Context of a Word: Overlapping Chinese Syllable Word Segmentation with Minimal Context

ACM Transactions on Asian Language Information Processing (TALIP)
Revising word lattice using support vector machine for Chinese word segmentation

Proceedings of the 14th International Conference on Information Integration and Web-based Applications & Services
An empirical study on word segmentation for chinese machine translation

CICLing'13 Proceedings of the 14th international conference on Computational Linguistics and Intelligent Text Processing - Volume 2

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents the results from the ACL-SIGHAN-sponsored First International Chinese Word Segmentation Bakeoff held in 2003 and reported in conjunction with the Second SIGHAN Workshop on Chinese Language Processing, Sapporo, Japan. We give the motivation for having an international segmentation contest (given that there have been two within-China contests to date) and we report on the results of this first international contest, analyze these results, and make some recommendations for the future.