Introduction to CKIP Chinese word segmentation system for the first international Chinese Word Segmentation Bakeoff

Authors:
Wei-Yun Ma;Keh-Jiann Chen
Affiliations:
Institute of Information science, Academia Sinica;Institute of Information science, Academia Sinica
Venue:
SIGHAN '03 Proceedings of the second SIGHAN workshop on Chinese language processing - Volume 17
Year:
2003

Citing 5
Cited 29

Lexical analysis for Chinese—difficulties and possible solutions

Journal of the Chinese Institute of Engineers - Chinese speech and language processing
Word identification for Mandarin Chinese sentences

COLING '92 Proceedings of the 14th conference on Computational linguistics - Volume 1
Unknown word extraction for Chinese documents

COLING '02 Proceedings of the 19th international conference on Computational linguistics - Volume 1
Design of Chinese morphological analyzer

SIGHAN '02 Proceedings of the first SIGHAN workshop on Chinese language processing - Volume 18
A bottom-up merging algorithm for Chinese unknown word extraction

SIGHAN '03 Proceedings of the second SIGHAN workshop on Chinese language processing - Volume 17

Storyline-based summarization for news topic retrospection

Decision Support Systems
Enabling the creation of domain-specific reference collections to support text-based information retrieval experiments in the architecture, engineering and construction industries

Advanced Engineering Informatics
Assessing creative problem-solving with automated text grading

Computers & Education
Discovering genres of online discussion threads via text mining

Computers & Education
A synthetical approach for blog recommendation: Combining trust, social relation, and semantic analysis

Expert Systems with Applications: An International Journal
Personalized e-news monitoring agent system for tracking user-interested Chinese news events

Applied Intelligence
Preliminary vocabulary frequency findings for Mandarin Chinese AAC treatments

Proceedings of the 3rd International Convention on Rehabilitation Engineering & Assistive Technology
The role of lexical resources in CJK natural language processing

MLRI '06 Proceedings of the Workshop on Multilingual Language Resources and Interoperability
Learning bilingual linguistic reordering model for statistical machine translation

NAACL '09 Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics
A hybrid ontology directed feedback selection algorithm for supporting creative problem solving dialogues

IJCAI'07 Proceedings of the 20th international joint conference on Artifical intelligence
Construction and analysis of educational assessments using knowledge maps with weight appraisal of concepts

Computers & Education
A hybrid Chinese information retrieval model

AMT'10 Proceedings of the 6th international conference on Active media technology
Ubiquitous Healthcare Service System with Context-awareness Capability: Design and Implementation

Expert Systems with Applications: An International Journal
Visually and Phonologically Similar Characters in Incorrect Chinese Words: Analyses, Identification, and Applications

ACM Transactions on Asian Language Information Processing (TALIP)
Multilingual sentence alignment from Wikipedia as multilingual comparable corpora

Proceedings of the 13th International Conference on Humans and Computers
An analysis of network structure and post content for blog post recommendation

DASFAA'11 Proceedings of the 16th international conference on Database systems for advanced applications
Using Sublexical Translations to Handle the OOV Problem in Machine Translation

ACM Transactions on Asian Language Information Processing (TALIP)
Error Diagnosis of Chinese Sentences Using Inductive Learning Algorithm and Decomposition-Based Testing Mechanism

ACM Transactions on Asian Language Information Processing (TALIP)
The contribution of lexical resources to natural language processing of CJK languages

ISCSLP'06 Proceedings of the 5th international conference on Chinese Spoken Language Processing
A personal ontology model for library recommendation system

ICADL'06 Proceedings of the 9th international conference on Asian Digital Libraries: achievements, Challenges and Opportunities
Learning to deal with the OOV problem in phrase-based MT system: [in Chinese]

ROCLING '11 Proceedings of the 23rd Conference on Computational Linguistics and Speech Processing
Unsupervised overlapping feature selection for conditional random fields learning in Chinese word segmentation

ROCLING '11 Proceedings of the 23rd Conference on Computational Linguistics and Speech Processing
Unknown word extraction from multilingual code-switching sentences

ROCLING '11 ROCLING 2011 Poster Papers
Validating Contradiction in Texts Using Online Co-Mention Pattern Checking

ACM Transactions on Asian Language Information Processing (TALIP) - Special Issue on RITE
DOMCAT: a bilingual concordancer for domain-specific computer assisted translation

ACL '12 Proceedings of the ACL 2012 System Demonstrations
Geographic Information Retrieval and Text Mining on Chinese Tourism Web Pages

International Journal of Information Technology and Web Engineering
An Intelligent Embedded Marketing Service System based on TV apps: Design and implementation through product placement in idol dramas

Expert Systems with Applications: An International Journal
Do they narrate in same vocabulary?: the result of core vocabulary investigation from children with/without asperger syndrome in Taiwan

i-CREATe '11 Proceedings of the 5th International Conference on Rehabilitation Engineering & Assistive Technology
Do they need specific language training content?: results of core vocabulary investigation from children with/without intellectual disabilities in Taiwan

Proceedings of the 7th International Convention on Rehabilitation Engineering and Assistive Technology

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we roughly described the procedures of our segmentation system, including the methods for resolving segmentation ambiguities and identifying unknown words. The CKIP group of Academia Sinica participated in testing on open and closed tracks of Beijing University (PK) and Hong Kong Cityu (HK). The evaluation results show our system performs very well in either HK open track or HK closed track and just acceptable in PK tracks. Some explanations and analysis are presented in this paper.