Introduction to algorithms
A stochastic finite-state word-segmentation algorithm for Chinese
Computational Linguistics
Adaptive multilingual sentence boundary disambiguation
Computational Linguistics
Critical tokenization and its properties
Computational Linguistics
Two parsing algorithms by means of finite state transducers
COLING '94 Proceedings of the 15th conference on Computational linguistics - Volume 1
| Hi-index | 0.00 |
Sumo is a formalism for universal segmentation of text. Its purpose is to provide a framework for the creation of segmentation applications. It is called "universal" as the formalism itself is independent of the language of the documents to process and independent of the levels of segmentation (e.g. words, sentences, paragraphs, morphemes...) considered by the target application. This framework relies on a layered structure representing the possible segmentations of the document. This structure and the tools to manipulate it are described, followed by detailed examples highlighting some features of Sumo.