A program for aligning sentences in bilingual corpora
Computational Linguistics - Special issue on using large corpora: I
Adaptive multilingual sentence boundary disambiguation
Computational Linguistics
ISDA '05 Proceedings of the 5th International Conference on Intelligent Systems Design and Applications
Developing an open-source, rule-based proofreading tool
Software—Practice & Experience
| Hi-index | 0.00 |
In this paper, we evaluate using the SRX (Segmentation Rules eXchange) standard for specifying sentence segmentation rules. The rules were originally created for a proofreading tool called LanguageTool. As proofreading tools are quite sensitive to segmentation errors, the underlying segmentation mechanisms must be sufficiently reliable. Even though SRX allows only regular expressions as a means for specifying sentence breaks and exceptions to those breaks, our evaluation shows that it is sufficient for the task, both in terms of the performance of the algorithm used and correctness of results. Moreover, it offers interoperability with different tools, which in turn allows maintaining consistent segmentation in a whole language-processing pipeline. Our rules are available on an open-source license (LGPL), which also helped in receiving valuable community input from our users.