Part-of-speech tagging of Northern Sotho: disambiguating polysemous function words

Authors:
Gertrud Faaß;Ulrich Heid;Elsabé Taljard;Danie Prinsloo
Affiliations:
Universität Stuttgart, Germany and University of Pretoria, South Africa;Universität Stuttgart, Germany;University of Pretoria, South Africa;University of Pretoria, South Africa
Venue:
AfLaT '09 Proceedings of the First Workshop on Language Technologies for African Languages
Year:
2009

Citing 4
Cited 1

A maximum entropy approach to natural language processing

Computational Linguistics
TnT: a statistical part-of-speech tagger

ANLC '00 Proceedings of the sixth conference on Applied natural language processing
The best of two worlds: cooperation of statistical and rule-based taggers for Czech

ACL '07 Proceedings of the Workshop on Balto-Slavonic Natural Language Processing: Information Extraction and Enabling Technologies
Estimation of conditional probabilities with decision trees and an application to fine-grained POS tagging

COLING '08 Proceedings of the 22nd International Conference on Computational Linguistics - Volume 1

Exploring the sawa corpus: collection and deployment of a parallel corpus English--Swahili

Language Resources and Evaluation

Quantified Score

Hi-index	0.00

Visualization

Abstract

A major obstacle to part-of-speech (=POS) tagging of Northern Sotho (Bantu, S 32) are ambiguous function words. Many are highly polysemous and very frequent in texts, and their local context is not always distinctive. With certain taggers, this issue leads to comparatively poor results (between 88 and 92% accuracy), especially when sizeable tagsets (over 100 tags) are used. We use the RF-tagger (Schmid and Laws, 2008), which is particularly designed for the annotation of fine-grained tagsets (e.g. including agreement information), and we restructure the 141 tags of the tagset proposed by Taljard et al. (2008) in a way to fit the RF tagger. This leads to over 94% accuracy. Error analysis in addition shows which types of phenomena cause trouble in the POS-tagging of Northern Sotho.