A Comparison of Performance of Sequential Learning Algorithms on the Task of Named Entity Recognition for Indian Languages

  • Authors:
  • Awaghad Ashish Krishnarao;Himanshu Gahlot;Amit Srinet;D. S. Kushwaha

  • Affiliations:
  • Motilal Nehru National Institute of Technology, Allahabad, India 211004;Motilal Nehru National Institute of Technology, Allahabad, India 211004;Motilal Nehru National Institute of Technology, Allahabad, India 211004;Motilal Nehru National Institute of Technology, Allahabad, India 211004

  • Venue:
  • ICCS '09 Proceedings of the 9th International Conference on Computational Science: Part I
  • Year:
  • 2009

Quantified Score

Hi-index 0.01

Visualization

Abstract

We have taken up the issue of named entity recognition of Indian languages by presenting a comparative study of two sequential learning algorithms viz. Conditional Random Fields (CRF) and Support Vector Machine (SVM). Though we only have results for Hindi, the features used are language independent, and hence the same procedure could be applied to tag the named entities in other Indian languages like Telgu, Bengali, Marathi etc. that have same number of vowels and consonants. We have used CRF++ for implementing CRF algorithm and Yamcha for implementing SVM algorithm. The results show a superiority of CRF over SVM and are just a little lower than the highest results achieved for this task. This can be attributed to the non-usage of any pre-processing and post-processing steps. The system makes use of the contextual information of words along with various language independent features to label the Named Entities (NEs).