Cooperative Sign Language Tutoring: A Multiagent Approach

  • Authors:
  • İlker Yıldırım;Oya Aran;Pınar Yolum;Lale Akarun

  • Affiliations:
  • Department of Computer Engineering, Boğaziçi University, Istanbul, Turkey 34342;Department of Computer Engineering, Boğaziçi University, Istanbul, Turkey 34342;Department of Computer Engineering, Boğaziçi University, Istanbul, Turkey 34342;Department of Computer Engineering, Boğaziçi University, Istanbul, Turkey 34342

  • Venue:
  • ESAW '09 Proceedings of the 10th International Workshop on Engineering Societies in the Agents World X
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

Sign languages can be learned effectively only with frequent feedback from an expert in the field. The expert needs to watch a performed sign, and decide whether the sign has been performed well based on his/her previous knowledge about the sign. The expert's role can be imitated by an automatic system, which uses a training set as its knowledge base to train a classifier that can decide whether the performed sign is correct. However, when the system does not have enough previous knowledge about a given sign, the decision will not be accurate. Accordingly, we propose a multiagent architecture in which agents cooperate with each other to decide on the correct classification of performed signs. We apply different cooperation strategies and test their performances in varying environments. Further, through analysis of the multiagent system, we can discover inherent properties of sign languages, such as the existence of dialects.