An NLP-Based 3D Scene Generation System for Children with Autism or Mental Retardation

Authors:
Yılmaz Kılıçaslan;Özlem Uçar;Edip Serdar Güner
Affiliations:
Department of Computer Engineering, University of Trakya, Edirne, Turkey 22030;Department of Computer Engineering, University of Trakya, Edirne, Turkey 22030;Department of Computer Engineering, University of Trakya, Edirne, Turkey 22030
Venue:
ICAISC '08 Proceedings of the 9th international conference on Artificial Intelligence and Soft Computing
Year:
2006

Citing 4
Cited 0

WordsEye: an automatic text-to-scene conversion system

Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Natural language driven image generation

ACL '84 Proceedings of the 10th International Conference on Computational Linguistics and 22nd annual meeting on Association for Computational Linguistics
Healthcare Systems and Other Applications

IEEE Pervasive Computing
Put: Language-Based Interactive Manipulation of Objects

IEEE Computer Graphics and Applications

Quantified Score

Hi-index	0.00

Visualization

Abstract

It is well-known that people with autism or mental retardation experience crucial problems in thinking and communicating using linguistic structures. Thus, we foresee the emergence of text-to-image conversion systems to let such people establish a bridge between linguistic expressions and the concepts these expressions refer to via relevant images. S2S is such a system for converting Turkish sentences into representative 3D scenes via the mediation of an HPSG-based NLP module. A precursor to S2S, a non-3D version, has been tested with a group of students with autism and mental retardation in a special education center and has provided promising results motivating the work presented in this paper.