Put that where? voice and gesture at the graphics interface
ACM SIGGRAPH Computer Graphics
Alice: lessons learned from building a 3D system for novices
Proceedings of the SIGCHI conference on Human Factors in Computing Systems
WordsEye: an automatic text-to-scene conversion system
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Motion Control of Virtual Humans
IEEE Computer Graphics and Applications
The story picturing engine: finding elite images to illustrate a story using mutual reinforcement
Proceedings of the 6th ACM SIGMM international workshop on Multimedia information retrieval
From text to images through meanings
Proceedings of the 2004 ACM SIGCHI International Conference on Advances in computer entertainment technology
The Story Picturing Engine---a system for automatic text illustration
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
A study on a geometry transformation method for a geometry and scene modeler by a verbal interface
Proceedings of the 4th international conference on Computer graphics and interactive techniques in Australasia and Southeast Asia
Real-time automatic 3D scene generation from natural language voice and text descriptions
MULTIMEDIA '06 Proceedings of the 14th annual ACM international conference on Multimedia
Making sense of virtual environments: action representation, grounding and common sense
Proceedings of the 12th international conference on Intelligent user interfaces
Constraint-based conversion of fiction text to a time-based graphical representation
Proceedings of the 2007 annual research conference of the South African institute of computer scientists and information technologists on IT research in developing countries
Mechanisms for multimodality: taking fiction to another dimension
AFRIGRAPH '07 Proceedings of the 5th international conference on Computer graphics, virtual reality, visualisation and interaction in Africa
An NLP-Based 3D Scene Generation System for Children with Autism or Mental Retardation
ICAISC '08 Proceedings of the 9th international conference on Artificial Intelligence and Soft Computing
Toward communicating simple sentences using pictorial representations
Machine Translation
Easy as ABC?: facilitating pictorial communication via semantically enhanced layout
CoNLL '08 Proceedings of the Twelfth Conference on Computational Natural Language Learning
A text-to-picture synthesis system for augmenting communication
AAAI'07 Proceedings of the 22nd national conference on Artificial intelligence - Volume 2
The development of a language interface for 3D scene generation
IASTED-HCI '07 Proceedings of the Second IASTED International Conference on Human Computer Interaction
From text descriptions to interactive 3D scene reconstruction
MS '08 Proceedings of the 19th IASTED International Conference on Modelling and Simulation
Automatic generation of computeranimation: using AI for movie animation
Automatic generation of computeranimation: using AI for movie animation
Frame semantics in text-to-scene generation
KES'10 Proceedings of the 14th international conference on Knowledge-based and intelligent information and engineering systems: Part IV
VigNet: grounding language in graphics using frame semantics
RELMS '11 Proceedings of the ACL 2011 Workshop on Relational Models of Semantics
KES'11 Proceedings of the 15th international conference on Knowledge-based and intelligent information and engineering systems - Volume Part IV
3D visualization of simple natural language statement using semantic description
IVIC'11 Proceedings of the Second international conference on Visual informatics: sustaining research and innovations - Volume Part I
Visual semantic approach for virtual scene generation
Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry
EVA'11 Proceedings of the 2011 international conference on Electronic Visualisation and the Arts
| Hi-index | 0.00 |
Describing a scene to a computer is an inherent task of computer graphics applications. Modeled scenes are typically built with direct placement techniques or specialized scripting languages. The scene description task could be greatly eased if natural language were an interactive control option. However, natural language understanding is notoriously difficult for computers. This difficulty is exacerbated in the case of computer graphics by the need for geometric output, not just "conceptual understanding" or high-level inferencing. General text-understanding techniques have not been successfully applied to scene generation. Typically, a few task-specific commands, such as "walk," are implemented as an ad-hoc collection of procedures. Our approach aims to separate the expressive power of fundamental natural concepts from the difficult task of text understanding. We are developing a 3D object placement system based on a combination of natural commands and interactive techniques. Guided by research in cognitive linguistics, we use basic spatial relationships--such as in, on, and at--and fundamental scene parameters--such as viewer location and object dimensionality--to identify regions of placement for objects in a scene. These natural commands can be used to quickly prototype a complex scene and constrain object placement.