SceneMaker: intelligent multimodal visualization of natural language scripts

  • Authors:

  • Eva Hanser;Paul Mc Kevitt;Tom Lunney;Joan Condell

  • Affiliations:

  • School of Computing & Intelligent Systems, Faculty of Computing & Engineering, University of Ulster, Magee, Derry, Londonderry, Northern Ireland;School of Computing & Intelligent Systems, Faculty of Computing & Engineering, University of Ulster, Magee, Derry, Londonderry, Northern Ireland;School of Computing & Intelligent Systems, Faculty of Computing & Engineering, University of Ulster, Magee, Derry, Londonderry, Northern Ireland;School of Computing & Intelligent Systems, Faculty of Computing & Engineering, University of Ulster, Magee, Derry, Londonderry, Northern Ireland

  • Venue:
  • AICS'09 Proceedings of the 20th Irish conference on Artificial intelligence and cognitive science
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

Producing plays, films or animations is a complex and expensive process involving various professionals and media. Our proposed software system, SceneMaker, aims to facilitate this creative process by automatically interpreting natural language film/play scripts and generating multimodal, animated scenes from them. During generation of story content, SceneMaker will give particular attention to emotional aspects and their reflection in fluency and manner of actions, body posture, facial expressions, speech, scene composition, timing, lighting, music and camera work. Related literature and software on Natural Language Processing, in particular textual affect sensing, affective embodied agents, visualisation of 3D scenes and digital cinematography are reviewed. In relation to other work, SceneMaker will present a genre-specific text-to-animation methodology which combines all relevant expressive modalities and is made accessible via web-based and mobile platforms. In conclusion, SceneMaker will enhance the communication of creative ideas providing quick pre-visualisations of scenes.