Text-to-video: story illustration from online photo collections

Authors:
Katharina Schwarz;Pavel Rojtberg;Joachim Caspar;Iryna Gurevych;Michael Goesele;Hendrik P. A. Lensch
Affiliations:
Ulm University;TU Darmstadt;TU Darmstadt;TU Darmstadt;TU Darmstadt;Ulm University
Venue:
KES'10 Proceedings of the 14th international conference on Knowledge-based and intelligent information and engineering systems: Part IV
Year:
2010

Citing 6
Cited 1

Color matching for image retrieval

Pattern Recognition Letters
Information extraction

Communications of the ACM
Photo clip art

ACM SIGGRAPH 2007 papers
Scene completion using millions of photographs

ACM SIGGRAPH 2007 papers
Sketch2Photo: internet image montage

ACM SIGGRAPH Asia 2009 papers
Color style transfer techniques using hue, lightness and saturation histogram matching

Computational Aesthetics'05 Proceedings of the First Eurographics conference on Computational Aesthetics in Graphics, Visualization and Imaging

Collecting semantic information for locations in the scenario-based lexical knowledge resource of a text-to-scene conversion system

KES'11 Proceedings of the 15th international conference on Knowledge-based and intelligent information and engineering systems - Volume Part IV

Quantified Score

Hi-index	0.00

Visualization

Abstract

We present a first system to semi-automatically create a visual representation for a given, short text. We first parse the input text, decompose it into suitable units, and construct meaningful search terms. Using these search terms we retrieve a set of candidate images from online photo collections. We then select the final images in a user-assisted process and automatically create a storyboard or photomatic animation. We demonstrate promising initial results on several types of texts.