Data-Driven Object Manipulation in Images

  • Authors:
  • Chen Goldberg;Tao Chen;Fang-Lue Zhang;Ariel Shamir;Shi-Min Hu

  • Affiliations:
  • The Interdisciplinary Center, Israel;TNList, Department of Computer Science and Technology, Tsinghua University, China;TNList, Department of Computer Science and Technology, Tsinghua University, China;The Interdisciplinary Center, Israel;TNList, Department of Computer Science and Technology, Tsinghua University, China

  • Venue:
  • Computer Graphics Forum
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present a framework for interactively manipulating objects in a photograph using related objects obtained from internet images. Given an image, the user selects an object to modify, and provides keywords to describe it. Objects with a similar shape are retrieved and segmented from online images matching the keywords, and deformed to correspond with the selected object. By matching the candidate object and adjusting manipulation parameters, our method appropriately modifies candidate objects and composites them into the scene. Supported manipulations include transferring texture, color and shape from the matched object to the target in a seamless manner. We demonstrate the versatility of our framework using several inputs of varying complexity, for object completion, augmentation, replacement and revealing. Our results are evaluated using a user study. © 2012 Wiley Periodicals, Inc. (This work was performed while Chen Goldberg was a visiting researcher at Tsinghua University, Beijing, China.)