Interactive images: cuboid proxies for smart image manipulation

  • Authors:
  • Youyi Zheng;Xiang Chen;Ming-Ming Cheng;Kun Zhou;Shi-Min Hu;Niloy J. Mitra

  • Affiliations:
  • KAUST;KAUST and Zhejiang Univ.;TNList, Tsinghua Univ.;Zhejiang Univ.;TNList, Tsinghua Univ.;KAUST and University College London

  • Venue:
  • ACM Transactions on Graphics (TOG) - SIGGRAPH 2012 Conference Proceedings
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

Images are static and lack important depth information about the underlying 3D scenes. We introduce interactive images in the context of man-made environments wherein objects are simple and regular, share various non-local relations (e.g., coplanarity, parallelism, etc.), and are often repeated. Our interactive framework creates partial scene reconstructions based on cuboid-proxies with minimal user interaction. It subsequently allows a range of intuitive image edits mimicking real-world behavior, which are otherwise difficult to achieve. Effectively, the user simply provides high-level semantic hints, while our system ensures plausible operations by conforming to the extracted non-local relations. We demonstrate our system on a range of real-world images and validate the plausibility of the results using a user study.