Automatic browsing of large pictures on mobile devices
MULTIMEDIA '03 Proceedings of the eleventh ACM international conference on Multimedia
Automatic thumbnail cropping and its effectiveness
Proceedings of the 16th annual ACM symposium on User interface software and technology
Gaze-based interaction for semi-automatic photo cropping
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Video retargeting: automating pan and scan
MULTIMEDIA '06 Proceedings of the 14th annual ACM international conference on Multimedia
Seam carving for content-aware image resizing
ACM SIGGRAPH 2007 papers
Improved seam carving for video retargeting
ACM SIGGRAPH 2008 papers
Re-cinematography: Improving the camerawork of casual video
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Optimized scale-and-stretch for image resizing
ACM SIGGRAPH Asia 2008 papers
Multi-operator media retargeting
ACM SIGGRAPH 2009 papers
PatchMatch: a randomized correspondence algorithm for structural image editing
ACM SIGGRAPH 2009 papers
Optimized image resizing using seam carving and scaling
ACM SIGGRAPH Asia 2009 papers
A system for retargeting of streaming video
ACM SIGGRAPH Asia 2009 papers
Motion-aware temporal coherence for video resizing
ACM SIGGRAPH Asia 2009 papers
ACM SIGGRAPH ASIA 2009 Courses
Energy-based image deformation
SGP '09 Proceedings of the Symposium on Geometry Processing
Motion-based video retargeting with optimized crop-and-warp
ACM SIGGRAPH 2010 papers
Resizing by symmetry-summarization
ACM SIGGRAPH Asia 2010 papers
A comparative study of image retargeting
ACM SIGGRAPH Asia 2010 papers
EGSR'06 Proceedings of the 17th Eurographics conference on Rendering Techniques
SeamCrop: changing the size and aspect ratio of videos
Proceedings of the 4th Workshop on Mobile Video
Algorithm and VLSI architecture for real-time 1080p60 video retargeting
EGGH-HPG'12 Proceedings of the Fourth ACM SIGGRAPH / Eurographics conference on High-Performance Graphics
State of the Art Report on Video-Based Graphics and Video Visualization
Computer Graphics Forum
VEA 2012: Interactive image/video retexturing using GPU parallelism
Computers and Graphics
Depth Mapping for Stereoscopic Videos
International Journal of Computer Vision
Video retargeting combining warping and summarizing optimization
The Visual Computer: International Journal of Computer Graphics
GPU video retargeting with parallelized SeamCrop
Proceedings of the 5th ACM Multimedia Systems Conference
Hi-index | 0.00 |
The key to high-quality video resizing is preserving the shape and motion of visually salient objects while remaining temporally-coherent. These spatial and temporal requirements are difficult to reconcile, typically leading existing video retargeting methods to sacrifice one of them and causing distortion or waving artifacts. Recent work enforces temporal coherence of content-aware video warping by solving a global optimization problem over the entire video cube. This significantly improves the results but does not scale well with the resolution and length of the input video and quickly becomes intractable. We propose a new method that solves the scalability problem without compromising the resizing quality. Our method factors the problem into spatial and time/motion components: we first resize each frame independently to preserve the shape of salient regions, and then we optimize their motion using a reduced model for each pathline of the optical flow. This factorization decomposes the optimization of the video cube into sets of sub-problems whose size is proportional to a single frame's resolution and which can be solved in parallel. We also show how to incorporate cropping into our optimization, which is useful for scenes with numerous salient objects where warping alone would degenerate to linear scaling. Our results match the quality of state-of-the-art retargeting methods while dramatically reducing the computation time and memory consumption, making content-aware video resizing scalable and practical.