A Model of Saliency-Based Visual Attention for Rapid Scene Analysis
IEEE Transactions on Pattern Analysis and Machine Intelligence
Automatic browsing of large pictures on mobile devices
MULTIMEDIA '03 Proceedings of the eleventh ACM international conference on Multimedia
Looking into video frames on small displays
MULTIMEDIA '03 Proceedings of the eleventh ACM international conference on Multimedia
Automatic thumbnail cropping and its effectiveness
Proceedings of the 16th annual ACM symposium on User interface software and technology
Robust Real-Time Face Detection
International Journal of Computer Vision
Gaze-based interaction for semi-automatic photo cropping
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Video retargeting: automating pan and scan
MULTIMEDIA '06 Proceedings of the 14th annual ACM international conference on Multimedia
Seam carving for content-aware image resizing
ACM SIGGRAPH 2007 papers
Improved seam carving for video retargeting
ACM SIGGRAPH 2008 papers
Optimized scale-and-stretch for image resizing
ACM SIGGRAPH Asia 2008 papers
Multi-operator media retargeting
ACM SIGGRAPH 2009 papers
PatchMatch: a randomized correspondence algorithm for structural image editing
ACM SIGGRAPH 2009 papers
Concurrent number cruncher: a GPU implementation of a general sparse linear solver
International Journal of Parallel, Emergent and Distributed Systems
Optimized image resizing using seam carving and scaling
ACM SIGGRAPH Asia 2009 papers
A system for retargeting of streaming video
ACM SIGGRAPH Asia 2009 papers
Motion-aware temporal coherence for video resizing
ACM SIGGRAPH Asia 2009 papers
ACM SIGGRAPH ASIA 2009 Courses
Energy-based image deformation
SGP '09 Proceedings of the Symposium on Geometry Processing
EGSR'06 Proceedings of the 17th Eurographics conference on Rendering Techniques
Resizing by symmetry-summarization
ACM SIGGRAPH Asia 2010 papers
Scalable and coherent video resizing with per-frame optimization
ACM SIGGRAPH 2011 papers
ISVC'11 Proceedings of the 7th international conference on Advances in visual computing - Volume Part I
Content aware video manipulation
Computer Vision and Image Understanding
Multidimensional image retargeting
SIGGRAPH Asia 2011 Courses
Using eye-tracking to assess different image retargeting methods
Proceedings of the ACM SIGGRAPH Symposium on Applied Perception in Graphics and Visualization
Patchwise scaling method for content-aware image resizing
Signal Processing
Computer Graphics Forum
Multi-operator image retargeting with automatic integration of direct and indirect seam carving
Image and Vision Computing
Silhouette-aware warping for image-based rendering
EGSR'11 Proceedings of the Twenty-second Eurographics conference on Rendering
Algorithm and VLSI architecture for real-time 1080p60 video retargeting
EGGH-HPG'12 Proceedings of the Fourth ACM SIGGRAPH / Eurographics conference on High-Performance Graphics
Dynamic distortion maps for image retargeting
Journal of Visual Communication and Image Representation
Technical Section: Planar shape interpolation using relative velocity fields
Computers and Graphics
A hybrid method for video stabilization and retargeting
Proceedings of the Fifth International Conference on Internet Multimedia Computing and Service
Video retargeting combining warping and summarizing optimization
The Visual Computer: International Journal of Computer Graphics
Scale and Object Aware Image Thumbnailing
International Journal of Computer Vision
A framework for key-frame selection based on relevance feedback
Proceedings of the 12th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry
GPU video retargeting with parallelized SeamCrop
Proceedings of the 5th ACM Multimedia Systems Conference
Optimizing disparity for motion in depth
EGSR '13 Proceedings of the Eurographics Symposium on Rendering
Hi-index | 0.00 |
We introduce a video retargeting method that achieves high-quality resizing to arbitrary aspect ratios for complex videos containing diverse camera and dynamic motions. Previous content-aware retargeting methods mostly concentrated on spatial considerations, attempting to preserve the shape of salient objects in each frame by removing or distorting homogeneous background content. However, sacrificeable space is fundamentally limited in video, since object motion makes foreground and background regions correlated, causing waving and squeezing artifacts. We solve the retargeting problem by explicitly employing motion information and by distributing distortion in both spatial and temporal dimensions. We combine novel cropping and warping operators, where the cropping removes temporally-recurring contents and the warping utilizes available homogeneous regions to mask deformations while preserving motion. Variational optimization allows to find the best balance between the two operations, enabling retargeting of challenging videos with complex motions, numerous prominent objects and arbitrary depth variability. Our method compares favorably with state-of-the-art retargeting systems, as demonstrated in the examples and widely supported by the conducted user study.