A Model of Saliency-Based Visual Attention for Rapid Scene Analysis
IEEE Transactions on Pattern Analysis and Machine Intelligence
Automatic browsing of large pictures on mobile devices
MULTIMEDIA '03 Proceedings of the eleventh ACM international conference on Multimedia
Automatic thumbnail cropping and its effectiveness
Proceedings of the 16th annual ACM symposium on User interface software and technology
Distinctive Image Features from Scale-Invariant Keypoints
International Journal of Computer Vision
Proceedings of the 2004 Eurographics/ACM SIGGRAPH symposium on Geometry processing
Gaze-based interaction for semi-automatic photo cropping
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
MUM '05 Proceedings of the 4th international conference on Mobile and ubiquitous multimedia
CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2
Video retargeting: automating pan and scan
MULTIMEDIA '06 Proceedings of the 14th annual ACM international conference on Multimedia
Seam carving for content-aware image resizing
ACM SIGGRAPH 2007 papers
Image alignment and stitching: a tutorial
Foundations and Trends® in Computer Graphics and Vision
Improved seam carving for video retargeting
ACM SIGGRAPH 2008 papers
Re-cinematography: Improving the camerawork of casual video
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Non-homogeneous resizing of complex models
ACM SIGGRAPH Asia 2008 papers
Optimized scale-and-stretch for image resizing
ACM SIGGRAPH Asia 2008 papers
Focus+Context Visualization with Distortion Minimization
IEEE Transactions on Visualization and Computer Graphics
Multi-operator media retargeting
ACM SIGGRAPH 2009 papers
A system for retargeting of streaming video
ACM SIGGRAPH Asia 2009 papers
EGSR'06 Proceedings of the 17th Eurographics conference on Rendering Techniques
A system for retargeting of streaming video
ACM SIGGRAPH Asia 2009 papers
ACM SIGGRAPH ASIA 2009 Courses
Nonlinear disparity mapping for stereoscopic 3D
ACM SIGGRAPH 2010 papers
Motion-based video retargeting with optimized crop-and-warp
ACM SIGGRAPH 2010 papers
Interactive content-aware zooming
Proceedings of Graphics Interface 2010
Resizing by symmetry-summarization
ACM SIGGRAPH Asia 2010 papers
Algorithms for video retargeting
Multimedia Tools and Applications
Scalable and coherent video resizing with per-frame optimization
ACM SIGGRAPH 2011 papers
Multiple-cue saliency measurement and optimized image composition for image retargeting
Journal of Computational and Applied Mathematics
Content aware video manipulation
Computer Vision and Image Understanding
Combining content-based analysis and crowdsourcing to improve user interaction with zoomable video
MM '11 Proceedings of the 19th ACM international conference on Multimedia
Multidimensional image retargeting
SIGGRAPH Asia 2011 Courses
Patchwise scaling method for content-aware image resizing
Signal Processing
Image resizing via non-homogeneous warping
Multimedia Tools and Applications
Algorithm and VLSI architecture for real-time 1080p60 video retargeting
EGGH-HPG'12 Proceedings of the Fourth ACM SIGGRAPH / Eurographics conference on High-Performance Graphics
Video retargeting combining warping and summarizing optimization
The Visual Computer: International Journal of Computer Graphics
Saliency detection based on integrated features
Neurocomputing
Hi-index | 0.01 |
Temporal coherence is crucial in content-aware video retargeting. To date, this problem has been addressed by constraining temporally adjacent pixels to be transformed coherently. However, due to the motion-oblivious nature of this simple constraint, the retargeted videos often exhibit flickering or waving artifacts, especially when significant camera or object motions are involved. Since the feature correspondence across frames varies spatially with both camera and object motion, motion-aware treatment of features is required for video resizing. This motivated us to align consecutive frames by estimating interframe camera motion and to constrain relative positions in the aligned frames. To preserve object motion, we detect distinct moving areas of objects across multiple frames and constrain each of them to be resized consistently. We build a complete video resizing framework by incorporating our motion-aware constraints with an adaptation of the scale-and-stretch optimization recently proposed by Wang and colleagues. Our streaming implementation of the framework allows efficient resizing of long video sequences with low memory cost. Experiments demonstrate that our method produces spatiotemporally coherent retargeting results even for challenging examples with complex camera and object motion, which are difficult to handle with previous techniques.