The virtual cinematographer: a paradigm for automatic real-time camera control and directing
SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Automatic browsing of large pictures on mobile devices
MULTIMEDIA '03 Proceedings of the eleventh ACM international conference on Multimedia
On the Spatial Statistics of Optical Flow
ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 - Volume 01
MUM '05 Proceedings of the 4th international conference on Mobile and ubiquitous multimedia
CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2
Video retargeting: automating pan and scan
MULTIMEDIA '06 Proceedings of the 14th annual ACM international conference on Multimedia
Adapting Surneillance Video to Small Displays Via Object-Based Cropping
WIAMIS '07 Proceedings of the Eight International Workshop on Image Analysis for Multimedia Interactive Services
Seam carving for content-aware image resizing
ACM SIGGRAPH 2007 papers
Improved seam carving for video retargeting
ACM SIGGRAPH 2008 papers
EGSR'06 Proceedings of the 17th Eurographics conference on Rendering Techniques
Content-aware video resizing based on salient visual cubes
Journal of Visual Communication and Image Representation
Salient object detection in videos by optimal spatio-temporal path discovery
Proceedings of the 21st ACM international conference on Multimedia
| Hi-index | 0.00 |
Video retargeting aims at transforming an existing video in order to display it appropriately on a target device, often in a lower resolution, such as a mobile phone. To preserve a viewer's experience, it is desired to keep the important regions in their original aspect ratio, i.e., to maintain them distortion-free. Most previous methods are susceptible to geometric distortions due to the anisotropic manipulation of image pixels. In this paper, we propose a novel approach to distortion-free video retargeting by scale-space spatiotemporal saliency tracking. An optimal source cropping window with the target aspect ratio is smoothly tracked over time, and then isotropically resized to the retargeted display. The problem is cast as the task of finding the most spatiotemporally salient cropping window with minimal information loss due to resizing. We conduct the spatiotemporal saliency analysis in scale-space to better account for the effect of resizing. By leveraging integral images, we develop an efficient coarse-to-fine solution that combines exhaustive coarse and gradient-based fine search, which we term scale-space spatiotemporal saliency tracking. Experiments on real-world videos and our user study demonstrate the efficacy of the proposed approach.