Real-time image mosaicing using non-rigid registration

Authors:
Rafael Henrique Castanheira de Souza;Masatoshi Okutomi;Akihiko Torii
Affiliations:
Tokyo Institute of Technology, Japan;Tokyo Institute of Technology, Japan;Tokyo Institute of Technology, Japan
Venue:
PSIVT'11 Proceedings of the 5th Pacific Rim conference on Advances in Image and Video Technology - Volume Part I
Year:
2011

Citing 11
Cited 0

Mosaicing on Adaptive Manifolds

IEEE Transactions on Pattern Analysis and Machine Intelligence
Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography

Communications of the ACM
Automated Mosaics via Topology Inference

IEEE Computer Graphics and Applications
Robust Video Mosaicing through Topology Inference and Local to Global Alignment

ECCV '98 Proceedings of the 5th European Conference on Computer Vision-Volume II - Volume II
A new point matching algorithm for non-rigid registration

Computer Vision and Image Understanding - Special issue on nonrigid image registration
Real-Time Non-Rigid Surface Detection

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1 - Volume 01
Automatic Panoramic Image Stitching using Invariant Features

International Journal of Computer Vision
Image alignment and stitching: a tutorial

Foundations and Trends® in Computer Graphics and Vision
A Fast 2D Shape Recovery Approach by Fusing Features and Appearance

IEEE Transactions on Pattern Analysis and Machine Intelligence
Image mosaicing via quadric surface estimation with priors for tunnel inspection

ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
SURF: speeded up robust features

ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part I

Quantified Score

Hi-index	0.00

Visualization

Abstract

Mosaicing is a classical application of image registration where images from the same scene are stitched together to generate a larger seamless image. This paper presents a real-time incremental mosaicing method that generates 2D mosaics by stitching video key-frames as soon as they are detected. The contributions are three-fold: (1) we propose a “fast” key-frame selection procedure based solely on the distribution of the distance of matched feature descriptors. This procedure automatically selects key-frames that are used to expand the mosaics while achieving real-time performance; (2) we register key-frame images by using a non-rigid deformation model in order to “smoothly” stitch images when scene transformations can not be expressed by homography: (3) we add a new constraint on the non-rigid deformation model that penalizes over-deformation in order to create “visually natural” mosaics. The performance of the proposed method was validated by experiments in non-controlled conditions and by comparison with the state-of-the-art method.