Fast construction of dynamic and multi-resolution 360° panoramas from video sequences

Authors:
Zhigang Zhu;Guangyou Xu;Edward M. Riseman;Allen R. Hanson
Affiliations:
Department of Computer Science, City College of New York, Convent Avenue and 138th Street, NY 10031, USA;Department of Computer Science and Technology, Tsinghua University, Beijing 100084, China;Department of Computer Science, University of Massachusetts at Amherst, MA 01003, USA;Department of Computer Science, University of Massachusetts at Amherst, MA 01003, USA
Venue:
Image and Vision Computing
Year:
2006

Citing 11
Cited 4

Using Dynamic Programming for Solving Variational Problems in Vision

IEEE Transactions on Pattern Analysis and Machine Intelligence
A fast algorithm for active contours and curvature estimation

CVGIP: Image Understanding
Omnistereo: Panoramic Stereo Imaging

IEEE Transactions on Pattern Analysis and Machine Intelligence
Deformable Contours: Modeling and Extraction

IEEE Transactions on Pattern Analysis and Machine Intelligence
Mosaic based representations of video sequences and their applications

ICCV '95 Proceedings of the Fifth International Conference on Computer Vision
Stereo Reconstruction from Multiperspective Panoramas

IEEE Transactions on Pattern Analysis and Machine Intelligence
Generalized Parallel-Perspective Stereo Mosaics from Airborne Video

IEEE Transactions on Pattern Analysis and Machine Intelligence
Image matching with scale adjustment

Computer Vision and Image Understanding
Efficient Fourier-based approach for detecting orientations and occlusions in epipolar plane images for 3D scene modeling

International Journal of Computer Vision
LAMP: 3D layered, adaptive-resolution, and multi-perspective panorama—a new scene representation

Computer Vision and Image Understanding - Model-based and image-based 3D scene representation for interactive visalization
Fast panoramic stereo matching using cylindrical maximum surfaces

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Drift-Free Real-Time Sequential Mosaicing

International Journal of Computer Vision
Key frames selection into panoramic mosaics

ICICS'09 Proceedings of the 7th international conference on Information, communications and signal processing
Visual nouns for indoor/outdoor navigation

ICCHP'12 Proceedings of the 13th international conference on Computers Helping People with Special Needs - Volume Part II
Human detection for a robot tractor using omni-directional stereo vision

Computers and Electronics in Agriculture

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents a unified approach to automatically build dynamic and multi-resolution 360^o panoramic (DMP) representations from image sequences captured by hand-held cameras mainly undertaking rotation and zooming for natural scenes with moving targets. A simple (yet stable) rigid motion model and a closed-loop-based mosaicing algorithm are proposed to generate cylindrical mosaics automatically. Multi-resolution representations are built for interesting areas by separating zooming sub-sequences from a pan/zoom sequence. Moving objects are detected and separated from images based on motion information, and then more accurate contours are extracted using a modified active contour algorithm. The DMP construction method is fast, robust, and automatic, achieving five frames per second for image sequences with 384x288 color images on a Pentium III 800MHz PC. The construction of the DMP representation can be used in virtual reality, video surveillance, and very low bit-rate video coding.