GPU-accelerated hierarchical dense correspondence for real-time aerial video processing

Authors:
Stephen Cluff;Bryan S. Morse;Mark Duchaineau;Jonathan D. Cohen
Affiliations:
Brigham Young University, Provo, UT;Brigham Young University, Provo, UT;Lawrence Livermore National Laboratory, Livermore, CA;Lawrence Livermore National Laboratory, Livermore, CA
Venue:
WMVC'09 Proceedings of the 2009 international conference on Motion and video computing
Year:
2009

Citing 18
Cited 0

Improving image resolution using subpixel motion

Pattern Recognition Letters
Improving resolution by image registration

CVGIP: Graphical Models and Image Processing
Local image reconstruction and subpixel restoration algorithms

CVGIP: Graphical Models and Image Processing
Creating full view panoramic image mosaics and environment maps

Proceedings of the 24th annual conference on Computer graphics and interactive techniques
Bundle Adjustment - A Modern Synthesis

ICCV '99 Proceedings of the International Workshop on Vision Algorithms: Theory and Practice
Panoramic mosaics by manifold projection

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
Efficient Image Warping and Super-Resolution

WACV '96 Proceedings of the 3rd IEEE Workshop on Applications of Computer Vision (WACV '96)
Moving Target Classification and Tracking from Real-time Video

WACV '98 Proceedings of the 4th IEEE Workshop on Applications of Computer Vision (WACV'98)
Site model acquisition and extension from aerial images

ICCV '95 Proceedings of the Fifth International Conference on Computer Vision
Mosaic based representations of video sequences and their applications

ICCV '95 Proceedings of the Fifth International Conference on Computer Vision
Real-Time Optimal Adaptation for Planetary Geometry and Texture: 4-8 Tile Hierarchies

IEEE Transactions on Visualization and Computer Graphics
Video Visualization

Proceedings of the 14th IEEE Visualization 2003 (VIS'03)
Efficiently Registering Video into Panoramic Mosaics

ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision - Volume 2
Visual Signatures in Video Visualization

IEEE Transactions on Visualization and Computer Graphics
Optical flow based super-resolution: A probabilistic approach

Computer Vision and Image Understanding
Image alignment and stitching: a tutorial

Foundations and Trends® in Computer Graphics and Vision
Video Mosaics for Virtual Environments

IEEE Computer Graphics and Applications
Human-robot interactions during the robot-assisted urban search and rescue response at the World Trade Center

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Quantified Score

Hi-index	0.00

Visualization

Abstract

Video from aerial surveillance can provide a rich source of data for many applications and can be enhanced for display and analysis through such methods as mosaic construction, super-resolution, and mover detection. All of these methods require accurate frame-to-frame registration, which for live use must be performed in real time. In many situations, scene parallax may make alignment using global transformations impossible or error-prone, limiting the performance of subsequent processing and applications. For these cases, dense (per-pixel) correspondence is required, but this can be computationally prohibitive. This paper presents a hierarchical dense correspondence algorithm designed for implementation on graphics processing units (GPUs). Since the method does not rely on epipolar geometry, it is also suitable for use when there are uncorrected nonlinear lens distortions. A framework for using this dense correspondence to implement local mosaicking, super-resolution enhancement, and mover detection is also presented and demonstrated using examples of each of these types of enhancement and different types of video sources.