Fast and robust multiframe super resolution

Authors:
S. Farsiu;M. D. Robinson;M. Elad;P. Milanfar
Affiliations:
Electr. Eng. Dept., Univ. of California, Santa Cruz, CA, USA;-;-;-
Venue:
IEEE Transactions on Image Processing
Year:
2004

Citing 0
Cited 115

An iterative super-resolution reconstruction of image sequences using affine block-based registration

Proceedings of the 2006 international conference on Wireless communications and mobile computing
Region-based super-resolution for compression

Multidimensional Systems and Signal Processing
A two-step neural-network based algorithm for fast image super-resolution

Image and Vision Computing
Practical least-squares for computer graphics: Video files associated with this course are available from the citation page

ACM SIGGRAPH 2007 courses
Super-resolution using hidden Markov model and Bayesian detection estimation framework

EURASIP Journal on Applied Signal Processing
Adaptive outlier rejection in image super-resolution

EURASIP Journal on Applied Signal Processing
Super-resolution for synthetic zooming

EURASIP Journal on Applied Signal Processing
Subpixel registration directly from the phase difference

EURASIP Journal on Applied Signal Processing
Video-to-video dynamic super-resolution for grayscale and color sequences

EURASIP Journal on Applied Signal Processing
A frequency domain approach to registration of aliased images with application to super-resolution

EURASIP Journal on Applied Signal Processing
Robust fusion of irregularly sampled data using adaptive normalized convolution

EURASIP Journal on Applied Signal Processing
Low-cost super-resolution algorithms implementation over a HW/SW video compression platform

EURASIP Journal on Applied Signal Processing
A Lorentzian stochastic estimation for a robust iterative multiframe super-resolution reconstruction with Lorentzian-Tikhonov regularization

EURASIP Journal on Advances in Signal Processing
Robust color image superresolution: an adaptive M-estimation framework

Journal on Image and Video Processing - Color in Image and Video Processing
Determining the regularization parameters for super-resolution problems

Signal Processing
A soft MAP framework for blind super-resolution image reconstruction

Image and Vision Computing
Region-Based Super Resolution for Video Sequences Considering Registration Error

PSIVT '09 Proceedings of the 3rd Pacific Rim Symposium on Advances in Image and Video Technology
Joint Blind Super-Resolution and Shadow Removing

IEICE - Transactions on Information and Systems
Example-based image super-resolution with class-specific predictors

Journal of Visual Communication and Image Representation
An Efficient and Robust Algorithm for Improving the Resolution of Video Sequences

ISNN 2009 Proceedings of the 6th International Symposium on Neural Networks: Advances in Neural Networks - Part III
Robust Super-Resolution Using a Median Filter for Irregular Samples

IbPRIA '09 Proceedings of the 4th Iberian Conference on Pattern Recognition and Image Analysis
Super-resolution image reconstruction for a steerable array of sub-imagers

Digital Signal Processing
Superresolution with compound Markov random fields via the variational EM algorithm

Neural Networks
Video Super Resolution Using Duality Based TV-L1 Optical Flow

Proceedings of the 31st DAGM Symposium on Pattern Recognition
A PDE Approach to Coupled Super-Resolution with Non-parametric Motion

EMMCVPR '09 Proceedings of the 7th International Conference on Energy Minimization Methods in Computer Vision and Pattern Recognition
A multi-frame image super-resolution method

Signal Processing
A blind superresolution method that works for arbitrary motions and point spread functions

ISCGAV'09 Proceedings of the 9th WSEAS international conference on Signal processing, computational geometry and artificial vision
Registration errors: are they always bad for super-resolution?

IEEE Transactions on Signal Processing
A super-resolution reconstruction algorithm for surveillance images

Signal Processing
Generalizing the Nonlocal-means to super-resolution reconstruction

IEEE Transactions on Image Processing
Exact feature extraction using finite rate of innovation principles with an application to image super-resolution

IEEE Transactions on Image Processing
SoftCuts: a soft edge smoothness prior for color image super-resolution

IEEE Transactions on Image Processing
Super resolutionwith probabilistic motion estimation

IEEE Transactions on Image Processing
Super-resolution without explicit subpixel motion estimation

IEEE Transactions on Image Processing
Real time turbulent video perfecting by image stabilization and super-resolution

VIIP '07 The Seventh IASTED International Conference on Visualization, Imaging and Image Processing
Superresolution from Occluded Scenes

ICONIP '09 Proceedings of the 16th International Conference on Neural Information Processing: Part II
Kurtosis-based super-resolution algorithm

ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
Regularized super-resolution of brain MRI

ISBI'09 Proceedings of the Sixth IEEE international conference on Symposium on Biomedical Imaging: From Nano to Macro
Storage-efficient quasi-Newton algorithms for image super-resolution

DSP'09 Proceedings of the 16th international conference on Digital Signal Processing
On the impact of up-sampling method for super-resolution image reconstruction

CGIM '08 Proceedings of the Tenth IASTED International Conference on Computer Graphics and Imaging
Locally adaptive selection of parameters in regularization-based denoising algorithms

SPPRA '08 Proceedings of the Fifth IASTED International Conference on Signal Processing, Pattern Recognition and Applications
Motion compensated video super resolution

SSVM'07 Proceedings of the 1st international conference on Scale space and variational methods in computer vision
Virtual focus and depth estimation from defocused video sequences

IEEE Transactions on Image Processing
Learning-based super-resolution system using single facial image and multi-resolution wavelet synthesis

ACCV'07 Proceedings of the 8th Asian conference on Computer vision - Volume Part II
Image upscaling using global multimodal priors

ACIVS'07 Proceedings of the 9th international conference on Advanced concepts for intelligent vision systems
Robust orientation diffusion via pca method and application to image super-resolution reconstruction

LSMS'07 Proceedings of the Life system modeling and simulation 2007 international conference on Bio-Inspired computational intelligence and applications
Super-resolution image with estimated high frequency compensated algorithm

ISCIT'09 Proceedings of the 9th international conference on Communications and information technologies
Video enhancement using a robust iterative SRR based on Leclerc stochastic estimation

ISCIT'09 Proceedings of the 9th international conference on Communications and information technologies
Realizing super-resolution with a directional anisotropic correlation model

ICICS'09 Proceedings of the 7th international conference on Information, communications and signal processing
Edge-preserving nonlinear iterative image resampling method

ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
A high-resolution image reconstuction method from low-resolution image sequence

ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
Super resolution of time-of-flight depth images under consideration of spatially varying noise variance

ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
Directionally adaptive super-resolution

ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
New results on performance analysis of super-resolution image reconstruction

ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
Maximum a posteriori super-resolution of compressed video using a new multichannel image prior

ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
Efficient perceptual attentive super-resolution

ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
Maximum a posteriori video super-resolution using a new multichannel image prior

IEEE Transactions on Image Processing
Compressive image super-resolution

Asilomar'09 Proceedings of the 43rd Asilomar conference on Signals, systems and computers
Performance of reconstruction-based super-resolution with regularization

Journal of Visual Communication and Image Representation
Optimization transfer approach to joint registration / reconstruction for motion-compensated image reconstruction

ISBI'10 Proceedings of the 2010 IEEE international conference on Biomedical imaging: from nano to Macro
Efficient Fourier-wavelet super-resolution

IEEE Transactions on Image Processing - Special section on distributed camera networks: sensing, processing, communication, and implementation
Estimation of the parameters in regularized simultaneous super-resolution

Pattern Recognition Letters
Novel framework for single/multi-frame super-resolution using sequential Monte Carlo method

Proceedings of the international conference on Multimedia
Super-resolution algorithm based on discrete Fourier transform

ICIC'10 Proceedings of the Advanced intelligent computing theories and applications, and 6th international conference on Intelligent computing
Image super-resolution via sparse representation

IEEE Transactions on Image Processing
Multiframe super-resolution reconstruction of small moving objects

IEEE Transactions on Image Processing
Review article: Edge and line oriented contour detection: State of the art

Image and Vision Computing
Adaptive multiple-frame image super-resolution based on U-curve

IEEE Transactions on Image Processing
A convex approach for variational super-resolution

Proceedings of the 32nd DAGM conference on Pattern recognition
Maximum a posteriori estimation of isotropic high- resolution volumetric MRI from orthogonal thick-slice scans

MICCAI'10 Proceedings of the 13th international conference on Medical image computing and computer-assisted intervention: Part II
A novel kernel-based framework for facial-image hallucination

Image and Vision Computing
Super-resolution mosaicking of unmanned aircraft system (UAS) surveillance video using levenberg marquardt (LM) algorithm

ISVC'10 Proceedings of the 6th international conference on Advances in visual computing - Volume Part I
Image and video upscaling from local self-examples

ACM Transactions on Graphics (TOG)
Understanding video sequences through super-resolution

MMM'11 Proceedings of the 17th international conference on Advances in multimedia modeling - Volume Part II
Video deblurring and super-resolution technique for multiple moving objects

ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part IV
Region-based weighted-norm with adaptive regularization for resolution enhancement

Digital Signal Processing
Single image example-based super-resolution using cross-scale patch matching and markov random field modelling

ICIAR'11 Proceedings of the 8th international conference on Image analysis and recognition - Volume Part I
Getting the face behind the squares: reconstructing pixelized video streams

WOOT'11 Proceedings of the 5th USENIX conference on Offensive technologies
A space-time depth super-resolution scheme for 3D face scanning

ACIVS'11 Proceedings of the 13th international conference on Advanced concepts for intelligent vision systems
On Kernel Selection of Multivariate Local Polynomial Modelling and its Application to Image Smoothing and Reconstruction

Journal of Signal Processing Systems
Multi-camera 3D scanning with a non-rigid and space-time depth super-resolution capability

CAIP'11 Proceedings of the 14th international conference on Computer analysis of images and patterns - Volume Part II
Image super resolution using sparse image and singular values as priors

CAIP'11 Proceedings of the 14th international conference on Computer analysis of images and patterns - Volume Part II
KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera

Proceedings of the 24th annual ACM symposium on User interface software and technology
Total least square kernel regression

Journal of Visual Communication and Image Representation
Fast and robust filtering-based image magnification

ICIAR'06 Proceedings of the Third international conference on Image Analysis and Recognition - Volume Part I
An image interpolation scheme for repetitive structures

ICIAR'06 Proceedings of the Third international conference on Image Analysis and Recognition - Volume Part I
Local geometry driven image magnification and applications to super-resolution

ICNC'06 Proceedings of the Second international conference on Advances in Natural Computation - Volume Part II
Direct energy minimization for super-resolution on nonlinear manifolds

ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part IV
Singular value decomposition based fusion for super-resolution image reconstruction

Image Communication
A VQ-Based blind super-resolution algorithm

ICIC'05 Proceedings of the 2005 international conference on Advances in Intelligent Computing - Volume Part I
A new signal processing method for video: reproduce the frequency spectrum exceeding the Nyquist frequency

Proceedings of the 3rd Multimedia Systems Conference
Super-resolution image reconstruction techniques: Trade-offs between the data-fidelity and regularization terms

Information Fusion
Morphable model space based face super-resolution reconstruction and recognition

Image and Vision Computing
Detection of aliasing in image sequences using nonlinear factor analysis

LVA/ICA'12 Proceedings of the 10th international conference on Latent Variable Analysis and Signal Separation
Fast computation of edge model representation for image sequence super-resolution

PerMIn'12 Proceedings of the First Indo-Japan conference on Perception and Machine Intelligence
Multitask dictionary learning and sparse representation based single-image super-resolution reconstruction

Neurocomputing
Vehicle license plate super-resolution using soft learning prior

Multimedia Tools and Applications
Reconstruction of low-resolution images using adaptive bimodal priors

ICIAR'07 Proceedings of the 4th international conference on Image Analysis and Recognition
Image super-resolution by textural context constrained visual vocabulary

Image Communication
Variational multiframe restoration of images degraded by noisy (stochastic) blur kernels

Journal of Computational and Applied Mathematics
A robust multiframe super-resolution algorithm based on half-quadratic estimation with modified BTV regularization

Digital Signal Processing
Superfaces: a super-resolution model for 3d faces

ECCV'12 Proceedings of the 12th international conference on Computer Vision - Volume Part I
Self-content super-resolution for ultra-HD up-sampling

Proceedings of the 9th European Conference on Visual Media Production
Bayesian combination of sparse and non-sparse priors in image super resolution

Digital Signal Processing
Super resolution via sparse representation in l1 framework

Proceedings of the Eighth Indian Conference on Computer Vision, Graphics and Image Processing
Regularization based super-resolution image processing algorithm using edge-adaptive non-local means filter

Proceedings of the 7th International Conference on Ubiquitous Information Management and Communication
Single image super resolution reconstruction in perturbed exemplar sub-space

ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part III
Image super-resolution: use of self-learning and gabor prior

ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part III
Classification-based video super-resolution using artificial neural networks

Signal Processing
A Bayesian approach to visualization-oriented hyperspectral image fusion

Information Fusion
3D Deformable Super-Resolution for Multi-Camera 3D Face Scanning

Journal of Mathematical Imaging and Vision
Towards precise real-time 3D difference detection for industrial applications

Computers in Industry
Face hallucination based on sparse local-pixel structure

Pattern Recognition
Sparse representation with morphologic regularizations for single image super-resolution

Signal Processing
A unified framework for multi-sensor HDR video reconstruction

Image Communication

Quantified Score

Hi-index	0.02

Visualization

Abstract

Super-resolution reconstruction produces one or a set of high-resolution images from a set of low-resolution images. In the last two decades, a variety of super-resolution methods have been proposed. These methods are usually very sensitive to their assumed model of data and noise, which limits their utility. This paper reviews some of these methods and addresses their shortcomings. We propose an alternate approach using L1 norm minimization and robust regularization based on a bilateral prior to deal with different data and noise models. This computationally inexpensive method is robust to errors in motion and blur estimation and results in images with sharp edges. Simulation results confirm the effectiveness of our method and demonstrate its superiority to other super-resolution methods.