Improving resolution by image registration
CVGIP: Graphical Models and Image Processing
Single Lens Stereo with a Plenoptic Camera
IEEE Transactions on Pattern Analysis and Machine Intelligence - Special issue on interpretation of 3-D scenes—part II
Nonlinear total variation based noise removal algorithms
Proceedings of the eleventh annual international conference of the Center for Nonlinear Studies on Experimental mathematics : computational issues in nonlinear science: computational issues in nonlinear science
SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Virtualized reality: constructing time-varying virtual worlds from real world events
VIS '97 Proceedings of the 8th conference on Visualization '97
A real-time distributed light field camera
EGRW '02 Proceedings of the 13th Eurographics workshop on Rendering
IEEE Transactions on Pattern Analysis and Machine Intelligence
Limits on Super-Resolution and How to Break Them
IEEE Transactions on Pattern Analysis and Machine Intelligence
High performance imaging using large camera arrays
ACM SIGGRAPH 2005 Papers
Overcoming registration uncertainty in image super-resolution: maximize or marginalize?
EURASIP Journal on Advances in Signal Processing
Super resolutionwith probabilistic motion estimation
IEEE Transactions on Image Processing
Compressive image super-resolution
Asilomar'09 Proceedings of the 43rd Asilomar conference on Signals, systems and computers
The Light Field Camera: Extended Depth of Field, Aliasing, and Superresolution
IEEE Transactions on Pattern Analysis and Machine Intelligence
Super-Resolution From Unregistered and Totally Aliased Signals Using Subspace Methods
IEEE Transactions on Signal Processing - Part II
Joint MAP registration and high-resolution image estimation using a sequence of undersampled images
IEEE Transactions on Image Processing
Multiframe demosaicing and super-resolution of color images
IEEE Transactions on Image Processing
Superresolution and noise filtering using moving least squares
IEEE Transactions on Image Processing
A self-reconfigurable camera array
EGSR'04 Proceedings of the Fifteenth Eurographics conference on Rendering Techniques
Scene collages and flexible camera arrays
EGSR'07 Proceedings of the 18th Eurographics conference on Rendering Techniques
Spatial and angular variational super-resolution of 4d light fields
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part V
Hi-index | 0.00 |
We present PiCam (Pelican Imaging Camera-Array), an ultra-thin high performance monolithic camera array, that captures light fields and synthesizes high resolution images along with a range image (scene depth) through integrated parallax detection and superresolution. The camera is passive, supporting both stills and video, low light capable, and small enough to be included in the next generation of mobile devices including smartphones. Prior works [Rander et al. 1997; Yang et al. 2002; Zhang and Chen 2004; Tanida et al. 2001; Tanida et al. 2003; Duparré et al. 2004] in camera arrays have explored multiple facets of light field capture - from viewpoint synthesis, synthetic refocus, computing range images, high speed video, and micro-optical aspects of system miniaturization. However, none of these have addressed the modifications needed to achieve the strict form factor and image quality required to make array cameras practical for mobile devices. In our approach, we customize many aspects of the camera array including lenses, pixels, sensors, and software algorithms to achieve imaging performance and form factor comparable to existing mobile phone cameras. Our contributions to the post-processing of images from camera arrays include a cost function for parallax detection that integrates across multiple color channels, and a regularized image restoration (superresolution) process that takes into account all the system degradations and adapts to a range of practical imaging conditions. The registration uncertainty from the parallax detection process is integrated into a Maximum-a-Posteriori formulation that synthesizes an estimate of the high resolution image and scene depth. We conclude with some examples of our array capabilities such as postcapture (still) refocus, video refocus, view synthesis to demonstrate motion parallax, 3D range images, and briefly address future work.