Recovering high dynamic range radiance maps from photographs
Proceedings of the 24th annual conference on Computer graphics and interactive techniques
Phidgets: easy development of physical interfaces through physical widgets
Proceedings of the 14th annual ACM symposium on User interface software and technology
Smart Cameras as Embedded Systems
Computer
ACM SIGGRAPH 2003 Papers
Recon .gurable High Resolution Network Camera
FCCM '03 Proceedings of the 11th Annual IEEE Symposium on Field-Programmable Custom Computing Machines
Digital photography with flash and no-flash image pairs
ACM SIGGRAPH 2004 Papers
Flash photography enhancement via intrinsic relighting
ACM SIGGRAPH 2004 Papers
High performance imaging using large camera arrays
ACM SIGGRAPH 2005 Papers
Cyclops: in situ image sensing and interpretation in wireless sensor networks
Proceedings of the 3rd international conference on Embedded networked sensor systems
Coded exposure photography: motion deblurring using fluttered shutter
ACM SIGGRAPH 2006 Papers
High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting (The Morgan Kaufmann Series in Computer Graphics)
Proceedings of the 6th international conference on Information processing in sensor networks
Real-time edge-aware image processing with the bilateral grid
ACM SIGGRAPH 2007 papers
PG '07 Proceedings of the 15th Pacific Conference on Computer Graphics and Applications
Computational Photography: Mastering New Techniques for Lenses, Lighting, and Sensors
Computational Photography: Mastering New Techniques for Lenses, Lighting, and Sensors
Image deblurring using inertial measurement sensors
ACM SIGGRAPH 2010 papers
ACM Transactions on Graphics (TOG)
Image enhancement method VIA blur and noisy image fusion
ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
Multi-exposure imaging on mobile devices
Proceedings of the international conference on Multimedia
Multi-exposure imaging on mobile devices (demo)
Proceedings of the international conference on Multimedia
Computational stereo camera system with programmable control loop
ACM SIGGRAPH 2011 papers
Estimating image segmentation difficulty
MLDM'11 Proceedings of the 7th international conference on Machine learning and data mining in pattern recognition
The composition context in point-and-shoot photography
ACM SIGGRAPH 2011 Posters
The FCam API for programmable cameras
MM '11 Proceedings of the 19th ACM international conference on Multimedia
Decoupling algorithms from schedules for easy optimization of image processing pipelines
ACM Transactions on Graphics (TOG) - SIGGRAPH 2012 Conference Proceedings
Computer Graphics Forum
A cell phone based platform for facial performance capture
ACM SIGGRAPH 2012 Posters
Computational plenoptic imaging
ACM SIGGRAPH 2012 Courses
Implementation of HDR photographic pipeline in mobile devices
ICIAR'12 Proceedings of the 9th international conference on Image Analysis and Recognition - Volume Part I
ACM Transactions on Graphics (TOG) - Proceedings of ACM SIGGRAPH Asia 2012
Instant scene recognition on mobile platform
ECCV'12 Proceedings of the 12th international conference on Computer Vision - Volume Part III
Proceedings of the 34th ACM SIGPLAN conference on Programming language design and implementation
Convolution engine: balancing efficiency & flexibility in specialized computing
Proceedings of the 40th Annual International Symposium on Computer Architecture
Patch-based high dynamic range video
ACM Transactions on Graphics (TOG)
WYSIWYG computational photography via viewfinder editing
ACM Transactions on Graphics (TOG)
EVA: an efficient vision architecture for mobile systems
Proceedings of the 2013 International Conference on Compilers, Architectures and Synthesis for Embedded Systems
| Hi-index | 0.01 |
Although there has been much interest in computational photography within the research and photography communities, progress has been hampered by the lack of a portable, programmable camera with sufficient image quality and computing power. To address this problem, we have designed and implemented an open architecture and API for such cameras: the Frankencamera. It consists of a base hardware specification, a software stack based on Linux, and an API for C++. Our architecture permits control and synchronization of the sensor and image processing pipeline at the microsecond time scale, as well as the ability to incorporate and synchronize external hardware like lenses and flashes. This paper specifies our architecture and API, and it describes two reference implementations we have built. Using these implementations we demonstrate six computational photography applications: HDR viewfinding and capture, low-light viewfinding and capture, automated acquisition of extended dynamic range panoramas, foveal imaging, IMU-based hand shake detection, and rephotography. Our goal is to standardize the architecture and distribute Frankencameras to researchers and students, as a step towards creating a community of photographer-programmers who develop algorithms, applications, and hardware for computational cameras.