Recovering high dynamic range radiance maps from photographs
Proceedings of the 24th annual conference on Computer graphics and interactive techniques
Smart Cameras as Embedded Systems
Computer
ACM SIGGRAPH 2003 Papers
Digital photography with flash and no-flash image pairs
ACM SIGGRAPH 2004 Papers
Flash photography enhancement via intrinsic relighting
ACM SIGGRAPH 2004 Papers
High performance imaging using large camera arrays
ACM SIGGRAPH 2005 Papers
Cyclops: in situ image sensing and interpretation in wireless sensor networks
Proceedings of the 3rd international conference on Embedded networked sensor systems
Coded exposure photography: motion deblurring using fluttered shutter
ACM SIGGRAPH 2006 Papers
High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting (The Morgan Kaufmann Series in Computer Graphics)
Proceedings of the 6th international conference on Information processing in sensor networks
Computational Photography: Mastering New Techniques for Lenses, Lighting, and Sensors
Computational Photography: Mastering New Techniques for Lenses, Lighting, and Sensors
| Hi-index | 48.22 |
Although there has been much interest in computational photography within the research and photography communities, progress has been hampered by the lack of a portable, programmable camera with sufficient image quality and computing power. To address this problem, we have designed and implemented an open architecture and application programming interface (API) for such cameras: the Frankencamera. It consists of a base hardware specification, a software stack based on Linux, and an API for C++. Our architecture permits control and synchronization of the sensor and image processing pipeline at the microsecond timescale, as well as the ability to incorporate and synchronize external hardware like lenses and flashes. This paper specifies our architecture and API, and it describes two reference implementations we have built. Using these implementations, we demonstrate several computational photography applications: high dynamic range (HDR) viewfinding and capture, automated acquisition of extended dynamic range panoramas, foveal imaging, and inertial measurement unit (IMU)-based hand shake detection. Our goal is to standardize the architecture and distribute Frankencameras to researchers and students, as a step toward creating a community of photographer-programmers who develop algorithms, applications, and hardware for computational cameras.