Camera mote with a high-performance parallel processor for real-time frame-based video processing

Authors:
Richard Kleihorst;Anteneh Abbo;Ben Schueler;Alexander Danilin
Affiliations:
NXP Research and Philips Research, Eindhoven, the Netherlands;NXP Research and Philips Research, Eindhoven, the Netherlands;NXP Research and Philips Research, Eindhoven, the Netherlands;NXP Research and Philips Research, Eindhoven, the Netherlands
Venue:
AVSS '07 Proceedings of the 2007 IEEE Conference on Advanced Video and Signal Based Surveillance
Year:
2007

Citing 0
Cited 2

Design and optimization of the videoweb wireless camera network

Journal on Image and Video Processing - Special issue on multicamera information processing: acquisition, collaboration, interpretation, and production
Architecture Exploration Based on Tasks Partitioning Between Hardware, Software and Locality for a Wireless Vision Sensor Node

International Journal of Distributed Systems and Technologies

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper describes a new smart camera mote with a high performance SIMD (Single-Instruction Multiple-Data) processor. Previous versions of our camera mote were equipped with IC3D, a line-based processor. The mote described in this paper is equipped with Xetal-II, a processor designed for frame-based real-time video analysis. The processor uses 320 processing elements in parallel to achieve performance figures of more than 100GOPS with a power consumption of 600mWatt at peak performance. The IC has a 10Mbit internal memory cache to store and work on 4 VGA frames. The internal bandwidth to this memory is more than 1.5 Tbit/s allowing multiple passes over the images within frametime. Augmented with hardware tools for object processing, the new mote opens the door for embedded active vision applications and other iterative techniques such as watershedding and distance transforms in collaborative camera networks.