Parallel processing of data from very large-scale wireless sensor networks

Authors:
Christine Jardak;Janne Riihijärvi;Frank Oldewurtel;Petri Mähönen
Affiliations:
RWTH Aachen University, Kackertstrasse, Aachen, Germany;RWTH Aachen University, Kackertstrasse, Aachen, Germany;RWTH Aachen University, Kackertstrasse, Aachen, Germany;RWTH Aachen University, Kackertstrasse, Aachen, Germany
Venue:
Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing
Year:
2010

Citing 15
Cited 3

A bridging model for parallel computation

Communications of the ACM
DB2 parallel edition

IBM Systems Journal
Cluster I/O with River: making the fast case common

Proceedings of the sixth workshop on I/O in parallel and distributed systems
Using MPI (2nd ed.): portable parallel programming with the message-passing interface

Using MPI (2nd ed.): portable parallel programming with the message-passing interface
Multidimensional divide-and-conquer

Communications of the ACM
MapReduce: simplified data processing on large clusters

OSDI'04 Proceedings of the 6th conference on Symposium on Opearting Systems Design & Implementation - Volume 6
Bigtable: a distributed storage system for structured data

OSDI '06 Proceedings of the 7th symposium on Operating systems design and implementation
Implementation and performance evaluation of nanoMAC: a low-power MAC solution for high density wireless sensor networks

International Journal of Sensor Networks
A vehicle for research: using street sweepers to explore the landscape of environmental community action

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Infrastructure for Data Processing in Large-Scale Interconnected Sensor Networks

MDM '07 Proceedings of the 2007 International Conference on Mobile Data Management
Experiences on Processing Spatial Data with MapReduce

SSDBM 2009 Proceedings of the 21st International Conference on Scientific and Statistical Database Management
Sensor Networks—Motes, Smart Spaces, and Beyond

IEEE Pervasive Computing
Impact of correlation in node locations on the performance of distributed compression

WONS'09 Proceedings of the Sixth international conference on Wireless On-Demand Network Systems and Services
Design of large-scale agricultural wireless sensor networks: email from the vineyard

International Journal of Sensor Networks
Routing techniques in wireless sensor networks: a survey

IEEE Wireless Communications

Extremely large-scale sensing applications for planetary WSNs

Proceedings of the 2nd ACM International Workshop on Hot Topics in Planet-scale Measurement
sMapReduce: a programming pattern for wireless sensor networks

Proceedings of the 2nd Workshop on Software Engineering for Sensor Network Applications
Static type checking of Hadoop MapReduce programs

Proceedings of the second international workshop on MapReduce and its applications

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper we explore the problems of storing and reasoning about data collected from very large-scale wireless sensor networks (WSNs). Potential worldwide deployment of WSNs for, e.g., environmental monitoring purposes could yield data in amounts of petabytes each year. Distributed database solutions such as BigTable and Hadoop are capable of dealing with storage of such amounts of data. However, it is far from clear whether the associated MapReduce programming model is suitable for processing of sensor data. This is because typical applications MapReduce is used for, currently are relational in nature, whereas for sensing data one is usually interested in spatial structure of data instead. We show that MapReduce can indeed be used to develop such applications, and also describe in detail a general architecture for service platform for storing and processing of data obtained from massive WSNs.