Reduce, You Say: What NoSQL Can Do for Data Aggregation and BI in Large Repositories

Authors:
Laurent Bonnet;Anne Laurent;Michel Sala;Benedicte Laurent;Nicolas Sicard
Affiliations:
-;-;-;-;-
Venue:
DEXA '11 Proceedings of the 2011 22nd International Workshop on Database and Expert Systems Applications
Year:
2011

Citing 0
Cited 2

Performance evaluation of a MongoDB and hadoop platform for scientific data analysis

Proceedings of the 4th ACM workshop on Scientific cloud computing
Spatiotemporal transformation of social media geostreams: a case study of Twitter for flu risk analysis

Proceedings of the 4th ACM SIGSPATIAL International Workshop on GeoStreaming

Quantified Score

Hi-index	0.00

Visualization

Abstract

Data aggregation is one of the key features used in databases, especially for Business Intelligence (e.g., ETL, OLAP) and analytics/data mining. When considering SQL databases, aggregation is used to prepare and visualize data for deeper analyses. However, these operations are often impossible on very large volumes of data regarding memory-and-time-consumption. In this paper, we show how NoSQL databases such as MongoDB and its key-value stores, thanks to the native MapReduce algorithm, can provide an efficient framework to aggregate large volumes of data. We provide basic material about the MapReduce algorithm, the different NoSQL databases (read intensive vs. write intensive). We investigate how to efficiently modelize the data framework for BI and analytics. For this purpose, we focus on read intensive NoSQL databases using MongoDB and we show how NoSQL and MapReduce can help handling large volumes of data.