MapReduce and parallel DBMSs: friends or foes?

Authors:
Michael Stonebraker;Daniel Abadi;David J. DeWitt;Sam Madden;Erik Paulson;Andrew Pavlo;Alexander Rasin
Affiliations:
Massachusetts Institute of Technology, Cambridge, MA;Yale University, New Haven, CT;Microsoft Inc., Madison, WI;Massachusetts Institute of Technology, Cambridge, MA;University of Wisconsin-Madison, Madison, WI;Brown University, Providence, RI;Brown University, Providence, RI
Venue:
Communications of the ACM - Amir Pnueli: Ahead of His Time
Year:
2010

Citing 16
Cited 65

The design of POSTGRES

SIGMOD '86 Proceedings of the 1986 ACM SIGMOD international conference on Management of data
A benchmark of NonStop SQL release 2 demonstrating near-linear speedup and scaleup on large databases

SIGMETRICS '90 Proceedings of the 1990 ACM SIGMETRICS conference on Measurement and modeling of computer systems
Parallel database systems: the future of high performance database systems

Communications of the ACM
Prototyping Bubba, A Highly Parallel Database System

IEEE Transactions on Knowledge and Data Engineering
An Overview of The System Software of A Parallel Relational Database Machine GRACE

VLDB '86 Proceedings of the 12th International Conference on Very Large Data Bases
GAMMA - A High Performance Dataflow Database Machine

VLDB '86 Proceedings of the 12th International Conference on Very Large Data Bases
MapReduce: simplified data processing on large clusters

OSDI'04 Proceedings of the 6th conference on Symposium on Opearting Systems Design & Implementation - Volume 6
Dryad: distributed data-parallel programs from sequential building blocks

Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems 2007
Scalable semantic web data management using vertical partitioning

VLDB '07 Proceedings of the 33rd international conference on Very large data bases
Technical perspective: the data center is the computer

Communications of the ACM - 50th anniversary issue: 1958 - 2008
Column-stores vs. row-stores: how different are they really?

Proceedings of the 2008 ACM SIGMOD international conference on Management of data
Pig latin: a not-so-foreign language for data processing

Proceedings of the 2008 ACM SIGMOD international conference on Management of data
SCOPE: easy and efficient parallel processing of massive data sets

Proceedings of the VLDB Endowment
A comparison of approaches to large-scale data analysis

Proceedings of the 2009 ACM SIGMOD International Conference on Management of data
Hive: a warehousing solution over a map-reduce framework

Proceedings of the VLDB Endowment
HadoopDB: an architectural hybrid of MapReduce and DBMS technologies for analytical workloads

Proceedings of the VLDB Endowment

Caching and Materialization for Web Databases

Foundations and Trends in Databases
HadoopToSQL: a mapReduce query optimizer

Proceedings of the 5th European conference on Computer systems
SPARQL basic graph pattern processing with iterative MapReduce

Proceedings of the 2010 Workshop on Massive Data Analytics on the Cloud
Integrating hadoop and parallel DBMs

Proceedings of the 2010 ACM SIGMOD International Conference on Management of data
Database systems research on data mining

Proceedings of the 2010 ACM SIGMOD International Conference on Management of data
An experience report on scaling tools for mining software repositories using MapReduce

Proceedings of the IEEE/ACM international conference on Automated software engineering
Towards personal high-performance geospatial computing (HPC-G): perspectives and a case study

Proceedings of the ACM SIGSPATIAL International Workshop on High Performance and Distributed Geographic Information Systems
Comparing SQL and MapReduce to compute Naive Bayes in a single table scan

CloudDB '10 Proceedings of the second international workshop on Cloud data management
Relational versus non-relational database systems for data warehousing

DOLAP '10 Proceedings of the ACM 13th international workshop on Data warehousing and OLAP
Comparing Hadoop and Fat-Btree based access method for small file I/O applications

WAIM'10 Proceedings of the 11th international conference on Web-age information management
Multidimensional arrays for warehousing data on clouds

Globe'10 Proceedings of the Third international conference on Data management in grid and peer-to-peer systems
Dremel: interactive analysis of web-scale datasets

Proceedings of the VLDB Endowment
The performance of MapReduce: an in-depth study

Proceedings of the VLDB Endowment
Hadoop++: making a yellow elephant run like a cheetah (without it even noticing)

Proceedings of the VLDB Endowment
Integrating MapReduce and RDBMSs

Proceedings of the 2010 Conference of the Center for Advanced Studies on Collaborative Research
The case for object databases in cloud data management

ICOODB'10 Proceedings of the Third international conference on Objects and databases
Dremel: interactive analysis of web-scale datasets

Communications of the ACM
A scalable architecture for real-time online data access

ICDCIT'11 Proceedings of the 7th international conference on Distributed computing and internet technology
A generic parallel processing model for facilitating data mining and integration

Parallel Computing
ASTERIX: towards a scalable, semistructured data platform for evolving-world models

Distributed and Parallel Databases
Aspects of data-intensive cloud computing

From active data management to event-based systems and more
TrustedDB: a trusted hardware based database with privacy and data confidentiality

Proceedings of the 2011 ACM SIGMOD International Conference on Management of data
Automated partitioning design in parallel database systems

Proceedings of the 2011 ACM SIGMOD International Conference on Management of data
Emerging trends in the enterprise data analytics: connecting Hadoop and DB2 warehouse

Proceedings of the 2011 ACM SIGMOD International Conference on Management of data
Full-text indexing for optimizing selection operations in large-scale data analytics

Proceedings of the second international workshop on MapReduce and its applications
Scatter-Gather-Merge: An efficient star-join query processing algorithm for data-parallel frameworks

Cluster Computing
CoHadoop: flexible data placement and its exploitation in Hadoop

Proceedings of the VLDB Endowment
New ideas track: testing mapreduce-style programs

Proceedings of the 19th ACM SIGSOFT symposium and the 13th European conference on Foundations of software engineering
ETLMR: a highly scalable dimensional ETL framework based on mapreduce

DaWaK'11 Proceedings of the 13th international conference on Data warehousing and knowledge discovery
Building cubes with MapReduce

Proceedings of the ACM 14th international workshop on Data Warehousing and OLAP
Easy and effective parallel programmable ETL

Proceedings of the ACM 14th international workshop on Data Warehousing and OLAP
Parallel data processing with MapReduce: a survey

ACM SIGMOD Record
Of hammers and nails: an empirical comparison of three paradigms for processing large graphs

Proceedings of the fifth ACM international conference on Web search and data mining
Enhancing TCP throughput of highly available virtual machines via speculative communication

VEE '12 Proceedings of the 8th ACM SIGPLAN/SIGOPS conference on Virtual Execution Environments
Distributed parallel architecture for storing and processing large datasets

SEPADS'12/EDUCATION'12 Proceedings of the 11th WSEAS international conference on Software Engineering, Parallel and Distributed Systems, and proceedings of the 9th WSEAS international conference on Engineering Education
Abstract state machines for data-parallel computing

Conceptual Modelling and Its Theoretical Foundations
Apriori-based frequent itemset mining algorithms on MapReduce

Proceedings of the 6th International Conference on Ubiquitous Information Management and Communication
What next?: a half-dozen data management research goals for big data and the cloud

PODS '12 Proceedings of the 31st symposium on Principles of Database Systems
CloudRAMSort: fast and efficient large-scale distributed RAM sort on shared-nothing cluster

SIGMOD '12 Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data
The efficiency of mapreduce in parallel external memory

LATIN'12 Proceedings of the 10th Latin American international conference on Theoretical Informatics
Inside "Big Data management": ogres, onions, or parfaits?

Proceedings of the 15th International Conference on Extending Database Technology
An optimization framework for map-reduce queries

Proceedings of the 15th International Conference on Extending Database Technology
Towards a scalable, performance-oriented OLAP storage engine

DASFAA'12 Proceedings of the 17th international conference on Database Systems for Advanced Applications - Volume Part II
ParaLite: Supporting Collective Queries in Database System to Parallelize User-Defined Executable

CCGRID '12 Proceedings of the 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012)
On saying "enough already!" in MapReduce

Proceedings of the 1st International Workshop on Cloud Intelligence
MapReduce-based dimensional ETL made easy

Proceedings of the VLDB Endowment
SCOPE: parallel databases meet MapReduce

The VLDB Journal — The International Journal on Very Large Data Bases
Sailfish: a framework for large scale data processing

Proceedings of the Third ACM Symposium on Cloud Computing
Cogset: a high performance MapReduce engine

Concurrency and Computation: Practice & Experience
Towards building a high performance spatial query system for large scale medical imaging data

Proceedings of the 20th International Conference on Advances in Geographic Information Systems
Breaking the MapReduce stage barrier

Cluster Computing
Eagle-eyed elephant: split-oriented indexing in Hadoop

Proceedings of the 16th International Conference on Extending Database Technology
Elastic online analytical processing on RAMCloud

Proceedings of the 16th International Conference on Extending Database Technology
Data mining algorithms as a service in the cloud exploiting relational database systems

Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data
Shark: SQL and rich analytics at scale

Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data
ODYS: an approach to building a massively-parallel search engine using a DB-IR tightly-integrated parallel DBMS for higher-level functionality

Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data
Business intelligence and analytics: from big data to big impact

MIS Quarterly
Distributed data management using MapReduce

ACM Computing Surveys (CSUR)
Data-Intensive Cloud Computing: Requirements, Expectations, Challenges, and Solutions

Journal of Grid Computing
Can we analyze big data inside a DBMS?

Proceedings of the sixteenth international workshop on Data warehousing and OLAP
The family of mapreduce and large-scale data processing systems

ACM Computing Surveys (CSUR)
Cloud-aware processing of MapReduce-based OLAP applications

AusPDC '13 Proceedings of the Eleventh Australasian Symposium on Parallel and Distributed Computing - Volume 140
P2EST: parallelization philosophies for evaluating spatio-temporal queries

Proceedings of the 2nd ACM SIGSPATIAL International Workshop on Analytics for Big Geospatial Data
Hadoop GIS: a high performance spatial data warehousing system over mapreduce

Proceedings of the VLDB Endowment
SHadoop: Improving MapReduce performance by optimizing job execution mechanism in Hadoop clusters

Journal of Parallel and Distributed Computing

Quantified Score

Hi-index	0.02

Visualization

Abstract

MapReduce complements DBMSs since databases are not designed for extract-transform-load tasks, a MapReduce specialty.