Map/reduce on EMF models

  • Authors:
  • Markus Scheidgen;Anatolij Zubow

  • Affiliations:
  • Humboldt Universität zu Berlin, Berlin, Germany;Humboldt Universität zu Berlin, Berlin, Germany

  • Venue:
  • Proceedings of the 1st International Workshop on Model-Driven Engineering for High Performance and CLoud computing
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

Map/Reduce is the programming model in cloud computing. It enables the processing of data sets of unprecedented size, but it also delegates the handling of complex data structures completely to its users. In this paper, we apply Map/Reduce to EMF-based models to cope with complex data structures in the familiar an easy-to-use and type-safe EMF fashion, combining the advantages of both technologies. We use our framework EMF-Fragments to store very large EMF models in distributed key-value stores (Hadoop's Hbase). This allows us to build Map/Reduce programs that use EMF's generated APIs to process those very large EMF-models. We present our framework and two example Map/Reduce jobs for querying software models and for analyzing sensor data represented as EMF-models.