DGFIndex: a hive multidimensional range index for smart meter big data

Authors:
Yue Liu;Wantao Liu;Zheng Xiao;Weihao Qiu;Yanhu Li;Ying Liang
Affiliations:
University of Chinese Academy of Sciences, China and Chinese Academy of Sciences, China;Chinese Academy of Sciences, China;State Grid Electricity Science Research Institute, China;Zhejiang Electric Power Corporation, China;Chinese Academy of Sciences, China;Chinese Academy of Sciences, China
Venue:
Proceedings Demo & Poster Track of ACM/IFIP/USENIX International Middleware Conference
Year:
2013

Citing 3
Cited 0

The Grid File: An Adaptable, Symmetric Multikey File Structure

ACM Transactions on Database Systems (TODS)
Hadoop++: making a yellow elephant run like a cheetah (without it even noticing)

Proceedings of the VLDB Endowment
Eagle-eyed elephant: split-oriented indexing in Hadoop

Proceedings of the 16th International Conference on Extending Database Technology

Quantified Score

Hi-index	0.00

Visualization

Abstract

In Smart Grid, High-performance analysis of massive meter data is very crucial for electric companies to make decisions. With our observation, these data analysis applications typically involve multidimensional range queries (MDRQ) on meter data. While popular data warehouses for big data, like Hive, can perform complex analysis, but lack efficient index for MDRQ. In this paper, we propose DGFIndex, a dedicated index structure that effectively support MDRQ for massive meter data. Our preliminary experiments show that DGFIndex can save significant disk space than Compact Index in Hive, and almost keeps the same data IO.