Optimized column-oriented model: a storage and search efficient representation of medical data

Authors:
Razan Paul;Abu Sayed Md. Latiful Hoque
Affiliations:
Department of Computer Science and Engineering, Bangladesh University of Engineering and Technology, Dhaka, Bangladesh;Department of Computer Science and Engineering, Bangladesh University of Engineering and Technology, Dhaka, Bangladesh
Venue:
ITBAM'10 Proceedings of the First international conference on Information technology in bio- and medical informatics
Year:
2010

Citing 8
Cited 0

A decomposition storage model

SIGMOD '85 Proceedings of the 1985 ACM SIGMOD international conference on Management of data
The entity-relationship model—toward a unified view of data

ACM Transactions on Database Systems (TODS) - Special issue: papers from the international conference on very large data bases: September 22–24, 1975, Framingham, MA
Data Cube: A Relational Aggregation Operator Generalizing Group-By, Cross-Tab, and Sub-Totals

Data Mining and Knowledge Discovery
On the Computation of Multidimensional Aggregates

VLDB '96 Proceedings of the 22th International Conference on Very Large Data Bases
Research Issues in Clinical Data Warehousing

SSDBM '98 Proceedings of the 10th International Conference on Scientific and Statistical Database Management
Storage and Querying of High Dimensional Sparsely Populated Data in Compressed Representation

EurAsia-ICT '02 Proceedings of the First EurAsian Conference on Information and Communication Technology
C-store: a column-oriented DBMS

VLDB '05 Proceedings of the 31st international conference on Very large data bases
PhD: a web database application for phenotype data management

Bioinformatics

Quantified Score

Hi-index	0.00

Visualization

Abstract

Medical data have a number of unique characteristics like data sparseness, high dimensionality and rapidly changing set of attributes. Entity Attribute Value (EAV) is the widely used solution to handle the above challenges of medical data, but EAV is neither storage efficient nor search efficient. In this paper, we have proposed a storage & search efficient data model: Optimized Column-Oriented Model (OCOM) for physical representation of high dimensional and sparse data as an alternative of widely used EAV. We have implemented both EAV and OCOM models in a medical data warehousing environment and performed different relational and warehouse queries on both the models. The experimental results show that OCOM is dramatically search efficient and occupy less storage space compared to EAV.