The Implementation of POSTGRES
IEEE Transactions on Knowledge and Data Engineering
Efficient Organization of Large Multidimensional Arrays
Proceedings of the Tenth International Conference on Data Engineering
The Sloan Digital Sky Survey and beyond
ACM SIGMOD Record - Tribute to honor Jim Gray
MAD skills: new analysis practices for big data
Proceedings of the VLDB Endowment
A demonstration of SciDB: a science-oriented DBMS
Proceedings of the VLDB Endowment
ArrayStore: a storage manager for complex parallel array processing
Proceedings of the 2011 ACM SIGMOD International Conference on Management of data
Distribution rules for array database queries
DEXA'05 Proceedings of the 16th international conference on Database and Expert Systems Applications
An architecture for a data-intensive computer
Proceedings of the first international workshop on Network-aware data management
The MADlib analytics library: or MAD skills, the SQL
Proceedings of the VLDB Endowment
EarthDB: scalable analysis of MODIS data using SciDB
Proceedings of the 1st ACM SIGSPATIAL International Workshop on Analytics for Big Geospatial Data
Intel "big data" science and technology center vision and execution plan
ACM SIGMOD Record
Research lattices: towards a scientific hypothesis data model
Proceedings of the 25th International Conference on Scientific and Statistical Database Management
Graywulf: a platform for federated scientific databases and services
Proceedings of the 25th International Conference on Scientific and Statistical Database Management
Astronomical data processing in EXTASCID
Proceedings of the 25th International Conference on Scientific and Statistical Database Management
| Hi-index | 0.01 |
SciDB is an open-source analytical database oriented toward the data management needs of scientists. As such it mixes statistical and linear algebra operations with data management ones, using a natural nested multidimensional array data model. We have been working on the code for two years, most recently with the help of venture capital backing. Release 11.06 (June 2011) is downloadable from our website (SciDB.org). This paper presents the main design decisions of SciDB. It focuses on our decisions concerning a high-level, SQL-like query language, the issues facing our query optimizer and executor and efficient storage management for arrays. The paper also discusses implementation of features not usually present in DBMSs, including version control, uncertainty and provenance.