A query language for multidimensional arrays: design, implementation, and optimization techniques
SIGMOD '96 Proceedings of the 1996 ACM SIGMOD international conference on Management of data
The design and implementation of an object-oriented toolkit for 3D graphics and visualization
Proceedings of the 7th conference on Visualization '96
Practical lessons in supporting large-scale computational science
ACM SIGMOD Record
SQL and management of external data
ACM SIGMOD Record
Coordinating backup/recovery and data consistency between database and file systems
Proceedings of the 2002 ACM SIGMOD international conference on Management of data
The Implementation of POSTGRES
IEEE Transactions on Knowledge and Data Engineering
A Language for Manipulating Arrays
VLDB '97 Proceedings of the 23rd International Conference on Very Large Data Bases
VLDB '94 Proceedings of the 20th International Conference on Very Large Data Bases
Efficient Execution of Operations in a DBMS for Multidimensional Arrays
SSDBM '98 Proceedings of the 10th International Conference on Scientific and Statistical Database Management
Database Support for Multisource Multiresolution Scientific Data
SOFSEM '02 Proceedings of the 29th Conference on Current Trends in Theory and Practice of Informatics: Theory and Practice of Informatics
Query, analysis, and visualization of hierarchically structured data using Polaris
Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining
A data model for scientific visualization with provisions for regular and irregular grids
VIS '91 Proceedings of the 2nd conference on Visualization '91
Efficient exploration of large scientific databases
VLDB '02 Proceedings of the 28th international conference on Very Large Data Bases
Querying and Visualizing Gridded Datasets for e-Science
ICDE '05 Proceedings of the 21st International Conference on Data Engineering
Towards integrated and efficient scientific sensor data processing: a database approach
Proceedings of the 12th International Conference on Extending Database Technology: Advances in Database Technology
Beyond rasters: introducing the new OGC web coverage service 2.0
Proceedings of the 18th SIGSPATIAL International Conference on Advances in Geographic Information Systems
ImG-complex: graph data model for topology of unstructured meshes
Proceedings of the 22nd ACM international conference on Conference on information & knowledge management
Database support for unstructured meshes
Proceedings of the VLDB Endowment
Hi-index | 0.00 |
We investigate algebraic processing strategies for large numeric datasets equipped with a possibly irregular grid structure. Such datasets arise, for example, in computational simulations, observation networks, medical imaging, and 2-D and 3-D rendering. Existing approaches for manipulating these datasets are incomplete: The performance of SQL queries for manipulating large numeric datasets is not competitive with specialized tools. Database extensions for processing multidimensional discrete data can only model regular, rectilinear grids. Visualization software libraries are designed to process gridded datasets efficiently, but no algebra has been developed to simplify their use and afford optimization. Further, these libraries are data dependent - physical changes to data representation or organization break user programs. In this paper, we present an algebra of grid-fields for manipulating both regular and irregular gridded datasets, algebraic optimization techniques, and an implementation backed by experimental results. We compare our techniques to those of spatial databases and visualization software libraries, using real examples from an Environmental Observation and Forecasting System. We find that our approach can express optimized plans inaccessible to other techniques, resulting in improved performance with reduced programming effort.