The JPEG still picture compression standard
Communications of the ACM - Special issue on digital multimedia systems
Query processing techniques for arrays
SIGMOD '99 Proceedings of the 1999 ACM SIGMOD international conference on Management of data
Compilation and delayed evaluation in APL
POPL '78 Proceedings of the 5th ACM SIGACT-SIGPLAN symposium on Principles of programming languages
Database System Implementation
Database System Implementation
Modeling Multidimensional Databases
ICDE '97 Proceedings of the Thirteenth International Conference on Data Engineering
Supporting Fine-grained Data Lineage in a Database Visualization Environment
ICDE '97 Proceedings of the Thirteenth International Conference on Data Engineering
Efficient Organization of Large Multidimensional Arrays
Proceedings of the Tenth International Conference on Data Engineering
A Language for Manipulating Arrays
VLDB '97 Proceedings of the 23rd International Conference on Very Large Data Bases
A Foundation for Multi-dimensional Databases
VLDB '97 Proceedings of the 23rd International Conference on Very Large Data Bases
Storage of Multidimensional Arrays Based on Arbitrary Tiling
ICDE '99 Proceedings of the 15th International Conference on Data Engineering
Practical Lineage Tracing in Data Warehouses
ICDE '00 Proceedings of the 16th International Conference on Data Engineering
SSDBM '01 Proceedings of the 13th International Conference on Scientific and Statistical Database Management
Query processing techniques for arrays
Query processing techniques for arrays
Query processing techniques for arrays
The VLDB Journal — The International Journal on Very Large Data Bases
Tracing lineage beyond relational operators
VLDB '07 Proceedings of the 33rd international conference on Very large data bases
| Hi-index | 0.00 |
Arrays are a common and important class of data in many applications. Arrays can model data such as digital images, digital video, scientific and experimental data, matrices, and finite element grids. Although array manipulations are diverse and domain-specific, they often exhibit structural regularities. This paper describes an algorithm called sub-pushdown to trace data lineage in such array computations. Lineage tracing is a type of data-flow analysis that relates parts of a result array to those parts of the argument (base) arrays that have bearings on the result array parts. Sub-pushdown can be used to trace data lineage in array-manipulating computations expressed in the Array Manipulation Language (AML) that was introduced previously. Sub-pushdown has several useful features. First, the lineage computation is expressed as an AML query. Second, it is not necessary to evaluate the AML lineage query to compute the array data lineage. Third, sub-pushdown never gives false-negative answers. Sub-pushdown has been implemented as part of the ArrayDB prototype array database system that we have built.