$${10^{(10^{6})}}$$ worlds and beyond: efficient representation and processing of incomplete information

Authors:
Lyublena Antova;Christoph Koch;Dan Olteanu
Affiliations:
Cornell University, Ithaca, USA;Cornell University, Ithaca, USA;Oxford University, Oxford, UK
Venue:
The VLDB Journal — The International Journal on Very Large Data Bases
Year:
2009

Citing 25
Cited 11

Incomplete Information in Relational Databases

Journal of the ACM (JACM)
Incomplete object—a data model for design and planning applications

SIGMOD '91 Proceedings of the 1991 ACM SIGMOD international conference on Management of data
Consistent query answers in inconsistent databases

PODS '99 Proceedings of the eighteenth ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems
The theory of joins in relational databases

ACM Transactions on Database Systems (TODS)
Testing implications of data dependencies

ACM Transactions on Database Systems (TODS)
AJAX: an extensible data cleaning tool

SIGMOD '00 Proceedings of the 2000 ACM SIGMOD international conference on Management of data
Foundations of Databases: The Logical Level

Foundations of Databases: The Logical Level
Dependency Satisfaction in Databases with Incomplete Information

VLDB '84 Proceedings of the 10th International Conference on Very Large Data Bases
Potter's Wheel: An Interactive Data Cleaning System

Proceedings of the 27th International Conference on Very Large Data Bases
On the decidability and complexity of query answering over inconsistent and incomplete databases

Proceedings of the twenty-second ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems
A cost-based model and effective heuristic for repairing constraints by value modification

Proceedings of the 2005 ACM SIGMOD international conference on Management of data
U-DBMS: a database system for managing constantly-evolving data

VLDB '05 Proceedings of the 31st international conference on Very large data bases
Working Models for Uncertain Data

ICDE '06 Proceedings of the 22nd International Conference on Data Engineering
Clean Answers over Dirty Databases: A Probabilistic Approach

ICDE '06 Proceedings of the 22nd International Conference on Data Engineering
ULDBs: databases with uncertainty and lineage

VLDB '06 Proceedings of the 32nd international conference on Very large data bases
Creating probabilistic databases from information extraction models

VLDB '06 Proceedings of the 32nd international conference on Very large data bases
From complete to incomplete information and back

Proceedings of the 2007 ACM SIGMOD international conference on Management of data
Efficient query evaluation on probabilistic databases

VLDB '04 Proceedings of the Thirtieth international conference on Very large data bases - Volume 30
Representing Tuple and Attribute Uncertainty in Probabilistic Databases

ICDMW '07 Proceedings of the Seventh IEEE International Conference on Data Mining Workshops
Approximating predicates and expressive queries on probabilistic databases

Proceedings of the twenty-seventh ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems
Conditioning probabilistic databases

Proceedings of the VLDB Endowment
A compositional framework for complex queries over uncertain data

Proceedings of the 12th International Conference on Database Theory
Fast and Simple Relational Processing of Uncertain Data

ICDE '08 Proceedings of the 2008 IEEE 24th International Conference on Data Engineering
Database Support for Probabilistic Attributes and Tuples

ICDE '08 Proceedings of the 2008 IEEE 24th International Conference on Data Engineering
World-set decompositions: expressiveness and efficient algorithms

ICDT'07 Proceedings of the 11th international conference on Database Theory

Combining intensional with extensional query evaluation in tuple independent probabilistic databases

Information Sciences: an International Journal
Probabilistic XML via Markov Chains

Proceedings of the VLDB Endowment
Monitoring unmanaged business processes

OTM'10 Proceedings of the 2010 international conference on On the move to meaningful internet systems - Volume Part I
Incomplete information and certain answers in general data models

Proceedings of the thirtieth ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems
Provenance for aggregate queries

Proceedings of the thirtieth ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems
Continuous probabilistic count queries in wireless sensor networks

SSTD'11 Proceedings of the 12th international conference on Advances in spatial and temporal databases
The implication problem of data dependencies over SQL table definitions: Axiomatic, algorithmic and logical characterizations

ACM Transactions on Database Systems (TODS)
Efficient reasoning in proper knowledge bases with unknown individuals

IJCAI'11 Proceedings of the Twenty-Second international joint conference on Artificial Intelligence - Volume Volume Two
Ontology-based access to probabilistic data with OWL QL

ISWC'12 Proceedings of the 11th international conference on The Semantic Web - Volume Part I
Armstrong databases: validation, communication and consolidation of conceptual models with perfect test data

APCCM '12 Proceedings of the Eighth Asia-Pacific Conference on Conceptual Modelling - Volume 130
Entity resolution for distributed probabilistic data

Distributed and Parallel Databases

Quantified Score

Hi-index	0.00

Visualization

Abstract

We present a decomposition-based approach to managing probabilistic information. We introduce world-set decompositions (WSDs), a space-efficient and complete representation system for finite sets of worlds. We study the problem of efficiently evaluating relational algebra queries on world-sets represented by WSDs. We also evaluate our technique experimentally in a large census data scenario and show that it is both scalable and efficient.